I know this thread is older now, but having ordered some led poi and playing around with them, I have some information to help this thread. The problem with them clicking on and off sometimes is due to the spring, on the piece you take off to put the batteries in.
If the spring is bent out of shape, in any direction, it can make contact with the sidewall and short the connection (look closely at the top of the sidewall and you will see what i mean)
When you set the little lid down to put the batteries in, you may bend the spring a little bit (its a tiny spring, has to be so take care) just make sure it's bent back to the right shape before you screw it back together, and you should have no further problems.
as a note - these things are so awesome. They said these things are designed to be durable, but I had to test it.
I took my green one, and threw it at the ground. all good. So then I wailed it into my stone fireplace as hard as I could, never blinked at all. So then I threw it on the ground, ran after it and jumped on it - hah! nothing changed, thing works like a dream.
Best practice replacement for sandweighted raquetballs ever.