Switch chatter is almost always caused by improper placement of one of the insulated pins. But there can be other causes.....
Remove the switch from the track and try controlling it standing alone. If it still chatters by itself there may be a short and you'll have to take the bottom off to explore.