First step would be to try the B-U posts and see if it does the same thing. Might as well eliminate the whistle switch on that size. It sounds like the contacts of the whistle switch aren't providing the boost, or the shunt resistor isn't being switched in.
Just a thought, have you tested it with a different transformer? Does it run normally without the horn?