Does the R-unit pull? (R-unit for Marx)
Does it pull FULLY? (Partial pull is possible on a coil)
A coil set up on ac does vibrate. How excessive that is can vary.
Are you using the same plunger? More precise, there is a pin that rides in the heart shaped opening. Is that bent? Reaches the top?
I'm stabbing while I think
Considering the drive works, that should be fine. One brush should go to frame via a brass strip to the brush plate's lower nut. I've never actually chased wires yet they are so bullet proof. But I have some, and should have a diagram, so I can check later too.
There are only a couple ways to wire an open frame train motor. It is basically blind to what brand anyhow.
Till later, I'd look for a short on the R-u.
From coil to R-u frame= no continuity.
Then check that an R-u contact or pad isn't hitting the R-u frame somehow.
That or wires got crossed, or are shorting on something.
Might be a wire is internally broken with only a slight connection in it as well. Could even be a combo, but I'll bet it's the wire or R-unit contacts, not the motor.