The quick answer is: YES. Any electrical device can be connected to its supply directly. YES, this applies to toy train accessories. YES it's your layout, wire it anyway you want.
Now, let's drill down a little deeper: I have no idea if the banjo signal is electrically and mechanically robust enough to operate continuously. Its coil, motor, vibrator, whatever, may not like being energized all the time. Only you can answer that question, as you experiment with voltage and time (what we call its "duty cycle.")
Finally, I would recommend that you put a switch in the circuit, somewhere, just so that if you do want to turn it on and off quickly and efficiently, you have that option.
Wire the banjo to the A-U posts and adjust the voltage for optimum operation. That means not too little, and not too much. Make a note of the voltage after measuring with your voltmeter, so that you can re-create the proper supply voltage in the future.