Since you have a DC source (your AC/DC adapter), you need a regulator to set the voltage applied to your signs to 4.5V DC. As mentioned there have been many threads (with photos) discussing low-cost regulator modules available from Asia - usually via eBay - for less than $2 shipped! Search "LM2596 regulator" on eBay. These are adjustable output so you need a voltmeter to set them to 4.5V.
In the last year or so, for a few dollars more these module can include an on-board digital voltmeter! I got one off eBay for less than $5 shipped in 10 days. Here's a photo of it set to 4.5V DC. 2 wires in from adapter, 2 wires out to signs.
Any of these LM2596 modules will have the ability to drive your 3 signs...but your AC/DC adapter must also have enough capacity to do so. Adapters usually have a label or embossed lettering with a voltage and current rating...such as 12VDC 500mA, or 9VDC 300mA, etc. If you report what you have, someone familiar with Miller signs should be able to confirm its suitability.