Rockwool is absolutely the last thing in the world that I would ever use to dampen sound. It has got to be the nastiest construction material I have ever dealt with in my entire life. When you come into contact with it you will itch for days. If you don’t seal it completely when the trains run it will filter into the air and if you need to work on the wiring that means laying under the layout with Rockwool dusting in your face. It is used as a fire retardant in areas that will be sealed off to the public and that’s it ! Fiberglass insulation has better sound transference reduction but why on earth would you suffer with it.
The product you need is convoluted acoustic foam sheets. Looks like egg cartons, very cheap and comes in a roll. Sound studios use it for a reason, because it is the best bang for the buck. You will need to purchase it on line as hardware stores usually don’t carry it.
As a Journeyman cabinetmaker who has built many layouts, use homasote on top and the convoluted acoustic foam underneath and your layout will be whisper quiet.