I did this on my N gauge layout years ago - had switchable pallets that would go on and off the layout in a section, and plan to do it on my O gauge but have not yet done that project: in one place, I plan a roughly 30 by 20 inch "pallet" that would have either a small rural train station or a pastoral little lake with a fishing boat and fishermen.
When I did this in N gauge, I discovered an interesting fact: building scenery and buildings on "pallets" that could then be installed on the layout was more efficient - build the whole thing on the bench, finish it, and then lay it down on the layout. I actually do that with everything now, but simply have no plans to switch them out for something else in the future.
I recall an article in the last few years in CTT or OGR about someone who did this with a couple of scenes on their layout.