Completely understandable - I have messed around for years coming close to operating layouts but never quite making it. I've done a couple of small British O scale shelf switchers but didn't complete them. I also built a 2' x 9' N scale layout based on John Allen's first small G&D track-plan - but N scale drove me nuts. Back I went to O scale 2 rail, but nothing concrete. Chasing the lofty ideals of the model railroading magazines isn't too practical without their resources.
You never know what will spark an idea though, and several years ago I bought a Polar Express for the Christmas tree. That started me on 3 rail O and also American Flyer after seeing some toy train articles. The 3 rail prejudice disappeared and the collection grew a little. Now this quarantine time has resulted in a burst of activity - a 10' x 13' L -shaped layout that I drew up in SCARM a couple of years ago. I just did the first test run on it - so far so good.
I think going through the collection with some rationale for your mixed layout in your mind will get you somewhere. Maybe an upper level On30 point-to-point and a 'looper' 3 rail lower level would suit your preferences. To get things going I would definitely set up the 'looper' first.
The approach that really helped me was two-fold.
1. Having some type of back story/rationale for my railroad empire that suited the equipment I was running.
2. Doing my design in SCARM, which really paid off when it came to building the physical layout. The learning curve is fast and it may just spark your new empire.
Best of luck.