The simplest way to decide how large of a space this will require is to mock up your "locomotive, 10 cars and caboose". Be sure to use your largest engine. In my case, I plan to only run GP-7 and GP-9 along with some SW...I have also limited myself to 40 ft boxcars and the occasional 50-52 ft flat or gondola...but for "train length" I figure 40 ft cars.
That above information will give you real world feet and inches INSIDE your switches on the main that serve the arrival and departure yard. From there, everything else is pretty much "optional"...your yard tracks can be 3 cars or 20 cars depending on your space, but the A/D track, along with your "minimum loco-10 cars-caboose" and switches sets a "limit".
Track planning software will not give you the dimensions for that "limit", you have to figure out that distance and then include that yourself when designing the layout.
A rough estimate is around 12 inches for a 40 ft O gauge boxcar...just for extra clearance, figure the caboose at the same 12 inches and then measure your locomotive that will be your "work horse"...or the largest engine you anticipate buying...because you will be limiting future growth with whatever size you allow.
As for my own layout...I put the basic curves on the ends of the wall in place (O-72 takes basically 6 ft, 3 ft per "end" of the wall shelf) and then added a single section of 10 inch straight track (to ease coupling...I strongly dislike coupling and uncoupling on curves) and then placed my O-72 turnout in place...THAT is what set my layout's minimum and maximum pass track dimensions. Basically, I can get around four, or perhaps five, 40 ft cars, plus caboose and locomotive in the clear on the main track between clearance for the pass track turnouts. That is "about" 11 ft linear distance.
Thus my best guess for your "minimum" with a little "slop room" is "around 17 ft linear distance on straight track". Remember, that is INSIDE the switches as if the train is "holding the main". And remember, this is a "best guess".
Edit to add..........
Cost?
Count the switches, make rough estimates of the length of track. Come up with a rough total of components.
Find the switch you like and figure current market prices and multiply the cost by the number of switches then figure the amount of track and repeat the process...you will be close...kind of. Add approximately 15% to 25% for a safety net.
Track planning software does not do "everything", most of it still boils down to the layout builder redesigning AFTER he figures all the above...and then applies real world constraints. At least that is my experience thus far.