Rabbit trails are a major component of this hobby; as we all can attest.
With regards to the fire house I see your predicament. Given the unusual angle you have I would suggest finishing the area with the red brick all the way across and alongside the fire house.Perhaps a white or yellow line of demarcation. Another possibility would be to make it look like concrete; or the asphalt. Or, can you swap out structures?
Jay