I've never thought about it until your question, but:
The building is more important, BUT, the shrubs, grass and trees are essential - you really can't have one without the other, they are part of the building project.
I think you have to also learn to "think like a landscaper." I have three photos that are examples below.
The farmhouse looked strange without a few bushes and weeds growing up around it - there the look required a rather untrimmed, wild look to it. Dino's restaurant and 77 sunset strip, I copied as closely as I could plants and such in photos of the original.
Even something like a diner needs not just some scrubs, but some scrubs arranged in a realistic way, to make it look, well . . . realistic. I actually drove to a shiny aluminum diner near us to take a photo of the plants before I got it right.