What I meant is: several buildings can be seen from a direction. The clue then indicates any one of them, correct ? I'm not a native speaker, but shouldn't "*the* building" be rephrased as "*a* building" then ?
I think I could've improved the wording with "the building of that height will be seen from that direction".
For example, a clue 3 would imply that 'the 3-storey building will be seen from that direction'. It could be in the first cell, or any other cell as long as it is seen.
But I think you understand the rules correctly now.