Four ways of looking at a building

When you look at these images of a building, each taken at a different time of day, notice the different quality of light. How does our mind see times of day out of shades of light?
Early morning:

Mid day:

Sundown:

Twilight:
.
You may have guessed the reveal even without the couple in the lower left: these are all the same image, each rendered differently in Lightroom.