There was a study a while back where participants were shown a very short video clip (1-3 seconds) of a speaker, and were tasked with creating a personality analysis. The study reported they were very successful in extracting massive amounts of personality data from just seconds of exposure.

That seems to validate the legitimacy of 'first impressions' being lasting and accurate.