Did you know that until the 18th century the shirt was worn as an undergarment?
A shirt would be pulled over the head, a shirt was to be worn under the outer garments. Therefore the only visible part of the shirt would have been the collar. Which is why it is still regarded to be a faux pas for a Gentleman to take off his jacket un-invited especially in the presence of ladies.
Source: Bernhard Roetzel