The nubby, breathable button-ups you love look even better under a scuzzy cardigan or a corduroy blazer.