Further to my last post, Dickie Umfraville says this in Temporary Kings (1973) by Anthony Powell:
You know growing old’s like being increasingly penalized for a crime you haven’t committed.
Strangely this quote is also widely misattributed to Pierre Teilhard de Chardin.