As the years went by, he found himself caring less and less about what others thought.

The importance of the issue became less and less as new problems arose.