It's not wasting away. The ability to give love and affection is always there, waiting for the right partner.
I'm going to say something that might sound strange, but it's proved true in my experience. Whatever it is that you feel ashamed of, or different because of, or feel you "should"...