I just read an article in an AARP journal that said hearing loss in a background noise situation is neuro, not audio. The article said we loose the ability to sort out an individual sound. There is a computer program that gives you pratice in sorting out sounds. In short, learning to follow a part is just the kind of thing you SHOULD keep doing - it may be very beneficial for you.
sing on!