I'm Too Sensitive

I'm an iNFJ. Thus I have too much empathy. I can sense someone's feelings just by listening to voices. I kind of absorb that feeling..and it hurt me a lot actually. That's why I don't like tense meeting where sometimes the attendees tend to voice out their disappointment, anger, frustration and so on. I will absorb it all an it affects me so much which later if I can't control all those feelings inside me, I will cry then and there..and often people wouldn't know & understand why I'm crying.
Hearing someone talking to other person (the conversation are not related to me) also take a toll on me. I can sense his/her frustration towards the other person. Sometimes I have to walk away. I can't stop this things but I can walk away. I tend to not bother with other people because of this.
I wonder..should I have been a counselor, I will go crazy I think..