Actually you remind me of one of my old friends.
A long time ago I ran into some buddies in a club. All of sudden one of the buddies pushed me to the side. I was like what gives? until I saw what came next. 4 of the buddies went to pounce on a guy who must have pissed them off before. The 5th buddy just stood by the side and watched the other 4. I asked him why he wasn't involved too. He told me, "I am lover, not a fighter"., just like you wrote above.
Those 4 guys just had too much testosterone flowing through their blood when they were young and always easily got offended. One day one of them told me he was connected and it all made some sense. I guess being connected can have its downsides like he cannot back down in a fight and be diplomatic about it as someone may be watching and report back to his family. Keeping face can be so troublesome.
I guess that guy told me a bit about his background because he figured out that I won't pass judgment on him because of his family, plus he knows I am not in the same profession.