Math lost most of his aura once Diz swung on him. I agree that getting swung on doesn't mean you're soft, but the perception of you changes. Especially if you got swung on and then nothing really happens.
Maybe it's unfair, but when you portray an image of this wild tough nikka and someone snuffs you, didn't knock you out but they're tweeting and posting blogs an hour later, and they live in your city, it looks kinda wild. That's why playing the gangster rap role is always shaky because it's easy to lose and hard to gain.