You did the right thing. I know it is very hard to walk away sometimes. But, you have to remember that even getting into a regular fight can result in assault charges. Those charges can keep you from carrying your ccw. I have had many times that i have had to bite my tongue and walk away. It is worth it in the long run.