Is an errant shot that takes an innocent life something you want to live with? When you can hit COM at 7 yards without using the sights but by point shooting, you should be OK. Every shot you take you need to identify the target and what's behind it.

I carry a S&W 1911SC with night sights and a spare mag. 17 rounds of .45 is plenty for any scenario I can think of. The 1911 platform is slim, conceals well, and carries comfortably.
...but the single action is not for everyone. I carry it because I can put every shot on target with a cold gun.