Heard this morning that if you shoot the zombie in the head, sometimes the brain will crawl out and then you have to shoot it in order to kill it.
Make sure of your target and kill the SOB's brain.