I've done both retaining empties and dump them.

If you're doing an emergency reload dump the mag on the ground and worry about collecting them if you live.

If you're doing administrative reloads retain them

Rolly polley on my left side also