One of the ways we succeed in hunting and anything in life is by learning from our mistakes. If you passed up a good opportunity on a 4x4 bull because you were looking for something bigger, that's a decision for you to make, and reasonable if it fits your goal. Should you have another opportunity you'll have a fresh decision to make based on the importance of your goal and on the evolving circumstance of your experience such as the number of animals you're seeing, the likelihood of success, and the time left to hunt. Besides the quality of animals in the hunt area, a hunter's experience, age, physical ability and hunting skills will all play a part.
It's easy to get caught up in the fantasy stories of magazine hunting writers who often report about guided hunts on private land or other restricted areas managed for trophy animals. But for most hunters using public land where hunt success averages around 23%, getting any elk, bull or cow, is a good measure of success, and any legal bull is a good bull.
While my first goal is bringing home the meat, I'd be lying if I said that taking a good antlered bull means nothing to me. I appreciate a trophy bull because they are magnificent and I know how hard they are to come by in the areas I hunt. Given my first goal, I take pride in bringing home an elk almost every year. Our family relies on the elk, deer and pronghorn I bring home. The 6x6 bull I took last year was exciting but I'll be every bit as appreciative should I run into a cow elk or a smaller bull next month. Where I hunt I know better than to pass on any legal elk, but what's important to you is a very personal thing.