Is it a case of bad measurements or just personal taste?
In a critique of ZMF’s Bokeh Closed headphones, YouTuber Super Review* labeled the sound as “bass bloated and unbalanced.” He gave the headphones a low score, and Zach from ZMF, the manufacturer, responded by questioning his testing methods.
The dust-up has everyone asking: How should we really review headphones? And do measurements tell the whole story?
What Happened?
The story kicked off in May 2024, when ZMF reached out to Super* Review, offering their Bokeh Closed and Caldera Closed headphones for evaluation. Ryan, clearly intrigued by the chance to work with ZMF for the first time, accepted.
By September, he had the headphones in hand and got to work, uploading frequency response graphs to Squig.Link. Still, it wasn’t until January 2025 that he finally dropped his full review.
When the review did land, Ryan had mixed feelings. He couldn’t stop raving about the build quality and craftsmanship, calling the headphones heirloom-worthy. But sound? That was a different story.
Cue the public response from ZMF founder Zach Mehrbach, who didn’t mince words.
He called out Ryan’s measurement approach, pointing to improper placement on the testing rig as a key issue. Mehrbach explained that the Bokeh’s off-center driver design requires precise alignment for accurate measurements – a detail Ryan’s setup apparently missed.
Mehrbach also noted that Ryan hadn’t watched ZMF’s instructional video on optimizing fit and performance, suggesting the reviewer hadn’t fully explored the product before making his judgment.
In response, Ryan went back to his rig, adjusted the headphone positioning as recommended, and re-measured. The updated results did show improved “ear gain” in the midrange, much closer to ZMF’s own data. But Ryan didn’t budge on his ultimate takeaway—his listening impressions, he said, remained the same.
Measurement Methodology and Independent Testing
The debate between measurements and real-world experience drives much of the audiophile world’s most heated discussions.
Ryan has his own approach. He measures headphones the way he wears them—no fussing with alignment or chasing perfection. For him, it’s about keeping things consistent so readers can make fair comparisons.
When Ryan re-measured the ZMF Bokeh Closed using Zach Mehrbach’s suggested setup, the results changed. Suddenly, there was more midrange “ear gain,” which matched what ZMF had promised.
But things got murkier when measurements from other reviewers surfaced. Some looked a lot like Ryan’s original graph; others lined up with ZMF’s.
This variation wasn’t surprising. Tiny changes (pad choice, fit, rig setup) can throw measurements in different directions. Ryan even called out ZMF for publishing inconsistent graphs, which seemed to change depending on how and where they were measured.
Mehrbach didn’t deny it. Instead, he leaned into it, explaining that the Bokeh Closed is designed for customization. With different pads and mesh configurations, users can tweak the sound to fit their preferences.
In his view, a proper review should reflect this flexibility.
But Ryan wasn’t buying it. He argued that reviewers should reflect how products perform in the wild, not under optimized, manufacturer-defined conditions.
“I’m not really inclined to adjust based on manufacturer-suggested guidance. I think most people don’t want me taking that kind of feedback from manufacturers either,” Ryan stated in his response video.
“They want me to review a headphone as it naturally fits in my normal conditions, not by collaborating with manufacturers on the “correct” way to wear or measure a headphone.”
However, Ryan admitted that while listening impressions mattered more to him, his initial measurements might have influenced how he perceived the Bokeh’s sound.
So, should reviewers focus on how most people will use headphones in the real world, or should they test them exactly how manufacturers designed them to be used? Both sides make sense, but there’s no easy answer.
Why It’s a Big Deal
The clash between ZMF and Super* Review reveals more than just a disagreement about headphone measurements. It shows us how complex the relationships between manufacturers, reviewers, and consumers have become in today’s audio world.
ZMF headphones have a pretty good reputation, so Super* Review’s critical take really stands out. His preference for neutral, midrange-focused sound naturally clashed with the bass-heavy tuning of the Bokeh Closed. And, his honest, independent take felt refreshing in a space often dominated by consensus.
We can’t deny that Mehrbach’s response opened up another can of worms. though.
Sure, reviewers don’t have to check with manufacturers before publishing, but what if they miss important details about how to test the product? There’s a tricky balance between testing gear exactly how manufacturers want versus showing how regular people will actually use it.
This whole debate could change how we look at future audio reviews.
When something as simple as how you position headphones can completely change how they sound, who should we listen to? Should we trust the perfect testing conditions from manufacturers, or the real-world experience from reviewers?
The takeaway? Review and measurements are valuable tools but they can’t tell the whole story. Combining insights, both technical and personal, is the best way to decide if a headphone fits your preferences.
[01/12/2025] Update: Zach Apologizes for the Mistake
Zach Mehrbach took an unexpected step by publicly apologizing for his initial response to Super* Review’s critique. He acknowledged that his emotional reaction and poor communication created unnecessary confusion and frustration in the community.
He also clarified that his intent wasn’t to dictate how users should wear the Bokeh, but rather to discuss measurement variations across different testing setups. According to him, the Bokeh’s driver placement was actually designed to accommodate various wearing styles, based on extensive testing with different measurement rigs and subjective listening.