AI and cameras in headphones could be amazing, but there’s still one major detail missing.
Meta is reportedly working on “Camerabuds,” a new project to develop AI-powered headphones with built-in cameras. These cameras will help detect the wearer’s surroundings and enable real-time AI features, further cementing Meta’s presence in the AI industry.
The Camerabuds Project
So, what exactly is this “Camerabuds” project? Well, it involves designing headphones or earbuds with two outward-facing cameras.
These cameras would allow the device to recognize the environment and activate AI functions. It should work similarly to Meta’s multimodal AI features in its smart glasses.
By integrating its latest AI features into familiar devices like headphones, Meta is eager to prove itself as a leading AI firm. The company hopes this approach will be more successful and appealing to consumers than some of its previous efforts.
The project is still in its early stages, though, with no confirmation on whether it will proceed to market. Yet, insider sources claim Meta is already investing substantial resources into this initiative.
But one key detail remains undecided: whether the Camerabuds will take the form of headphones or earbuds.
Technical Challenges
Of course, the Camerabuds project isn’t without its fair share of technical and privacy challenges.
The key concerns include:
- Battery life and heat management.
- Privacy issues due to the use of camera-enabled wearables.
- The potential for the user’s long hair to obstruct the cameras.
Modern wireless earbuds and headphones are also already packed with features like active noise cancellation and spatial audio. So, their interiors are very cramped. Adding cameras and AI components would push the limits from thermal and ergonomic standpoints.
This is where the design choice between earbuds and headphones becomes crucial.
Headphones with larger ear-cups might be more suitable, as they are less likely to be obstructed by hair and can better manage heat dissipation.
However, Meta will likely want these new headphones to be able to compete with more portable options such as Apple’s AirPods.
So, Meta hasn’t finalized that detail yet.
Meta’s Hardware Track Record and Market Competition
Meta’s track record in hardware projects has been mixed so far.
The company discontinued its Portal smart speakers in 2022. And, they have shelved plans for a camera-enabled smartwatch.
On the other hand, the latest version of its Ray-Ban-branded smart glasses, which feature Meta AI, has been well-received. Reports indicate high demand and sustained user engagement for these glasses (though Meta has yet to release the actual figures).
That’s why, there’s no real benchmark on how much these Camerabuds will actually impact the market.
Meta also isn’t the first to have been rumored to add cameras on personal audio devices.
Apple was also reportedly developing similar features for its next-generation AirPods, just this year. This will potentially add cameras to enhance user interaction with their surroundings.
Codenamed as ‘B798’, this aims to integrate augmented reality (AR) and health sensors into AirPods. These low-resolution cameras are designed for data processing rather than video recording, which could aid visually impaired users, offer personalized health monitoring, and even aid in AI features.