New AI headphone prototype filters out noise, focuses on voices

zohaibahd

Posts: 124   +1
Staff
Why it matters: If you are fed up with the noisy co-worker who won't stop hammering at their keyboard or that wailing baby on your flight, a headphone prototype from researchers at the University of Washington could be the upgrade you've been waiting for. Instead of simply dampening ambient sounds, this device uses AI to let you selectively filter out noises and focus on specific voices.

Most active noise-canceling headphones work by producing sound waves to counteract lower-frequency environmental rumbles like engine drones. But they end up canceling all sound in those frequencies, potentially removing audio you want to hear. The new prototype aims to give users more nuanced noise control.

The headphones have built-in microphones feeding audio to a neural network trained to recognize different types of sounds – barking dogs, ringing phones, bird calls, and more. Using a companion app, you can enable or disable categories, allowing just the noises you want to filter through the headphones.

But the really cool part is that the headphones can also zero in on a particular voice amid background chatter. Just tap a button and it will "enroll" the voice directly in front of you as the only sound to be amplified, dampening all other noise.

Shyam Gollakota, who developed the technology with a team of researchers, presented the idea on May 16 at a conference held by the Acoustical Society of America and the Canadian Acoustical Association. He demoed a working prototype at the event, as reported by New Scientist.

Under the hood, the microphones pipe audio into an AI processor that deciphers and removes unwanted sounds in real time. This is done with just an 8-millisecond delay, which the researchers say should be enough to avoid weird latency hiccups. For the on-device AI processing, the current headphone rig uses an OrangePi board connected via USB rather than going through a cloud server.

Of course, this prototype isn't something you can buy just yet. Commercialization would likely require everything shrinking down to a tiny chip that could integrate into future wireless headphone designs.

That said, AI is already making its way into mainstream audio gear through algorithm-powered noise cancellation for microphones. But this flips that concept on its head, using AI to augment what the wearer can hear, not just what the mic picks up. Any device with a decent AI accelerator and mic input could theoretically offer this kind of selective noise muting.

I'll admit that this innovative tech triggered a mildly creepy Black Mirror thought – about the "White Christmas" episode where a woman uses implants to literally "block" out and mute her partner from her senses. If noise cancellation of this sort can help enhance voices, could it also help mute certain voices? Let's not get too carried away with sci-fi scenarios just yet.

Permalink to story:

 
Is it AI though? Sounds like noise cancelling software.
Of course it's AI. Everything is AI now. It's the cool new buzz word that can be attached to any existing tech to make it sound like it's something brand new and never before seen. AI is the new VR/AR replacement buzz word. It's a new way to trick all the rubes into buying a bunch of new stuff they don't actually need. Intel is hard at work on new AI PCs and AI laptops for example. You know, PCs and laptops that are exactly the same as the one you own now, but more expensive because it has some crappy NPU built into it now.

PS. My company is currently working on an AI toilet. It uses ML to figure out how long after you're done your business it should flush for you automatically. Then it uses AI to analyze the amalgamation of smells you produced based on your diet and triggers olfactory countermeasures to neutralise offending odours so that all your BMs will smell like roses. Welcome to the future, friend.
 
Last edited:
I feel like we need more stories like this that show the practical benefits of "AI" as opposed to the gloom and doom stuff all the time.

This is a legitimately cool and practical use of the tech.

I liked your comment. And at the same time I see people like Musk thinking about an AI implant that makes people only hear the great leader and his loyal commanders.
 
I tried RTX voice once and I was blown away by how good it separates my voice from the surrounding noise. technically it uses GPU processing power so it could be "AI" too. considering my old GTX960 could run it well and uses very little GPU power, I guess someone could came up with an AI soundcard soon too.

I remember the EAX and Alchemy sound effect in games 20 years ago. back then if you want better 3D sound you had to buy soundcard so your game sounds more realistic. I found out soon after that everything is software-based and you can actually install it on realtek onboard sound too.
 
Is it AI though? Sounds like noise cancelling software.

Sorry, you're wrong. "Noise cancelling" is just some crap you just made up.

Clearly, this is AI.

So, you know, get with the program here. "AI".

"AI".

Say it with me. "A". "I".

......"noise cancelling"....
 
WTF now we need a PI and a Droid to listen to music? how long until Nvidia makes a RTX headset?
 
Back