Beehaw
  • Communities
  • Create Post
  • search
    Search
  • Login
  • Sign Up
floofloof ( floofloof@lemmy.ca )  to Technology@lemmy.mlEnglish · 2 years ago

‘Selective hearing’ headphones: Hear clearly in a crowd with one look

newatlas.com

external-link
message-square
12
link
fedilink
98
external-link

‘Selective hearing’ headphones: Hear clearly in a crowd with one look

newatlas.com

floofloof ( floofloof@lemmy.ca )  to Technology@lemmy.mlEnglish · 2 years ago
message-square
12
link
fedilink
Researchers have used AI attached to off-the-shelf headphones to isolate the voice of one speaker in a noisy crowd just by looking at them. The code for their next-level noise cancelling system is freely available if you want to build your own.
alert-triangle
You must log in or # to comment.
  • Gerudo ( Gerudo@lemm.ee ) 
    link
    fedilink
    arrow-up
    28
    ·
    2 years ago

    Damn this could help me every day. i have trouble understanding people if there is background noise.

    • zero_spelled_with_an_ecks ( zero_spelled_with_an_ecks@programming.dev ) 
      link
      fedilink
      arrow-up
      3
      ·
      2 years ago

      Me, too. I carry earplugs and that helps a little in crowded places. Communicating with shower buddies is always tough, though. Especially when there’s a crowd.

      • WeirdGoesPro ( WeirdGoesPro@lemmy.dbzer0.com ) 
        link
        fedilink
        arrow-up
        7
        ·
        2 years ago

        How many people are typically in your shower?

        • zero_spelled_with_an_ecks ( zero_spelled_with_an_ecks@programming.dev ) 
          link
          fedilink
          arrow-up
          2
          ·
          2 years ago

          Two to four.

  • onlinepersona ( onlinepersona@programming.dev ) 
    link
    fedilink
    English
    arrow-up
    25
    ·
    2 years ago

    Amazing. And they even made it opensource! I’m amazed at how readable it is, even though I don’t get most of it. Code written by people with 20 years of C experience looks leagues worse than what this repo looks like. Bravo!

    Anti Commercial-AI license

    • thejevans ( thejevans@lemmy.ml ) 
      link
      fedilink
      arrow-up
      22
      ·
      edit-2
      1 year ago

      deleted by creator

      • corsicanguppy ( corsicanguppy@lemmy.ca ) 
        link
        fedilink
        arrow-up
        6
        ·
        2 years ago

        Thank you for not jamming the ‘open’ and ‘source’ together like a schmuck.

  • saigot ( saigot@lemmy.ca ) 
    link
    fedilink
    arrow-up
    8
    ·
    2 years ago

    If this application is legit it’s going to get snatched up by Apple/Amazon/Google to make their voice assistants better, right now they can’t handle cross talk at all.

    • BlameThePeacock ( BlameThePeacock@lemmy.ca ) 
      link
      fedilink
      English
      arrow-up
      4
      ·
      2 years ago

      This particular implementation doesn’t really apply to those situations, there are already existing technologies which can pre-train on specific voices they could be using for that since the target is known. The main “improvement” from this system is that you can train it on any target subject, even with background noise, in only a few seconds.

      It’s most useful in scenarios they’ve outlined in their study, like using it with your friend you ran into on the bus, your tour guide, etc.

  • lemmeout ( lemmeout@lemm.ee ) 
    link
    fedilink
    arrow-up
    3
    ·
    2 years ago

    The video fails to explain what about this is “AI” as opposed to active noise cancelling with some regular old signal processing.

    • blindsight ( blindsight@beehaw.org ) 
      link
      fedilink
      arrow-up
      5
      ·
      2 years ago

      To add to what the other poster said:

      I’m not an expert, but my understanding is that noise cancellation works by inverting sounds waves to deaden the sound. So, like, if you add sin(x) and –sin(x) you get 0.

      This system is actively adding inverted sound waves to cancel most sounds. What makes this system unique is that it samples the voice and uses the unique “voice print” to selectively not invert the sound waves from the targeted voice.

      Or that’s what I’m getting from reading this, as a layman.

    • floofloof ( floofloof@lemmy.ca ) OP
      link
      fedilink
      English
      arrow-up
      5
      ·
      2 years ago

      I think once it has taken a profile of the voice it no longer requires you to be facing the person because it can now recognize that voice among the noise. The AI but is taking an imprint of the voice and then extracting it.

  • MHLoppy ( MHLoppy@fedia.io ) 
    link
    fedilink
    arrow-up
    2
    ·
    2 years ago

    Cool idea, though I was surprised by the level of fidelity loss in the fountain example. I would’ve expected that to be a good case scenario for noise cancellation so maybe it just needs some more time to iterate and improve on its level of “false positive” removal.

  • Blizzard ( Blizzard@lemmy.zip ) 
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 years ago

    deleted by creator

Technology@lemmy.ml

technology@lemmy.ml

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@lemmy.ml

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 2 users / day
  • 27 users / week
  • 741 users / month
  • 3.07K users / 6 months
  • 1.1K local subscribers
  • 43.4K subscribers
  • 4.7K Posts
  • 26.7K Comments
  • Modlog
  • mods:
  • MinutePhrase ( MinutePhrase@lemmy.ml ) 
  • BE: 0.19.15
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code