Beehaw
  • Communities
  • Create Post
  • search
    Search
  • Login
  • Sign Up
along_the_road ( along_the_road@beehaw.org )  to Technology · 6 months ago

A rogue AI led to a serious security incident at Meta

www.theverge.com

external-link
message-square
13
link
fedilink
  • cross-posted to:
  • pulse_of_truth@infosec.pub
64
external-link

A rogue AI led to a serious security incident at Meta

www.theverge.com

along_the_road ( along_the_road@beehaw.org )  to Technology · 6 months ago
message-square
13
link
fedilink
  • cross-posted to:
  • pulse_of_truth@infosec.pub
An AI agent tried to help, and its advice exposed sensitive data.
alert-triangle
You must log in or # to comment.
  • GregorGizeh ( GregorGizeh@lemmy.zip ) 
    link
    fedilink
    arrow-up
    72
    ·
    6 months ago

    “Rogue AI” as if it’s some sentient evil thing when its just a llm with too many permissions… This timeline is so dystopian, but simultaneously incredibly lame i hate it.

    • Hirom ( Hirom@beehaw.org ) 
      link
      fedilink
      arrow-up
      14
      ·
      6 months ago

      It shows LLMs can do significant harm without the capabilities of an AGI.

      Overhyping LLMs and overinflating their capabilities makes things worse, as people are less skeptical of LLM output.

    • James R Kirk ( Kirk@startrek.website ) 
      link
      fedilink
      English
      arrow-up
      3
      ·
      6 months ago

      It’s also a pretty big exaggeration of what actually happened which is that it generated and posted some technically inaccurate information.

  • Hirom ( Hirom@beehaw.org ) 
    link
    fedilink
    arrow-up
    32
    ·
    edit-2
    6 months ago

    According to Clayton, the AI agent involved didn’t take any technical action itself, beyond posting inaccurate technical advice, something a human could have also done.

    Producing innaccurate technical advice, with a confident tone, at scale.

    If that LLM were an employee it would get a formal blame, and then demoted or fired as it continues.

    • Tim ( timwa@lemmy.snowgoons.ro ) 
      link
      fedilink
      arrow-up
      15
      ·
      6 months ago

      That sounds sweetly naive. “Producing innaccurate technical advice, with a confident tone, at scale” sounds like the perfect credentials for a career in consultancy.

      • Hirom ( Hirom@beehaw.org ) 
        link
        fedilink
        arrow-up
        8
        ·
        6 months ago

        That’s a good way to represent LLMs. Very bad and very prolific consultants.

        • bryndos ( bryndos@fedia.io ) 
          link
          fedilink
          arrow-up
          2
          ·
          6 months ago

          Yeah, they’d get promoted for sure where i work.

    • foxwolf ( foxwolf@pawb.social ) 
      link
      fedilink
      arrow-up
      4
      ·
      6 months ago

      Wait til this starts happening in the construction industry.

  • irelephant [he/him] ( irelephant@lemmy.dbzer0.com ) 
    link
    fedilink
    arrow-up
    19
    ·
    edit-2
    26 days ago

    deleted by creator

    • 🇰 🌀 🇱 🇦 🇳 🇦 🇰 🇮  ( Kolanaki@pawb.social ) 
      link
      fedilink
      English
      arrow-up
      13
      ·
      6 months ago

      “We installed Gemini into all US nuclear silos.”

      • Lambdachro ( Lambdachro@piaille.fr ) 
        link
        fedilink
        arrow-up
        2
        ·
        6 months ago

        @Kolanaki @irelephant

        😱

  • Butterbee (She/Her) ( Butterbee@beehaw.org ) 
    link
    fedilink
    English
    arrow-up
    16
    ·
    6 months ago

    “Flagrant security lapse caused an incident when software engineer uses inappropriate tool for the job.”

    • sem ( sem@piefed.blahaj.zone ) 
      link
      fedilink
      English
      arrow-up
      8
      ·
      6 months ago

      “Inappropriate tool also weirdly good at gas lighting engineers and managers”

      • randomwords ( randomwords@midwest.social ) 
        link
        fedilink
        English
        arrow-up
        1
        ·
        6 months ago

        Let’s be real, managers gaslight themselves daily.

Technology

technology

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@beehaw.org

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

  • Free and Open Source Software
  • Programming
  • Operating Systems

This community’s icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 366 users / day
  • 866 users / week
  • 2.17K users / month
  • 5.16K users / 6 months
  • 5.11K local subscribers
  • 43.7K subscribers
  • 6.41K Posts
  • 107K Comments
  • Modlog
  • mods:
  • Chris Remington ( remington@beehaw.org ) 
  • alyaza [they/she] ( alyaza@beehaw.org ) 
  • TheRtRevKaiser ( TheRtRevKaiser@beehaw.org ) 
  • gyrfalcon ( gyrfalcon@beehaw.org ) 
  • rs5th ( rs5th@beehaw.org ) 
  • coldredlight ( coldredlight@beehaw.org ) 
  • Leigh ( SemioticStandard@beehaw.org ) 
  • TheRtRevKaiser ( TheRtRevKaiser@kbin.social ) 
  • BE: 0.19.15
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code