• mindbleach ( mindbleach@sh.itjust.works ) 
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    It’s just a fucking chatbot.

    The fact these tools are so flexible has far-reaching concerns - but we cannot seriously suggest the company is responsible, for making flexible tools. Turns out, most things can be misused. How far removed is this from saying ‘the thieves extensively planned their heist using Google Maps,’ like Google should be liable? What is the remedy, here, besides asking the company to spy on users more closely?

    You can talk to computers now. They’re not smart in the ways we wanted, but reasoning does occur. Even the small models presumably retain enough publicly-available military doctrine and equipment trivia to act like talking with an amoral gun nerd. That’s not separable from having Son Of Clippy summarize your e-mail. (And frankly, letting a third party read all your e-mail is a more prevalent threat than gun violence.) If you can tell spicy autocomplete to roleplay Lara Croft, and expect it to know she’d use British spelling, then you can tell it to roleplay a bigoted military advisor and expect it to know anything that’s in a Tom Clancy novel.

    When the bubble bursts, this isn’t going away. Safeguards don’t work because LLMs are just smart enough to be tricked. We are not about to ban an entire category of software. Practically we couldn’t, morally we shouldn’t, and realistically we will not try. We have to get used to the idea that computers will just do things when asked. What you ask for is all you.

    • Nik282000 ( nik282000@lemmy.ca ) 
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      The fact these tools are so flexible has far-reaching concerns - but we cannot seriously suggest the company is responsible, for making flexible tools.

      They provided a machine that encouraged a school shooter, doesn’t matter if it’s a preprogrammed script or an LLM. If limits placed on the LLM fail that is 100% on the provider.

      • mindbleach ( mindbleach@sh.itjust.works ) 
        link
        fedilink
        English
        arrow-up
        0
        ·
        2 months ago

        Write me the set of instructions that prevent all bad things from happening.

        You can pretend we’re using A Guy Instead, faking the bot part of the chatbot, so it’s all real intelligent humans talking to one another. Show me what possible outline could stop someone from asking all dangerous questions, such that any crack in your effort makes you liable for what some crank does with that information.

        Information which I will remind you is just scraped from the web. And hypermasculine military-fantasy novels. And dry encyclopedias of historical minutia.

        • Nik282000 ( nik282000@lemmy.ca ) 
          link
          fedilink
          English
          arrow-up
          0
          ·
          2 months ago

          Buddy, you are trying to argue that a business is NOT responsible for the text that was generated by it’s service. If they included dangerous information in the training data (which was mostly acquired by violating copyright) then they are responsible for not filtering that training data. And here were safeties and they did flag the interaction, management overrode them and actively chose NOT to contact law enforcement. How much more liable do you want?

          They haven’t even gone public yet so I donno what horse you have in this race to make you side with a bunch of fucking tech bros. Their ideal future includes pulling the rug out from whatever industry you’re in and leaving you to toil in whatever labour they can’t automate.

          • mindbleach ( mindbleach@sh.itjust.works ) 
            link
            fedilink
            English
            arrow-up
            0
            ·
            2 months ago

            Dangerous information like library books. Like the text of any Tom Clancy novel. These models, online or offline, just pick words based on what you write. You choose what comes out. If you ask for vile pornography, you don’t get to blame the company for offending you, and if some prick asks for tactical advice ‘in Minecraft,’ the company did not proactively radicalize him. The chatbot can only repackage what’s readily available to any pirate.

            And here were safeties and they did flag the interaction, management overrode them and actively chose NOT to contact law enforcement.

            That’s a wildly different standard than ‘no matter what they do any problem is entirely their fault.’ You are trying to argue that even if management had told law enforcement, and this prick had a shootout with the arresting officers, the company would still be to blame. Their model still generated… what he fuckin’ asked for. That’s all it does.

            All of these companies are fucked anyway. The bubble will burst. It’d be nice if the proud haters could conceptualize a milquetoast defense of the technology as anything but boot-slobbering devotion to specific high-profile cocaine enthusiasts. ‘There’s less work, oh no’ is not a real problem. A child knows the answer. And if a local model lets that child slap together a program that surpasses what I could do, fresh from a college education in computer science - good. We’ve been trying to make that happen for sixty years.

            • Nik282000 ( nik282000@lemmy.ca ) 
              link
              fedilink
              English
              arrow-up
              0
              ·
              2 months ago

              Dangerous information like library books. Like the text of any Tom Clancy novel. These models, online or offline, just pick words based on what you write. You choose what comes out. If you ask for vile pornography, you don’t get to blame the company for offending you, and if some prick asks for tactical advice ‘in Minecraft,’ the company did not proactively radicalize him. The chatbot can only repackage what’s readily available to any pirate.

              The majority of that text is being used in violation of copyright, but that’s beside the point.

              My point is that if I were to have see kid online say they were gonna shoot up a school, and then I spent the next week coaching them how to do so, I would be responsible for my involvement with the eventual shooting. Operating a service which does the same thing should entail the same responsibilities. OpenAI’s failure to control their service does not absolve them from responsibility, if anything it shows how knowingly irresponsible they are.

              They can easily implement stronger limits on what their models are allowed to say to a user BUT that would makes their service feel more like a computer and less like a person. A simple regex and blacklist of words and phrases could restrict topics. A second agent that only looks at the model output could be used as a nanny. Are you saying that it is reasonable that a teenager was able to bypass all the safeties of a billion dollar business?

              And if a local model lets that child slap together a program that surpasses what I could do, fresh from a college education in computer science - good. We’ve been trying to make that happen for sixty years.

              That says more about you than the LLM. LLMs can be used as an elaborate autocomplete but fully LLM written projects are known as slop for a reason, each small part may be complete and correct but as a whole it is just an unmaintainable mess of security issues and technical debt.