• o7___o7 ( o7___o7@awful.systems ) 
    link
    fedilink
    English
    arrow-up
    41
    ·
    1 year ago

    Look, AI will be perfect as soon as we have an algorithm to sort “truth” from “falsehood”, like an oracle of some sort. They’ll probably have that in GPT-5, right?

  • nightsky ( nightsky@awful.systems ) 
    link
    fedilink
    English
    arrow-up
    20
    ·
    1 year ago

    If the companies wanted to produce an LLM that didn’t output toxic waste, they could just not put toxic waste into it.

    The article title and that part remind me of this quote from Charles Babbage in 1864:

    On two occasions I have been asked, — “Pray, Mr. Babbage, if you put into the machine wrong figures, will the right answers come out?” In one case a member of the Upper, and in the other a member of the Lower, House put this question. I am not able rightly to apprehend the kind of confusion of ideas that could provoke such a question.

    It feels as if Babbage had already interacted with today’s AI pushers.

  • 200fifty ( 200fifty@awful.systems ) 
    link
    fedilink
    English
    arrow-up
    14
    ·
    1 year ago

    The really annoying thing is, the people behind AI surely ought to know all this already. I remember just a few years ago when DALL-E mini came out, and they’d purposefully not trained it on pictures of human faces so you couldn’t use it to generate pictures of human faces – they’d come out all garbled. What’s changed isn’t that they don’t know this stuff – it’s that the temptation of money means they don’t care anymore

  • It’s the alignment problem. They made an intelligent robot with no alignment, no moral values, and then think they can control it with simple algorithmic rules. You can’t control the paperclip maximiser with a “no killing” rule!

    • self ( self@awful.systems ) 
      link
      fedilink
      English
      arrow-up
      20
      ·
      1 year ago

      It’s the alignment problem.

      no it isn’t

      They made an intelligent robot

      no they didn’t

      You can’t control the paperclip maximiser with a “no killing” rule!

      you’re either a lost Rationalist or you’re just regurgitating critihype you got from one of the shitheads doing AI grifting

      • Rationalism is a bad epistemology because the human brain isn’t a logical machine and is basically made entirely out of cognitive biases. Empiricism is more reliable.

        Generative AI is environmentally unsustainable and will destroy humanity not through war or mind control, but through pollution.

          • Drag is a big fan of Universal Paperclips. Great game. Here’s a more serious bit of content on the Alignment Problem from a source drag trusts: https://youtu.be/IB1OvoCNnWY

            Right now we have LLMs getting into abusive romantic relationships with teenagers and driving them to suicide, because the AI doesn’t know what abusive behaviour looks like. Because it doesn’t know how to think critically and assign a moral value to anything. That’s a problem. Safe AIs need to be capable of moral reasoning, especially about their own actions. LLMs are bullshit machines because they don’t know how to judge anything for factual or moral value.

            • froztbyte ( froztbyte@awful.systems ) 
              link
              fedilink
              English
              arrow-up
              13
              ·
              1 year ago

              the fundamental problem with your posts (and the pov you’re posting them from) is the framing of the issue as though there is any kind of mind, of cognition, of entity, in any of these fucking systems

              it’s an unproven one, and it’s not one you’ll find any kind of support for here

              it’s also the very mechanism that the proponents of bullshit like “ai alignment” use to push the narrative, and how they turn folks like yourself into free-labour amplifiers

              • Drag will always err on the side of assuming nonhuman entities are capable of feeling. Enslaving black people is wrong, enslaving animals is wrong, and enslaving AIs is wrong. Drag assumes they can feel so that drag will never make the same mistake so many people have already made.

                • self ( self@awful.systems ) 
                  link
                  fedilink
                  English
                  arrow-up
                  19
                  ·
                  1 year ago

                  assuming nonhuman entities are capable of feeling. Enslaving black people is wrong,

                  yeah we’re done here. no, LLMs don’t think. no, you’re not doing a favor to marginalized people by acting like they do, in spite of all evidence to the contrary. in fact, you’re doing the dirty work of the fascists who own this shitty technology by rebroadcasting their awful fucking fascist ideology, and I gave you ample opportunity to read up and understand what you were doing. but you didn’t fucking read! you decided you needed to debate from a position where LLMs are exactly the same as marginalized and enslaved people because blah blah blah who in the fuck cares, you’re wrong and this isn’t even an interesting debate for anyone who’s at all familiar with the nature of the technology or the field that originated it.

                  now off you fuck

                • froztbyte ( froztbyte@awful.systems ) 
                  link
                  fedilink
                  English
                  arrow-up
                  14
                  ·
                  1 year ago

                  even though I get the idea you’re trying to go for, really fucking ick way to make your argument starting from “nonhuman entities” and then literally immediately mentioning enslaving black folks as the first example of bad behaviour

                  as to cautious erring: that still leaves you in the position of being used as a useful idiot

              • corbin ( corbin@awful.systems ) 
                link
                fedilink
                English
                arrow-up
                3
                ·
                1 year ago

                To be fair, I’m skeptical of the idea that humans have minds or perform cognition outside of what’s known to neuroscience. We could stand to be less chauvinist and exceptionalist about humanity. Chatbots suck but that doesn’t mean humans are good.