Networks in China and Iran also used AI models to create and post disinformation but campaigns did not reach large audiences

In Russia, two operations created and spread content criticizing the US, Ukraine and several Baltic nations. One of the operations used an OpenAI model to debug code and create a bot that posted on Telegram. China’s influence operation generated text in English, Chinese, Japanese and Korean, which operatives then posted on Twitter and Medium.

Iranian actors generated full articles that attacked the US and Israel, which they translated into English and French. An Israeli political firm called Stoic ran a network of fake social media accounts which created a range of content, including posts accusing US student protests against Israel’s war in Gaza of being antisemitic.

    •  frog 🐸   ( @frog@beehaw.org ) 
      link
      fedilink
      English
      24
      edit-2
      26 days ago

      Ah, the old “the only way to stop a bad person with a gun is for all the good people to have guns” argument.

      Were the dictators even working on their own large language models, or do these tools only exist because OpenAI made one and released it to the public before all the consequences had been considered, thus sparking an arms race where everyone felt the need to jump in on the action? Because as far as I can see, ChatGPT being used to spread disinformation is only a problem because OpenAI were too high on the smell of their own arses to think about whether making ChatGPT publicly available was a good idea.

        •  frog 🐸   ( @frog@beehaw.org ) 
          link
          fedilink
          English
          4
          edit-2
          25 days ago

          It really is. I’m also not a huge fan of “everyone needs to have access to their own personal open source AI, otherwise only corporations will be able to use it”, like somehow the answer to corporations being shit is to give everyone else a greater ability to be shit too. What the world really needs is even more shit!

      • The reality is, passing this huge amount of data was the only way these crazy current AI models work as powerful as ChatGPT. With a restriction like you fantasize, the AI programs would have been dominated by bad actors and the west would not have a counter technology for a decade if not longer.

        Regulating the outputs of AIs would be a separate story. But it’s still overwhelmingly difficult. OpenAI is actually advanced in this region in the sense that they have in pocket the single best technology to politically balance the replies by a chatbot.

        •  frog 🐸   ( @frog@beehaw.org ) 
          link
          fedilink
          English
          325 days ago

          AI programs are already dominated by bad actors, and always will be. OpenAI and the other corporations are every bit the bad actors as Russia and China. The difference between Putin and most techbros is as narrow as a sheet of paper. Both put themselves before the planet and everyone else living on it. Both are sociopathic narcissists who take, take, take, and rely on the exploitation of those poorer and weaker than themselves in order to hoard wealth and power they don’t deserve.

            •  frog 🐸   ( @frog@beehaw.org ) 
              link
              fedilink
              English
              124 days ago

              Well, let’s see about the evidence, shall we? OpenAI scraped a vast quantity of content from the internet without consent or compensation to the people that created the content, and leaving aside any conversations about whether copyright should exist or not, if your company cannot make a profit without relying on labour you haven’t paid for, that’s exploitation.

              And then, even though it was obvious from the very beginning that AI could very easily be used for nefarious purposes, they released it to the general public with guardrails that were incredibly flimsy and easily circumvented.

              This is a technology that required being handled with care. Instead, its lead proponents are of the “move fast and break things” mentality, when the list of things that can be broken is vast and includes millions of very real human beings.

              You know who else thinks humans are basically disposable as long as he gets what he wants? Putin.

              So yeah, the people running OpenAI and all the other AI companies are no better than Putin. None of them care who gets hurt as long as they get what they want.

      • I already write one reply to tell my main point. But whatever argument you come up with, I don’t think that’ll match the reality as viewed by AI researchers. If you give me specific short questions I’d be happy to engage in a discussion, with conditions on time.

        In any case, I won’t listen to metaphoric arguments like yours with guns because metaphoric arguments are very difficult to do scientifically. Every situation is different. I mean that anybody can always end the discussion saying “that’s oranges vs apples”, and everything time this happens you’d not have an objective way to counter that.

        •  frog 🐸   ( @frog@beehaw.org ) 
          link
          fedilink
          English
          225 days ago

          The metaphoric argument is exactly on point, though: the answer to “bad actors will use it for evil” is not “so everybody should have unrestricted access to this really dangerous thing.” Sorry, but in no situation you can possibly devise is giving everyone access to a dangerous tool the correct answer to bad people having access to it.

          • I can say it’s both on point and not. For the not, you can ban the gun in the UK and it will be very difficult to bring one from the continent. Peace. But the same is not true for AI. If the UK government bans AI, Russia can still bring it through the internet.

            And then I can still counter-argue that one, and then counter-argue this one also. See what a mess a metaphoric arguments bring.

            •  frog 🐸   ( @frog@beehaw.org ) 
              link
              fedilink
              English
              124 days ago

              Had OpenAI not released ChatGPT, making it available to everyone (including Russia), there are no indications that Russia would have developed their own ChatGPT. Literally nobody has made any suggestion that Russia was within a hair’s breadth of inventing AI and so OpenAI had better do it first. But there have been plenty of people making the entirely valid point that OpenAI rushed to release this thing before it was ready and before the consequences had been considered.

              So effectively, what OpenAI have done is start handing out guns to everyone, and is now saying “look, all these bad people have guns! The only solution is everyone who doesn’t already have a gun should get one right now, preferably from us!”

    • it was better than banning AI in the free world and giving dictators advantages in AI tech.

      The US doesn’t need to ban AI. It just needs to stop publicly deploying it, untested and unregulated, on the masses. And some of these big tech companies need to stop releasing open models that can be easily obtained and abused by bad actors. Dictatorships don’t actually like AI internally, because it threatens their control of the narrative within their country. For example, the CCP has been very cautious of it when compared to the US because it is concerned about how it could be employed against the party.

      And this whole arms race argument sort of ignores the fact that the US continuing to mass deploy this shit at breakneck speed is already giving the dictators the advantages they need to fuck with democracy. No one needs to have a real war with the US if it starts one with itself.