I was thinking about this after a discussion at work about large language models (LLMs) - the initial scrape of the internet before Chat GPT become publicly usable was probably the last truly high quality scrape of human-made content any model will get. The second Chat GPT went public, the data pool became tainted with people publishing information from it. Future language models will have increasingly large percentages of their data tainted by AI-generated content, skewing the results away from how humans actually write. To get actual human content, they may need to turn to transcriptions of audio recordings or phone calls for training, and even that wouldn’t be quite correct because people write differently than they speak.
I sort of wonder if eventually people will start being influenced in how they choose to write based on seeing this AI content. If teachers use AI-generated texts in school lessons, especially at lower levels, will that effect how kids end up writing and formatting their work? It’s weird to think about the wider implications of how this AI stuff will ultimately impact society.
What’s your predictions? Is there a future where AI can get a clean, human-made scrape? Are we doomed to start writing like AIs?
- PenguinTD ( @PenguinTD@lemmy.ca ) English19•1 year ago
You have to remember one thing, writing or speaking of a language is not a fixed scientific law or math formula that will stay true through out history. A living language is always moving and evolving in most of its components, be a vocabulary, grammar, or even meaning of words/phrases. We are just entering an era where AI generated content someone might feel appealing and follow that style, compare to copy a contemporary popular writer.
- FaceDeer ( @FaceDeer@kbin.social ) 4•1 year ago
Indeed. As long as the language is still expressive and we understand what is being communicated, I don’t see why it would matter if it “sounds like” AI or not.
If it really becomes a problem then just curate the training data better to exclude the stuff that “sounds like” an AI. Doesn’t matter if it’s actually written by an AI or not, just select the training data that matches what you’d like the AI to learn and go with that. There’s not some kind of magical ghost present in human-written words that’s absent in AI-written words, if the words are the words you want then that’s all that matters.
- dave_r ( @Dave_r@reddthat.com ) English18•1 year ago
This is a classic feedback problem: you use a microphone to amplify your voice, but If the mic picks up the amplified sound it creates audio feedback + a sharply increasing wail.
I can’t imagine what LLM feed back ‘sounds like’, but a guarantee you it ain’t pretty.
- Chris Koss ( @chriskoss@lemmy.fmhy.ml ) English17•1 year ago
I’ve heard this theory. Feels like unrealistic hopeful wishes of people who want AI to fail.
LLM processing will be a huge tool for pruning and labeling training sets. Humans can sample and validate the work. These better training sets will produce better LLMs.
Who cares is a chunk of text was written by a human or not? Plenty of humans are shit writers who believe illogical or clearly incorrect things. The idea that human origin text is superior is a fantasy. chatGPT is a better writer than 80% of humans todat. In 10 years LLMs will be better than 99.9% of humans. There is no poison to be avoided.
chatGPT has an apparent style when used in the default mode, but you can already get away from that with simple prompt tweaks. This whole thing is a non-issue.
- conderoga ( @conderoga@beehaw.org ) English4•1 year ago
LLM generated text can also be easily detected provided you can figure out which model it came from and the weights within it. For people training models, this won’t be hard to do.
I agree with the take that getting better and better datasets for training is going to get easier over time, rather than harder. The story of AlphaZero is a good example of this too - the best chess AI quickly trounced any AI trained on human games simply by playing against itself. To me, that suggests that training on LLM output will lead to even better results, since you can generate so much more of it.
- itsybitesyspider ( @itsybitesyspider@beehaw.org ) English8•1 year ago
The chess engine’s training is anchored by the win/lose outcome of the game. LLM training is anchored by what humans like to read and write. This means that a human needs to somehow be in the loop.
- Chris Koss ( @chriskoss@lemmy.fmhy.ml ) English2•1 year ago
I think OpenAI’s own chatGPT detector had double digit false negative and positive rates. I expect as diversity of LLMs proliferates, it will become increasingly harder to detect.
- CFinley97 ( @CFinley97@kbin.social ) 17•1 year ago
I suspect the quality LLM development teams will pursue the same in-depth data sourcing & cleaning techniques that quality ML researchers are developing today. Or rather, they’ll do something similar in principle to mitigate this issue.
I still agree with your conclusions. It will be a bigger consideration and less scrupulous teams will be more effected.
- primbin ( @primbin@lemmy.one ) English16•1 year ago
I think it could end up being a problem that we face in the future, but probably not an insurmountable one.
For one, I suspect that clean data sources will always be available, though it could become a lot more expensive to obtain. As an extreme example, you could always source your data by recording in-person conversations.
Also, as AI improves, I’m guessing it will be able to handle bad data more gracefully, and that it should be able to train to the same effectiveness while using a smaller dataset.
- SenorBolsa ( @SenorBolsa@beehaw.org ) English23•1 year ago
I feel like if you tried to train an LLM on spoken conversational English the output would just be “yeah um yeah um yeah um”
But on a more serious note spoken English is very different than written.
Either way you can find validated sources of human written text it just won’t be as easy.
- beeehawwww ( @beeehawwww@beehaw.org ) English5•1 year ago
Maybe an LLM that can have a normal sounding spoken conversation will be a next step. The Turing test but speaking instead of typing. I assume the neural networks could learn things like intonation.
- IntendantTradwife ( @IntendantTradwife@kbin.social ) 14•1 year ago
thanks, it’s terrifying
- SpacePirate ( @SpacePirate@lemmy.ml ) English12•1 year ago
I’m not sure this is true. They could be trained based on published works prior to a certain date as the formal writing style, eg Project Gutenberg, then layer on the recent internet to better capture modern stylistic trends.
Ultimately, the models will always require fine tuning, and selecting which data set you use for early training has a very large impact on the overall performance of the model. Additional knowledge and trendiness can be learned after the fact.
- mitigd ( @mitigd@kbin.social ) 11•1 year ago
Well thankfully we have tons of archived conversations before ChatGPT on archive.org.
Many forums with hundreds of thousands of posts are just waiting to be scraped.
- HobbitFoot ( @HobbitFoot@thelemmy.club ) English11•1 year ago
There has already been jokes of AI being used to create well crafted correspondence, then another AI translating that into a short summary.
I think you are going to see AI as something people lean on more to talk to others, and that is going to create its own language where AI talks to AI.
- trent ( @trent@kbin.social ) 9•1 year ago
That’s not a joke – that’s exactly how a lot of the smaller open-source LLMs are trained. Orca (paper) is trained between GPT-4 and GPT-3.5-turbo
- techno156 ( @techno156@kbin.social ) 9•1 year ago
There’s usually a context difference that might might be significant. People don’t write the same way way for an email, like they would a letter, text message, or tweet.
They might write more like an LLM for things like essays and reports, but your usual writing is probably still fine. Then classics that inspire people to write are still around, and I doubt that they would be supplanted by an LLM any time soon.
We might start being in trouble if people start republishing books with them, but that’s unlikely to to happen any time soon, considering the current state of copyright around AI works.
- JWBananas ( @JWBananas@kbin.social ) 9•1 year ago
Thanks, I hate it
- coolin ( @coolin@beehaw.org ) English9•1 year ago
There are some in the research community that agree with your take: THE CURSE OF RECURSION: TRAINING ON GENERATED DATA MAKES MODELS FORGET
Basically the long and short of that paper is that LLMs are inherently biased towards likely responses. The more their training set is LLM generated, and thus contains that bias, the less the LLM will be able to produce unlikely responses, over time degrading the model quality throughout successive generations.
However, I tend to think this viewpoint is probably missing something important. Can you train a new LLM on today’s internet? Probably not, at least without some heavy cleaning. Can you train a multimodal model on video, audio, the chat logs of people talking to it, and even other better LLMs? Yes, and you will get a much higher quality model and likely won’t get the same model collapse implied by the paper.
This is more or less what OpenAI has done. All the conversations with 100M+ users are saved and used to further train the AI. Their latest GPT4 is also trained on video and image recognition, and they have also been exploring ways for LLMs to train new ones, especially to aid in alignment of these models.
Another recent example is Orca, a fine tune of the open source llama model, which is trained by GPT-3.5 and GPT-4 as teachers, and retains ~90% of GPT-3.5’s performance though it uses a factor of 10 less parameters.
- ✨Abigail Watson✨ ( @SgtSilverLining@lemmy.blahaj.zone ) English8•1 year ago
Slightly unrelated, but I was just talking with a friend about how we’re going to have similar issues with young artists trying to copy ai. As is, many young artists will turn to cartoons instead of real life when starting out. Their work is a bastardization of a bastardization, with serious flaws in anatomy, gravity, light, and depth. They go on to call those mistakes their “style” and point to other artists making those same mistakes to normalize them. Since “style” isn’t something they think they need to improve on, they may become good artists overall while having severe, glaring holes in their skillet that any professional can see. You can sometimes even tell when someone started out because “90s anime” or “10s cartoon network” made specific stylistic choices that changed over time.
So I think ai is going to cause similar problems. Newbies will copy what looks pretty to the untrained eye and learn an ai based style. Then when they become more popular they’ll be fed into ai as reference material and perpetuate the problem. Even worse is actual professionals may turn to ai instead of real life references or a desk mannequin. Then their skills may degrade because they rely too much on improper tools. (I’ve already seen this becoming an issue with photoshopped reference photos.)
Anyways, that’s my $0.02
- shanghaibebop ( @shanghaibebop@beehaw.org ) English3•1 year ago
It’s not just art, mass media means we live in the state of hyperreality -where we cannot differentiate between tour chosen representation (signs, symbols) of reality from reality itself-
Most of us have personally experienced far less than what we have consumed through media. Much of our understanding of reality is completely rooted in symbols that we have no grounding for understanding and contextualization.
- AdminWorker ( @AdminWorker@lemmy.ca ) English8•1 year ago
This sounds like what an ai would write /s
I think that while LLMs are going to get worse, the AI software will get better to the point of strong AI, and it will do a lot of “apple-esque” changes to mass produced speech that will ultimately be for the better… The cynical possibility is that it will further taint human dialogue even though it could provide a better way.
- ZILtoid1991 ( @ZILtoid1991@kbin.social ) 7•1 year ago
What I predict is that they’ll try to implement data filters to avoid feedback loops, but there will be an enshittification process for AI too.
What might put the nail into the coffin much quicker isn’t the feedback loop, but trying to monetize the whole thing. I think it’s only a matter of time until OpenAI will try to get money off of it, like putting certain features behind a paywall, especially those that professionals might use.
- Spy ( @Spy@kbin.social ) 5•1 year ago
This is already happening though and it’s somewhat understandable.
Gpt4 is locked behind a pay wall, and there are a lot of companies that offer twicked versions for specific uses for a price.Considering the server space, filtering, and training this thing takes, asking for some fee is almost a given.
On the other hand you have the HuggingFace models that try to create an open source space for AI and I really hope that goes well!
- wet_lettuce ( @wet_lettuce@beehaw.org ) 1•1 year ago
I don’t mind them charging a fee. The freemium model is nice and usually sustainable. It lets people pay for extra features but provides the free tier to those that don’t want to.
I kinda wish we collectively started becoming okay with paying for internet-based products and services.
Even something like beehaw. Why not pay a couple of bucks a month for something you get value and joy out of?
I say this as a guy who runs Linux fulltime and uses mostly free and open source software, but who also donates to System76 (my OS’s maintainer) and to a few of the projects I really like.
- Xanvial ( @Xanvial@lemmy.one ) 5•1 year ago
But OpenAI already has a monetization system now, and last update they reduce the price