LLMs, and everyone who uses them to process information:
Facts are not a data type for LLMs
I kind of like this because it highlights the way LLMs operate kind of blind and drunk, they’re just really good at predicting the next word.
ATTN: If you’re coming into this thread to say, “The output of AI is bad because your prompts suck,” I’m just proud that you managed to figure out how to use the internet at all. Good job, you!
remember remember, eternal september
(not that I much agree with the classist overtones of the original, but fuck me does it come to mind often)
Well, to be fair, AI can do it in seconds. Which beats humans.
But if that is relevant if the results are worthless is another question.
Yeah it changes the task from note taking or summarizing to proofreading.
And proofreading is notably more complex and has a worse failure state than just writing your own summary.
Thing is you can do in real time and not pay as much attention to the goings on as you write or do it in the end and forget stuff. there is no harm in the ai summariziation. you could instead write a summary and check if you left anything out via the ai.
that’s great thanks
Made strange choices about what to highlight.
They certainly do. For a while it was common to see AI-generated summaries under links to articles on lemmy, so I got a feel for them. Seems to me you would not need any fancy artificial intelligence to do equally well: Just take random excerpts, or maybe just read every third sentence.
how the hell did this of all the posts turn into a promptfondler shooting gallery
1.26K subscribers
Promptfondler has to be my new favourite slur!
*Epithet
i have seen the light from the helpful posters here, made up bullshit alleged summaries of documents are great actually
I had GPT 3.5 break down 6x 45-minute verbatim interviews into bulleted summaries and it did great. I even asked it to anonymize people’s names and it did that too. I did re-read the summaries to make sure no duplicate info or hallucinations existed and it only needed a couple of corrections.
Beats manually summarizing that info myself.
Maybe their prompt sucks?
“Are you sure you’re holding it correctly?”
christ, every damn time
I got AcausalRobotGPT to summarise your post and it said “I’m not saying it’s always programming.dev, but”
@RagnarokOnline @dgerard “They failed to say the magic spells correctly”
How did you make sure no hallucinations existed without reading the source material; and if you read the source material, what did using an LLM save you?
deleted by creator
Dang everyone here needs to look at a tree or a cat or something. Energy is wack in here
I just went outside and appreciated the rendering
Pretty nice right? I did the trees and cats.
DANGER WILL ROBINSON, godposting detected
I have some competition!
if people don’t appreciate the kitties their tamagotchi is in some fucking trouble
While reading this entire stuff I periodically looked at my cat and let out a sigh, and he just looks at me with that knowing gaze
“Ye, you are all dumb, hoomans. Don’t think about it. Pet me now.”
Nearly every cat is a tree-cat.
Is it only me, or is the linked article not super long on details & is reaching a conclusion from 2 examples? This is important & I need to hear more, & I’m generally biased against AI at this point— but the article isn’t doing enough to convince me
did you click through to any of the inline citations? David’s shorter articles on pivot mostly gather and summarize those, so if you need to read the original research and its conclusions that’s where to go
Ah, that’s better, yes. Thank you , no sarcasm :) now sleepy brain is more informed
deleted by creator
ChatGPT gives you a bad summary full of hallucinations and, as a result, you choose not to read the text based on that summary.
deleted by creator
But the claims of the text are often why you read it in the first place! If you have a hundred scientific papers you’re going to read the ones that make claims either supporting or contradicting your research.
You might as well just skim the titles and guess.
deleted by creator
not reading the fucking sidebar and thinking this is high school debate club fallacy
deleted by creator
holy shit, imagine getting a second chance to not be a fucking debatelord and doubling down this hard
off you fuck
this argument
I agree, you’re quite right, and I thank you for taking the time and putting in the effort on such a wonderfully thorough portrayal of why your argument is total horseshit
Unless it doesn’t accurately represent the topic, which happens, and then a researcher chooses not to read the text based on the chatbot’s summary.
Nirvana fallacy.
All these chatbots do is guess. I’m just saying a researcher might as well cut out the hallucinating middleman.
Both the use cases here are goverment documents. I’m baffled at the idea of it being “fine if the AI makes shit up”.
if the text is well-written you don’t need this sort of “Gemini/ChatGPT, tell me what this text is about” on first place.
And if it’s badly written then the LLM will shit itself.
Now let’s ask ourselves how much of the text in the world is “well-written”?
Or even better, you could apply this to Copilot. How much code in the world is good code? The answer is fucking none, mate.
deleted by creator
You’d think so, but guess what precise use case LLMs are being pushed hard for.
I keep having to remind people. Chatgpt is only as good as the prompt you give it. I am astounded as the amount of garbage that some people get, but I also know that it’s generally because their prompts are garbage.
Sometimes it’s output sucks, even with good input. But likely, if the output is bad, the input was bad.
Ok? I don’t have another human available to skim a shitload of documents for me to find answers I need and I don’t have time to do ot myself. AI is my best option.
So long as you don’t care about whether they’re the right or relevant answers, you do you, I guess. Did you use AI to read the linked post too?
I didn’t read the post at all because its premise is irrelevant to my situation. If I had another human to read documentation for me I would do that. I don’t so the next best thing is AI. I have to double check its findings but it gets me 95% of the way there and saves hours of work. It’s a useful tool.
everyone, we have a new worst poster
I didn’t read the post at all
rather refreshing to have someone come out and just say it. thank you for the chuckle
we really do need “my source is that I made it the fuck up” for people who aggressively don’t want to read any of the text they’re allegedly commenting on
absolutely superb posting, thank you
This is hall of fame shit right here, someone should study the way you use the internet sir
