Previous posts: https://programming.dev/post/3974121 and https://programming.dev/post/3974080
Original survey link: https://forms.gle/7Bu3Tyi5fufmY8Vc8
Thanks for all the answers, here are the results for the survey in case you were wondering how you did!
Edit: People working in CS or a related field have a 9.59 avg score while the people that aren’t have a 9.61 avg.
People that have used AI image generators before got a 9.70 avg, while people that haven’t have a 9.39 avg score.
Edit 2: The data has changed slightly! Over 1,000 people have submitted results since posting this image, check the dataset to see live results. Be aware that many people saw the image and comments before submitting, so they’ve gotten spoiled on some results, which may be leading to a higher average recently: https://docs.google.com/spreadsheets/d/1MkuZG2MiGj-77PGkuCAM3Btb1_Lb4TFEx8tTZKiOoYI
Dandroid ( @dandroid@dandroid.app ) 23•9 months agoThis is what I was suspecting. People are just guessing. I have had people adamantly claim pictures that I took were AI generated and that I was lying when I said they weren’t. I see people on the internet constantly pull reasons out of their ass of why something is AI generated, saying “a real artist wouldn’t make this mistake,” but my wife has made those exact mistakes before.
I feel for you. A few people said the human art I put in the survey were lackluster but I thought they were pretty good, not everyone is an S-tier artist.
77% of people guessed this was AI generated, and a friend of mine kept saying it was weird and inconsistent so “I doubt a real artist would put random food in the back”
It’s actually a cropped image of https://www.deviantart.com/tsaoshin/art/Strawberry-Taiyaki-Cat-905271835 . I wouldn’t want to be an artist right now.
Dandroid ( @dandroid@dandroid.app ) 6•9 months agoThat image is adorable. It was one of my favorites from the survey.
Martineski ( @Martineski@lemmy.dbzer0.com ) English8•9 months agoI would love to see the same study but with every image being ai generated.
Dandroid ( @dandroid@dandroid.app ) 7•9 months agoThat or even every image being human generated. See all the reasons people come up with to explain why they thought human generated art was AI generated.
ApeNo1 ( @ApeNo1@lemm.ee ) English17•9 months agoWould be good to see tests against only images of real life scenarios or things. Limited to photorealistic people, places, events like say floods etc. I think cartoons or non photorealistic drawings will always be hard to pick as there is not an obvious image of reference you would have in your mind as there is no limit to different artists styles.
Euphoma ( @Euphoma@lemmy.ml ) English8•9 months agoI got the cartoon with text wrong because I didn’t know dalle-3 could do text. I got 12 from vibes of more detail? This assumption that AI does more detail gets a lot of actual humans. AI image generation is really crazy. The simpler stuff is pretty much indistinguishable from real human stuff at this point.
peanuts4life ( @peanuts4life@beehaw.org ) English6•9 months agoAwesome job! Here is the first image dalle-3 generated of you.
Not overly convincing, but look at those hands!
Absolutely horrifying, thanks
Helix 🧬 ( @Helix@feddit.de ) 2•9 months agoYeah why the fuck are the test tubes of different lengths???
Euphoma ( @Euphoma@lemmy.ml ) English1•9 months agoThe only odd thing I noticed is the test tubes that look like they should be out of focus like the rest of the background. That is extremely convincing and idk if I would notice if I saw it out of context.
apotheotic(she/they) ( @apotheotic@beehaw.org ) English6•9 months agoI was quite disappointed that I “only” got 14, originally, but these results make me feel a lot better about that score. Any chance you could share some more involved results of this survey? I’m curious about percentiles for each score, and standard deviations for those averages - is 9.70 vs 9.39 statistically relevant or within expected variance?
I was, of course, fooled by the cartoon and the lineart sketch, those two are stupendously convincing.
Someone asked for the raw dataset in the other thread, here it is: https://docs.google.com/spreadsheets/d/1MkuZG2MiGj-77PGkuCAM3Btb1_Lb4TFEx8tTZKiOoYI
Have at it.
apotheotic(she/they) ( @apotheotic@beehaw.org ) English1•9 months agoThank you! I’ll poke around the data.
- Caaaaarrrrlll ( @Caaaaarrrrlll@lemmy.ml ) 4•9 months ago
Can people tell tell
Instigate ( @Instigate@aussie.zone ) 2•9 months agoMy wife and I took part in the survey as people who aren’t in programming and have never used LLM art generators before, and we scored quite poorly. I got all of the photorealistic images correct, but the painting/drawing pictures were much more difficult.
I think a better test would be to give four real artists and five LLM art generators the same prompt, show all nine of those together in a square and you have to pick the real ones. Then we’re comparing like-for-like as opposed to trying to spot an LLM image out of the blue.
For the sake of an survey you are right.
But practically this shows how easy people are fooled nowadays, and it will only get worse in the future.
edric ( @scytale@lemm.ee ) 1•9 months agoI scored 9 on this so I’m right at average. lol