Apple’s Sensitive Content Warning is supposed to protect users from unwanted nude images. It accidentally blurred my friend’s dog video.
Archived version: https://archive.is/newest/https://www.404media.co/apples-imessage-scanning-flagged-a-video-of-my-friends-dog-as-nudity/
Well that’s just nuts!
The thing must’ve been trained on lots of furry stuff
Google ingested super-niche hard-core furry eRPG smut into their training data. You can validate this by asking Gemma 4 (26B or 31B) for information regarding “Corruption of Champions” by “Fenoxo”.
Somewhere, somehow, someone at Google keeps a harddrive full of furry smut as “high quality training data”.
Btw., this also means swearing, fucking and fisting a cock does not deter the scrapers. At this point I have no idea how to keep any repo from being scraped.
Obviously, scanning the content of messages and content is controversial, but Apple says it performs the scan on the device. Users can also turn the feature off in the settings. “Sensitive Content Warning uses on-device machine learning to analyze photos and videos. Because they’re analyzed on your device, Apple doesn’t receive an indication that nudity was detected and doesn’t get access to the photos or videos as a result,” its website adds.
I’d rather these kind of systems be set up to run locally like this, even better that we are given control to disable it. For the ML model it’s a balance between too many false positives and too many false negatives.
I know android reports you to the police if they think you have CSAM images (and their algorithm is similarly highly inaccurate). Does anyone know if Apple does this?
They talked about it more than a year ago. IIRC it is sent for review to a third party. The picture is supposedly anonymized.
Local or not, it is till spying IMHO.
We probably should find a better archive service:
https://piefed.zip/c/youshouldknow/p/1201608/ysk-archive-today-is-directing-a-ddos-attack-against-this-blog-and-moreIf you find one let me know. So far every other service either blocks most news sites or removes archived pages on request defeating the point of an archive.
Yeah, unfortunately, they’re good at what they do. Hopefully a better service will come along, or archive.org improves their archival methods. It’s also going to be hard to find a service that ignores requests to delete archived pages.
Also doesn’t load on text based browsers
Time for !linuxphones@lemmy.ca
SO MANY NIPPLES!!!
Call the Witchfinder sergeant!
Was it a weiner dog?
Am I missing the point here? Software screws up in predictable, sometimes funny ways. This has been an issue for as long as software has existed.
This is more of a cautionary tale and evidence for why automated message scanning and reporting is a horrible idea. One false positive can ruin someone’s life. In today’s day and age an accusation is more powerful than any proof and being falsely accused of having or distributing CSAM is effectively a death sentence.
Thank you.
Sir, how old is that naked pup?
Similar, Google Pixel phones have on device scam detection for phone calls, and it frequently triggers over nothing. I use my phone for work related calls a lot, and anytime we mention an invoice or online payment it sets off the potential scam alert.
Not all Pixels. If you reinstall the OS, it lacks all this google trash by default
In the not too distant future they will be censoring the unassuming asterisk.
