this post was submitted on 28 Aug 2023
1736 points (97.9% liked)

Lemmy.World Announcements

29163 readers
36 users here now

This Community is intended for posts about the Lemmy.world server by the admins.

Follow us for server news 🐘

Outages πŸ”₯

https://status.lemmy.world/

For support with issues at Lemmy.world, go to the Lemmy.world Support community.

Support e-mail

Any support requests are best sent to info@lemmy.world e-mail.

Report contact

Donations πŸ’—

If you would like to make a donation to support the cost of running this platform, please do so at the following donation URLs.

If you can, please use / switch to Ko-Fi, it has the lowest fees for us

Ko-Fi (Donate)

Bunq (Donate)

Open Collective backers and sponsors

Patreon

Join the team

founded 2 years ago
MODERATORS
 

Hello everyone,

We unfortunately have to close the !lemmyshitpost community for the time being. We have been fighting the CSAM (Child Sexual Assault Material) posts all day but there is nothing we can do because they will just post from another instance since we changed our registration policy.

We keep working on a solution, we have a few things in the works but that won't help us now.

Thank you for your understanding and apologies to our users, moderators and admins of other instances who had to deal with this.

Edit: @Striker@lemmy.world the moderator of the affected community made a post apologizing for what happened. But this could not be stopped even with 10 moderators. And if it wasn't his community it would have been another one. And it is clear this could happen on any instance.

But we will not give up. We are lucky to have a very dedicated team and we can hopefully make an announcement about what's next very soon.

Edit 2: removed that bit about the moderator tools. That came out a bit harsher than how we meant it. It's been a long day and having to deal with this kind of stuff got some of us a bit salty to say the least. Remember we also had to deal with people posting scat not too long ago so this isn't the first time we felt helpless. Anyway, I hope we can announce something more positive soon.

you are viewing a single comment's thread
view the rest of the comments
[–] douglasg14b@lemmy.world 37 points 1 year ago (7 children)

Isn't there semi-automated tools that can detect CP?

Those might be an automated solution to at least cut down on the volume.

The same can go for banned images. These can automatically be identified with perceptual hashing, and automatically be denied when uploading.

We should just track these people and send them the police directly, way more efficient than Symptom control.

[–] cley_faye@lemmy.world 19 points 1 year ago

There are. They are easy to abuse too, and cause a lot of other issues, along with not being 100% efficient. Apple tried that and was met with appropriate backlash. There are many issues : training data is one, but also it is impossible to rule out false positive/false negative automatically, and it is relatively easy (for now) to doctor pictures to pass through. A nefarious actor could easily bypass these. There's also the case of false positive that can very quickly push some bystander under the bus, and knowing how moderate and understanding internet is… yup.

It is also risky, as this will effectively be a censorship tool; they are often setup in the pretense of "helping", but once they're up, it all depends on who steers it. Such responsibility can hardly fall on moderators/admin of lemmy, and it would also be problematic to handle them on a more nationwide (or more) level, since it would give incredible censorship power to authorities.

And a bigger bottom-line is that working hard to prevent these kind of content from reaching us, while it have an obvious upside, also does nothing in respect to the actual issue of the content existing and being created.

tl;dr: there is no easy solution that doesn't come with one hell of a string attached to it.

On the other hand, it is quite hard to hide yourself from authorities online, and this kind of behavior (I hope, somehow, that the people that posted these only do so to be toxic to lemmy and not to actually disseminate content) should lead to some action from authorities, getting to actual people and subsequently moving upward the stream to actually act on it. Hopefully.

[–] Rolive@discuss.tchncs.de 13 points 1 year ago (2 children)

The one thing AI would be good for... Humans shouldn't have to see that shit.

[–] Zeth0s@lemmy.world 12 points 1 year ago (1 children)

Humans have to see that shit to train ai. That is why it is so difficult to find a model for that

[–] kylian0087@lemmy.world 5 points 1 year ago (1 children)

Honestly what a shit job you must have when working with that stuff. it is sad and a difficult thing.

A lot of the mods for big providers like FB require counseling after the horrible crap they see (not just CSAM, but also terrible things like animal abuse and mutilation, etc). Unfortunately, the big companies have outsourced much of it to other countries where there aren't as many worker protections, traumatizing people and replacing them when they can't meet some arbitrary metric.

[–] shotgun_crab@lemmy.world 11 points 1 year ago (2 children)

You'd need data to train an AI... Yeah that won't happen

[–] HikingVet@lemmy.sdf.org 11 points 1 year ago

IIRC there is a database that law enforcement uses during investigations to obtain access to these groups (they obtain consent from the victims to use the material).

[–] joshuaacasey@lemmy.world 8 points 1 year ago (1 children)

the one thing you do not do with this shit is use AI (too much risk of false positives. I mean, I remember Facebook's AI thought that an onion was nudity (probably thought it was a boob).

But tools do exist. PhotoDNA by Microsoft. Although much more user-friendly implementation if you use Cloudflare, related links:

[–] Zeus@lemmy.world 7 points 1 year ago* (last edited 1 year ago)

the "risk" of false positives comes down to the consequence. if the consequence is being stuck in the slammer, don't use ai. if the consequence is you can't upload the image unless you manually appeal, or even maybe have to use an external image host; i think ai is fine

edit: ah bugger, wrong acct. ah well

(please tag @zeus@lemm.ee if you want me to see your response)

[–] HelloHotel@lemmy.world 6 points 1 year ago

Apple is building the tech, too they arent sharing it with the world for humanitarian purposes like this.

[–] guts@lemmy.ml 3 points 1 year ago
[–] HelloHotel@lemmy.world 0 points 1 year ago

Apple willingly made that tech, however its designed to get the individual in trouble by looking at the photos from their personal device and snitching on its owner (leaking them in the process). They can easly adapt it into a tool for social media, but it goes against their beleafs.