this post was submitted on 19 Jul 2024
450 points (99.3% liked)

Technology

59402 readers
2854 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Bots can now solve CAPTCHAs better than humans

https://www.youtube.com/watch?v=IWUHv3S8JVI

#tech #video

@technology@lemmy.world

you are viewing a single comment's thread
view the rest of the comments
[–] ArmokGoB@lemmy.dbzer0.com 8 points 4 months ago (2 children)

I feel like this could be abused by admins to create a system of social credit. An admin acting unethically could revoke access up the chain as punishment for being associated with people voicing unpopular opinions, for example.

[–] skaffi@infosec.pub 4 points 4 months ago

Absolutely, but the chain of trust, in a way, doesn't start with the admin - only the explicit chain does. Implicitly, the chain of trust starts with all of us. We collectively decide if any given chain is trustworthy or not, and abuse of power will undoubtedly be very hard to keep hidden for long. If it becomes apparent that any given chain have become untrustworthy, we will cast off those chains. We can broke new bonds of trust, to replace chains that have broken entirely.

It's a good system, because started a new chain should be incredibly easy. It's really just a refined version of the web rings of old, presented in a catalogue form. It's pretty great!

[–] lvxferre@mander.xyz 4 points 4 months ago* (last edited 4 months ago) (1 children)

By "up the chain", you mean the nodes that I represented near the bottom, right?

Theoretically they could, by revoking their guarantee. But then the guarantee could simply ask someone else to be their guarantor, and the chain is redone.

For example, check the infographic #2. Let's say that, instead of botting, Charlie used her chain to bully Hector.

  • Charlie: "Hector likes ponies! What a shitty person! Gerald, I demand you to revoke their guarantee!"
  • Gerald: "sod off you muppet"
  • Charlie: "Waaah Gerald is a pony lover lover! Fran, revoke their access! Otherwise I revoke yours!"
  • Fran: "Nope."
  • [Charlie revokes Fran's guarantee]
  • Fran: "Hey Alice! Could you guarantee me?"
  • Alice: "eh, sure. Also, Charlie, you're abusive."
  • [Alice guarantees Fran]
  • [Alice revokes Charlie's access.]

Now the only one out is Charlie. Because the one abusing power also loses intrinsic trust (as @skaffi@infosec.pub correctly highlighted, there's another chain of trust going on, an intrinsic one).

[–] ArmokGoB@lemmy.dbzer0.com 2 points 4 months ago* (last edited 4 months ago) (1 children)

When I say "up the chain," I mean towards the admins. A platform isn't gonna let just anyone start a chain, because any random loser could just be the start of an access chain for a bunch of bots, with no oversight. So I conclude that the chain would necessarily start with the website admins.

My experience online is that the upper levels of moderation/administration feel beholden to no one once they get enough users. It's been shown time and time again that you can act like a dictator if you have enough people under you to make some of them expendable. It might not be a problem on, say, db0. However, I've seen Discord servers that are big enough to have this problem. I could definitely see companies abusing this to minimize risk.

So, for example, pretend Reddit had this system during the API nonsense:

  • You're a nobody who is complaining about it.
  • Spez sees you are dissenting and follows your chain.
  • Turns out you're probably gonna ask for a guarantee from people you share some sort of relationship/community with, even if it's cursory.
  • Spez suspends everyone up the chain for 14 days until he reaches someone "important" like a mod.
  • Everyone points fingers at you for daring to say something that could get them in trouble, and you suffer social consequences, subreddit bans, etc.
  • Spez keeps doing this, but randomly suspends mods up the chain that aren't explicitly loyal to Reddit (the company).
  • People start threatening to revoke access from others if they say things that break Reddit ToS or piss off the admins.
  • Dystopia complete

Maybe I'm still misunderstanding how this system works, but it seems like it would start to run into problems as a website got more users and as people became reliant on it for their social life (like I am with Discord and some of my friends/family are with Facebook).

[–] lvxferre@mander.xyz 2 points 3 months ago (1 children)

Got it - up "up".

Yes, if this sort of chain starts with the admins, they could exploit it for censorship. However that doesn't give them "new" powers to abuse, it's still the "old" powers with extra steps.

And, in this case, the "old" powers are full control over the platform and access to privileged info. Even without this system, the same shitty admins could do things yielding the same dystopia as your example - such as censoring complains through vaguely worded bans ("multiple, repeated violations of the content policy") or exploiting social relations to throw user against user, since they know who you interact with.

So, while I think that you're noticing a real problem, I think that this problem is deeper and appears even without this feature - it's the fact that people would be willing to play along such abusive admins on first place, even as the later misuses systems at their disposal to silence the former. They should be getting up and leaving.

It's also tempting to think on ways to make this system headless, with multiple concurrent chains started by independent parties, that platforms are allowed to accept or decline independently. In this case admins wouldn't be responsible so much for creating those chains, but accepting or declining chains created by someone else. With multiple sites being able to use the same chains.

[–] ArmokGoB@lemmy.dbzer0.com 2 points 3 months ago* (last edited 3 months ago) (1 children)

My main criticism was how this system enables admins to implement collective punishment with almost zero effort, unless it's made headless.

[–] lvxferre@mander.xyz 2 points 3 months ago

I got it. And to be fair it is an actual concern.