this post was submitted on 07 Mar 2024
574 points (97.7% liked)

Technology

59446 readers
3485 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
L3s@lemmy.world
L3s@fry.gs
L4s@fry.gs
L4s@lemmy.world
enu@lemmy.world
574
Reddit Will License Its Data to Train LLMs, So We Made a Firefox Extension That Lets You Replace Your Comments With Any (Non-Copyrighted) Text (theluddite.org)
submitted 8 months ago by Kory@lemmy.ml to c/technology@lemmy.world
65 comments fedilink hide all child comments
 

I know there are other ways of accomplishing that, but this might be a convenient way of doing it. I'm wondering though if Reddit is still reverting these changes?

you are viewing a single comment's thread
view the rest of the comments
[–] abhibeckert@lemmy.world 65 points 8 months ago (5 children)

Reddit was open source until relatively recently. According to the source code, editing comments does overwrite your data. Or at least it used to.

Keeping old data is expensive, and usually a waste of money.

[–] magic_lobster_party@kbin.run 31 points 8 months ago

It’s not a waste of money if you can sell it.

And text comments is rarely more than 1kb. They can provably fit more than 1 billion comments in a 1TB drive if they want, which is peanuts in terms of storage.

[–] T156@lemmy.world 25 points 8 months ago* (last edited 8 months ago)

Relatively recently being 6 years ago.

Keeping old data is expensive, and usually a waste of money.

At the same time, text, which Reddit was exclusively, for a good long time, compresses really well. The entirety of Wikipedia goes from 10 TB to 100 GB when compressed, and if it's just the article text alone, 22 GB.

That's a drop in the bucket compared to the amount of data that they would have had to deal with when they started deciding to take on video and image hosting.

[–] SorteKanin@feddit.dk 15 points 8 months ago

Text data is like practically 0 compared to all the rest of the data (i.e. images for instance).

[–] Limeey@lemmy.world 8 points 8 months ago

I assure you that’s not the case anymore

[–] ColeSloth@discuss.tchncs.de 2 points 8 months ago

Keeping old comments data is small and relatively cheap to store. I'm sure they've kept backups. Probably even yearly ones for the past 5 years. Storage for text really doesn't take up much room. There's over 4,500,000,000 words in the entirety of Wikipedia. You can download it all right now if you'd like. An offline copy of wiki is currently about 95GB. Probably half the size of your last CoD game update.