Asklemmy

43898 readers

1495 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

Open-ended question
Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
Not ad nauseam inducing: please make sure it is a question that would be new to most members
An actual topic of discussion

Looking for support?

Looking for a community?

Lemmyverse: community search
sub.rehab: maps old subreddits to fediverse options, marks official as such
!lemmy411@lemmy.ca: a community for finding communities

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 5 years ago

MODERATORS

397

for the Reddit refugees, do you also feel a bit heartbroken? (lemmy.world)

submitted 1 year ago by Acetamide@lemmy.world to c/asklemmy@lemmy.ml

418 comments fedilink hide all child comments

For me it feels like breaking up with someone after many years. At the same time, I feel a bit dirty mentioning the name in the post title.

you are viewing a single comment's thread
view the rest of the comments

[–] thomas@lemmy.douwes.co.uk 22 points 1 year ago* (last edited 1 year ago) (12 children)

I hate reddit. But it feels like the library of Alexandria burning down (yea I know). All those google search results and educational subreddits that are shutting down forever, and because they are too small reddit won't force open them again.
A lot are in the pushshift archive, but that cuts of at 2022. Also, it doesn't include a lot of the smaller subreddits.
I have had my PC running 24/7 with multiple VPNs to avoid rate limits downloading as much as I can before the API dies, but with some blackouts moving forward a day I have already missed a few.
Like many others, I would often add "reddit" to the end of my searches to get better results, half the websites on web searches now are either AI generated, copies or on completely AD ridden websites that ask you to turn off your AD blocker.

[–] Captain_Pieces@beehaw.org 3 points 1 year ago (1 children)

how exaclty does this pushshift work? I downloaded some zsts from it but what do I do with them?

[–] thomas@lemmy.douwes.co.uk 2 points 1 year ago

The file you downloaded is a compressed JSON file, it's not something you can really just look at. But it contains all the data needed to build a nice UI around.
I don't know what OS you are on but on linux you can run zstd -d -c file.zst | jq . and it will print everything in the file. It's not really readable though. Also it doesn't have any of the media content, only the text

load more comments (10 replies)