majorswitcher

joined 1 year ago
[–] majorswitcher@lemmyfly.org 1 points 1 year ago

14 days later, my postgres directory was 12GB. I was still on 18.1. Updated to 18.3 just now. Postgres directory was downscaled to 2.6GB !!! Thank you Lemmy dev's and contributors !!

[–] majorswitcher@lemmyfly.org 1 points 1 year ago (1 children)

pictrs isn’t even taking up that much space, postgres takes up most !

# du -sch volumes/*
8.0K	volumes/lemmy-ui
3.4G	volumes/pictrs
8.2G	volumes/postgres
12G	total
[–] majorswitcher@lemmyfly.org 1 points 1 year ago

I also noticed the logs were growing and taking up quite some gb's. I've used truncate to make the syslog smaller and journalctl vacuum to keep that smaller

[–] majorswitcher@lemmyfly.org 1 points 1 year ago (1 children)

i'm trying to find documentation for this config but can't find any. Do you have a link maybe ?

[–] majorswitcher@lemmyfly.org 2 points 1 year ago

thanks for your detailed how-to ! Will try this, hopefully it holds 2 more weeks I'm leaving for holidays now :)

 

the diskspace on the server I'm using for lemmyfly.org is getting full (it was 40GB local volume, and it's at 80% now) I can get extra volumes at my hosting (Hetzner) but is it possible lemmy looks at different volumes for the volumes folder that contains pictrs, postgres and lemmy-ui ?

Or do I need to move the complete main lemmy folder to this other volume and run lemmy from there, leaving my system-volume unused for lemmy ?

[–] majorswitcher@lemmyfly.org 9 points 1 year ago (3 children)

oh it's visible because I'm admin/ mod ?

[–] majorswitcher@lemmyfly.org 1 points 1 year ago

actually I did delete the server (after creating a snapshot of it) a week or so ago. But this morning I wanted to check lemmyfly.org, couldn't load the page. Checking my Hetzner dashboard I noticed CPU was spiked at 200%?! It did drop again though, but apparently had last for 2-3 minutes. But prometheus was down, so no graphs apart from the hetzner ones. I doesn't relate to network traffic spikes, so I don't know what caused it. I've started the prometheus server again (that snapshot was really useful :) ) and will leave it on for a couple of months now.

current system consumption:

I might need to get an extra volume for storage, Lemmy is starting to eat up the root filesystem.. Does anyone know how I re-configure Lemmy to look at a different volume for storage ?

 

Pay for Sendgrid (100 / day for free is not enough) VS set up your own email server?

For own email server, do you not get flagged a lot as spam ?

[–] majorswitcher@lemmyfly.org 1 points 1 year ago

Mine too I see now. You can only ban a user when they have posted something right ? There is no list for admins of all users registered ? Maybe I'll do it direct in the database..

[–] majorswitcher@lemmyfly.org 0 points 1 year ago (1 children)

with what purpose ? posting stuff, or some other use ?

 

I've set registration to Require application again, don't like this bots creating accounts.

Also I'm running into email limitations. Using the Sendgrid Free plan of 100 emails per day, but if a couple of member have email notification on, I'm reaching that 100 very quickly. How do others handle the high email traffic ?

[–] majorswitcher@lemmyfly.org 1 points 1 year ago (1 children)

why all these upvotes? This post is on top of my posts since yesterday.

[–] majorswitcher@lemmyfly.org 1 points 1 year ago

http_response metrics are also up, using https://github.com/martin-helmich/prometheus-nginxlog-exporter

would be nice to see the numbers go up :)

[–] majorswitcher@lemmyfly.org 0 points 1 year ago (1 children)

i'm now looking into logging more specific http request data. Maybe https://github.com/martin-helmich/prometheus-nginxlog-exporter?

 

running a lemmy instance has learned me a lot about devops already!

I love playing around with this, the lemmy instance was a great reason. lemmyfly.org doesn't have a lot of traffic yet, I think it can handle some more. Currently running on 2 vcpu/4gb ram.

After chatting to my devops colleague at work I wanted to set up a Grafana dashboard with metrics on the server. Seems it's pretty pretty doable!

  • I installed prometheus node_exporter on my lemmy server
  • I created a second server at my VPS. Very cheap, and don't think I'll be running the Prometheus/Grafana 24/7 so I'll just create a snapshot of it, destroy the server and re-create when wanted
  • Created an internal private network so the instances can communicate without exposing ports to the public
  • Installed Prometheus on the new prometheus server
  • Installed Grafana
  • log in to Grafana, admin:admin then change password
  • Go to the Grafana home dashboard, click on + sign and click on Import. In Import via grafana.com, put the dashboard id 1860 (preset for all prometheus node_exporter metrics) and click on Load.
  • Done!

Last 2 hours in the garden with a beer on the side, WFH FTW

 

cross-posted from: https://lemmyfly.org/post/2382

thanks to @Hopfgeist@feddit.de for noticing www.lemmyfly.org was not secured and not pointing to the lemmy instance.

Checking the lemmy ansible files I saw your nginx configuration file is located in /etc/nginx/sites-available/[sitename].conf

To add a redirect for your www.[sitename, add: (lemmyfly.org example)

server {
  server_name www.lemmyfly.org;
  return 301 $scheme://lemmyfly.org$request_uri;
}

check your config with sudo nginx -t

restart nginx: sudo systemctl restart nginx

 

Is it possible applications go missing? I received an email yesterday about a request and 2 hours ago, but can’t find them in the applications overview, neither unread nor all

 

When the admin of a instance wants to stop the server (for example costs are running too high) but your communities are active and you don’t want them to die along with it, is it possible to migrate the communities to another instance?

 

seems not scaleable. I thought you could subscribe at one instance, then browse communities from all instances and read and comment no matter if your instance has it in their Allowed list or not ? (apart from the ones in Blocked)

 

I've subscribed on my new instance lemmyfly.org to !lemmy_support@lemmy.ml. One post (by me) on there (postfix issues, possible to use sendgrid?) has 4 comments. But when I click on that post from my own server timeline, it shows an earlier state of the post with 0 comments.

Maybe I don't understand the federation well enough yet, but shouldn't the state of a post be similar no matter from which instance you look at it ?

edit: I see different comments on this post when looking at it direct on lemmy.ml/c/lemmy_support and on https://lemmyfly.org/c/lemmy_support@lemmy.ml

My own comment posted from lemmyfly.org, does not show under this post at lemmy.ml, only on my own instance ? This is why I edit the main post to write this. Is it supposed to work like this ?

view more: next ›