Ryzen 5900X, 64 gig DDR4-3200, 2tb ssd,10tb hdd and an RTX2070. Hosting Stable Diffusion, various llama.cpp instances with python bindings, jellyfin, sonarr, multiple modded minecraft servers, and a network file share.
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.
Resources:
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
Nice, you must be into deep learning with such a setup, any particular reason the deep deep learning models and GPU run in your server rather than in a powerful desktop system? Maybe you're actively offering AI services to the outside world?
It is a powerful desktop system as in it's housed in a desktop case and uses a "non-server" CPU.
Which like any computer can be a server. Being a server is more of a role than a form factor even if there are form factors specifically aimed at servers (rack mounted).
Wow, a reply I made in another community ended up under this one. Yeah I'm doing a lot of work on local models and text embedding models for vector search.
Looks tidy buddy! Have fun 😊
Yup, mostly running pretrained models for text embedding and some generative stuff. No real fine tuning.