People Twitter

5234 readers

793 users here now

People tweeting stuff. We allow tweets from anyone.

RULES:

Mark NSFW content.
No doxxing people.
Must be a tweet or similar
No bullying or international politcs
Be excellent to each other.

founded 1 year ago

MODERATORS

SendMeYourTaTas@sh.itjust.works

pelespirit@sh.itjust.works

1922

The dream (lemmy.world)

submitted 10 months ago by Stamets@lemmy.world to c/whitepeopletwitter@sh.itjust.works

251 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Xanaus@lemmy.ml 4 points 10 months ago (2 children)

Could you please share your process for us mortals ?

[–] CeeBee@lemmy.world 6 points 10 months ago

Stable diffusion SXDL Turbo model running in Automatic1111 for image generation.

Ollama with Ollama-webui for an LLM. I like the Solar:7b model. It's lightweight, fast, and gives really good results.

I have some beefy hardware that I run it on, but it's not necessary to have.

[–] Ookami38@sh.itjust.works 2 points 10 months ago (1 children)

Depends on what AI you're looking for. I don't know of an LLM (a language model,think chatgpt) that works decently on personal hardware, but I also haven't really looked. For art generation though, look up automatic1111 installation instructions for stable diffusion. If you have a decent GPU (I was running it on a 1060 slowly til I upgraded) it's a simple enough process to get started, there's tons of info online about it, and it's all run on local hardware.

[–] CeeBee@lemmy.world 2 points 10 months ago (1 children)

I don't know of an LLM that works decently on personal hardware

Ollama with ollama-webui. Models like solar-10.7b and mistral-7b work nicely on local hardware. Solar 10.7b should work well on a card with 8GB of vram.

[–] ParetoOptimalDev@lemmy.today 1 points 10 months ago

If you have really low specs use the recently open sourced Microsoft Phi model.