LocalLLaMA

2249 readers

1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS

pax@sh.itjust.works

SkySyrup@sh.itjust.works

noneabove1182@sh.itjust.works

Discovering Locally Run Language Models: Share Your Favorites/Not So Favorites! (beehaw.org)

submitted 1 year ago* (last edited 1 year ago) by dtlnx@beehaw.org to c/localllama@sh.itjust.works

2 comments fedilink hide all child comments

Let's talk about our experiences working with different models, either known or lesser-known.

Which locally run language models have you tried out? Share your insights, challenges, or anything you found interesting during your encounters with those models.

top 2 comments

sorted by: hot top controversial new old

[–] dtlnx@beehaw.org 0 points 1 year ago (1 children)

I'd have to say I'm very impressed with WizardLM 30B (the newer one). I run it in GPT4ALL, and even though it is slow the results are quite impressive.

Looking forward to Orca 13b if it ever releases!

[–] micheal65536@lemmy.micheal65536.duckdns.org 1 points 1 year ago

Which one is the "newer" one? Looking at the quantised releases by TheBloke, I only see one version of 30B WizardLM (in multiple formats/quantisation sizes, plus the unofficial uncensored version).