this post was submitted on 27 Sep 2023
26 points (90.6% liked)
Trees
6779 readers
7 users here now
A community centered around cannabis.
In the spirit of making Trees a welcoming and uplifting place for everyone, please follow our Commandments.
- Be Cool.
- I'm not kidding. Be nice to each other.
- Avoid low-effort posts
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Surprisingly good comment on running such language models locally. Thanks, I will try to run the 70B model as well. So far I have only used up to 13B with Oobabooga.