There are many llms you can use offline
Open Source
All about open source! Feel free to ask questions, and share news, and interesting stuff!
Useful Links
- Open Source Initiative
- Free Software Foundation
- Electronic Frontier Foundation
- Software Freedom Conservancy
- It's FOSS
- Android FOSS Apps Megathread
Rules
- Posts must be relevant to the open source ideology
- No NSFW content
- No hate speech, bigotry, etc
Related Communities
- !libre_culture@lemmy.ml
- !libre_software@lemmy.ml
- !libre_hardware@lemmy.ml
- !linux@lemmy.ml
- !technology@lemmy.ml
Community icon from opensource.org, but we are not affiliated with them.
Proton have been too noisy from the very start .
It might be that they're equating the name with the app and company, not the open source model, based on one of the first lines:
AI chat apps like ChatGPT collect user data, filter responses, and make content moderation decisions that are not always transparent.
Emphasis mine. The rest of the article reads the same way.
Most people aren't privacy-conscious enough to care who gets what data and who's building the binaries and web apps, so sounding the alarm is appropriate for people who barely know the difference between AI and AGI.
I get that people are mad at Proton right now (anyone have a link? I'm behind on the recent stuff), but we should ensure we get mad at things that are real, not invent imaginary ones based on contrived contexts.
Yeah it's a fair call, but to me it is the very context of why people are made at Proton that makes me suspicious of articles like this.
I can't find the original summary post someone made, but here's the last response from Proton CEO. Read the comments as well to get a good summary: https://www.reddit.com/r/ProtonMail/comments/1i2nz9v/on_politics_and_proton_a_message_from_andy/
TL;DR: Proton used their official accounts to share CEO's pro-US-Republican thoughts as their official stance. They since apologized and said they would use personal account to share those thoughts. But (IMO) now having posted this blog on the actual Proton website, it says to me that there are some serious bias alignment issues with a company that is supposed to be a safe-haven away from all of that.
it is certainly that. but recently its become very trendy to hate Proton, so its just easier to do that instead of thinking. I'm really disappointed in this community
im not an expert at criticism, but I think its fair from their part.
I mean, can you remind me what are the hardware requirements to run deepseek locally?
oh, you need a high-end graphics card with at least 8 GB VRAM for that*? for the highly distilled variants! for more complete ones you need multiple such graphics card interconnected! how do you even do that with more than 2 cards on a consumer motherboard??
how many do you think have access to such a system, I mean even 1 high-end gpu with just 8 GB VRAM, considering that more and more people only have a smartphone nowadays, but also that these are very expensive even for gamers?
and as you will read in the 2nd referenced article below, memory size is not the only factor: the distill requiring only 1 GB VRAM still requires a high-end gpu for the model to be usable.
so my point is that when talking about deepseek, you can't ignore how they operate their online service, as most people will only be able to try that.
I understand that recently it's very trendy, and cool to shit on Proton, but they have a very strong point here.