sith

joined 1 month ago
[–] sith@lemmy.zip 2 points 1 day ago* (last edited 1 day ago)

It's for sure not impossible. But my guess is that it's because you learn the new model and your behavior and expectations change. It's a known phenomenon and I do believe the developers/companies when they say that they didn't change anything. It's also quite easy to verify/test this hypothesis by using locally hosted LLMs. There are probably a few papers covering this already.

Though it does happen that one is downgraded to a smaller model when using free versions OpenAI, Anthropic and others. But my experience is that this information allways is explicit in the UI. Still, it's probably quite easy to miss.

Also, I'm almost exclusively using the free version of Mistral Large (Le Chat) and I've never experienced regression. But Mistral also never downgrades, it just becomes very slow.

[–] sith@lemmy.zip 9 points 1 day ago* (last edited 1 day ago)

This kind of talk is effective if you want to push EU towards China. Don't really understand the tactics here. Trump in a nutshell I guess.

If he's really interested in Greenland he should try to create more division between Greenland and Denmark. Maybe that's what we'll see next.

[–] sith@lemmy.zip 10 points 2 days ago

Honestly, I believe most people overestimate intellectual and conscious rationality. Among themselves and others. The rationalizing is usually there afterwards. To justify current emotions, actions and circumstances.

Self preservation, since one can't control much anyways. And one needs a somewhat coherent world view.

[–] sith@lemmy.zip 4 points 2 days ago
[–] sith@lemmy.zip 16 points 2 days ago (2 children)

I find it quite simple. Voters are economic left/progressive and social right/conservative. Center left parties are economic center and social left. The trend is similar in all western countries. And it's a bad match.

[–] sith@lemmy.zip 3 points 3 days ago

Yeah, I'm only interested in the "least bad" here. Taking usability, libre and performance into account. I don't think that even the Framework Laptop 13 RISC-V will be completely libre.

Thanks for input though!

[–] sith@lemmy.zip 2 points 3 days ago

Actually, it is not true from what I've learned. For example, Intel is about to push chipset/bios upgrades to boost the performance of the new Core Ultra 9 285k. And that kind of driver can at best be open source and in the upstream kernel or at worst closed source and only installed by some windows only bloatware.

[–] sith@lemmy.zip 12 points 3 days ago

Nice website! Thanks!

[–] sith@lemmy.zip 10 points 3 days ago (3 children)

Having to use windows when upgrading firmware is very Linux unfriendly.

 

The talk is that the Core Ultra 9 285K works better with Linux than Windows. What's your experience? And how well does it work with Proton?

 

I'm looking into buying a new system and I wonder which of all the mainboard manufacturers you recommend for Linux in general and gaming in particular? Which ones have the best Linux driver support and which ones publish open source drivers? Are AMD or Intel chipsets preferred?

Also general best bang for the buck recommendations are appreciated!

And yes, I have googled this and I have some ideas, but I'm interested in what my fellow Lemmies think. And I also want this information to be here on Lemmy instead of Reddit or AI generated blogs. If you feel offended by this, you're totally free to not reply and also down vote this post.

[–] sith@lemmy.zip 1 points 4 days ago (1 children)

Ah, I think I have a better understanding of the PCIe hardware protocol now. Feel a bit more confident regard a 2 x8 setup. Thanks.

Just for the record: my understanding is that the HW protocol performs a handshake which settles the number of lanes that will be used when establishing a link. And the PCIe standard is always backwards compatible, so things should work just fine even if I buy something that says PCIe 6.0 later. Or at least the lower layers of the protocol should be compatible. And as long bandwidth isn't an issue.

 

This is related to my previous question about AM5. Turns out 2 8x lane GPUs on AM5 might be an option after all.

So my question: Does a 16x lane PCIe GPU always support x8 lanes as well? (Like a Radeon RX 7900 XTX or something bigger and better from the future.)

12
submitted 1 week ago* (last edited 1 week ago) by sith@lemmy.zip to c/amd@lemmy.zip
 

Hello!

I'm looking into buying a system for running inference with small to medium size LLM models. I wonder, is there any AM5 CPU + Chipset combination that supports 2x PCIe 16x with all lanes connected directly to the CPU? From what I've gathered my understanding is that there is no such configuration because the Ryzen 7000/9000 only have 24 PCIe lanes at best. This means I have to go for a Threadripper configuration, which is much more expensive. (The ROCm mGPU documentation states that all lanes shall be connected directly to the CPU.)

It's possible that I can manage running two GPUs with 8x lanes, but it's for sure not optimal..

But the thing is, it is quite hard for me to navigate the AMD website and the websites of various motherboard producers. I might very well be wrong.

So again: Is there any AM5 CPU + chipset combination that supports 2x PCIe 16x with all lanes connected directly to the CPU?

view more: next ›