Leopards Ate My Face

3901 readers

168 users here now

Rules:

If you don't already have some understanding of what this is, try reading this post. Off-topic posts will be removed.
Please use a high-quality source to explain why your post fits if you think it might not be common knowledge and isn't explained within the post itself.
Links to articles should be high-quality sources – for example, not the Daily Mail, the New York Post, Newsweek, etc. For a rough idea, check out this list. If it's marked in red, it probably isn't allowed; if it's yellow, exercise caution.
The mods are fallible; if you've been banned or had a comment removed, you're encouraged to appeal it.
For accessibility reasons, an image of text must either have alt text or a transcription in the comments.
All Lemmy.World Terms of Service apply.

Also feel free to check out !leopardsatemyface@lemm.ee (also active).

Icon credit C. Brück on Wikimedia Commons.

founded 2 years ago

MODERATORS

TheTechnician27@lemmy.world

418_im_a_teapot@lemmy.world

180

Chinese firms ‘distilling’ US AI models to create rival products, warns OpenAI (www.theguardian.com)

submitted 2 days ago by withabeard@lemmy.world to c/leopardsatemyface@lemmy.world

37 comments fedilink hide all child comments

Honestly an AI firm being salty that someone has potentially taken their work, "distilled" it and selling that on feels hilariously hypocritical.

Not like they've taken the writings, pictures, edits and videos of others, "distilled" them and created something new from it.

you are viewing a single comment's thread
view the rest of the comments

[–] brucethemoose@lemmy.world 7 points 1 day ago

Chains of distillation is mostly uncharted territory! There aren't a lot of distillations because each one is still very expensive (as in at least tens of thousands of dollars, maybe millions of dollars for big models).

Usually a distillation is used to make a smaller model out of a bigger one.

But the idea of distillations from multiple models is to "add" the knowledge and strengths of each model together. There's no formal selection process, it's just whatever the researchers happen to try. You can read about another example here: https://huggingface.co/arcee-ai/SuperNova-Medius