Technology

59428 readers

3118 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

392

Tim Cook is “not 100 percent” sure Apple can stop AI hallucinations (www.theverge.com)

submitted 5 months ago by neme@lemm.ee to c/technology@lemmy.world

146 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Deconceptualist@lemm.ee 46 points 5 months ago (16 children)

As others are saying it's 100% not possible because LLMs are (as Google optimistically describes) "creative writing aids", or more accurately, predictive word engines. They run on mathematical probability models. They have zero concept of what the words actually mean, what humans are, or even what they themselves are. There's no "intelligence" present except for filters that have been hand-coded in (which of course is human intelligence, not AI).

"Hallucinations" is a total misnomer because the text generation isn't tied to reality in the first place, it's just mathematically "what next word is most likely".

https://arstechnica.com/science/2023/07/a-jargon-free-explanation-of-how-ai-large-language-models-work/

[–] QuantumSoul@lemmy.dbzer0.com -1 points 5 months ago (4 children)

They do have internal concepts though: https://www.lesswrong.com/posts/yzGDwpRBx6TEcdeA5/a-chess-gpt-linear-emergent-world-representation

Probably not of what a human is, but thought process is needed for better text generarion and is therefore emergent in their neural net

[–] Deconceptualist@lemm.ee 4 points 5 months ago (1 children)

Ok, maybe there's a possibility someday with that approach. But that doesn't reflect my understanding or (limited) experience with the major LLMs (ChatGPT, Gemini) out in the wild today. Right now they confidently advise ingesting poison because it's grammatically sound and they found it on some BS Facebook post.

If ML engineers can design an internal concept of what constitutes valid information (a hard problem for humans, let alone machines) maybe there's hope.

[–] QuantumSoul@lemmy.dbzer0.com 2 points 5 months ago

Ethical and healthy is a whole harder problem lol. Having reasoning and thinking will come before

load more comments (2 replies)

load more comments (13 replies)