this post was submitted on 02 Aug 2023
359 points (94.1% liked)

Technology

60123 readers
2774 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
 

Tech experts are starting to doubt that ChatGPT and A.I. ‘hallucinations’ will ever go away: ‘This isn’t fixable’::Experts are starting to doubt it, and even OpenAI CEO Sam Altman is a bit stumped.

you are viewing a single comment's thread
view the rest of the comments
[–] Dark_Arc@lemmy.world 6 points 1 year ago (14 children)

Sure, but these things exists as fancy story tellers. They understand language patterns well enough to write convincing language, but they don't understand what they're saying at all.

The metaphorical human equivalent would be having someone write a song in a foreign language they barely understand. You can get something that sure sounds convincing, sounds good even, but to someone who actually speaks Spanish it's nonsense.

[–] Serdan@lemm.ee -5 points 1 year ago* (last edited 1 year ago) (8 children)

GPT can write and edit code that works. It simply can't be true that it's solely doing language patterns with no semantic understanding.

To fix your analogy: the Spanish speaker will happily sing along. They may notice the occasional odd turn of phrase, but the song as a whole is perfectly understandable.

Edit: GPT can literally write songs that make sense. Even in Spanish. A metaphor aiming to elucidate a deficiency probably shouldn't use an example that the system is actually quite proficient at.

[–] tryptaminev@feddit.de 3 points 1 year ago (6 children)

Because it can look up code for this specific problem in its enormous training data? It doesnt need to understand the concepts behind it as long as the problem is specific enough to have been solved already.

[–] Mirodir@lemmy.fmhy.net 3 points 1 year ago (1 children)

It doesn't have the ability to just look up anything from its training data, that stuff is encoded in its parameters. Still, the input has to be encoded in a way that causes the correct "chain reaction" of excited/not excited neurons.

Beyond that, it's not just a carbon copy from what was in the training either because you can tell it what variable names to use, which order to do things in, change some details, etc. If it was simply a lookup that wouldn't be possible. The training made it able to generalize what it learned to some extent.

[–] tryptaminev@feddit.de 5 points 1 year ago

Yes, but it doesnt do so because it understands what a variable is, it does so because it has statistics as to where variables belong most likely.

In a way it is like the guy that won the french scrabble championship without speaking a single word of french, by learning the words in the dictionary.

load more comments (4 replies)
load more comments (5 replies)
load more comments (10 replies)