Hacker News

3943 readers

3 users here now

This community serves to share top posts on Hacker News with the wider fediverse.

Rules

0. Keep it legal

Keep it civil and SFW
Keep it safe for members of marginalised groups

founded 1 year ago

MODERATORS

haxor@derp.foo

Meta Introduces Self-Rewarding Language Model Capable of GPT-4 Level Performance (digialps.com)

submitted 10 months ago by haxor@derp.foo to c/hackernews@derp.foo

2 comments fedilink hide all child comments

There is a discussion on Hacker News, but feel free to comment here as well.

you are viewing a single comment's thread
view the rest of the comments

[–] lvxferre@mander.xyz 4 points 10 months ago

I feel like a broken record, but...

Seriously, the current large "language" models - or should I say, large syntax models? - are a technological dead end. They might find a lot of applications, but they certainly will not evolve to the "superhuman capabilities" from the tech bros' wet dreams.

In the best hypothesis, all that the self-instruction will do is to play whack-a-mole with hallucinations. In the worst it'll degenerate.

You'll need a different architecture to go meaningfully past that. Probably one that doesn't handle semantics as an afterthought, but instead as its own layer, a central and big one.