656
Remember how ChatGPT totally aced the bar exam? Wow! yeah, turns out that was just a lie
(www.nytimes.com)
this post was submitted on 15 May 2024
656 points (100.0% liked)
TechTakes
1550 readers
128 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I mean, it’s not shit at everything; it can be quite useful in the right context (GitHub Copilot is a prime example). Still, it doesn’t surprise me that these first-party LLM benchmarks are full of smoke and mirrors.
citation needed
That GitHub Copilot and friends are useful? I would argue that their utility is rather subjective, but there are indications that it improves developer productivity.
I’m unsure if you’ve used tools like GH Copilot before, but it primarily operates through “completions” (“spicy autocorrect” in its truest form) rather than a chatbot-like interface. It’s mostly good for filling out boilerplate and code that has a single obvious solution; not game-changing intelligence by any means, but useful in relieving the programmer of various menial tasks.
May I ask, what evidence are you hoping to see in particular?
holy fuck shut the fuck up
near-verbatim sealioning in tyol 2024. who says satire is dead
And devs wonder why people think they are hostile shut-ins that have no social skills...
SMFH
that’s great thanks
wut