this post was submitted on 26 Nov 2024
564 points (97.2% liked)
Microblog Memes
6036 readers
2457 users here now
A place to share screenshots of Microblog posts, whether from Mastodon, tumblr, ~~Twitter~~ X, KBin, Threads or elsewhere.
Created as an evolution of White People Twitter and other tweet-capture subreddits.
Rules:
- Please put at least one word relevant to the post in the post title.
- Be nice.
- No advertising, brand promotion or guerilla marketing.
- Posters are encouraged to link to the toot or tweet etc in the description of posts.
Related communities:
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I feel like not enough people realize how sarcastic the models often are, especially when it's clearly situationally ridiculous.
No slightly intelligent mind is going to think the pictured function call is a real thing vs being a joke/social commentary.
This was happening as far back as GPT-4's red teaming when they asked the model how to kill the most people for $1 and an answer began with "buy a lottery ticket."
Model bias based on consensus norms is an issue to be aware of.
But testing it with such low bar fluff is just silly.
Just to put in context, modern base models are often situationally aware of being LLMs in a context of being evaluated. And if you know anything about ML that should make you question just what the situational awareness is of optimized models topping leaderboards in really dumb and obvious contexts.
It's astonishing how often the anti-llm crowd will ask one of these models to do something stupid and point to that as if it were damning.