zogwarg

The article almost looks like satire.

If all script kiddies waste their time trying to use generative AI to produce barely functional malware, we might be marginally safer for a while ^^. Or maybe this is the beginning of an entirely new malware ecology, clueless development using LLMs falling prey to clueless malware using LLMs.

Not every rationalist I've met has been nice or smart ^^.

I think it's hard to grow up in our society, without harboring a kernel of fascism in our hearts, it's easy to fall into the constantly sold "everything would work better if we just put the right people in charge". With varying definitions of who the "right people" are:

• Racism
• Eugenics
• Benevolent AI
• Fellow tribe,
• The enlightened who can read "the will of the people" or who are able to "carve reality at the joints"
• Some brands of "sovereign citizen" or corporate libertarianism (I'm the best person in charge of me!).
• The positivist invokers of ScientificProgress™

Do they deserve better? Absolutely, but you can't remove their agency, they ultimately chose this. The world is messy and broken, it's fine not to make too much peace with that, but you have to ponder your ends and your means more thoughtfully than a lot of EAs/Rationalists do. Falling prey to magical thinking is a choice, and/or a bias you can overcome (Which I find extremely ironic given the bias correction advertising in Rationalists spheres)

From reading the paper I'm not sure which is more egregious, the frameworks that pass code and/or use exec directly without checking, or the ones that rely on the LLM to do the checking (based on the fact that some of the CVEs require LLM prompt jailbreaking)

If you wanted to be exceedingly charitable, you could try and make the maintainers of said framework claim that "of course none of this should be used with unsanitized inputs open to the public, it's merely a productivity boost tool that you would run on your own machine, don't worry about possible prompts being evaluated by our agent from top bing results, don't use this for anything REAL."

Let's not forget the:

Ah! PotemkinTurd-4.0 is getting worse! Like it's starting to make all the same mistakes that PotemkinTurd-3.0 used to make! Honestly Poirot-2 is just as good now.

Cue to an answer from PotemCorp:

We haven't changes anything since the release of 4.0, but thanks we'll look into possible causes.

Like yes those a big Spaghetti monsters of RHLF and sad attempts at content filtering and/or removals of liability from PotemCorp, but isn't a much more rational explanation that the product was never that good to begin with, fundamentally random, and that sometimes the shit sticks and sometimes it doesn't?

You can take solace in the fact that mxcl hasn't contributed to brew since 2012 (I guess the world ended) at least in terms of commits.

EDIT: Even if they are better at PR the mere fact that they would be onboard with tea and AI generated logos/descriptions foisted on projects that didn't ask for them, and acting confused when people are justifiably angry, shows a disturbing lack of care and consideration. (Paired with I take it incorrect installation scripts even)

A choice selection of musks deposition with TurdRationalist™ adjacent brainrot shibboleths:

Q: (By Mr. Bankston) And this quote says from the Isaacson book, "My tweets are like Niagara Falls sometimes and they come too fast," Musk says. "Just dip a cup in there and try to avoid the random turds." Do you think that's an accurate quotation from you?

A: (By Elon) That is acutally not -- not accurate. [...] The things that I see on twitter, not the [...] posts that I make are like Niagara Falls. [...] my account is the most interacted with in the world I believe. It is physically impossible for, you know, any one person to see all of the interactions that happen. So the only way I can really gauge the interactions is by sampling them essentially.

Q: Got you. So would it be fair to say that Isaacson made a mistake here and what thus really should say is not my tweets are like Niagara Falls, but everyone else's tweets are like Niagara Falls?

A: Not exactly. It means [...] all of what I see when I use the X app, [...] all the posts that I see and all the interactions that happen with those posts, are far to numerous [...] for any human being to consume.

Q: Okay. So when this quote talks about random turds; these are other people's random turds?

A: I mean I suppose I -- I could be guilty of a random turd too, but [...] what I'm really referring to is that the only way for me to actually get an understanding of what is happening on the system is to sample it. Like try to do -- just like in statistics, you don't -- you do -- try to do -- you sample a distribution in order to understand what's going on, but you cannot look at every single data point.

I can only gauge truth from first principled anecdotal sampling of my nazi friends, I can't look at everything alas, I'll leave community notes to deal with pesky liberals

[Which btw in other parts of the deposition he says, for a community note to be surfaced people must vote the same note as being helpful, where they previously disagreed, which doesn't sound at all like it couldn't be gamed, and doesn't at all sound like it would sometimes force "centrism" with nazis]

On a all too sadly self-aware note

Elon: I may of done more to financially impair the company than to help it.

You think?

It remains infuriating how many agencies/governments simply don’t have reliable online public feeds, with information.

Especially annoying when the only place with info is twitter and/or Facebook.

(That doesn’t fully solve the community contributions, which should also be useful, but at minimum any info from official accounts SHOULD be posted elsewhere)

Saying “prime reason” Is maybe overselling it a bit ^^.

I think the fact it’s Japan let’s them a bit too uncritically act amazed though, for the lady in red one: the location is reminiscent of Shibuya but doesn’t exist and doesn’t make sense, the text on billboards and signs is scribbely gibberish, and the woman face changes over the course of the video.

(Everyone should be unsettled by the godawful lack of perspective)

General weebishness is probably a bigger factor, though I wish I could gatekeep them out of that descriptor.

It underscores a bit of a universal delusion with Potemkin shitbots in general. People lauding the outputs, into languages (visual art, foreign language, programming, apparently inorganic chemistry, ...) that they don't speak, and since it passes the first glance test, they don't even think to look twice.

I think this is actually part of the reason why the prime reason (subconsciously or otherwise) they choose Japan for their main SORA video, the overall exotic nature decreases the uncanny valley factor.

Not since 2013! https://gs.statcounter.com/browser-market-share/all/belarus/2014 still has a large presence though. (20% in poland!)

I'd go further and combine it with the similarly good "Potemkin AI" to make "Potemkin Botshit"

Time is a flat circle: https://en.wikipedia.org/wiki/Minitel see "pink messages".