zogwarg

joined 2 years ago
[–] zogwarg@awful.systems 11 points 2 weeks ago

I remember being quite ticked off by her takes about free will, and specifically severly misrepresenting compatibilism and calling philosphers stupid for coming up with the idea.

[–] zogwarg@awful.systems 14 points 1 month ago (1 children)

I think that particular talking point also serves an exculpatory purpose: "If it was only a razor-thin victory I might understand being angry with me, but see it's a decisive victory. He has the mandate ~~of heaven~~ of the people (this is a Trumpian victory! not a Democrat failure!) ! It would be wrong not to congratulate him!"

[–] zogwarg@awful.systems 9 points 1 month ago

It's also incredibly misleading, maybe it was possible to "completely" re-write the UI back in 2005—never mind that most of the value would come from, the underlying geographic data being mostly correct and mostly correctly labeled—there is no way in hell that the same would achievable in 2024. (Also the notion it would take any coder 2 * 1000 / (365 * 5/7) = 7 years to achieve a comparable result is proposterous)

[–] zogwarg@awful.systems 12 points 1 month ago (2 children)

As long as no-one ever bakes—pluginlessly—LLMs into vanilla vim (or into normal nano) I won't despair too much.

[–] zogwarg@awful.systems 18 points 1 month ago

Not surprised, still very disappointed, I feel sick.

[–] zogwarg@awful.systems 9 points 2 months ago (5 children)

Why hasn't he attempted to make a robotic owl yet? Poser...

[–] zogwarg@awful.systems 4 points 2 months ago (1 children)

To be "fair" kubernetes api only supports strongly validated/typed YAML-ish input..., it won't let you put non-string values in string locations. And in reality at the HTTP api layer—at least for kubectl—json is used. (Which also means you cant' do the more weird occult YAML things that JSON wouldn't let you)

You have to blame the deep-nestedness of k8s resources for unreadability...

[–] zogwarg@awful.systems 13 points 2 months ago (6 children)

I was also a Elon skeptic back-then, but I'll admit I did get a kick out of the "don't panic" dashboard.

But golly does he read H2G2 completely wrong (transcript):

I think and it highlighted an important point which is that a lot of times the question is harder than the answer. And if you can properly phrase the question, then the answer is the easy part. So, to the degree that we can better understand the universe, then we can better know what questions to ask. Then whatever the question is that most approximates: what’s the meaning of life? That’s the question we can ultimately get closer to understanding. And so I thought to the degree that we can expand the scope and scale of consciousness and knowledge, then that would be a good thing.

It's backwards! It misses the joke! It took thousands of years and they got a nonsensical answer before any question! It took a thousand more and they got a nonsensical—incompatible—question! It has been theorized that should someone understand the universe it would be replaced by something more complicated! It has also been theorized this has already happened! Also regarding scale of knowledge, Trin Tragula definetly showed that the One thing you can't afford to have in this universe, is a sense of perspective!

Surely his reading comprehension isn't actually this bad, and he only got a bad meme-cliffnotes version of the radio-series/books/movies!?!

[–] zogwarg@awful.systems 5 points 2 months ago* (last edited 2 months ago) (1 children)

I wouldn't swap it for the world ^^, but maybe a tad fewer existantial crises would be nice (no monkey-paw curls plz)

[–] zogwarg@awful.systems 8 points 2 months ago (3 children)
  • I don't know Matt Mullenweg, but I'm afraid to ask
  • I love the nonsensical misleading QR code onliner, conflictingly using both echo "<URL>" | and mac-only getoutput("pbpaste") (yuck).
  • It is famously easy to maintain a job and mental well-being when you have no stable home and few sets of clothes! Famously you don't need a registered address to open a bank account, and you don't need a bank account to get a registered address!
  • I guess you could run the GPU for 1000 years.
  • One needs to learn that interpolation = confabulation = useless bullshit.
[–] zogwarg@awful.systems 13 points 2 months ago (6 children)

How nice it must be to never ponder how large humanity is, and how each and every person you see outside has a full and rich interior and exterior world, and you that only see a tiny fraction of the people outside.

Personally one of my "oh other people are real!" moment, was when our parents (along with my sisters) took us on a surprise ferry trip to England (from France) and our grandparents that—at least as far as kid me remembered—we only ever saw in their home city, were waiting for us in Portsmouth, and we visited the city together (Portsmouth Historic Dockyard is quite nice btw).

I knew they were real, but realizing that they weren't geo-locked, made me more fully internalize that they had full and independent lives, and therefore that everyone had.


How about people here? When did you realize people are real?

[–] zogwarg@awful.systems 15 points 2 months ago

No no no it's fine! You get the word shuffler to deshuffle the—eloquently—shuffled paragraphs back into nice and tidy bullet points. And I have an idea! You could get an LLM to add metadata to the email to preserve the original bullet points, so the recipient LLM has extra interpolation room to choose to ignore the original list, but keep the—much more correct and eloquent, and with much better emphasis—hallucinated ones.

 

Need to let loose a primal scream without collecting footnotes first? Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid: Welcome to the Stubsack, your first port of call for learning fresh Awful you’ll near-instantly regret.

Any awful.systems sub may be subsneered in this subthread, techtakes or no.

If your sneer seems higher quality than you thought, feel free to cut’n’paste it into its own post — there’s no quota for posting and the bar really isn’t that high.

The post Xitter web has spawned soo many “esoteric” right wing freaks, but there’s no appropriate sneer-space for them. I’m talking redscare-ish, reality challenged “culture critics” who write about everything but understand nothing. I’m talking about reply-guys who make the same 6 tweets about the same 3 subjects. They’re inescapable at this point, yet I don’t see them mocked (as much as they should be)

Like, there was one dude a while back who insisted that women couldn’t be surgeons because they didn’t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I can’t escape them, I would love to sneer at them.

(Semi-obligatory thanks to @dgerard for starting this)

 

Source: nitter, twitter

Transcribed:

Max Tegmark (@tegmark):
No, LLM's aren't mere stochastic parrots: Llama-2 contains a detailed model of the world, quite literally! We even discover a "longitude neuron"

Wes Gurnee (@wesg52):
Do language models have an internal world model? A sense of time? At multiple spatiotemporal scales?
In a new paper with @tegmark we provide evidence that they do by finding a literal map of the world inside the activations of Llama-2! [image with colorful dots on a map]


With this dastardly deliberate simplification of what it means to have a world model, we've been struck a mortal blow in our skepticism towards LLMs; we have no choice but to convert surely!

(*) Asterisk:
Not an actual literal map, what they really mean to say is that they've trained "linear probes" (it's own mini-model) on the activation layers, for a bunch of inputs, and minimizing loss for latitude and longitude (and/or time, blah blah).

And yes from the activations you can get a fuzzy distribution of lat,long on a map, and yes they've been able to isolated individual "neurons" that seem to correlate in activation with latitude and longitude. (frankly not being able to find one would have been surprising to me, this doesn't mean LLM's aren't just big statistical machines, in this case being trained with data containing literal lat,long tuples for cities in particular)

It's a neat visualization and result but it is sort of comically missing the point


Bonus sneers from @emilymbender:

  • You know what's most striking about this graphic? It's not that mentions of people/cities/etc from different continents cluster together in terms of word co-occurrences. It's just how sparse the data from the Global South are. -- Also, no, that's not what "world model" means if you're talking about the relevance of world models to language understanding. (source)
  • "We can overlay it on a map" != "world model" (source)
 

Source Tweet

@ESYudkowsky: Remember when you were a kid and thought you might have psychic powers, so you dealt yourself face-down playing cards and tried to guess whether they were red or black, and recorded your accuracy rate over several batches of tries?

|

And then remember how you had absolutely no idea to do stats at that age, so you stayed confused for a while longer?


Apologies for the usage of the japanese; but it is a very apt description: https://en.wikipedia.org/wiki/Chūnibyō,

 

And of course no experiments whatsoever, the cost of the Manhattan project, the hundreds of thousands of employees were merely a "focusing" magick, a sacrifice to re-enforce the greater powers of our handful of esteemed and glorious thinking men, who wrought the power of destruction from the æther.

Source Tweet

@ESYudkowsky: Yes, but because the first nuclear weapon makers knew what the duck they were doing - analytic precise prediction of desired outcomes and of each intervening step. AGI makers lack similar mastery or anything remotely close, and have a much harder problem; that's the big issue.

@EigenGender: seems pretty noteworthy that the first nuclear weapons were made under conditions where they couldn’t do any experiments and they involved a lot of math but still worked on the first try.

view more: next ›