this post was submitted on 26 Dec 2024
68 points (71.5% liked)
Technology
60123 readers
3672 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Yet, it takes an enormous amount of processing power to produce a comment such as this one. How much would it take to reason why the experiment was structured as it was?
Information theory is all about cutting through the waste of a given computation to compare apples to apples.
I'll replicate an example I posted elsewhere:
Let's say I make a machine that sums two numbers between 0-127, and returns the output. Let's say this machine also only understands spoken French. According to information theory, this machine receives 14 bits of information (two 7-bit numbers with equal probability for all values) and returns 8 bits of information. The fact that it understands spoken French is irrelevant to the computation and is ignored.
That's the same line of reasoning here, and the article makes this clear by indicating that brains take in billions of bits of sensory data. But they're not looking at overall processing power, they're looking at cognition, or active thought. Performing a given computational task is about 10 bits/s, which is completely separate from the billions of bits per second of background processing we do.
A lion sucks if measured as a bird.