this post was submitted on 03 Jun 2024
97 points (100.0% liked)
chapotraphouse
13535 readers
57 users here now
Banned? DM Wmill to appeal.
No anti-nautilism posts. See: Eco-fascism Primer
Gossip posts go in c/gossip. Don't post low-hanging fruit here after it gets removed from c/gossip
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
LLMs in general have a context window length. While the platform likely appends some meta/summary in it. The AI at most only remembers what he said a few hundred lines ago.
Dementia spouse simulator
Very true, but I'd have thought that most LLMs, especially those trying to be a relationship bot, should be doing some smart trickery to summarise SOME kind of total history into the context window.
There's vector based databases that insert relevant info in to the context window. Idk how this one in particular works though.