this post was submitted on 03 Jun 2024
90 points (100.0% liked)

TechTakes

1490 readers
32 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago
MODERATORS
 

somehow I managed to miss this until now

archive link

you are viewing a single comment's thread
view the rest of the comments
[–] Architeuthis@awful.systems 6 points 6 months ago* (last edited 6 months ago)

this isn’t really even related to GenAI at all

Besides the ocr there appears to be all sorts of image-to-text metadata recorded, the nadella demo had the journalist supposedly doing a search and getting results with terms that were neither typed at the time nor appearing in the stored screenshots.

Also, I thought they might be doing something image-to-text-to-image-again related (which - I read somewhere - was what bing copilot did when you asked it to edit an image) to save space, instead of storing eleventy billion multimonitor screenshots forever.

edit - in the demo the results included screens.