Programming

17416 readers

45 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Follow the programming.dev instance rules
Keep content related to programming in some way
If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev

founded 1 year ago

MODERATORS

snowe@programming.dev

Ategon@programming.dev

MaungaHikoi@lemmy.nz

Intentionally corrupting LLM training data? (lemmy.world)

submitted 1 year ago* (last edited 1 year ago) by colonial@lemmy.world to c/programming@programming.dev

12 comments fedilink hide all child comments

Inspired by the comments on this Ars article, I've decided to program my website to "poison the well" when it gets a request from GPTBot.

The intuitive approach is just to generate some HTML like this:

<p>
// Twenty pages of random words
</p>

(I also considered just hardcoding twenty megabytes of "FUCK YOU," but that's a little juvenile for my taste.)

Unfortunately, I'm not very familiar with ML beyond a few basic concepts, so I'm unsure if this would get me the most bang for my buck.

What do you smarter people on Lemmy think?

(I'm aware this won't do much, but I'm petty.)

you are viewing a single comment's thread
view the rest of the comments

[–] colonial@lemmy.world 3 points 1 year ago* (last edited 1 year ago) (1 children)

Re: CSS and Javascript being obvious - I'm planning to do this entirely server side, since I control the whole stack.

Regular users (and good bots) get regular pages, but if a GPTBot user agent makes a request, they just get garbage back. (Obviously this relies on OpenAI not masking the user agent, but if they do that, hopefully bigger webmasters will notice the lack of hits and call them out.)

I like your idea with the sentence fragments. Because the LLM check would happen before I actually look up the requested resource, I think I could combine it with fake links to lead the scraper on a wild goose chase.

[–] TootSweet@lemmy.world 2 points 1 year ago

Yeah, that all makes sense. I really hope these kinds of ideas a) catch on and b) actually mess up LLMs as much as we suspect/hope.