this post was submitted on 26 Aug 2023
67 points (94.7% liked)

Artificial Intelligence

1340 readers
37 users here now

Welcome to the AI Community!

Let's explore AI passionately, foster innovation, and learn together. Follow these guidelines for a vibrant and respectful community:

You can access the AI Wiki at the following link: AI Wiki

Let's create a thriving AI community together!

founded 1 year ago
 
you are viewing a single comment's thread
view the rest of the comments
[–] senoro@lemmy.ml 6 points 1 year ago

Companies do honour robots.txt. Maybe not the small project made by some guy somewhere. But large companies do.