this post was submitted on 26 Aug 2023
67 points (94.7% liked)
Artificial Intelligence
1340 readers
37 users here now
Welcome to the AI Community!
Let's explore AI passionately, foster innovation, and learn together. Follow these guidelines for a vibrant and respectful community:
- Be kind and respectful.
- Share high-quality contributions.
- Stay on-topic.
- Enhance accessibility.
- Verify information.
- Encourage meaningful discussions.
You can access the AI Wiki at the following link: AI Wiki
Let's create a thriving AI community together!
founded 1 year ago
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Companies do honour robots.txt. Maybe not the small project made by some guy somewhere. But large companies do.