this post was submitted on 26 Aug 2023
67 points (94.7% liked)

Artificial Intelligence

1340 readers
37 users here now

Welcome to the AI Community!

Let's explore AI passionately, foster innovation, and learn together. Follow these guidelines for a vibrant and respectful community:

You can access the AI Wiki at the following link: AI Wiki

Let's create a thriving AI community together!

founded 1 year ago
 
you are viewing a single comment's thread
view the rest of the comments
[–] agressivelyPassive@feddit.de 7 points 1 year ago

Robots.txt never was any hurdle, it's just a flag which you are free to ignore.