Robots.txt File Creator
Define rules for web robots (crawlers) below. Rules are automatically compiled into the final `robots.txt` output.
Add New Rule
Current Rule Set
| Agent | Directive | Path / Value | Actions |
|---|
Define rules for web robots (crawlers) below. Rules are automatically compiled into the final `robots.txt` output.
| Agent | Directive | Path / Value | Actions |
|---|