Robots.txt Tester
Paste your robots.txt and instantly check whether a URL is allowed or blocked for crawlers.
Result
?
—
How rules are evaluated
- ①When both Allow and Disallow match, the longer (more specific) rule wins.
- ②If both are the same length, Allow takes priority.
- ③Only User-agent: * rules are evaluated.
- ④An empty Disallow: means all URLs are allowed.