Issues: ekalinin/robots.js
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Provide a CLI interface to test if a specific URL is accessible using a specific user agent
#28
opened Jul 23, 2017 by
gajus
'Allow all' statement or blank line returns true for disallowed URLs
#19
opened Mar 21, 2015 by
sanderheilbron
ProTip!
What’s not been updated in a month: updated:<2024-04-19.