Robots.txt Generator

Generate standard robots.txt files for search engine crawler directives
爬虫规则与设置
Googlebot (谷歌)
Baiduspider (百度)
Bingbot (微软必应)
YandexBot (Yandex)
生成的 robots.txt 文件内容