# 屏蔽百度全系列爬虫:整个 .com 域名(所有语言)均不抓取、不收录 # 注意:百度蜘蛛只会读取与自己最匹配的分组,因此不会再读取下方的 User-agent: * 分组 User-agent: Baiduspider Disallow: / User-agent: Baiduspider-image Disallow: / User-agent: Baiduspider-video Disallow: / User-agent: Baiduspider-news Disallow: / User-agent: Baiduspider-favo Disallow: / User-agent: Baiduspider-cpro Disallow: / User-agent: Baiduspider-ads Disallow: / # 其它所有搜索引擎(Google、Bing 等)正常抓取,仅屏蔽内部构建资源 User-agent: * Disallow: /_nuxt/ Disallow: /_payload.json Disallow: /_i18n/ # 列出所有语言的站点地图(Sitemap 为全局指令,对所有爬虫生效) Sitemap: https://www.dinosawmachine.com/sitemap.xml Sitemap: https://www.dinosawmachine.com/zh/sitemap.xml Sitemap: https://www.dinosawmachine.com/tr/sitemap.xml Sitemap: https://www.dinosawmachine.com/pt/sitemap.xml Sitemap: https://www.dinosawmachine.com/es/sitemap.xml Sitemap: https://www.dinosawmachine.com/ru/sitemap.xml Sitemap: https://www.dinosawmachine.com/de/sitemap.xml Sitemap: https://www.dinosawmachine.com/ar/sitemap.xml Sitemap: https://www.dinosawmachine.com/vi/sitemap.xml Sitemap: https://www.dinosawmachine.com/fr/sitemap.xml Sitemap: https://www.dinosawmachine.com/it/sitemap.xml Sitemap: https://www.dinosawmachine.com/ko/sitemap.xml