# ============================================================ # WPK微扑克专属服务通道 — Robots.txt # 严格遵循 RFC 9309 / Robots Exclusion Protocol 规范 # 兼容:Bingbot / Baiduspider / Googlebot / YandexBot # 最后更新: 2026-08-13 # 编码: UTF-8 (无 BOM)、换行符: LF # ============================================================ # ------------------------------------------------------------ # 【必应蜘蛛专属配置】—— 优先匹配、精确规则 # User-Agent: bingbot # ------------------------------------------------------------ User-agent: bingbot Allow: / # 抓取频率:1秒/次 防止服务器压力 Crawl-delay: 1 # 允许抓取时间段:全天 Visit-time: 0000-2359 # 请求速率:每秒1页 Request-rate: 1/1 # ------------------------------------------------------------ # 【百度蜘蛛专属配置】 # ------------------------------------------------------------ User-agent: Baiduspider Allow: / Crawl-delay: 1 # ------------------------------------------------------------ # 【谷歌蜘蛛专属配置】 # ------------------------------------------------------------ User-agent: Googlebot Allow: / Crawl-delay: 1 # ------------------------------------------------------------ # 【Yandex蜘蛛专属】—— 识别 Host 指令(用于规范域名防镜像) # ------------------------------------------------------------ User-agent: YandexBot Allow: / Clean-param: utm_source&utm_medium&utm_campaign&gclid&fbclid / Host: wpk.wpkpoker.com.cn # ------------------------------------------------------------ # 【全局蜘蛛默认规则】 # 注意:Bingbot/Baiduspider/Googlebot 会先精确匹配到上面的专属规则, # 不会执行到本块,本块用于其他未单独配置的合规蜘蛛 # ------------------------------------------------------------ User-agent: * Allow: / # 禁止抓取系统/临时目录 Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /private/ Disallow: /admin/ Disallow: /.git/ Disallow: /.env Disallow: /*.log$ Disallow: /*.bak$ Disallow: /*.sql$ Disallow: /*.zip$ # 禁止抓取UTM追踪参数副本(防止内容重复降权) Disallow: /*?utm_ Disallow: /*?gclid Disallow: /*?fbclid # ------------------------------------------------------------ # 【禁止第三方 SEO 扫描蜘蛛】 # 避免无意义带宽消耗与内容抓取 # ------------------------------------------------------------ User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: PetalBot Disallow: / # ============================================================ # 【Sitemap 网站地图声明】 # 必应蜘蛛访问 robots.txt 时会优先读取本字段,直接进入抓取队列 # 建议同时通过 Bing Webmaster Tools 后台再提交一次双保险 # ============================================================ Sitemap: https://wpk.wpkpoker.com.cn/sitemap.xml Sitemap: https://wpk.wpkpoker.com.cn/rss.xml # ============================================================ # 【首选主机名(Yandex 标准)】 # 其他搜索引擎(必应/百度)多数也兼容此指令,用于避免镜像权重窃取 # ============================================================ Host: wpk.wpkpoker.com.cn