只允许百度谷歌等搜索引擎蜘蛛访问，正常用户无法访问，ua头根据自身情况进行增加删减

在nginx的server字段中配置下面内容即可
set $ua ''; if ($http_user_agent ~* (Baiduspider|googlebot|bing|sogou|yahoo)){ set $ua 1; } if ($ua != 1) { return 403; }

|---------------|---------------------------------------------------------------------------------------------------------------------------------| | 1 2 3 4 5 6 7 | set $ua ''; if ($http_user_agent ~* (Baiduspider|googlebot|bing|sogou|yahoo)){ set $ua 1; } if ($ua != 1) { return 403; } |

附：Nginx屏蔽百度谷歌等搜索引擎蜘蛛方法https://blog.whsir.com/post-1636.html