1、这批脸书爬虫facebookIP来源于尚贤达猎头公司网站采集数据

3、判断标准主要根据用户代理是否包含“facebook”和IP核实。

序号用户代理UserAgebt1facebookscraper/1.0(http://www.facebook.com/sharescraper_help.php)2facebookexternalhit/1.1(http://www.facebook.com/externalhit_uatext.php)3meta-externalagent/1.1(https://developers.facebook.com/docs/sharing/webmasters/crawler)4facebookexternalhit/1.1

三、脸书爬虫facebookIP地址

173.252.107.1173.252.69.5173.252.87.11366.220.149.11669.171.249.27173.252.107.10173.252.69.6173.252.87.11466.220.149.11769.171.249.28173.252.107.11173.252.69.7173.252.87.11566.220.149.11869.171.249.29173.252.107.111173.252.69.8173.252.87.11666.220.149.1269.171.249.3173.252.107.112173.252.69.9173.252.87.11766.220.149.12569.171.249.30173.252.107.113173.252.70.1173.252.87.11866.220.149.12669.171.249.31173.252.107.114173.252.70.111173.252.87.11966.220.149.1369.171.249.32173.252.107.115173.252.70.112173.252.87.1266.220.149.1469.171.249.33173.252.107.116173.252.70.113173.252.87.12066.220.149.1569.171.249.34173.252.107.117173.252.70.114173.252.87.12466.220.149.1669.171.249.35173.252.107.118173.252.70.116173.252.87.1366.220.149.1769.171.249.36173.252.107.119173.252.70.117173.252.87.1466.220.149.1969.171.249.37173.252.107.12173.252.70.118173.252.87.1566.220.149.269.171.249.4173.252.107.120173.252.70.124173.252.87.1666.220.149.2069.171.249.5173.252.107.124173.252.70.126173.252.87.1766.220.149.2169.171.249.6173.252.107.126173.252.70.2173.252.87.1866.220.149.2269.171.249.7173.252.107.13173.252.70.3173.252.87.1966.220.149.2369.171.249.8173.252.107.14173.252.70.4173.252.87.266.220.149.2469.171.249.9173.252.107.15173.252.79.119173.252.87.2066.220.149.2669.171.251.11173.252.107.16173.252.79.120173.252.87.2166.220.149.2769.171.251.116173.252.107.17173.252.79.2173.252.87.2266.220.149.2869.171.251.5173.252.107.18173.252.79.4173.252.87.2366.220.149.2969.63.184.1173.252.107.19173.252.79.6173.252.87.2466.220.149.369.63.184.10173.252.107.2173.252.79.7173.252.87.2566.220.149.3069.63.184.11173.252.107.20173.252.83.1173.252.87.2666.220.149.3169.63.184.111173.252.107.21173.252.83.10173.252.87.366.220.149.3369.63.184.113173.252.107.22173.252.83.11173.252.87.3066.220.149.3469.63.184.116173.252.107.23173.252.83.111173.252.87.3466.220.149.3569.63.184.117173.252.107.24173.252.83.112173.252.87.466.220.149.3769.63.184.118173.252.107.25173.252.83.113173.252.87.566.220.149.3869.63.184.119173.252.107.26173.252.83.114173.252.87.666.220.149.3969.63.184.12173.252.107.27173.252.83.115173.252.87.766.220.149.469.63.184.120173.252.107.28173.252.83.116173.252.87.866.220.149.4069.63.184.13173.252.107.29173.252.83.117173.252.87.966.220.149.4169.63.184.15173.252.107.3173.252.83.118173.252.95.166.220.149.4269.63.184.16173.252.107.30173.252.83.119173.252.95.1066.220.149.569.63.184.17173.252.107.31173.252.83.12173.252.95.11866.220.149.669.63.184.18173.252.107.32173.252.83.120173.252.95.11966.220.149.769.63.184.19173.252.107.33173.252.83.124173.252.95.1666.220.149.869.63.184.2173.252.107.34173.252.83.125173.252.95.1866.220.149.969.63.184.20173.252.107.37173.252.83.126173.252.95.1967.220.86.16069.63.184.21173.252.107.38173.252.83.13173.252.95.2169.171.230.1069.63.184.22173.252.107.4173.252.83.14173.252.95.2469.171.230.1169.63.184.23173.252.107.5173.252.83.15173.252.95.2569.171.230.11269.63.184.24173.252.107.6173.252.83.16173.252.95.469.171.230.11369.63.184.3173.252.107.7173.252.83.17173.252.95.569.171.230.11469.63.184.4173.252.107.8173.252.83.18173.252.95.669.171.230.11569.63.184.5173.252.107.9173.252.83.19173.252.95.769.171.230.11669.63.184.6173.252.111.116173.252.83.2173.252.95.869.171.230.11769.63.184.7173.252.111.118173.252.83.2031.13.103.1069.171.230.11869.63.184.8173.252.111.14173.252.83.2131.13.103.11969.171.230.11969.63.184.9173.252.111.5173.252.83.2231.13.103.469.171.230.1269.63.189.1173.252.127.1173.252.83.2331.13.115.169.171.230.12069.63.189.10173.252.127.10173.252.83.2431.13.115.1069.171.230.12569.63.189.112173.252.127.11173.252.83.2531.13.115.11669.171.230.12669.63.189.117173.252.127.112173.252.83.2631.13.115.12069.171.230.1369.63.189.119173.252.127.113173.252.83.2731.13.115.269.171.230.1469.63.189.120173.252.127.114173.252.83.2831.13.115.569.171.230.1569.63.189.2173.252.127.115173.252.83.2931.13.127.1169.171.230.1969.63.189.3173.252.127.116173.252.83.331.13.127.11469.171.230.2369.63.189.4173.252.127.117173.252.83.3031.13.127.11869.171.230.2469.63.189.5173.252.127.118173.252.83.3131.13.127.1369.171.230.2569.63.189.7173.252.127.119173.252.83.3231.13.127.1569.171.230.369.63.189.9173.252.127.12173.252.83.3331.13.127.1669.171.230.8173.252.127.13173.252.83.3454.167.129.23969.171.230.9173.252.127.14173.252.83.3557.141.3.169.171.231.116173.252.127.15173.252.83.3657.141.3.1069.171.231.118173.252.127.16173.252.83.3757.141.3.1169.171.231.5173.252.127.17173.252.83.3857.141.3.1269.171.249.1173.252.127.18173.252.83.3957.141.3.1369.171.249.10173.252.127.19173.252.83.457.141.3.1469.171.249.11173.252.127.2173.252.83.4057.141.3.1569.171.249.111173.252.127.20173.252.83.4157.141.3.1669.171.249.112173.252.127.21173.252.83.4257.141.3.1769.171.249.113173.252.127.22173.252.83.4357.141.3.1869.171.249.114173.252.127.23173.252.83.4457.141.3.1969.171.249.115173.252.127.24173.252.83.4557.141.3.269.171.249.116173.252.127.25173.252.83.4657.141.3.2069.171.249.117173.252.127.26173.252.83.4757.141.3.2169.171.249.118173.252.127.27173.252.83.4857.141.3.2269.171.249.119173.252.127.3173.252.83.4957.141.3.2369.171.249.12173.252.127.4173.252.83.557.141.3.2469.171.249.120173.252.127.5173.252.83.5057.141.3.2569.171.249.124173.252.127.6173.252.83.5157.141.3.2669.171.249.125173.252.127.7173.252.83.5257.141.3.2769.171.249.126173.252.127.8173.252.83.5357.141.3.2869.171.249.13173.252.127.9173.252.83.5457.141.3.2969.171.249.14173.252.69.1173.252.83.5557.141.3.369.171.249.15173.252.69.111173.252.83.5657.141.3.3069.171.249.16173.252.69.112173.252.83.657.141.3.469.171.249.17173.252.69.113173.252.83.6057.141.3.569.171.249.18173.252.69.114173.252.83.6457.141.3.669.171.249.19173.252.69.115173.252.83.757.141.3.769.171.249.2173.252.69.116173.252.83.857.141.3.869.171.249.20173.252.69.117173.252.83.957.141.3.969.171.249.21173.252.69.118173.252.87.166.220.149.169.171.249.22173.252.69.125173.252.87.1066.220.149.1069.171.249.23173.252.69.2173.252.87.1166.220.149.11269.171.249.24173.252.69.3173.252.87.11166.220.149.11369.171.249.25173.252.69.4173.252.87.11266.220.149.11569.171.249.26

1、对网站没什么危害但抓取网站频繁对资源消耗较大如果不做境外业务可能通过防火墙阻止。

五、EXECL格式数据下载