https://www.businesslegions.com/blog Deals, entrepreneur, money, business, website, design,technology and random ramblings Wed, 25 Mar 2015 23:37:42 +0000 en-US hourly 1 https://www.businesslegions.com/blog/2015/03/26/best-way-to-stop-crawler-bots/ https://www.businesslegions.com/blog/2015/03/26/best-way-to-stop-crawler-bots/#respond Wed, 25 Mar 2015 23:37:42 +0000 https://www.businesslegions.com/blog/?p=3282 I recently discovered one of my VPS servers was running constantly at 1-2 CPU load and received notifications from the VPS provider that it was using more than my fair share of CPU resources and temporarily suspended the VPS to prevent it from impacting my neighbouring customers – which was fair enough. Upon investigation there were […]]]> https://www.businesslegions.com/blog/2015/03/26/best-way-to-stop-crawler-bots/feed/ 0