Tag Archive: robots

March 26, 2015   /   by Marco   /   , , , ,

Best way to stop crawler bots

Best way to stop crawler bots

I recently discovered one of my VPS servers was running constantly at 1-2 CPU load and received notifications from the VPS provider that it was using more than my fair share of CPU resources and temporarily suspended the VPS to prevent it from impacting my neighbouring customers – which was fair enough. Upon investigation there were […]

read more

I just updated my website and do 404 pages hurt my page ranking

Today, we launched a revamped a website for one a company. We basically moved from using ASP to PHP pages so the permalink between the old and new is completely different. So one of the questions that I had was whether 404 actually impact on my Google Page ranking. The short answer is no but […]

read more