Forumsee logo

Crawl Delay Robots.txt

Search Engine Optimization - forums.seochat.com
Keep finding odd things in robots.txt files this month.

The latest one is:

User-agent: *

Crawl-delay: 2

It's on a small 16 page website selling bungalows to pensioners.

I've had a look round on the internet and the general consensus seems to be that only big sites need to do this.

The main question is how harmful could this be from an SEO point of view?

I ask because they sent over a snapshot of their analytics which shows them losing pretty much all of their organic traffic from December last year to now.
Date: Jun 14, 2017   


Last videos:

New And Trending Youtube views
New And Trending Youtube views
One Red Paper Clicp - Internet Success Story
One Red Paper Clicp - Internet Success Story
The correct way of changing domain name ?
The correct way of changing domain name ?

Cars ·
Travel ·
Pets ·
production-frontend