Daily Archives: 23 Feb 2011

Best Practice robots.txt

I did some research month ago and wrote a longer article about robots.txt. But for a quick lookup it’s too much to read, so today it’s time a for a simple best-practices check-list: Use ASCII encoding for robots.txt (see as … Continue reading

Posted in Pressed, Surviving the Internet | Tagged , , , , , | 2 Comments