How-To Block Alexa Robot

It’s easy and can save you some bandwidth per month, just add the following to your robots.txt file:

User-agent: ia_archiver
Disallow: /

Additionally it saves you to get too much information concentrated on alexa.com. You can contact them to delete existing content as well. Source and more information : Alexa For Webmasters.

Read On: Best Practice robots.txt and more about robots.txt on my blog.

This entry was posted in Surviving the Internet and tagged , , , . Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.