commit | 860a77fee80c923ffe08c08992fe61c40b5f96a3 | [log] [tgz] |
---|---|---|
author | Steven J. Hathaway <shathaway@apache.org> | Thu Jul 12 04:19:49 2012 +0000 |
committer | Steven J. Hathaway <shathaway@apache.org> | Thu Jul 12 04:19:49 2012 +0000 |
tree | 302a30cafbc6b602eeddac665a9a6355206c52d5 | |
parent | beeb551508468d8af2ffa839da80f3c9592e5b91 [diff] |
Add robots.txt to limit web crawlers access to specific content