tree ef56a019035a5c3e878e542d77b992c29fbff1e7
parent ec45fe5cd1b7b7d7da8d1a04701cfd140a323178
author Sebastian Nagel <snagel@apache.org> 1573215665 +0100
committer Sebastian Nagel <snagel@apache.org> 1575286644 +0100

NUTCH-2748 Fetch status gone (redirect exceeded) not to overwrite existing items in CrawlDb
- new configuration property `http.redirect.max.exceeded.skip`:
  * if true skip redirect targets if http.redirect.max is exceeded
  * if false (default): store the redirect targets with status "linked"
- log whether exceeded redirects are "skipped" or "linked"