tree b6affb72b2b58c5690bb8c2096eb4eb1a0caa6aa
parent 6934d52a501b7aa50f8a9d017b2bdf61490ab99f
author Sebastian Nagel <snagel@apache.org> 1548164729 +0100
committer Sebastian Nagel <snagel@apache.org> 1548165091 +0100

NUTCH-2689 Speed up urlfilter-regex and urlfilter-automaton
- do not extract host and domain name from the URL if not needed
- speed up regular expressions:
  - use non-capturing groups if possible
  - use (?i) to make the patterns case insensitiven and
    remove uppercase variants to keep alternations shorter