tree 0066ff9c58a41284530e910db40bfc3ec53ce2a7
parent e33aaa14739c7c02f4121ac1d8d0e7860f329e06
parent 6801ac79b2f45061ea4bd3b31ffd64e5195cf9c2
author Sebastian Nagel <snagel@apache.org> 1596481608 +0200
committer GitHub <noreply@github.com> 1596481608 +0200
gpgsig -----BEGIN PGP SIGNATURE-----
 
 wsBcBAABCAAQBQJfKGBICRBK7hj4Ov3rIwAAdHIIAC8c5ioNibI68OaiOq4itEVZ
 /MCq1DVTbrUId9zncHDpCr6uraDIOwOS33+btYGej+ni6xbzWNawZWlcV48tLIAm
 ii0ta/prvg2TScpIgVr/qjm8k6QfrVSgx/9bjCRYQ/ep/i4zRlwyoijgTRUyU+0+
 AEbRZUpVdSsHl3v8Pt3lAwRPBA8RRoQfl2RjQ3VzLdPeZJhKOSMYMTalzBumBvva
 Bjeu4AAXh9RbWl01KC+u3FM4dsJ5Y7MDPzsvT/W2zkyPF/HvYCkVzIlllTEYgB9L
 FK1G9KfXwr3oPnoC3iZFYorMToPe82m8SxNScTJVx4GrfBxcO8DbW+1q8/lxgGg=
 =NAdT
 -----END PGP SIGNATURE-----
 

Merge pull request #537 from sebastian-nagel/NUTCH-2801-robots-checker

[NUTCH-2801] RobotsRulesParser command-line checker to use http.robots.agents as fall-back