tree 05afc8b3ec41c0f2569ff7008eef7321aae29c86
parent e9dd18015d00ad731656c8288faff6376db93f07
parent e6bc45181369ced98fa7d9df23685620938b0c9c
author Sebastian Nagel <snagel@apache.org> 1586518907 +0200
committer GitHub <noreply@github.com> 1586518907 +0200
gpgsig -----BEGIN PGP SIGNATURE-----
 
 wsBcBAABCAAQBQJekFt7CRBK7hj4Ov3rIwAAdHIIAAtNk86n7m5q9ObPbfMaRhps
 2xr3NF3DoRuP/ITN7X4KmC4JdC52LEw5tz0L6BcRM9v7OXXeGr83ZvNLkBE+q2N4
 3dYddw+fQrjrXIUhYGBVOWEsr4EmGClbTVY6Mz2W2yaFUy8j6aWKepZPE1fyZXCW
 ZDbXkEKP4/2VSlad4E8/DVD+bN0BdqzHas0HYbHHW300FIG6q/NjyKTo2eXAlwKA
 hRUBJJNHkJFlC14rm3zX4e9f9LMSsJpLVLJnwqpkE/QKSEASJ2MAsr4dw8JxNgdO
 1iNMW/00xBfF926biXrjNAEJ8Y3VEbnzOK5DSBWzD/6L1XxZFcD9RXkO8G1NPZU=
 =8Ajq
 -----END PGP SIGNATURE-----
 

Merge pull request #506 from sebastian-nagel/NUTCH-2775-robots-min-delay

NUTCH-2775 Fetcher to guarantee minimum delay even if robots.txt defines shorter Crawl-delay