commit | ba6a37aa06d79b88636b72ba90e380cacc80585f | [log] [tgz] |
---|---|---|
author | Daniel Gruno <humbedooh@apache.org> | Wed Jul 17 05:50:30 2019 +0200 |
committer | Daniel Gruno <humbedooh@apache.org> | Wed Jul 17 05:50:30 2019 +0200 |
tree | 0e9c2c68c5e6b296e429bcbca8dfe0c3fba0a971 | |
parent | a07ff82fdb8a87a6103e965bdfbb3b3567384fb9 [diff] |
tweak GitHub to work around abuse limitations If we hit the abuse detection system, try to sleep it off a few times before finally bailing.
The Kibble Scanners collect information for the Kibble Suite.
python3 src/kibble-scanner.py
.usage: kibble-scanner.py [-h] [-o ORG] [-f CONFIG] [-a AGE] [-s SOURCE] [-n NODES] [-t TYPE] [-e EXCLUDE [EXCLUDE ...]] [-v VIEW] optional arguments: -h, --help show this help message and exit -o ORG, --org ORG The organisation to gather stats for. If left out, all organisations will be scanned. -f CONFIG, --config CONFIG Location of the yaml config file (full path) -a AGE, --age AGE Minimum age in hours before performing a new scan on an already processed source. --age 12 will not process any source that was processed less than 12 hours ago, but will process new sources. -s SOURCE, --source SOURCE A specific source (wildcard) to run scans on. -n NODES, --nodes NODES Number of nodes in the cluster (used for load balancing) -t TYPE, --type TYPE Specific type of scanner to run (default is run all scanners) -e EXCLUDE [EXCLUDE ...], --exclude EXCLUDE [EXCLUDE ...] Specific type of scanner(s) to exclude -v VIEW, --view VIEW Specific source view to scan (default is scan all sources)
conf/
: Config filessrc/
:kibble-scanner.py
: Main script for launching scansplugins/
:brokers
: The various database brokers (ES or JSON API)utils
: Utility librariesscanners
: The individual scanner applicationsplugins/scanners/ponymail.py
)plugins/scanners/jira.py
)plugins/scanners/bugzilla.py
)plugins/scanners/gerrit.py
)plugins/scanners/git-sync.py
)plugins/scanners/git-census.py
)plugins/scanners/git-evolution.py
)plugins/scanners/git-sloc.py
)plugins/scanners/github.py
)plugins/scanners/github-stats.py
)plugins/scanners/pipermail.py
)(optional)
TBD. Please see https://kibble.apache.org/ for details!