Sign in
◑
Theme
apache
/
stormcrawler
/
HEAD
f5cfe64
Regenerated License file after dependency upgrades (#2342)
by github-actions[bot]
· 24 hours ago
main
e5fd307
#2336 StatusMetricsBolt: report the status counts as a HashMap (#2337)
by Richard Zowalla
· 24 hours ago
364b6f2
#2338 Update DISCLAIMER-BINARIES.txt (#2339)
by Richard Zowalla
· 24 hours ago
fac78d3
#2340 Keep the archetype's .gitignore template in the source release (#2341)
by Richard Zowalla
· 24 hours ago
b55be84
build(deps): bump com.google.code.gson:gson from 2.14.0 to 2.15.0 (#2333)
by dependabot[bot]
· 24 hours ago
a58358d
build(deps): bump org.apache.commons:commons-secure-xml from 1.1.0 to 1.1.1 (#2332)
by dependabot[bot]
· 24 hours ago
2b6dc84
Update the migration guide and docs for 4.0 (#2318)
by Davide Polato
· 4 days ago
8fbe690
Exclude what Storm ships in lib-common from the archetype topology jars (#2321)
by Richard Zowalla
· 5 days ago
74e63b1
#2304 Solr StatusUpdaterBolt: do not overwrite known URLs with DISCOVERED (#2326)
by Richard Zowalla
· 5 days ago
0894d14
#2323 Make the source release pass ATR's checks (#2324)
by Richard Zowalla
· 5 days ago
72a7337
#2323 Document releasing through ATR (#2325)
by Richard Zowalla
· 5 days ago
e0f34b6
Upgrade to Apache Storm 3.2.0 (#2320)
by Richard Zowalla
· 6 days ago
798b5de
Remove two methods deprecated since 2.3 (#2322)
by Davide Polato
· 6 days ago
4c74369
Minor: Regenerated License File for 2daadc67f010a0b2763c8e88bb75f9bb0896a16d (#2319)
by github-actions[bot]
· 7 days ago
2daadc6
Remove deprecated AWS CloudSearch support (#2317)
by Davide Polato
· 7 days ago
4fbf8f6
build(deps): bump peter-evans/create-pull-request from 8.1.1 to 8.1.2 (#2314)
by dependabot[bot]
· 7 days ago
ebeb76c
build(deps): bump actions/setup-java from 6.1.0 to 6.2.0 (#2315)
by dependabot[bot]
· 7 days ago
88fc8c4
Minor: Regenerated License File for a7e996caf65bca77f34486ae38925d736eff526f (#2313)
by github-actions[bot]
· 8 days ago
a7e996c
build(deps): bump org.jsoup:jsoup from 1.23.2 to 1.24.1 (#2311)
by dependabot[bot]
· 8 days ago
f671b9a
Fixes for the Solr 10.1.0 update (#2307)
by Markos Volikas
· 8 days ago
2b6f597
build(deps): bump software.amazon.awssdk:bom from 2.57.7 to 2.57.10 (#2309)
by dependabot[bot]
· 8 days ago
4af458b
build(deps): bump com.puppycrawl.tools:checkstyle from 14.3.0 to 14.4.0 (#2312)
by dependabot[bot]
· 8 days ago
cf55b8d
build(deps): bump com.google.guava:guava from 33.7.2-jre to 33.8.0-jre (#2310)
by dependabot[bot]
· 8 days ago
e31dba6
#2303 Keep a drained fetch queue until its delay ends (#2306)
by Davide Polato
· 8 days ago
6307734
docs: document the 4.0.0 changed defaults (#2302)
by Abhinav
· 11 days ago
6faeb4a
4xx responses are retried as FETCH_ERROR, not marked ERROR straight away (#2301)
by Davide Polato
· 2 weeks ago
06838d8
build(deps-dev): bump org.apache.maven.plugins:maven-enforcer-plugin from 3.6.3 to 3.7.0 (#2295)
by dependabot[bot]
· 2 weeks ago
4a262ac
#2299 SelfURLFilter: compare the path and query case-sensitively (#2300)
by Richard Zowalla
· 2 weeks ago
a9d13be
#2282 Don't apply SitemapFilter to redirect targets (#2285)
by Richard Zowalla
· 2 weeks ago
21b1646
Minor: Regenerated License File for 52f31aa6e71840cb377747bf99dd768525de34fc (#2298)
by github-actions[bot]
· 2 weeks ago
52f31aa
build(deps): bump solr.version from 10.0.0 to 10.1.0 (#2292)
by dependabot[bot]
· 2 weeks ago
2fd0216
build(deps): bump software.amazon.awssdk:bom from 2.57.3 to 2.57.7 (#2296)
by dependabot[bot]
· 2 weeks ago
55317ed
build(deps): bump langchain4j.version from 1.22.0 to 1.23.0 (#2293)
by dependabot[bot]
· 2 weeks ago
44f3181
build(deps): bump org.jacoco:jacoco-maven-plugin from 0.8.15 to 0.8.16 (#2294)
by dependabot[bot]
· 2 weeks ago
40d225b
#2199 BasicURLNormalizer: split the query on & only, not on ; (#2260)
by EL MEHDI EL MOUATE
· 2 weeks ago
5452c1c
change back to setting max size, fixes #2289 (#2291)
by Julien Nioche
· 2 weeks ago
9ea2348
Round the next fetch dates without a Calendar (#2290)
by Julien Nioche
· 3 weeks ago
f0a8769
Upgrade to Tika 4.2.0 (#2288)
by Davide Polato
· 3 weeks ago
a505948
SpoutBenchmark: hide Storm's deprecated config warning and format numbers (#2287)
by Julien Nioche
· 3 weeks ago
390a134
Hide config validation warnings; round OPS and use separators for thousands (#2286)
by Julien Nioche
· 3 weeks ago
446832c
WARC: log the request line at debug level when its HTTP version is replaced (#2284)
by Richard Zowalla
· 3 weeks ago
237f47e
Archetype: use URLFrontier 2.6, as the urlfrontier module does (#2283)
by Richard Zowalla
· 3 weeks ago
c2493e7
Parse StatusUpdaterBenchmark input in parallel to raise its baseline throughput (#2280)
by Julien Nioche
· 3 weeks ago
2aa44dc
Add baseline SUB class for benchmarking (#2279)
by Julien Nioche
· 3 weeks ago
4bb9e03
#2266 Remove the dependency on HttpCore 5 (#2270)
by Richard Zowalla
· 3 weeks ago
94bb6a1
Minor: Regenerated License File for c9ea2a8486a4129194836b9cf47752c960e29134 (#2278)
by github-actions[bot]
· 3 weeks ago
c9ea2a8
build(deps): bump com.microsoft.playwright:playwright (#2277)
by dependabot[bot]
· 3 weeks ago
9d7ab58
build(deps): bump okhttp.version from 5.5.0 to 5.5.1 (#2275)
by dependabot[bot]
· 3 weeks ago
9e2377e
build(deps): bump com.ibm.icu:icu4j from 78.3 to 79.1 (#2274)
by dependabot[bot]
· 3 weeks ago
697423f
build(deps): bump org.apache.maven.plugins:maven-surefire-plugin (#2273)
by dependabot[bot]
· 3 weeks ago
4eec171
build(deps): bump software.amazon.awssdk:bom from 2.56.0 to 2.57.3 (#2272)
by dependabot[bot]
· 3 weeks ago
6392723
build(deps): bump com.mysql:mysql-connector-j from 26.7.0 to 26.10.0 (#2271)
by dependabot[bot]
· 3 weeks ago
a493873
#2198 preserve query strings containing slashes (#2231)
by sean0407
· 3 weeks ago
a2bd30c
#2264 Use entrySet() when iterating maps in WARCSpout and Solr IndexerBolt (#2265)
by EL MEHDI EL MOUATE
· 3 weeks ago
0be39e7
Minor: Regenerated License File for 1c9aeda58de6cb7353879d4cf16664e057aee602 (#2267)
by github-actions[bot]
· 3 weeks ago
36907a2
#158 document the JDK XML limits for sitemaps and feeds (#2263)
by Davide Polato
· 3 weeks ago
1c9aeda
#2211 Core now depends only on HttpCore 5 (#2236)
by SCORP711
· 3 weeks ago
db7aff0
#158 remove the DOM from the ParseFilters (#2262)
by Julien Nioche
· 3 weeks ago
466b85c
Minor: Regenerated License File for 1ac59f7bf376b7645a764b805a9d8f34b4a8003e (#2259)
by github-actions[bot]
· 3 weeks ago
1ac59f7
Tika ParserBolt: apply the JSoupFilters to the documents parsed by Tika (#2256)
by Julien Nioche
· 3 weeks ago
55b2d83
XPathFilter: skip blank values and try the next expression (#2258)
by Julien Nioche
· 3 weeks ago
d6893c3
Use commons-secure-xml for the XPath and DOM factories in core (#2257)
by Richard Zowalla
· 4 weeks ago
dbc35c5
#158 remove the DOM-based LDJsonParseFilter and LinkParseFilter (#2253)
by Julien Nioche
· 4 weeks ago
51c23bc
#158 jsoup XPathFilter: convert to W3C DOM once per page, not once per expression (#2252)
by Julien Nioche
· 4 weeks ago
9c8b85a
#2250 CharsetIdentification: read the content type under the protocol prefix (#2251)
by Nico Scandolo
· 4 weeks ago
0fd8847
Minor: Regenerated License File for 1b56770c5306b0027cc92a763dfc1ea14a52fcdc (#2255)
by github-actions[bot]
· 4 weeks ago
1b56770
#2212 move the opensearch-java implementation into external/opensearch (#2242)
by Davide Polato
· 4 weeks ago
2d6d637
#2212 retry 429 items and flush bulk requests by size (#2241)
by Davide Polato
· 4 weeks ago
56d9ed6
#2145 Punycode the host in politeness, partition and robots.txt keys (#2244)
by Omar Bounawara
· 4 weeks ago
d983b71
Minor: Regenerated License File for 37fe1b34f02e3b90bcdc318a034eaa95ef98b1ca (#2247)
by github-actions[bot]
· 4 weeks ago
23f3d1c
build(deps): bump actions/setup-java from 6.0.1 to 6.1.0 (#2248)
by dependabot[bot]
· 4 weeks ago
37fe1b3
build(deps): bump com.github.ben-manes.caffeine:caffeine (#2246)
by dependabot[bot]
· 4 weeks ago
208af27
build(deps): bump software.amazon.awssdk:bom from 2.55.13 to 2.56.0 (#2245)
by dependabot[bot]
· 4 weeks ago
3f964e6
MultiProxyManager: thread-safe round-robin rotation (#2228)
by Davide Polato
· 4 weeks ago
0ba9c2e
Regenerated License file after dependency upgrades (#2240)
by github-actions[bot]
· 5 weeks ago
fca69e9
build(deps): bump software.amazon.awssdk:bom from 2.55.10 to 2.55.13 (#2232)
by dependabot[bot]
· 5 weeks ago
01a0f5a
Minor: Regenerated License File for 21f2bf0c214224802139470c0498c02b1db4c26a (#2239)
by github-actions[bot]
· 5 weeks ago
21f2bf0
Minor: Regenerated License File for 58bb8a7dd86dd6fc134bcf432d6447cbc18428ff (#2238)
by github-actions[bot]
· 5 weeks ago
e551413
build(deps): bump langchain4j.version from 1.20.2 to 1.22.0 (#2233)
by dependabot[bot]
· 5 weeks ago
58bb8a7
build(deps): bump commons-codec:commons-codec from 1.22.1 to 1.23.0 (#2234)
by dependabot[bot]
· 5 weeks ago
4fdcc40
opensearch-java: fix the search_after values sent by HybridSpout (#2237)
by Davide Polato
· 5 weeks ago
e98da1a
URLFrontier Spout: report the query time (#2235)
by Julien Nioche
· 5 weeks ago
9593874
AbstractStatusUpdaterBolt: report cache hits/misses with a counter, not reset-on-read gauges (#2229)
by Julien Nioche
· 5 weeks ago
a575f49
#1901 Tika ParserBolt: limit the pages parsed in a PDF with parser.tika.pdf.maxpages (#2227)
by Richard Zowalla
· 5 weeks ago
d084f82
#2197 BasicURLNormalizer keeps the query when rebuilding a URL (#2207)
by Julien Nioche
· 6 weeks ago
d8c0d4c
Add SpoutBenchmark to measure the read performance of spouts (#2226)
by Julien Nioche
· 6 weeks ago
3c8f8c6
URLFrontier StatusUpdaterBolt: cheaper bookkeeping of the acks (#2223)
by Julien Nioche
· 6 weeks ago
6b9398b
opensearch-java: send bulk requests with the OpenSearchAsyncClient (#2225)
by Julien Nioche
· 6 weeks ago
343ae82
StatusUpdaterBenchmark: run several instances of the status updater in parallel (#2222)
by Julien Nioche
· 6 weeks ago
fd37a2c
Minor: Regenerated License File for 82bf0e48b35b54f0181bb3152f1dc6ba68b50829 (#2224)
by github-actions[bot]
· 6 weeks ago
82bf0e4
build(deps): bump com.puppycrawl.tools:checkstyle from 14.1.0 to 14.3.0 (#2220)
by dependabot[bot]
· 6 weeks ago
49eb5b5
build(deps): bump com.google.guava:guava from 33.7.1-jre to 33.7.2-jre (#2219)
by dependabot[bot]
· 6 weeks ago
2247e86
build(deps): bump org.apache.commons:commons-lang3 from 3.20.0 to 3.21.0 (#2221)
by dependabot[bot]
· 6 weeks ago
d7303a2
build(deps): bump git-code-format-maven-plugin.version from 6.1 to 6.2 (#2218)
by dependabot[bot]
· 6 weeks ago
2c10fc6
build(deps): bump langchain4j.version from 1.20.0 to 1.20.2 (#2217)
by dependabot[bot]
· 6 weeks ago
1b4f224
build(deps): bump software.amazon.awssdk:bom from 2.55.5 to 2.55.10 (#2216)
by dependabot[bot]
· 6 weeks ago
14ec73a
Add StatusUpdaterBenchmark to measure the performance of status updater backends (#2213)
by Julien Nioche
· 6 weeks ago
095d609
#2214 Manage the Jackson dataformat/datatype versions in the root pom (#2215)
by Tim Allison
· 7 weeks ago
0ffc02a
#2057 FetcherBolt: move the fetcher internals to o.a.s.fetcher
by Davide Polato
· 7 weeks ago
c39f3d0
#2057 FetcherBolt: extract the response and failure handling
by Davide Polato
· 7 weeks ago
Next »