Google GitGoogle Git
Sign in
apache/celeborn/HEAD
  1. fca9da2 [CELEBORN-2482] Report pushes failed by push-timeout channel close as push timeout instead of connection exception by afterincomparableyum · 4 hours ago main
  2. 69200e2 [CELEBORN-2220][CIP-14] Support Slow Start Push in C++ Client by afterincomparableyum · 4 hours ago
  3. 60a90e5 [CELEBORN-2488] Cache Maven distribution in CI workflows by yew1eb · 4 hours ago
  4. d7d6f7c [CELEBORN-2487] Fix leaked LifecycleManager in spark-it client suites by yew1eb · 5 hours ago
  5. eca6745 [CELEBORN-2484][BUILD] Make sbt downloads resilient to transient Maven Central failures by afterincomparableyum · 22 hours ago
  6. bc06a18 [CELEBORN-2481] Fix NPE when persisting MapFileMeta without segment granularity by Rudy Attias · 27 hours ago
  7. f4d6851 [CELEBORN-2483] Fix flaky RemoteShuffleMasterSuiteJ shuffleCount assertions racing with the initial app heartbeat by afterincomparableyum · 27 hours ago
  8. f937977 [CELEBORN-2476] Fix initial storage fallback for MEMORY locations by SparksFyz · 7 days ago
  9. cbcbeeb [CELEBORN-2403] Add worker metrics for disk status and unhealthy disk count by yew1eb · 7 days ago
  10. 626a07c [CELEBORN-2458] Invalidate transport client after push timeout by Venkata Krishnan Sowrirajan · 7 days ago
  11. 1fe959a [CELEBORN-2462][WORKER] Reduce misleading WARN/ERROR logs during decommission shutdown by yew1eb · 7 days ago
  12. 931e730 [CELEBORN-2463] Add ManuallyExcludedWorkerCount metric to distinguish manually excluded workers by yew1eb · 7 days ago
  13. e107e2d [CELEBORN-2466] Support per-zone worker StatefulSets and autoscaling in the Helm chart by strelok89 · 7 days ago
  14. b34cd83 [CELEBORN-2470] Add backoff with jitter to push retries and log hard split once per file by Venkata Krishnan Sowrirajan · 7 days ago
  15. a649f32 [CELEBORN-2472] Unregister Celeborn application from MR AppMaster on shutdown by senthh · 7 days ago
  16. 9a08869 [CELEBORN-2474] Send WWW-Authenticate challenge when no auth header present by senthh · 8 days ago
  17. 054af9d [CELEBORN-2475] Fix stale HA configuration documentation that breaks CI by zhengtao · 8 days ago
  18. 4d7fb8e [CELEBORN-2452] Prevent device error broadcast from deleting committed shuffle files by wang-haihua · 8 days ago
  19. ec098ee [CELEBORN-2446] Support topologySpreadConstraints for master and worker pods in Helm chart by strelok89 · 8 days ago
  20. 63381a8 [CELEBORN-2359] Deduplicate # HELP/# TYPE lines in PrometheusServlet output by afterincomparableyum · 8 days ago
  21. 71724db [CELEBORN-2361] Unblock stage-end when CommitFilesResponse carries an empty map-id bitmap by strelok89 · 8 days ago
  22. 29f3bae [CELEBORN-2356] Fix NPE before null-check in handleChunkFetchRequest by afterincomparableyum · 8 days ago
  23. 1256618 [CELEBORN-2357] Add Metrics Prefix by afterincomparableyum · 8 days ago
  24. ad5b99f [CELEBORN-2473] Do not relocate zstd-jni in the Tez shaded jar by senthh · 8 days ago
  25. 8c6e0c0 [MINOR] Update pnpm/action-setup to specific version v6.1.0 in web_lint.yml by sychen · 8 days ago
  26. c090945 [CELEBORN-2434] Clamp endMapIndex in sliceSortedBufferByMapRange by yew1eb · 10 days ago
  27. abdfd05 [CELEBORN-2453] Master should fail fast when the Ratis server is closed unexpectedly by yew1eb · 10 days ago
  28. cfaac4e [CELEBORN-2454] Add config celeborn.master.ha.ratis.raft.server.close.threshold and docs for Ratis JvmPauseMonitor by yew1eb · 10 days ago
  29. 9dfb74b [CELEBORN-2456] Fix wrong isAssignableFrom direction in Basic/Bearer authenticationSupported by yew1eb · 10 days ago
  30. 43b6e65 [CELEBORN-2455] Remove redundant synchronized in Dispatcher.postMessage by yew1eb · 10 days ago
  31. 5c116df [CELEBORN-2415] Add Celeborn Spark UI extension by yew1eb · 11 days ago
  32. f43f424 [CELEBORN-2471] Fix Flink uncompressed shuffle failing to load codec NONE by senthh · 11 days ago
  33. adadbd9 [CELEBORN-2442] Optimize meta memory for very large partitions by fengmingxiao · 5 weeks ago
  34. f28246d [CELEBORN-2430] Expose unexpected errors in client background threads by Kalvin2077 · 5 weeks ago
  35. fd453c0 [CELEBORN-2428] Fix TierWriter buffer accounting when CompositeByteBuf insertion fails by Kalvin2077 · 5 weeks ago
  36. 6b6efe2 [CELEBORN-2398] Allow ChangePartitionManager to refresh candidate workers without allocating slots by Kalvin2077 · 5 weeks ago
  37. 0d63a20 [CELEBORN-2447] Add a /healthz endpoint to master and worker by strelok89 · 5 weeks ago
  38. 231ffee [CELEBORN-2440][INFRA] Post a merge summary comment on the PR in merge_pr.py by Cheng Pan · 5 weeks ago
  39. 749e455 [CELEBORN-2060][FOLLOWUP] Fix rack-aware replica storage selection by Kalvin2077 · 8 weeks ago
  40. 4e20a61 [CELEBORN-2390] Add docker-compose for local cluster by yew1eb · 8 weeks ago
  41. cb086f2 [CELEBORN-2432] Cache sbt launcher and dependencies in SBT CI workflow by yew1eb · 8 weeks ago
  42. b356cce [CELEBORN-2437][INFRA] Fix JIRA fix version suggestion in merge_pr.py by Cheng Pan · 8 weeks ago
  43. 7b05008 [CELEBORN-2060] Refactor master slot allocation with strategy abstraction by Kalvin2077 · 9 weeks ago
  44. 83be003 [CELEBORN-2431] Fix flaky RemoteShuffleMasterSuiteJ shuffleCount assertions racing with app heartbeat counter reset by yew1eb · 9 weeks ago
  45. 9c7ea13 [CELEBORN-2410] Add missing module coverage to labeler.yml by yew1eb · 9 weeks ago
  46. 02dadde [CELEBORN-2421] Avoid redundant ByteBuffer allocation in LocalPartitionDataReader by r7raul1984 · 9 weeks ago
  47. 8cbf3fa [CELEBORN-2409] Fix outdated Spark version descriptions in docs by yew1eb · 9 weeks ago
  48. 52fa5ff [CELEBORN-2438][INFRA] Remove empty protected_branches in .asf.yaml by Cheng Pan · 9 weeks ago
  49. ba4fa59 [CELEBORN-2433] Fix Utils.tryWithResources evaluating by-name resource expression twice by yangjie01 · 9 weeks ago
  50. 8b7b73b [CELEBORN-2408] Exclude unused Netty QUIC/HTTP3 modules from shaded clients by yew1eb · 9 weeks ago
  51. 77f8c4b [CELEBORN-2435] Make CelebornConfSuite transport io.mode expectation platform-aware by yangjie01 · 9 weeks ago
  52. 9941064 [CELEBORN-2411][CIP22] Preserve Spark IO cipher transformation by SparksFyz · 9 weeks ago
  53. 51357a4 [CELEBORN-2425] Bump Ratis version from 3.2.2 to 3.3.0 by Nicholas Jiang · 9 weeks ago
  54. 08a2da4 [CELEBORN-2426] Correct the calculation of the count of unreleased partitions at shutdown by Rajeev Kumar · 9 weeks ago
  55. 9d3a5b5 [CELEBORN-2413] Fail transport requests retriably when the C++ connection is closed or a write fails by Yu Gan · 9 weeks ago
  56. c951e98 [CELEBORN-2427] Upgrade Netty to 4.2.17.Final by Fei Wang · 9 weeks ago
  57. 14b2cf5 [CELEBORN-2322][FOLLOWUP] Upgrade docker/login-action for release workflow by zhengtao · 9 weeks ago
  58. 9c16805 [CELEBORN-2420] Bump scala version to 2.12.18 by yew1eb · 10 weeks ago
  59. cfd01ef [CELEBORN-2412] Propagate the worker error message through cpp MessageDispatcher failures by Yu Gan · 10 weeks ago
  60. 87aae3f [CELEBORN-2032][FOLLOWUP] Disable replica preference for skewed partitions without map range by lijianfu03 · 10 weeks ago
  61. 1f15bdc [CELEBORN-2416] Export the C ABI from libceleborn_client.so by dropping --exclude-libs,ALL by Yu Gan · 10 weeks ago
  62. f7b878e [CELEBORN-2417] Pass CelebornConf properties through the C++ FFI by Yu Gan · 10 weeks ago
  63. 3e2820c [CELEBORN-2419] Fix the warning: deprecated systemProperties parameter in maven-surefire-plugin by yew1eb · 10 weeks ago
  64. a0444ea [CELEBORN-2418] Fix flaky Flink WordCountTest file length check by SparksFyz · 10 weeks ago
  65. 00113da [CELEBORN-2401] Change default of celeborn.client.spark.fetch.cleanFailedShuffle to true by wang-haihua · 2 months ago
  66. 90954f7 [CELEBORN-2399] Fix HA worker heartbeat using stateStartTime instead of actual time by ewoodbury · 2 months ago
  67. d1d69cb [CELEBORN-2406] Avoid blocking GetReducerFileGroup RPC under ConcurrentHashMap bin lock in updateFileGroup by Venkata Krishnan Sowrirajan · 2 months ago
  68. e8464d6 [CELEBORN-2402] Log the hostname for celeborn shuffle fetch failures by r7raul1984 · 3 months ago
  69. c0cad19 [CELEBORN-2404] Fix required field typo in SendWorkerEventRequest schema by yew1eb · 3 months ago
  70. 65132bb [CELEBORN-2394] Add REST v1 API to unregister shuffles by Kalvin2077 · 3 months ago
  71. fd6aaa5 [CELEBORN-2396][CLI] Fix CelebornCli.main discarding the configured CommandLine instance by yew1eb · 3 months ago
  72. 07dde50 [CELEBORN-2395] Reduce allocations in Utils.split* methods by yew1eb · 3 months ago
  73. 5a59fb7 Bump 1.0.0-SNAPSHOT by zhengtao · 3 months ago
  74. 2fcd8a1 [CELEBORN-2397][CLI] Expose logger level get/set endpoints in celeborn-cli (#3774) by yew1eb · 3 months ago
  75. 2b5dc8d [CELEBORN-2308] Bump commons-lang3 version from 3.17.0 to 3.20.0 by sychen · 3 months ago
  76. f0c8139 [CELEBORN-2371] Bound Spark batch-open client creation retries and stop them on interruption by Chao Sun · 3 months ago
  77. 76ce745 [CELEBORN-2380] Support JmxSink for exposing metrics as JMX MBeans by senthh · 3 months ago
  78. 59413d0 [CELEBORN-2385] Guard ByteBufAllocator cast in ChannelsLimiter trim path by sychen · 3 months ago
  79. 17f7d4f [CELEBORN-2379] Keep sbt and maven dependency lists in sync and cross-check both in CI by sychen · 3 months ago
  80. d77543e [CELEBORN-2382] Authorize `PbReviseLostShuffles` to prevent cross-application metadata modification by Kalvin2077 · 3 months ago
  81. 3aa2593 [CELEBORN-2383] Support Spark 4.2 by Nicholas Jiang · 3 months ago
  82. 50c18eb [CELEBORN-2381] Authorize PbApplicationMetaRequest to prevent secret disclosure by Nicholas Jiang · 3 months ago
  83. da8c1ce [CELEBORN-2362] Fix Flaky CI/CD by afterincomparableyum · 3 months ago
  84. b2f1da8 [CELEBORN-2377] Support Heartbeat message decoding in C++ client by yz · 3 months ago
  85. 1e715b2 [CELEBORN-2329][CIP22] Encryption at Rest Spark Impl by Aravind Patnam · 3 months ago
  86. a9055ae [CELEBORN-2374] Bump maven version from 3.9.14 to 3.9.16 by sychen · 4 months ago
  87. 17159eb [CELEBORN-2369] Retry stopped master Outbox failures by Chao Sun · 4 months ago
  88. 63e28ae [CELEBORN-2373] Support Flink 2.3 by Nicholas Jiang · 4 months ago
  89. 38f8231 [CELEBORN-2355] Return an empty stream from C++ ShuffleClientImpl::readPartition for an empty partition by Nicholas Jiang · 4 months ago
  90. a1ecf19 [CELEBORN-2372] Remove Hadoop 2 client support by Nicholas Jiang · 4 months ago
  91. 3820244 [CELEBORN-2368][FOLLOWUP] Remove leftover dependency list files for Spark 2.4 by sychen · 4 months ago
  92. a956fee [CELEBORN-2367][FOLLOWUP] Remove leftover dependency list files for Flink 1.16 and 1.17 by sychen · 4 months ago
  93. 581a0c0 [CELEBORN-2368] Remove Spark 2.4 client support by Nicholas Jiang · 4 months ago
  94. 5f49ed9 [CELEBORN-2367] Remove Flink 1.16 and 1.17 client support by Nicholas Jiang · 4 months ago
  95. 441d6b4 [CELEBORN-2354] Fix Helm chart indentation, PodMonitor flags and cluster-scoped PriorityClass namespace by Zemin Piao · 4 months ago
  96. 8903a31 [CELEBORN-2360] Fix ReviseLostShuffles RPC deserialization by afterincomparableyum · 4 months ago
  97. 0198bcf [CELEBORN-2334] Automatically restore RocksDB in case of failures by AmandeepSingh285 · 4 months ago
  98. d17489b [CELEBORN-2353] Align C++ shuffle client push/merge data path with Java ShuffleClient by Nicholas Jiang · 4 months ago
  99. 3a11d1e [CELEBORN-2365] Bump Spark version from 4.0.1 to 4.0.3 by Nicholas Jiang · 4 months ago
  100. 3eee443 [CELEBORN-2363] Bump Flink version to 1.20.5, 2.0.2 and 2.1.3 by Nicholas Jiang · 4 months ago