Google Git
Sign in
apache/celeborn/HEAD
  1. 749e455 [CELEBORN-2060][FOLLOWUP] Fix rack-aware replica storage selection by Kalvin2077 · 13 days ago main
  2. 4e20a61 [CELEBORN-2390] Add docker-compose for local cluster by yew1eb · 13 days ago
  3. cb086f2 [CELEBORN-2432] Cache sbt launcher and dependencies in SBT CI workflow by yew1eb · 13 days ago
  4. b356cce [CELEBORN-2437][INFRA] Fix JIRA fix version suggestion in merge_pr.py by Cheng Pan · 2 weeks ago
  5. 7b05008 [CELEBORN-2060] Refactor master slot allocation with strategy abstraction by Kalvin2077 · 2 weeks ago
  6. 83be003 [CELEBORN-2431] Fix flaky RemoteShuffleMasterSuiteJ shuffleCount assertions racing with app heartbeat counter reset by yew1eb · 2 weeks ago
  7. 9c7ea13 [CELEBORN-2410] Add missing module coverage to labeler.yml by yew1eb · 2 weeks ago
  8. 02dadde [CELEBORN-2421] Avoid redundant ByteBuffer allocation in LocalPartitionDataReader by r7raul1984 · 2 weeks ago
  9. 8cbf3fa [CELEBORN-2409] Fix outdated Spark version descriptions in docs by yew1eb · 2 weeks ago
  10. 52fa5ff [CELEBORN-2438][INFRA] Remove empty protected_branches in .asf.yaml by Cheng Pan · 2 weeks ago
  11. ba4fa59 [CELEBORN-2433] Fix Utils.tryWithResources evaluating by-name resource expression twice by yangjie01 · 2 weeks ago
  12. 8b7b73b [CELEBORN-2408] Exclude unused Netty QUIC/HTTP3 modules from shaded clients by yew1eb · 2 weeks ago
  13. 77f8c4b [CELEBORN-2435] Make CelebornConfSuite transport io.mode expectation platform-aware by yangjie01 · 2 weeks ago
  14. 9941064 [CELEBORN-2411][CIP22] Preserve Spark IO cipher transformation by SparksFyz · 3 weeks ago
  15. 51357a4 [CELEBORN-2425] Bump Ratis version from 3.2.2 to 3.3.0 by Nicholas Jiang · 3 weeks ago
  16. 08a2da4 [CELEBORN-2426] Correct the calculation of the count of unreleased partitions at shutdown by Rajeev Kumar · 3 weeks ago
  17. 9d3a5b5 [CELEBORN-2413] Fail transport requests retriably when the C++ connection is closed or a write fails by Yu Gan · 3 weeks ago
  18. c951e98 [CELEBORN-2427] Upgrade Netty to 4.2.17.Final by Fei Wang · 3 weeks ago
  19. 14b2cf5 [CELEBORN-2322][FOLLOWUP] Upgrade docker/login-action for release workflow by zhengtao · 3 weeks ago
  20. 9c16805 [CELEBORN-2420] Bump scala version to 2.12.18 by yew1eb · 3 weeks ago
  21. cfd01ef [CELEBORN-2412] Propagate the worker error message through cpp MessageDispatcher failures by Yu Gan · 4 weeks ago
  22. 87aae3f [CELEBORN-2032][FOLLOWUP] Disable replica preference for skewed partitions without map range by lijianfu03 · 4 weeks ago
  23. 1f15bdc [CELEBORN-2416] Export the C ABI from libceleborn_client.so by dropping --exclude-libs,ALL by Yu Gan · 4 weeks ago
  24. f7b878e [CELEBORN-2417] Pass CelebornConf properties through the C++ FFI by Yu Gan · 4 weeks ago
  25. 3e2820c [CELEBORN-2419] Fix the warning: deprecated systemProperties parameter in maven-surefire-plugin by yew1eb · 4 weeks ago
  26. a0444ea [CELEBORN-2418] Fix flaky Flink WordCountTest file length check by SparksFyz · 4 weeks ago
  27. 00113da [CELEBORN-2401] Change default of celeborn.client.spark.fetch.cleanFailedShuffle to true by wang-haihua · 4 weeks ago
  28. 90954f7 [CELEBORN-2399] Fix HA worker heartbeat using stateStartTime instead of actual time by ewoodbury · 4 weeks ago
  29. d1d69cb [CELEBORN-2406] Avoid blocking GetReducerFileGroup RPC under ConcurrentHashMap bin lock in updateFileGroup by Venkata Krishnan Sowrirajan · 4 weeks ago
  30. e8464d6 [CELEBORN-2402] Log the hostname for celeborn shuffle fetch failures by r7raul1984 · 4 weeks ago
  31. c0cad19 [CELEBORN-2404] Fix required field typo in SendWorkerEventRequest schema by yew1eb · 4 weeks ago
  32. 65132bb [CELEBORN-2394] Add REST v1 API to unregister shuffles by Kalvin2077 · 5 weeks ago
  33. fd6aaa5 [CELEBORN-2396][CLI] Fix CelebornCli.main discarding the configured CommandLine instance by yew1eb · 5 weeks ago
  34. 07dde50 [CELEBORN-2395] Reduce allocations in Utils.split* methods by yew1eb · 5 weeks ago
  35. 5a59fb7 Bump 1.0.0-SNAPSHOT by zhengtao · 5 weeks ago
  36. 2fcd8a1 [CELEBORN-2397][CLI] Expose logger level get/set endpoints in celeborn-cli (#3774) by yew1eb · 5 weeks ago
  37. 2b5dc8d [CELEBORN-2308] Bump commons-lang3 version from 3.17.0 to 3.20.0 by sychen · 6 weeks ago
  38. f0c8139 [CELEBORN-2371] Bound Spark batch-open client creation retries and stop them on interruption by Chao Sun · 6 weeks ago
  39. 76ce745 [CELEBORN-2380] Support JmxSink for exposing metrics as JMX MBeans by senthh · 6 weeks ago
  40. 59413d0 [CELEBORN-2385] Guard ByteBufAllocator cast in ChannelsLimiter trim path by sychen · 7 weeks ago
  41. 17f7d4f [CELEBORN-2379] Keep sbt and maven dependency lists in sync and cross-check both in CI by sychen · 7 weeks ago
  42. d77543e [CELEBORN-2382] Authorize `PbReviseLostShuffles` to prevent cross-application metadata modification by Kalvin2077 · 8 weeks ago
  43. 3aa2593 [CELEBORN-2383] Support Spark 4.2 by Nicholas Jiang · 8 weeks ago
  44. 50c18eb [CELEBORN-2381] Authorize PbApplicationMetaRequest to prevent secret disclosure by Nicholas Jiang · 8 weeks ago
  45. da8c1ce [CELEBORN-2362] Fix Flaky CI/CD by afterincomparableyum · 8 weeks ago
  46. b2f1da8 [CELEBORN-2377] Support Heartbeat message decoding in C++ client by yz · 8 weeks ago
  47. 1e715b2 [CELEBORN-2329][CIP22] Encryption at Rest Spark Impl by Aravind Patnam · 9 weeks ago
  48. a9055ae [CELEBORN-2374] Bump maven version from 3.9.14 to 3.9.16 by sychen · 9 weeks ago
  49. 17159eb [CELEBORN-2369] Retry stopped master Outbox failures by Chao Sun · 10 weeks ago
  50. 63e28ae [CELEBORN-2373] Support Flink 2.3 by Nicholas Jiang · 10 weeks ago
  51. 38f8231 [CELEBORN-2355] Return an empty stream from C++ ShuffleClientImpl::readPartition for an empty partition by Nicholas Jiang · 10 weeks ago
  52. a1ecf19 [CELEBORN-2372] Remove Hadoop 2 client support by Nicholas Jiang · 2 months ago
  53. 3820244 [CELEBORN-2368][FOLLOWUP] Remove leftover dependency list files for Spark 2.4 by sychen · 2 months ago
  54. a956fee [CELEBORN-2367][FOLLOWUP] Remove leftover dependency list files for Flink 1.16 and 1.17 by sychen · 2 months ago
  55. 581a0c0 [CELEBORN-2368] Remove Spark 2.4 client support by Nicholas Jiang · 2 months ago
  56. 5f49ed9 [CELEBORN-2367] Remove Flink 1.16 and 1.17 client support by Nicholas Jiang · 3 months ago
  57. 441d6b4 [CELEBORN-2354] Fix Helm chart indentation, PodMonitor flags and cluster-scoped PriorityClass namespace by Zemin Piao · 3 months ago
  58. 8903a31 [CELEBORN-2360] Fix ReviseLostShuffles RPC deserialization by afterincomparableyum · 3 months ago
  59. 0198bcf [CELEBORN-2334] Automatically restore RocksDB in case of failures by AmandeepSingh285 · 3 months ago
  60. d17489b [CELEBORN-2353] Align C++ shuffle client push/merge data path with Java ShuffleClient by Nicholas Jiang · 3 months ago
  61. 3a11d1e [CELEBORN-2365] Bump Spark version from 4.0.1 to 4.0.3 by Nicholas Jiang · 3 months ago
  62. 3eee443 [CELEBORN-2363] Bump Flink version to 1.20.5, 2.0.2 and 2.1.3 by Nicholas Jiang · 3 months ago
  63. 8c3108d [MINOR] Configure GitHub workflows to use concurrency cancel-in-progress for pull requests by Aurélien Pupier · 3 months ago
  64. 638270e [CELEBORN-2016] Fix the worker decommission and graceful shutdown condition by Sanskar Modi · 3 months ago
  65. 90b9b44 [CELEBORN-2351] Partition file sorting should only be paused for PUSH_AND_REPLICATE_PAUSED by Sanskar Modi · 3 months ago
  66. 61499a0 [CELEBORN-2319] Standalone LifecycleManager && rust sdk by 夷羿 · 3 months ago
  67. b1a7cb4 [CELEBORN-2315][FOLLOWUP] Change assertIteratorFullyConsumed to throw CelebornIOException by James Xu · 3 months ago
  68. 4a9112a [CELEBORN-2315] Add iterator fully-consumed validation after shuffle write by James Xu · 3 months ago
  69. b131a40 [MINOR] Fix PbSerDeUtilsTest failure by Sanskar Modi · 3 months ago
  70. e5099f9 [CELEBORN-2313] Extend E2E checked zone to batch assembly point by James Xu · 3 months ago
  71. a0f098f [CELEBORN-2347] Change get reducer file group cache to expireAfterAccess by Sanskar Modi · 3 months ago
  72. 93de9b3 [CELEBORN-2332] Fix self join deadlock in C++ WorkerPartitionReader fetch callbacks by afterincomparableyum · 3 months ago
  73. b105464 [CELEBORN-2348] Support end-to-end shuffle integrity check for Flink by Nicholas Jiang · 3 months ago
  74. bd2523f [CELEBORN-1577][FOLLOWUP] Fix backward compatiblity issue with interrupt shuffle by Sanskar Modi · 3 months ago
  75. bf0a1e8 [CELEBORN-2346] Add RequestSlots failure metrics by Chao Sun · 3 months ago
  76. 221129b [CELEBORN-2343] Fix timer leak in handlePushData by Sanskar Modi · 3 months ago
  77. c3bee9c [CELEBORN-2310][FOLLOWUP] Account actualUsableSpace while excluding workers by Sanskar Modi · 3 months ago
  78. c799373 [CELEBORN-2275][CIP-14] Add C++ merge-write and Java-read hybrid integration test by afterincomparableyum · 3 months ago
  79. 2497739 [CELEBORN-2342] Fix object aliasing in LegacySkewHandlingPartitionValidator corrupting sub-range metadata by James Xu · 3 months ago
  80. c546a21 [CELEBORN-2345] Fix allocation for rpcAskTimeout by Sanskar Modi · 3 months ago
  81. 2d5098b [CELEBORN-2339] Add tools.jar into classpath only for Java 8 by Cheng Pan · 3 months ago
  82. cf8d472 [CELEBORN-2338] Remove hardcoded CELEBORN_PRINT_LAUNCH_COMMAND=0 by Cheng Pan · 3 months ago
  83. dfe7def [CELEBORN-2337] Celeborn OpenAPI client should not shade slf4j-api by Cheng Pan · 3 months ago
  84. 759e7b5 [CELEBORN-2331] Parallelize batch open stream client creation by Chao Sun · 3 months ago
  85. 180db93 [CELEBORN-2326] Bump log4j-core version up to 2.25.4 by Yuriy Malygin · 3 months ago
  86. 1c807d9 [CELEBORN-2330] Fix HA master bootstrap redirect handling by Chao Sun · 3 months ago
  87. 91175ce [CELEBORN-2335] Bump Spark from 4.1.1 to 4.1.2 by SteNicholas · 3 months ago
  88. 671ef25 [CELEBORN-2328] Auto-apply correctness label from PR template checkbox by Fei Wang · 4 months ago
  89. 56444d2 [CELEBORN-2327] Add active-slot weight to load-aware placement by Chao Sun · 4 months ago
  90. 8b36b3d [CELEBORN-2333] Bump Flink from 2.2.0 to 2.2.1 by SteNicholas · 4 months ago
  91. f83350f [INFRA] Set up default rulesets for default and release branches by The Apache Software Foundation · 4 months ago
  92. ee7529f [CELEBORN-2310] Reject RESERVE_SLOTS when disks are full by Saurabh Dubey · 4 months ago
  93. 71a7d0a [CELEBORN-2257] Add reporting of remote disks during registration by Filip Darmanovic · 4 months ago
  94. 9ebbc6b [CELEBORN-2324] Fix JVMQuake threshold and JVMStat timer unit conversion by pithecuse527 · 4 months ago
  95. 50323e1 [CELEBORN-2316] Introduce metadata operation metrics by AmandeepSingh285 · 4 months ago
  96. e329b16 [CELEBORN-2253] Fix IndexOutOfBoundsException reading shuffle data from HDFS by 1fanwang · 4 months ago
  97. a70c8fd [CELEBORN-2306] Master adds shutdown hook for ratis stepdown by Kartikay Bhutani · 4 months ago
  98. 886e359 [CELEBORN-2314] Optimize the performance of DataBatches.requireBatches by afterincomparableyum · 4 months ago
  99. 7340428 [CELEBORN-2322] Upgrade version of docker/login-action for Login to Docker Hub by SteNicholas · 4 months ago
  100. 70ff956 [CELEBORN-2321] Avoid locking disk writers during memory split checks by Chao Sun · 4 months ago