Google Git
Sign in
apache/celeborn/HEAD
  1. 638270e [CELEBORN-2016] Fix the worker decommission and graceful shutdown condition by Sanskar Modi · 28 hours ago main
  2. 90b9b44 [CELEBORN-2351] Partition file sorting should only be paused for PUSH_AND_REPLICATE_PAUSED by Sanskar Modi · 2 days ago
  3. 61499a0 [CELEBORN-2319] Standalone LifecycleManager && rust sdk by 夷羿 · 2 days ago
  4. b1a7cb4 [CELEBORN-2315][FOLLOWUP] Change assertIteratorFullyConsumed to throw CelebornIOException by James Xu · 2 days ago
  5. 4a9112a [CELEBORN-2315] Add iterator fully-consumed validation after shuffle write by James Xu · 2 days ago
  6. b131a40 [MINOR] Fix PbSerDeUtilsTest failure by Sanskar Modi · 5 days ago
  7. e5099f9 [CELEBORN-2313] Extend E2E checked zone to batch assembly point by James Xu · 5 days ago
  8. a0f098f [CELEBORN-2347] Change get reducer file group cache to expireAfterAccess by Sanskar Modi · 5 days ago
  9. 93de9b3 [CELEBORN-2332] Fix self join deadlock in C++ WorkerPartitionReader fetch callbacks by afterincomparableyum · 5 days ago
  10. b105464 [CELEBORN-2348] Support end-to-end shuffle integrity check for Flink by Nicholas Jiang · 8 days ago
  11. bd2523f [CELEBORN-1577][FOLLOWUP] Fix backward compatiblity issue with interrupt shuffle by Sanskar Modi · 8 days ago
  12. bf0a1e8 [CELEBORN-2346] Add RequestSlots failure metrics by Chao Sun · 10 days ago
  13. 221129b [CELEBORN-2343] Fix timer leak in handlePushData by Sanskar Modi · 10 days ago
  14. c3bee9c [CELEBORN-2310][FOLLOWUP] Account actualUsableSpace while excluding workers by Sanskar Modi · 11 days ago
  15. c799373 [CELEBORN-2275][CIP-14] Add C++ merge-write and Java-read hybrid integration test by afterincomparableyum · 11 days ago
  16. 2497739 [CELEBORN-2342] Fix object aliasing in LegacySkewHandlingPartitionValidator corrupting sub-range metadata by James Xu · 12 days ago
  17. c546a21 [CELEBORN-2345] Fix allocation for rpcAskTimeout by Sanskar Modi · 12 days ago
  18. 2d5098b [CELEBORN-2339] Add tools.jar into classpath only for Java 8 by Cheng Pan · 2 weeks ago
  19. cf8d472 [CELEBORN-2338] Remove hardcoded CELEBORN_PRINT_LAUNCH_COMMAND=0 by Cheng Pan · 3 weeks ago
  20. dfe7def [CELEBORN-2337] Celeborn OpenAPI client should not shade slf4j-api by Cheng Pan · 3 weeks ago
  21. 759e7b5 [CELEBORN-2331] Parallelize batch open stream client creation by Chao Sun · 3 weeks ago
  22. 180db93 [CELEBORN-2326] Bump log4j-core version up to 2.25.4 by Yuriy Malygin · 3 weeks ago
  23. 1c807d9 [CELEBORN-2330] Fix HA master bootstrap redirect handling by Chao Sun · 3 weeks ago
  24. 91175ce [CELEBORN-2335] Bump Spark from 4.1.1 to 4.1.2 by SteNicholas · 3 weeks ago
  25. 671ef25 [CELEBORN-2328] Auto-apply correctness label from PR template checkbox by Fei Wang · 4 weeks ago
  26. 56444d2 [CELEBORN-2327] Add active-slot weight to load-aware placement by Chao Sun · 4 weeks ago
  27. 8b36b3d [CELEBORN-2333] Bump Flink from 2.2.0 to 2.2.1 by SteNicholas · 4 weeks ago
  28. f83350f [INFRA] Set up default rulesets for default and release branches by The Apache Software Foundation · 4 weeks ago
  29. ee7529f [CELEBORN-2310] Reject RESERVE_SLOTS when disks are full by Saurabh Dubey · 4 weeks ago
  30. 71a7d0a [CELEBORN-2257] Add reporting of remote disks during registration by Filip Darmanovic · 4 weeks ago
  31. 9ebbc6b [CELEBORN-2324] Fix JVMQuake threshold and JVMStat timer unit conversion by pithecuse527 · 4 weeks ago
  32. 50323e1 [CELEBORN-2316] Introduce metadata operation metrics by AmandeepSingh285 · 4 weeks ago
  33. e329b16 [CELEBORN-2253] Fix IndexOutOfBoundsException reading shuffle data from HDFS by 1fanwang · 4 weeks ago
  34. a70c8fd [CELEBORN-2306] Master adds shutdown hook for ratis stepdown by Kartikay Bhutani · 5 weeks ago
  35. 886e359 [CELEBORN-2314] Optimize the performance of DataBatches.requireBatches by afterincomparableyum · 5 weeks ago
  36. 7340428 [CELEBORN-2322] Upgrade version of docker/login-action for Login to Docker Hub by SteNicholas · 5 weeks ago
  37. 70ff956 [CELEBORN-2321] Avoid locking disk writers during memory split checks by Chao Sun · 5 weeks ago
  38. 8d473c5 [CELEBORN-2318] Miss increment to WRITE_DATA_HARD_SPLIT_COUNT on returning HARD_SPLIT in handlePushData by Kartikay Bhutani · 5 weeks ago
  39. fc08756 [CELEBORN-2320] Grafana dashboard linter should build from a checkout instead by SteNicholas · 5 weeks ago
  40. 69df893 [CELEBORN-2258][FOLLOWUP] Use IoHandlerFactories for EventLoopGroups to replace deprecated transport-specific event loop groups by SteNicholas · 7 weeks ago
  41. 59fd7a8 [CELEBORN-2309] Introduce JavaDeserializerFilter to support deserialization filter by SteNicholas · 7 weeks ago
  42. a56f69a [MINOR] Update DingTalk Contact Info by Shuang · 8 weeks ago
  43. 95419e1 [CELEBORN-2301] MessageEncoder enables zero-copy sendfile for FileRegion in Netty native transports by SteNicholas · 8 weeks ago
  44. 149f3b9 [CELEBORN-1577][BUG] Quota cancel shuffle should use app shuffle id by Sanskar Modi · 8 weeks ago
  45. c456df3 [CELEBORN-2298] Introduce NettyTransportBenchmark for Netty transport layer performance evaluation by SteNicholas · 9 weeks ago
  46. 913d027 [CELEBORN-2287] Split mode should be HARD_SPLIT when disk is full by zhengtao · 9 weeks ago
  47. 163bcb3 [CELEBORN-2297] Update workflow to manually install Helm and chart-testing by sychen · 9 weeks ago
  48. a30166d [CELEBORN-2305] Bump Ratis version from 3.2.1 to 3.2.2 by SteNicholas · 9 weeks ago
  49. c688c76 [CELEBORN-2063][FOLLOWUP] Fix timeout unit for parallel creation of partition writer by SteNicholas · 9 weeks ago
  50. c246031 [CELEBORN-2294][FOLLOWUP] Fix flaky test SparkUtilsSuite by Xianming Lei · 9 weeks ago
  51. 84830d9 [CELEBORN-2304] Fix timeout unit mismatch in disk monitor check by sychen · 9 weeks ago
  52. 7f1bac3 [CELEBORN-2302] Fix NPE in MemoryManager.close() when readBufferDispatcher is not initialized by sychen · 9 weeks ago
  53. 234ff2d [CELEBORN-2219][CIP-14] Support PushMergedData in CppClient by afterincomparableyum · 9 weeks ago
  54. ca8533c [CELEBORN-2300] Change the default value of celeborn.port.maxRetries from 1 to 16 by sychen · 9 weeks ago
  55. 37aed7e [CELEBORN-2295] CommitHandler should support retry interval by Xianming Lei · 2 months ago
  56. 37a27bc [CELEBORN-2296] Fix race condition in MemoryManager singleton initialization by sychen · 2 months ago
  57. 097f1df [CELEBORN-2294] The shuffle fetch failed report from the zombie stage should be ignored by Xianming Lei · 2 months ago
  58. c3adbca [CELEBORN-2293] Fix ConcurrentModificationException in WorkerStatusTracker.shuttingWorkers by Kartikay Bhutani · 2 months ago
  59. d3b7513 [CELEBORN-2292] Fix ArithmeticException when PUSH_DATA_HAND_SHAKE fails before any data written by luogen.lg · 2 months ago
  60. 42f1a08 [CELEBORN-2284] Fix TLS Memory Leak by Aravind Patnam · 3 months ago
  61. 235f07d [CELEBORN-2277] Replace synchronized in Flusher.getWorkerIndex with AtomicInteger by sychen · 3 months ago
  62. 6fc5565 [CELEBORN-2291] Support fsync on commit to ensure shuffle data durability by Kartikay Bhutani · 3 months ago
  63. 3773c65 [CELEBORN-2285] Bump maven 3.9.14 by sychen · 3 months ago
  64. 28a0733 [CELEBORN-2276] Fix race condition in MemoryManager.releaseSortMemory by sychen · 3 months ago
  65. 5fc0f19 [CELEBORN-2282] Eliminate redundant HashMap lookups in CelebornInputStream#fillBuffer by yew1eb · 3 months ago
  66. b4cb5a0 [CELEBORN-2283][BUG] Fix missing return in Master.handleRequestSlots when all workers are excluded by yew1eb · 3 months ago
  67. 7b25797 [CELEBORN-2274] Fix replicate channels not resumed when transitioning from PUSH_AND_REPLICATE_PAUSED to PUSH_PAUSED by Shuai Lu · 3 months ago
  68. 15cba46 [MINOR] Update repository references from incubator-gluten to gluten for TLP graduation of gluten by SteNicholas · 3 months ago
  69. af0ba1a [CELEBORN-2281] Improve error logging and null checks in CreditStreamManager by sychen · 3 months ago
  70. 400e951 [CELEBORN-2280] Support celeborn.network.memory.allocator.type to specify netty memory allocator by SteNicholas · 3 months ago
  71. 8c2c952 [CELEBORN-2279] Update log level from `INFO` to `ERROR` for console output in spark-it tests by sychen · 3 months ago
  72. 4b157c6 [CELEBORN-2278] Make HTTP auth bypass API paths configurable by Aravind Patnam · 3 months ago
  73. b78177f [CELEBORN-2238] Fix RuntimeException during stream cleanup preventing peer failover by Shuai Lu · 3 months ago
  74. 391ef4b [CELEBORN-2273] Fix cache mutation in TagsManager.getTaggedWorkers() by ShlomiTubul · 3 months ago
  75. dca3749 [CELEBORN-2218] Bump lz4-java version from 1.8.0 to 1.10.4 to resolve CVE‐2025‐12183 and CVE-2025-66566 by SteNicholas · 3 months ago
  76. 13ea40c [CELEBORN-2272] Add LZ4TPCDSDataBenchmark by Cheng Pan · 3 months ago
  77. ffdb416 [CELEBORN-2270] Fix problem with eviction to tiered storage during partition split by Enrico Olivelli · 3 months ago
  78. 0a67e2b [CELEBORN-2049] Bump Ratis version from 3.1.3 to 3.2.1 by SteNicholas · 3 months ago
  79. fddb817 [CELEBORN-2226][CIP-14] Support RetryFetchChunk functionality for Cel… by afterincomparableyum · 3 months ago
  80. deb7538 [CELEBORN-2248] Implement lazy loading for columnar shuffle classes and skew shuffle method using static holder pattern by zhenghuan · 4 months ago
  81. bc4dc12 [CELEBORN-2239] Support Spark 4.1 by SteNicholas · 4 months ago
  82. e119902 [CELEBORN-2268] Improve test coverage for MEMORY and S3 storage by Enrico Olivelli · 4 months ago
  83. 9d48e6c [CELEBORN-2258] Bump Netty version from 4.1.118.Final to 4.2.10.Final by SteNicholas · 4 months ago
  84. ad5a881 [CELEBORN-2267][FOLLOWUP] Add Cpp-Write Java-Read integration tests for LZ4 and ZSTD by afterincomparableyum · 4 months ago
  85. 2460efd [CELEBORN-2222][CIP-14] Support Retrying when createReader failed for CelebornInputStream in CppClient by afterincomparableyum · 4 months ago
  86. 4d97a85 [CELEBORN-2271] StorageManager#saveCommittedFileInfosExecutor should call shutdown before awaitTermination by Prateek Srivastava · 4 months ago
  87. feb3ed9 [CELEBORN-2262] Prepare S3 directory only once and cache s3 client for MultiPartUploader by Enrico Olivelli · 4 months ago
  88. ac6d1cf [CELEBORN-2269] Update Cpp TransportClient to resolve hostnames via DNS by jay.narale · 4 months ago
  89. e4836b7 [CELEBORN-2266] Modernize Protobuf CMake usage and add install rules by jay.narale · 4 months ago
  90. 13cd4a9 [CELEBORN-2265] Do not waste resources on hotpath for debug logging in HashBasedShuffleWriter and SortBasedShuffleWriter by Enrico Olivelli · 4 months ago
  91. eb7a720 [CELEBORN-2259] The S3MultipartUploadHandler uses fs.s3a.aws.credentials.provider by Dzeri96 · 4 months ago
  92. 8e6f4d5 [CELEBORN-2063] Parallelize the create partition writer in handleReserveSlots to speed up the reserveSlots RPC process time by SteNicholas · 4 months ago
  93. b1cbdab [CELEBORN-2221][CIP-14] Support writing with compression in C++ client by afterincomparableyum · 4 months ago
  94. 4ed9cbd [CELEBORN-2263] Fix IndexOutOfBoundsException while reading from S3 by Enrico Olivelli · 4 months ago
  95. 81d89f3 [CELEBORN-2256] Helm chart: add support for setting annotations on the service account (to support eks.amazonaws.com/role-arn) by Enrico Olivelli · 4 months ago
  96. b659439e [CELEBORN-2254] Fix support for S3 and add a simple integration test by Enrico Olivelli · 4 months ago
  97. 2097ad0 [CELEBORN-2205] Introduce metrics to fetch chunk for memory and local disk by xxx · 4 months ago
  98. 4752936 [CELEBORN-1577][FOLLOWUP] Fix master resource consumption metrics by Sanskar Modi · 4 months ago
  99. 46a49a8 [CELEBORN-2250] Fix lock contention in ReducePartitionCommitHandler.finishMapperAttempt via fine-grained locks by yew1eb · 5 months ago
  100. f04dddd [CELEBORN-2251] Introducing a shim layer and a common-tiered submodule for Flink clients by luogen.lg · 5 months ago