Google Git
Sign in
apache / celeborn / HEAD
  1. 3efc60c [CELEBORN-2047] Reuse FileChannel/FSDataInputStream in PartitionDataReader by daowu.hzy · 3 days ago main
  2. 449cb5d [CELEBORN-2127] When fileWriter is closed, it should return HARD_SPLIT StatusCode by xxx · 3 days ago
  3. 750aeef [CELEBORN-2139] Fix the condition for using OSS storage by xxx · 4 days ago
  4. 6c10244 [CELEBORN-2138] Avoiding multiple accesses to HDFS When writting index file by taowenjun · 4 days ago
  5. 7f08eb8 [CELEBORN-2137] Remove unused MAPGROUP PartitionType by SteNicholas · 4 days ago
  6. d038dd2 [CELEBORN-1258] Support to register application info with user identifier and extra info by Wang, Fei · 6 days ago
  7. 2817f7f [CELEBORN-2104] Clean up sources of NettyRpcEnv, Master and Worker to avoid thread leaks by dz · 8 days ago
  8. ffdaef9 [CELEBORN-2097] Support Zstd Compression in CppClient by Jray · 8 days ago
  9. 1858903 [CELEBORN-2135] Rename Blaze to Auron by sychen · 8 days ago
  10. db70473 [CELEBORN-2134] When creating a DiskFile, retrieve the storage type b… by xxx · 9 days ago
  11. 1be3094 [CELEBORN-2132] Enhance ratis peer add operation to support clientAddress & adminAddress by gaoyajun02 · 10 days ago
  12. 1a3b9f3 [CELEBORN-2129] CelebornBufferStream should invoke openStreamInternal in moveToNextPartitionIfPossible to avoid client creation timeout by SteNicholas · 11 days ago
  13. f590fb2 [CELEBORN-2122] Avoiding multiple accesses to HDFS when retrieving in… by xxx · 11 days ago
  14. d4e13b6 [CELEBORN-2128] Close hadoopFs FileSystem when worker is closed by xxx · 11 days ago
  15. 20e36ca [CELEBORN-2133] LifecycleManager should log stack trace of Throwable for invoking appShuffleTrackerCallback by SteNicholas · 11 days ago
  16. 679df6c [CELEBORN-2125] Imporve PartitionFilesSorter sort timeout log by sychen · 11 days ago
  17. a9490d6 [CELEBORN-2118] Introduce IsHighWorkload metric to monitor worker overload status by xxx · 12 days ago
  18. 1d62997 [CELEBORN-2123] Add log for commit file size by xxx · 12 days ago
  19. d6df794 [CELEBORN-2115][CIP-14] Support PushData in cppClient by HolyLow · 13 days ago
  20. 5f3884f [MINOR] Fix migration doc style by sychen · 2 weeks ago
  21. 3c9fe98 [MINOR] Fix doc about PushMergedData split by sychen · 2 weeks ago
  22. 686242c [MINOR] Fix appVersion in Chart.yaml by SteNicholas · 2 weeks ago
  23. 8effb73 [CELEBORN-2066] Release workers only with high workload when the number of excluded worker set is too large by yuanzhen · 2 weeks ago
  24. 661a096 [CELEBORN-2112] Introduce PausePushDataStatus and PausePushDataAndReplicateStatus metric to record status of pause push data by xxx · 2 weeks ago
  25. 8a37a7c [CELEBORN-2106] CommitFile/Reserved location shows detail primary location UniqueId by dz · 2 weeks ago
  26. 11b41f9 [CELEBORN-2102] Introduce SorterCacheHitRate metric to monitor the hit reate of index cache for sorter by dz · 3 weeks ago
  27. b537798 [CELEBORN-2108] Remove redundant PartitionType by xxx · 3 weeks ago
  28. adfc563 [CELEBORN-2119] DfsTierWriter should close s3MultipartUploadHandler and ossMultipartUploadHandler for close resource by SteNicholas · 3 weeks ago
  29. a8f6de5 [CELEBORN-2117] Use git submodules for Chart Actions by sychen · 3 weeks ago
  30. 0882db9 [CELEBORN-2096] Support Lz4 Compression in CppClient by Jray · 3 weeks ago
  31. 7e13c99 [CELEBORN-2098][CIP-14] Support Revive/Response in cppClient by HolyLow · 3 weeks ago
  32. 180a741 [CELEBORN-2100] Fix performance issue on readToReadOnlyBuffer by Jray · 3 weeks ago
  33. 1ed2abc [CELEBORN-2095][CIP-14] Support RegisterShuffle/Response in cppClient by HolyLow · 4 weeks ago
  34. eb5e8a4 [CELEBORN-2091] Support Zstd Decompression in CppClient by Jray · 4 weeks ago
  35. cfb490c [CELEBORN-2090] Support Lz4 Decompression in CppClient by Jray · 4 weeks ago
  36. 1ead784 [CELEBORN-2085] Use a fixed buffer for flush copying to reduce GC by TheodoreLx · 4 weeks ago
  37. 5a45925 [CELEBORN-1844][FOLLOWUP] Fix the condition of StoragePolicy that worker uses memory storage by SteNicholas · 5 weeks ago
  38. fdcc108 [CELEBORN-1792][FOLLOWUP] Add missing break in resumeByPinnedMemory by liuyang62 · 5 weeks ago
  39. 75446a0 [CELEBORN-2093] Support Flink 2.1 by SteNicholas · 5 weeks ago
  40. a61d6a5 [CELEBORN-2064] Fix the issue where reading replica partition that returns zero chunk causes tasks to hang by xinyuwang1 · 5 weeks ago
  41. a498b11 [CELEBORN-1984] Merge ResourceRequest to transportMessageProtobuf by zhaohehuhu · 5 weeks ago
  42. 20a629a [CELEBORN-2088] Fix NPE if `celeborn.client.spark.fetch.cleanFailedShuffle` enabled by Wang, Fei · 5 weeks ago
  43. 6044857 [CELEBORN-2092] Inc COMMIT_FILES_FAIL_COUNT when TimerWriter::close timeout by Wang, Fei · 5 weeks ago
  44. f3c6f30 [CELEBORN-2070][CIP-14] Support MapperEnd/Response in CppClient by HolyLow · 6 weeks ago
  45. 0a465ad [CELEBORN-2087] Refine the docs configuration table view by Wang, Fei · 6 weeks ago
  46. 392f618 [CELEBORN-2086] S3FlushTask and OssFlushTask should close ByteArrayInputStream to avoid resource leak by SteNicholas · 6 weeks ago
  47. 4540b57 [MINOR] Document introduced metrics into monitoring.md by SteNicholas · 6 weeks ago
  48. 3ff44fa [CELEBORN-894][CELEBORN-474][FOLLOWUP] PushState uses JavaUtils#newConcurrentHashMap to speed up ConcurrentHashMap#computeIfAbsent by SteNicholas · 6 weeks ago
  49. c6e68fd [CELEBORN-2053] Refactor remote storage configration usage by Kalvin2077 · 6 weeks ago
  50. 7ab6268 [CELEBORN-2083] For `WorkerStatusTracker`, log error for `recordWorkerFailure` by Wang, Fei · 6 weeks ago
  51. ae40222 [CELEBORN-2047] Support MapPartitionData on DFS by SteNicholas · 6 weeks ago
  52. df0def6 [CELEBORN-2082] Add the log of excluded workers with high workloads by sychen · 6 weeks ago
  53. abd6233 [CELEBORN-2081] PushDataHandler onFailure log shuffle key by sychen · 6 weeks ago
  54. c587f33 [CELEBORN-1793] Add netty pinned memory metrics by Wang, Fei · 6 weeks ago
  55. 29ab169 [CELEBORN-2056] Make the wait time for the client to read non shuffle partitions configurable by duanhao-jk · 6 weeks ago
  56. 4656bcb [CELEBORN-2071] Fix the issue where some gauge metrics were not registered to the metricRegistry by TheodoreLx · 6 weeks ago
  57. 4ced621 [CELEBORN-2080] Bump Flink from 1.19.2, 1.20.1 to 1.19.3, 1.20.2 by SteNicholas · 6 weeks ago
  58. b8253b0 [CELEBORN-2078] Fix wrong grafana metrics units by Wang, Fei · 7 weeks ago
  59. 66856f2 [CELEBORN-2077] Improve toString by JEP-280 instead of ToStringBuilder by SteNicholas · 7 weeks ago
  60. 0ed590d [CELEBORN-1917] Support celeborn.client.push.maxBytesSizeInFlight by DDDominik · 7 weeks ago
  61. 8a0d0d5 [CELEBORN-2075] Fix `OpenStreamTime` metrics for `PbOpenStreamList` request by Wang, Fei · 7 weeks ago
  62. d09b424 [CELEBORN-2061] Introduce metrics to count the amount of data flushed into different storage types by TheodoreLx · 7 weeks ago
  63. b92820c [CELEBORN-2072] Add missing instance filter to grafana dashboard by Wang, Fei · 7 weeks ago
  64. 979f2e2 [CELEBORN-2073] Fix PartitionFileSizeBytes metrics by Wang, Fei · 7 weeks ago
  65. 05fca23 [MINOR] Fix a typo buffer to body in ChunkFetchSuccess.toString by SteNicholas · 7 weeks ago
  66. cf3c05d [CELEBORN-2068] TransportClientFactory should close channel explicitly to avoid resource leak for timeout or failure by SteNicholas · 7 weeks ago
  67. 6a0e19c [CELEBORN-2067] Clean up deprecated Guava API usage by SteNicholas · 7 weeks ago
  68. 765265a [CELEBORN-2031] Interruption Aware Slot Selection by Aravind Patnam · 8 weeks ago
  69. cfb4438 [CELEBORN-2057] Bump ap-loader version from 3.0-9 to 4.0-10 by SteNicholas · 8 weeks ago
  70. 532cedb [CELEBORN-1844][FOLLOWUP] alway try to use memory storage if available by mingji · 8 weeks ago
  71. 0fa600a [CELEBORN-2055] Fix some typos by codenohup · 8 weeks ago
  72. cd5d9cd [CELEBORN-2052] Fix unexpected warning logs in Flink caused by duplicate BufferStreamEnd messages by codenohup · 9 weeks ago
  73. a649823 [INFRA] More contributors name mapping by Wang, Fei · 9 weeks ago
  74. 41b5154 [CELEBORN-2051] Support write MapPartition to DFS by daowu.hzy · 9 weeks ago
  75. d2474e0 [CELEBORN-894][FOLLOWUP] update commitMeta before update subPartition… by lijianfu03 · 10 weeks ago
  76. cde33d9 [CELEBORN-894] End to End Integrity Checks by Gaurav Mittal · 2 months ago
  77. 7a0eee3 [CELEBORN-2045] Add logger sinks to allow persist metrics data and avoid possible worker OOM by mingji · 2 months ago
  78. 0fc7827 [CELEBORN-2036] Fix NPE when TransportMessage has null payload by Jray · 2 months ago
  79. 3ee3a26 [CELEBORN-2046] Specify extractionDir of AsyncProfilerLoader with celeborn.worker.jvmProfiler.localDir by SteNicholas · 2 months ago
  80. 8ae9737 [CELEBORN-2044] Proactively cleanup stream state from ChunkStreamManager when the stream ends by Mridul Muralidharan · 2 months ago
  81. 582726f [CELEBORN-1721][FOLLOWUP] Return softsplit if there is no hardsplit for pushMergeData by Shuang · 2 months ago
  82. 676beca [CELEBORN-2043] Fix IndexOutOfBoundsException exception in getEvictedFileWriter by mingji · 3 months ago
  83. 4d4012e [CELEBORN-2040] Avoid throw FetchFailedException when GetReducerFileGroupResponse failed via broadcast by caohaotian · 3 months ago
  84. dac0f56 [CELEBORN-1056][FOLLOWUP] Support testing of dynamic configuration management cli by SteNicholas · 3 months ago
  85. 6a09794 [CELEBORN-2042] Fix FetchFailure handling when TaskSetManager is not found by gaoyajun02 · 3 months ago
  86. d44242e [MINOR] Batch few celeborn client logs by Sanskar Modi · 3 months ago
  87. 46c9980 [CELEBORN-1056][FOLLOWUP] Support upsert and delete of dynamic configuration management by SteNicholas · 3 months ago
  88. 3d614f8 [CELEBORN-1931][FOLLOWUP] Update config version for worker local flusher gather api by Wang, Fei · 3 months ago
  89. 2a2c6e4 [CELEBORN-2024] Publish commit files fail count metrics by Sanskar Modi · 3 months ago
  90. a0a4260 [CELEBORN-1817][FOLLOWUP] Correct the problematic metrics by Shuang · 3 months ago
  91. 6f1c105 [CELEBORN-1413][FOLLOWUP] Check JAVA_HOME variables for release by Wang, Fei · 3 months ago
  92. cc13c1e [CELEBORN-2011][FOLLOWUP][INFRA] Write sorted authors for release contributors by Wang, Fei · 3 months ago
  93. cfc3f1b [CELEBORN-1319][FOLLOWUP] Support celeborn optimize skew partitions patch for Spark v3.5.6 and v4.0.0 by SteNicholas · 3 months ago
  94. 03f97e6 [CELEBORN-1577][FOLLOWUP] Improve check quota message by Xianming Lei · 3 months ago
  95. 80bdb46 [CELEBORN-1892] Adding register with master fail count metric for worker by Sanskar Modi · 3 months ago
  96. bbd3bb4 [CELEBORN-2033] updateProduceBytes should be called even if updateProduceBytes throws exception by Xianming Lei · 3 months ago
  97. edeeb4b [CELEBORN-1719][FOLLOWUP] Rename throwsFetchFailure to stageRerunEnabled by Xianming Lei · 3 months ago
  98. 68f3230 [CELEBORN-1572][FOLLOWUP] Support to show Celeborn CLI version for sub command by Wang, Fei · 3 months ago
  99. 9a689b7 [CELEBORN-2028] Setup GA for grafana dashboard by Wang, Fei · 3 months ago
  100. 919ece8 [CELEBORN-2015][FOLLOWUP] Retry IOException failures for RPC requests by Sanskar Modi · 3 months ago