Google Git Google Git
Sign in
apache/uniffle/HEAD
  1. 3b4e2bf [Improvement] Modify the style of the dashboard. (#2819) by yl09099 · 6 hours ago master
  2. 3dc257b [#2673] feat(spark)(server)(part-2): add integrity-validation stats into the server side (#2817) by Junfan Zhang · 9 days ago
  3. fccc409 [MINOR] fix: resolve CI failure caused by outdated method calls (#2820) by Junfan Zhang · 13 days ago
  4. 2137d30 [#2807] fix(spark): Propagate exceptions when overlapping decompression fails (#2816) by Junfan Zhang · 2 weeks ago
  5. 740494d [#2814] improvement(client): eliminate duplicate buffer copies during overlapping decompression (#2815) by Zhen Wang · 2 weeks ago
  6. e78d646 [#2812] fix(spark): Double memory release after shuffle write failure (#2813) by Junfan Zhang · 2 weeks ago
  7. 39f3ada [#2810] fix(client): Release destination buffers when overlapping decompression fails (#2811) by Zhen Wang · 3 weeks ago
  8. 9b374a8 [#2807] feat(spark): Prevent skipped segments from entering the overlapping decompression queue (#2808) by Junfan Zhang · 3 weeks ago
  9. 4557210 [MINOR] chore: Upgrade dornay/paths-filter to refresh ASF-allowlisted version (#2809) by Junfan Zhang · 3 weeks ago
  10. b4f5187 [#2804] feat(spark): lazily executor initialization and logs for overlapping decompression (#2805) by Junfan Zhang · 5 weeks ago
  11. 80ae6bc [#2801] feat(spark): Activate read-prefetch by default (#2803) by Junfan Zhang · 5 weeks ago
  12. c237a3d [#2774] fix(test): flaky tests for GetReaderTest (#2796) by Junfan Zhang · 5 weeks ago
  13. 5215341 [#2801] feat(spark): Activate overlapping decompression by default (#2802) by Junfan Zhang · 5 weeks ago
  14. 1969abe [#1302] feat(spark): replace all `ConfigEntry` with `ConfigOption` (#2800) by Junfan Zhang · 5 weeks ago
  15. 0d8f906 [#2798] fix(spark): remove shuffle handle info on `unregister` (#2799) by Junfan Zhang · 5 weeks ago
  16. 99a8a10 [#2749] fix(test): stabilize shuffle server assignment retry test for `ShuffleWithRssClientTest` (#2795) by Junfan Zhang · 5 weeks ago
  17. b52c51c [#2790] fix(server): Return `NO_REGISTER` when shuffle metadata is missing (#2791) by Xianyang Liu · 5 weeks ago
  18. 6f0a6a1 [#2792] fix(spark): Make Uniffle listener events deserializable by newer Jackson versions (#2793) by Zhen Wang · 5 weeks ago
  19. b9b5d6d [#2788] improvement(spark): Reduce the default Spark driver gRPC thread pool size to 64 (#2789) by Zhen Wang · 7 weeks ago
  20. 9073f3b [#2786] improvement(client): Avoid repeated cleanup scans in DecompressionWorker (#2787) by Zhen Wang · 7 weeks ago
  21. dfeeb16 [#2769] improvement(ci): clean build outputs between sequential Maven profiles (#2770) by Zhen Wang · 8 weeks ago
  22. 069ead8 chore: use Java 17 for style checks (#2782) by Zhen Wang · 8 weeks ago
  23. 3bdffc5 [#2783] fix(spark): correct compression ratio and failure counters in Spark UI (#2784) by Zhen Wang · 8 weeks ago
  24. b1ac32f [#2780] fix(client): Fix prefetch executor thread leaks (#2781) by Zhen Wang · 2 months ago
  25. a080644 fix(spark): Fix shuffle cleanup failure with RssShuffleManager on Spark 4 (#2778) by Zhen Wang · 3 months ago
  26. a5372e9 [#2775] fix(ci): download envtest binaries from controller-tools releases (#2776) by YangJie · 3 months ago
  27. d0d7749 [#2771] feat(spark): Support Spark 4.2 (#2772) by YangJie · 3 months ago
  28. ec77694 Replace fixed sleeps with Awaitility in buffer manager tests (#2773) by Zhen Wang · 3 months ago
  29. 20167ff chore(hadoop): switch to hadoop shaded client (#2767) by Zhen Wang · 3 months ago
  30. 1bbfd79 fix(spark): remove shuffle write status on unregister (#2766) by Zhen Wang · 3 months ago
  31. 392573e [#2758] fix(rpc): followup to fix the ShuffleServerOnRandomPortTest CI failure (#2765) by Junfan Zhang · 3 months ago
  32. 755e05f [#2758] fix(rpc): simplify server port fallback to improve success rate (#2759) by Junfan Zhang · 4 months ago
  33. d31ff12 [#2763] fix(spark)(gluten): use a 1.0 spill ratio for final clear to prevent potential data loss (#2764) by Zhen Wang · 4 months ago
  34. 018ac28 [#2761] fix(spark): remove unnecessary synchronized (#2762) by Zhen Wang · 4 months ago
  35. 9df64d2 [#2755] fix(ci): upgrade dorny/paths-filter to match apache allow list (#2756) by Junfan Zhang · 4 months ago
  36. 8cd7747 [#2753] fix(spark): ignore removed failed blocks (#2754) by Junfan Zhang · 4 months ago
  37. 7f08785 [#2750] feat(spark): Support Spark 4.1 (#2751) by YangJie · 5 months ago
  38. c81ef85 [#1805] feat(spark): Support Spark 4 in client-spark/extension (#2749) by YangJie · 5 months ago
  39. c18774d [#1805] feat(spark): Support Spark 4.0.2 (#2748) by YangJie · 6 months ago
  40. 6acfd53 fix(spark): Increment segmentIndex when skipping segment due to crc check failure (#2746) by Zhen Wang · 7 months ago
  41. eb69200 [#2739] feat(server): Trigger flush when there are too many blocks in shuffle buffer (#2744) by xianjingfeng · 7 months ago
  42. ae417e6 fix(spark): potential hang with skipped segments on overlapping decompression (#2745) by Junfan Zhang · 7 months ago
  43. b80940d [#2740] improvement(server) Just check block count while checking commit result (#2742) by xianjingfeng · 7 months ago
  44. b98b488 [#2738] feat(server): add metrics to track shuffle data block count and avg block size (#2741) by xianjingfeng · 7 months ago
  45. 2f0b954 [#2601][FOLLOWUP] fix(spark): Release segmentPermits before buffer getting to avoid deadlock in decompression worker (#2737) by Zhen Wang · 8 months ago
  46. 2963220 fix(spark): Correct shuffle read time metrics in spark UI tab (#2736) by Zhen Wang · 8 months ago
  47. b324cc3 [#2716] feat(spark): Introduce option of max segments decompression to control memory usage (#2735) by Junfan Zhang · 8 months ago
  48. 4637321 [#2730] improvement(common): Use built-in `CompositeFileRegion` and remove unnecessary `deallocate` method (#2731) by Zhen Wang · 8 months ago
  49. 5986591 [#2733] fix(spark): Calculate total value for `ShuffleReadTimesSummary` (#2734) by Zhen Wang · 8 months ago
  50. 9c0c27d [#2725] fix(spark)(partition-split): Add fallback under load-balance mode and fix stale assignment missing callback that caused timeout (#2729) by Junfan Zhang · 9 months ago
  51. 2731cf2 [#2724] refactor(spark): Introduce `ReassignExecutor` to simplify shuffle writer logic (#2727) by Junfan Zhang · 9 months ago
  52. bdea9e6 chore(spark): Remove logs of successful heartbeat (#2728) by Junfan Zhang · 9 months ago
  53. eb53a1a [#2725] feat(spark): Introduce optional fast-switch and ignore retry-count checking for stale assignment (#2726) by Junfan Zhang · 9 months ago
  54. 1f809ed [#2718] feat(spark): Eliminate copy in WriterBuffer when compression off for Gluten (#2720) by Junfan Zhang · 9 months ago
  55. 69b1b45 [#2714] feat(spark): Respect compression type when activating overlapping compression mechanism (#2715) by Junfan Zhang · 9 months ago
  56. 82ed9f8 [#2716] feat(client): More overlapping decompression stats to log (#2717) by Junfan Zhang · 9 months ago
  57. 4290cfe feat(doc): Update spark related performance guide in doc (#2713) by Junfan Zhang · 9 months ago
  58. 3525bab [#2711] fix(spark): Race condition on deferred compressed block initialization (#2712) by Junfan Zhang · 10 months ago
  59. f43f66f [#2707] fix(server): Catch up on any failures in `calcTopNShuffleDataSize` (#2708) by xianjingfeng · 10 months ago
  60. 2d5fc0a [#2709] fix(spark): Fix serialization error in Spark History UI (#2710) by Zhen Wang · 10 months ago
  61. 1365115 [#2705] fix(spark): Use read-write lock for `MutableShuffleHandleInfo` to avoid global locking (#2706) by Zhen Wang · 10 months ago
  62. cf29d36 [#2674] improvement(client): use ack val to check the block send result (#2703) by xianjingfeng · 10 months ago
  63. 7867d59 [#2701] fix(server): release the memory of duplicate blocks (#2702) by xianjingfeng · 10 months ago
  64. a2c2d05 [#2697] refactor(spark): Involve related writer stats info into ShuffleWriteTaskStats (#2698) by Junfan Zhang · 10 months ago
  65. 7420351 [#2686] fix(client): Prefetch should be finished once shuffle result is empty or null (#2696) by Junfan Zhang · 11 months ago
  66. c7e23b6 chore: Fix grammar in RssException message (#2695) by Mark Wadham · 11 months ago
  67. 741ecba [#2691] feat(client): Introduce the `HARD_SPLIT_FROM_SERVER` response status code (#2694) by Junfan Zhang · 11 months ago
  68. 4c2fd4e chore: Update lz4 to address CVE-2025-12183 (#2693) by advancedxy · 11 months ago
  69. 61e47b3 [#2672] fix(server): NPE in PartitionedShuffleBlockIdManager (#2690) by KCH · 11 months ago
  70. 5bbe25e [#2675] test(spark)(followup): Add tests for Roaring64NavigableMap optimization in checkSentBlockCount (#2692) by zhan7236 · 11 months ago
  71. 8cb6625 [#1603] feat(spark): Disable dataPusher initialization for Spark Driver (#2688) by zhan7236 · 11 months ago
  72. b53c535 [#2675] improvement(spark): Optimize `checkSentBlockCount` by using Roaring64NavigableMap (#2687) by zhan7236 · 11 months ago
  73. fa80c34 [#2684] fix: Infinite memory data reading due to duplicate blockId (#2685) by Junfan Zhang · 11 months ago
  74. 43bfd20 [#2679] fix(spark): Potential data mismatch on overlapping decompression (#2680) by Junfan Zhang · 11 months ago
  75. b6848f8 [#2682] feat(spark): Make shuffleWriteTaskStats visible about integrity validation for Gluten (#2683) by Junfan Zhang · 11 months ago
  76. d6df94c [#2673] feat(spark)(part-2): Merge partition stats for partition split on integrity validation (#2681) by Junfan Zhang · 11 months ago
  77. afe1b9a improvement(spark): Move the reassign info logs to DEBUG to cut down on noise (#2677) by Junfan Zhang · 11 months ago
  78. de55bd9 [#2673] feat(spark)(part-1): Add client-side support for storing partition stats on shuffle servers (#2669) by Junfan Zhang · 12 months ago
  79. b40c509 [#2665] feat(spark): Reconstruct the shuffle handle from initial spark handle it haven't bee updated (#2667) by Junfan Zhang · 12 months ago
  80. d6c5988 feat(spark): Show shuffle failures into spark UI (#2668) by Junfan Zhang · 12 months ago
  81. f736c73 [#2648] fix(spark): Incorrect fetched bytes metric when overlapping decompression is enabled (#2650) by Junfan Zhang · 12 months ago
  82. a37936f [#2652] feat(spark): Add compression for task write stats (#2666) by Junfan Zhang · 12 months ago
  83. 1f371e8 feat(spark): Make integrity validation disabled by default (#2664) by Junfan Zhang · 12 months ago
  84. 17d2b25 [#2649] feat(spark): Introduce timeout mechanism when getting the decompressing data (#2651) by Junfan Zhang · 12 months ago
  85. 6e24451 refactor: Enhance spark client logs (#2662) by Junfan Zhang · 12 months ago
  86. d9815c0 [#2652] feat(spark): Add detailed integrity validation failure analysis (#2657) by Junfan Zhang · 12 months ago
  87. bef547d [#2654] fix(spark): NPE on adding data into overlapping decompression worker (#2661) by Junfan Zhang · 12 months ago
  88. 8124152 improvement(spark): Simplify client output logs for writer/reader (#2660) by Junfan Zhang · 12 months ago
  89. 8bfe1d3 chore: fix typo in `applicationpage.js` (#2656) by Ruilei Ma · 12 months ago
  90. 6aef846 [#2652] feat(spark): Introduce partition records number check to ensure data consistency (#2653) by Junfan Zhang · 12 months ago
  91. 5671a05 fix(spark): decompression time is always 0 when overlapping decompression is enabled (#2647) by Junfan Zhang · 1 year ago
  92. 5edf952 [#2517] fix(client): IllegalReferenceCountException about ShuffleBlockInfo (#2638) by Neo Chien · 1 year ago
  93. 42c5d9f [#2644] feat(spark): Involve shuffle failure into the event logs (#2645) by Junfan Zhang · 1 year ago
  94. 11881ab [#2640] feat(spark): Involve background prefetch time in spark UI (#2641) by Junfan Zhang · 1 year ago
  95. 8952913 chore: Add the space for ComposedClientReadHandler log (#2643) by Junfan Zhang · 1 year ago
  96. 1642c4d [#2494] feat(spark): Involve background overlapping decompress time in spark UI (#2639) by Junfan Zhang · 1 year ago
  97. 4805d13 [#2636] feat(spark): Cache shuffle handle info for reader to reduce RPC cost when partition reassign is enabled (#2637) by Junfan Zhang · 1 year, 1 month ago
  98. 8729261 improvement(spark): Always reset decompression buffer with explicit position and limit (#2634) by Junfan Zhang · 1 year, 1 month ago
  99. 1d162dc [#2631] fix(server): Potential data loss due to the shuffle result report retry (#2632) by yl09099 · 1 year, 1 month ago
  100. 770eab1 [#2494] feat(spark): Add more statistics about overlapping decompression (#2633) by Junfan Zhang · 1 year, 1 month ago