Google Git
Sign in
apache / uniffle / HEAD
  1. 3ccd91f [#2614] improvement(client): Add test case for Incorrect header length for getLocalShuffleDataV3 (#2617) by Neo Chien · 22 hours ago master
  2. 6ad3aa0 [#2618] fix(spark): Invalid reassign status show in spark UI tab (#2620) by Junfan Zhang · 23 hours ago
  3. abca581 [#2622] fix(spark): Make shuffleServerInfo comparable on updatePartitionSplitAssignment (#2623) by Junfan Zhang · 4 days ago
  4. 9338529 [#2619] fix(spark): NPE in ShuffleReadTimes.merge (#2621) by Junfan Zhang · 4 days ago
  5. ad66fe9 Revert "Remove protected branch (#2615)" (#2624) by Junfan Zhang · 5 days ago
  6. 67bd7af fix: Remove incubator to correct uniffle svn url (#2625) by Junfan Zhang · 5 days ago
  7. e0a49b9 Just a minor by Junfan Zhang · 6 days ago
  8. 10aa39d Remove protected branch (#2615) by roryqi · 6 days ago
  9. 1a46e2d [#2599] fix(spark): Fix bug the incorrect shuffle read metric for spark (#2600) by Neo Chien · 7 days ago
  10. 04964f3 [#2606] feat(mr): Add safety switch for map-stage combiner (#2607) by l.zonghai · 7 days ago
  11. 7015613 [#2609] feat(spark): Expose `checkDataIfAnyFailure` method so that Gluten can invoke it to trigger reassign ASSP (#2610) by Junfan Zhang · 7 days ago
  12. 9fdde02 [#2591] fix(client): Missing task_id propagation in getLocalShuffleDataV3 (#2605) by Junfan Zhang · 12 days ago
  13. 14a5098 [#2591] fix(client): Incorrect header length for getLocalShuffleDataV3 (#2604) by Junfan Zhang · 12 days ago
  14. 96bf76c [#2591] feat(client): Introduce the mechanism to report localfile read plan (#2603) by Junfan Zhang · 14 days ago
  15. 1e48bc6 [#2601] feat(spark): Introduce overlapping decompression for shuffle read (#2602) by Junfan Zhang · 3 weeks ago
  16. 2a32171 [#2569] feat(spark): Add statistic of shuffle read times (#2598) by Junfan Zhang · 3 weeks ago
  17. d5e689c [#2592] fix(spark): Ignore failure when reporting shuffle read metrics to driver (#2593) by Junfan Zhang · 4 weeks ago
  18. 32f4ac6 [#2575] fix(spark): Fix java.lang.IndexOutOfBoundsException: len is negative (#2589) by Neo Chien · 4 weeks ago
  19. f3bc84f [#2494] feat(spark): Enable overlapping compression by default (#2588) by Junfan Zhang · 4 weeks ago
  20. fe0ff7e [#2586] fix(spark): Support writer switching servers on partition split with LOAD_BALANCE mode without reassign (#2587) by Junfan Zhang · 5 weeks ago
  21. e787d87 [#2583] fix(spark): Enable taskIds filter only on AQE and multi replicas for reader (#2584) by Junfan Zhang · 5 weeks ago
  22. 0facb7b [#2568] feat(spark): Use space-efficient protobuf for `MutableShuffleHandleInfo` to reduce RPC memory overhead (#2578) by Junfan Zhang · 5 weeks ago
  23. 9b611cf [#2527] docs: Add some docs for LAB (#2585) by xianjingfeng · 5 weeks ago
  24. 7f1586e [#2579] fix(spark): Correct partition length for overlapping compression (#2580) by Junfan Zhang · 5 weeks ago
  25. e6f0941 [#2581] fix(spark): Use `SparkContext.getActive` instead of `getOrCreate` to align with method semantics (#2582) by Zhen Wang · 6 weeks ago
  26. a1974f6 [#2576] fix: Warm up java version var to eliminate lock on creating concurrent hashmap (#2577) by Junfan Zhang · 6 weeks ago
  27. 4eb83ee [#2571] fix(client): Race condition when adding shuffle servers (#2574) by Junfan Zhang · 7 weeks ago
  28. 7414ed5 [MINOR] chore(CI): bump dorny/paths-filter from v3.0.2 to de90cc6fb38fc0963ad72b210f1f284cd68cea36 (#2570) by xianjingfeng · 7 weeks ago
  29. 41d0fc5 [#2558] improvement(server): Limit the max flush event count for a single buffer (#2562) by xianjingfeng · 7 weeks ago
  30. 99d5c3a [#2525][FOLLOWUP] fix(server): remove metric `buffer_block_size` (#2567) by xianjingfeng · 7 weeks ago
  31. 066e71e [#2563] improvement(spark): Add more logs of shuffle write on reassignment failure (#2564) by Junfan Zhang · 8 weeks ago
  32. 1713c1f [#2549] fix(spark): Invalid remote storage configuration was propagated during application registration (#2550) by Junfan Zhang · 8 weeks ago
  33. be3a1ff [#2560] improvement(client): Fast fail on hadoop reader initialization failure (#2551) by Junfan Zhang · 8 weeks ago
  34. 8fa51bb [MINOR] improvement(client): Shorten log for multi replica client reader (#2561) by Junfan Zhang · 8 weeks ago
  35. a5086b3 [#2555] feat(server): support dynamically modifying the tags of shuffle server (#2557) by xianjingfeng · 8 weeks ago
  36. 850db71 [MINOR] improvement(client): Simplify logging of heartbeat failures (#2559) by xianjingfeng · 8 weeks ago
  37. 4b256e9 [#2492][FOLLOWUP] improvement: change the default value of chunkPoolCapacityRatio (#2554) by xianjingfeng · 9 weeks ago
  38. ccc534b [#2539] fix(spark): NPE in DataPusher when sendShuffleData fails (#2556) by Yunchi Pang · 9 weeks ago
  39. 03f42c5 [#2525] improvement(server): add some metrics for LAB (#2553) by xianjingfeng · 9 weeks ago
  40. 4629fc6 [#2544] fix(client): NPE about StatisticsCodec (#2547) by SalvadorRomo · 9 weeks ago
  41. 10df07d [#2533] fix(client): NPE on rendering spark UI tab (#2552) by Zhen Wang · 9 weeks ago
  42. f57eabe [#2545] feat: Align with spark executor cores on overlapping compression (#2548) by Junfan Zhang · 9 weeks ago
  43. f1323ab [#2536] feat(spark): Controllable concurrency for overlapping compression (#2541) by Junfan Zhang · 3 months ago
  44. 262519e [#2540] feat(spark): Show compression ratio into spark UI tab (#2542) by Junfan Zhang · 3 months ago
  45. ece59ee [#2537] feat(spark): Introduce option to activate small cache in grpc server (#2538) by Junfan Zhang · 3 months ago
  46. 77e6ab1 [#2494] feat(spark): Overlapping compression to avoid block shuffle writing (#2511) by Junfan Zhang · 3 months ago
  47. f2d7d86 [#2526] improvement: Reset the chunkID if it overflow (#2531) by OmarBustamante · 3 months ago
  48. ad7babb [#2496] improvement(server): Use tryLock instead of synchronized on buffer flushing (#2524) by xianjingfeng · 3 months ago
  49. f194cc5 [#2529] fix(spark3): Incorrect clientInfo without nettyPort if netty is enabled (#2530) by Junfan Zhang · 3 months ago
  50. 80aa170 [#2494] feat(client): Introduce codec statistics to measure de/compression performance (#2528) by Junfan Zhang · 3 months ago
  51. 887d042 [#2496] improvement(server): Improve the performance of flushing single buffer (#2523) by xianjingfeng · 3 months ago
  52. 7781bf6 [#2520] fix(spark3): Shuffle write total duration is incorrectly accumulated in event log (#2521) by Junfan Zhang · 3 months ago
  53. 69b2d51 [#2503] fix(spark): Skip reassignment number check on partition split (#2504) by Junfan Zhang · 3 months ago
  54. f3eaf06 [#2518] fix(client): Disable fast fail on any pushing failure if partition reassign is activated (#2519) by Junfan Zhang · 3 months ago
  55. ed26840 [#2508] feat(spark3): Record failed tasks on any shuffle write/failure into event logs (#2509) by Junfan Zhang · 3 months ago
  56. 5a45daa [#2502] feat(spark3): Fast fail for those stale assign blocks for partition reassign (#2516) by Junfan Zhang · 3 months ago
  57. 786ed48 [#2514] fix(spark3): Invalid decimal value conversion on spark UI rendering (#2515) by Junfan Zhang · 3 months ago
  58. 907e625 [#2512] feat(spark3): Attach stacktrace on any exception when UI tab rendering (#2513) by Junfan Zhang · 3 months ago
  59. a69930d [#2506] feat(spark3): Introduce option to enable reorder multi servers for reader (#2507) by Junfan Zhang · 3 months ago
  60. 3407a0a [#2460] fix(spark3): Record require buffer failure number every time (#2505) by Junfan Zhang · 3 months ago
  61. 22be628 [#2460] feat(spark3): Add reassign info into UI tab (#2501) by Junfan Zhang · 3 months ago
  62. 575eee0 [#2460] feat(spark3): Add client/uniffle different observed shuffle speed (#2500) by Junfan Zhang · 3 months ago
  63. 6356e42 feat(client): Log show the bytes length for each data RPC by Junfan Zhang · 3 months ago
  64. 6c636ac [#2460] feat(spark3): Add fine-grained shuffle write times with different parts (#2498) by Junfan Zhang · 3 months ago
  65. c83a1b5 [#1727] feat(server): Introduce local allocation buffer to store blocks in memory (#2492) by xianjingfeng · 3 months ago
  66. b3855e2 [#2495] feat(server): Add an option to disable flush buffer when caching data (#2497) by xianjingfeng · 3 months ago
  67. b45e986 [#2490] feat(spark): Display memory usage of all consumers under low-memory conditions (#2491) by Junfan Zhang · 4 months ago
  68. b7faef8 [#2487] fix(spark3): Fix NPE in UniffleListener (#2488) by Zhen Wang · 4 months ago
  69. bbdf71e [#2485] fix(Client): NPE in `CoordinatorGrpcRetryableClient.getShuffleAssignments` (#2486) by Zhen Wang · 4 months ago
  70. abb6bd5 [#2483] fix(spark): Avoid `NoSuchElementException` error in data pusher (#2484) by Zhen Wang · 4 months ago
  71. 07cc9ae [#2460] feat(spark3): Tracking failure of pushing data for spark UI (#2481) by Junfan Zhang · 4 months ago
  72. 855cec1 [MINOR] improvement(remote merge): print log when merge failed (#2479) by xianjingfeng · 5 months ago
  73. cc440df [#2469] feat(spark): Introducing a dedicated shuffleId of uniffle for stage retry (#2471) by yl09099 · 5 months ago
  74. 293d01b [#1745][FOLLOWUP] fix(client): exclude kryo when package spark shaded client (#2478) by xianjingfeng · 5 months ago
  75. 917e45e [#2369] fix(spark): Potential race condition on reading prefetch (#2475) by Junfan Zhang · 5 months ago
  76. 057dcd2 [#2460] feat(spark)(part-4): Hybrid storage reading statistics (#2468) by Junfan Zhang · 5 months ago
  77. 95dccbd [#2454] improvement(server): Remove lock in ShuffleTaskManager#registerShuffle (#2456) by xianjingfeng · 5 months ago
  78. 3beec2b [#2460] feat(spark)(part-3): Add support of read metrics report (#2465) by Junfan Zhang · 5 months ago
  79. 4d92020 [#2466] fix(server): Ignore appIdToInfos when serialize ServerNode (#2467) by xianjingfeng · 5 months ago
  80. aa85e3f improvement(docker): Add dashboard to docker (#2463) by Andras Salamon · 5 months ago
  81. 3e681e3 [#2460] feat(spark)(part-2): Add support of history server plugin (#2464) by Junfan Zhang · 5 months ago
  82. 4e3dfbc [#2460] feat(spark)(part-1): Introducing spark uniffle ui for better observability (#2459) by Junfan Zhang · 5 months ago
  83. 4064da2 [Improvement] Clear the alarm log when starting the relevant service (#2453) by yl09099 · 5 months ago
  84. 21e1753 [MINOR] fix(docs): Fixing rss-env.sh directory (#2462) by Andras Salamon · 5 months ago
  85. 7a9e7cf [#2457] feat(spark): Introducing shuffle-server data push statistics (#2458) by Junfan Zhang · 5 months ago
  86. 9c01bff [MINOR] fix(docs): Fixing formatting error (#2452) by Andras Salamon · 5 months ago
  87. f27570e Fix: Use correct Field object for InputDescriptor className (#2445) by Jiale Qi · 5 months ago
  88. 6c00c79 [MINOR] fix(docker): Fix hadoop version (#2447) by Andras Salamon · 5 months ago
  89. da71d06 fix(CI): Update CI ubuntu version to latest (#2448) by Junfan Zhang · 5 months ago
  90. b43872f [#2441] improvement(client): remove synchronized in ShuffleServerClientFactory#getShuffleServerClient (#2442) by xianjingfeng · 5 months ago
  91. eedbc59 [#2428] fix(test): Fix flaky test for LocalStorageManagerTest#testGetLocalStorageInfo (#2430) by Guoyuan · 5 months ago
  92. f732fc2 [#493][FOLLOWUP] improvement: replace putIfAbsent to avoid performance loss (#2444) by xianjingfeng · 5 months ago
  93. 6843c06 fix(spark3): Reserve previous writer initialization way for gluten + uniffle (#2437) by Junfan Zhang · 5 months ago
  94. 07eb8d5 [#2439] fix(test): remove shuffleServer from coordinators when it stops (#2440) by xianjingfeng · 6 months ago
  95. 9d43c1e [MINOR] fix(docs): Correct storage type in MR / TEZ documentation. (#2438) by Andras Salamon · 6 months ago
  96. 890758b fix(test): Fix test about default storage type for DefaultStorageMediaProviderTest (#2419) by Andras Salamon · 6 months ago
  97. 9007bed [#1651] fix(netty): Set Netty as the default client type (#2422) by Andras Salamon · 6 months ago
  98. 6555280 [#2082] fix: spark executor task error when reading shuffle data when using java open jdk11 (#2436) by roryqi · 6 months ago
  99. 32187f8 [#2426] improvement: Skip the application which is expired when flushing buffers (#2427) by xianjingfeng · 6 months ago
  100. fe447f2 [MINOR] improvement: Fix logger classname in RssMergeManager (#2435) by Andras Salamon · 6 months ago