Google Git
Sign in
apache / incubator-uniffle / HEAD
  1. 8e26a34 [MINOR] docs: modify the default value of `rss.coordinator.select.partition.strategy` in docs (#1692) by xianjingfeng · 27 hours ago master
  2. 313d4e0 [#1538] feat(spark): report blockIds to spark driver optionally (#1677) by Junfan Zhang · 30 hours ago
  3. 7b63177 [#1686] feat(netty): Support pending tasks number metrics for Netty EventLoopGroup (#1687) by RickyMa · 32 hours ago
  4. 8e66ef4 [#1680] improvement(server): Remove partial HDFS files that written by server self for expired apps (#1681) by xianjingfeng · 33 hours ago
  5. 40bd14b [#1684] fix(server): use the diskSize obtained from periodic check to determine whether is writable (#1685) by xianjingfeng · 33 hours ago
  6. ae72831 [#1678] fix(server): disk size leak on removing resources by AppPurgeEvent (#1679) by Junfan Zhang · 2 days ago
  7. 30bf8dc [#1608][part-5] feat(spark3): always use the available assignment (#1652) by Junfan Zhang · 3 days ago
  8. 43bd09c [#1682] feat(server): Introduce localfile isWritable metric (#1683) by Junfan Zhang · 4 days ago
  9. 917456c [#1675] fix(test): Fix tests which may be flaky on different machines (#1676) by RickyMa · 4 days ago
  10. a1e0d56 [#1543] improvement(spark): Speed up reading when both sort and combine are used. (#1640) by QI Jiale · 4 days ago
  11. 6d19327 [#1657] build: Add license information after version 0.9.0 (#1671) by roryqi · 6 days ago
  12. 65ccce5 [MINOR] chore(rust): disable flaky test of local_store_test (#1674) by Junfan Zhang · 6 days ago
  13. 89d2f1c [#1585] feat(server): Support app-level block size statistics to report metrics (#1593) by leslizhang · 12 days ago
  14. 636d0be [#1341] fix(mr): Fix MR Combiner ArrayIndexOutOfBoundsException Bug. (#1666) by QI Jiale · 12 days ago
  15. 6f6d35a [#378][FOLLOWUP] fix(server): Fix huge_partition_num metric (#1669) by RickyMa · 2 weeks ago
  16. 1516a53 [#1664] improvement(docs): Update the descriptions and default values of outdated conf (#1665) by RickyMa · 2 weeks ago
  17. 3bc0ee5 [#1662] fix(test): Fix Netty related flaky tests (#1663) by RickyMa · 2 weeks ago
  18. 45ad0b8 [#1607][FOLLOWUP] docs(benchmark): Show link in README (#1661) by RickyMa · 3 weeks ago
  19. d9c75c2 [#1655] Bump version to 0.10.0-SNAPSHOT (#1656) by Enrico Minack · 3 weeks ago
  20. 5ab625b [#1607] docs(benchmark): Performance report with partial TPC-DS(SF=40000) queries (#1650) by RickyMa · 4 weeks ago
  21. 60fce8e [#1608][part-3] feat(spark3): support reading data from multiple reassigned servers (#1615) by Junfan Zhang · 4 weeks ago
  22. b4c92b8 [#1629] fix(operator): Support parsing NaN float value in metrics (#1630) by zhengchenyu · 4 weeks ago
  23. 91191e6 [#1087] feat(spark)(gluten): Support dynamic allocation for Gluten Uniffle (#1649) by summaryzb · 4 weeks ago
  24. b39ff24 [MINOR] Remove meaningless string concatenation, use slf4j (#1647) by RickyMa · 4 weeks ago
  25. ba81c29 [#1645] feat(server): Add gauge metrics for reading localfile data (#1646) by RickyMa · 4 weeks ago
  26. 222f5d4 [#1459][FOLLOWUP] fix(server): Fix the issue of log variable printing (#1648) by RickyMa · 4 weeks ago
  27. 6ea4300 [#1634] fix(server): remove app folder if app is expired (#1635) by Junfan Zhang · 4 weeks ago
  28. 07d8cb5 [MINOR] chore(rust): disable flaky test of test_ticket_manager (#1637) by Junfan Zhang · 4 weeks ago
  29. 5ad9f48 [#1459][FOLLOWUP] improvement(server): Print an error log when an event is dropped (#1643) by RickyMa · 4 weeks ago
  30. a238a73 [#1596][FOLLOWUP] fix(netty): Send failed responses only when the channel is writable (#1641) by RickyMa · 4 weeks ago
  31. ed39955 build(deps): bump h2 from 0.3.21 to 0.3.26 in /rust/experimental/server (#1625) by dependabot[bot] · 5 weeks ago
  32. a7a0b4c [#1626] fix(server): Remove the meaningless eventOfUnderStorageManagers cache (#1627) by RickyMa · 5 weeks ago
  33. 1431c8a [#1631] fix(server): ShuffleTaskInfo may leak when app is removed. (#1632) by zhengchenyu · 5 weeks ago
  34. 3ea3aaa [#1373][FOLLOWUP] fix(spark): register with incorrect partitionRanges after reassign (#1612) by dingshun3016 · 5 weeks ago
  35. 80caa0e [#1608][part-2] fix(spark): avoid releasing block in advance when enable block resend (#1610) by Junfan Zhang · 5 weeks ago
  36. f9d71da [#1606] feat(client): Add client retry mechanism for NO_BUFFER when reading data(memory/local/index) (#1616) by RickyMa · 5 weeks ago
  37. 1051d26 [#1608][part-1] fix(spark): Only share the replacement servers for faulty servers in one stage (#1609) by Junfan Zhang · 6 weeks ago
  38. 05ff6db [#1373][FOLLOWUP] fix(spark): shuffle manager rpc service invalid when partition data reassign is enabled (#1583) by dingshun3016 · 6 weeks ago
  39. cbf4f6f [#1596] fix(netty): Use a ChannelFutureListener callback mechanism to release readMemory (#1605) by RickyMa · 6 weeks ago
  40. 3a1b4d2 [#1598] fix(server) Fix inaccurate used_direct_memory_size metric (#1599) by RickyMa · 7 weeks ago
  41. 220d9cb [#1472][FOLLOWUP] improvement(server): Release memory more accurately when failing to cache shuffle data (#1597) by RickyMa · 7 weeks ago
  42. 32d533d [MINOR] refactor: Calling lock() method outside try block to avoid unnecessary errors (#1590) by RickyMa · 7 weeks ago
  43. dd67774 [#1591] feat(spark): Support Spark 3.5.1 (#1592) by QI Jiale · 8 weeks ago
  44. 403a7a9 [#1586] improvement(netty): Allow Netty Worker thread pool size to dynamically adapt to the number of processor cores (#1587) by RickyMa · 8 weeks ago
  45. f3775a1 [#1588] improvement(server): Add exception handling for the thread pool when flushing events (#1589) by RickyMa · 8 weeks ago
  46. d12d6f2 [#1576] feat(doc): server deploy guide without hadoop-home env (#1577) by Junfan Zhang · 8 weeks ago
  47. d851b2e [#1571] fix(server): Memory may leak when `EventInvalidException` occurs (#1574) by leslizhang · 8 weeks ago
  48. c3c0c37 [#1373][FOLLOWUP] fix(spark): incorrect partition id type (#1582) by dingshun3016 · 8 weeks ago
  49. 0b66472 [#1373][FOLLOWUP] fix(spark3):Add client type when request shuffle assignment (#1580) by dingshun3016 · 8 weeks ago
  50. f6569b0 build(deps): bump google.golang.org/protobuf from 1.28.0 to 1.33.0 (#1575) by dependabot[bot] · 8 weeks ago
  51. de50442 [#1554] feat(spark): Fetch dynamic client conf as early as possible (#1557) by Enrico Minack · 8 weeks ago
  52. b2baef5 [#1572] fix(spark): Exceptions might be discarded when spilling buffers (#1573) by RickyMa · 8 weeks ago
  53. 9737d57 [#1564] fix(server): disk health check invalid when hang (#1568) by Junfan Zhang · 9 weeks ago
  54. 142e3ff [#731][FOLLOWUP] feat(Spark): Configure blockIdLayout for Spark based on max partitions (#1566) by Enrico Minack · 9 weeks ago
  55. 51b8581 [#1567] fix(spark): Let Spark use its own NettyUtils (#1565) by RickyMa · 9 weeks ago
  56. cf6d2bf [#1569] fix(rust): flaky test for test_ticket_manager (#1570) by Junfan Zhang · 9 weeks ago
  57. d994b27 [MINOR] improvement(test): A better computation logic for WriteAndReadMetricsTest without using reflection (#1563) by RickyMa · 9 weeks ago
  58. dc890ff [#731] feat(spark): Make blockid layout configurable for Spark clients (#1528) by Enrico Minack · 9 weeks ago
  59. ec4251d [#808] improvement(spark): Verify the number of written records to ensure data correctness (#1558) by RickyMa · 9 weeks ago
  60. b36d461 [MINOR] improvement(client): Override getClientInfo method in ShuffleServerGrpcNettyClient and remove unused getDesc method (#1559) by RickyMa · 9 weeks ago
  61. d8aedf3 [#1552] improvement: Migrate from log4j1 to log4j2 (#1553) by RickyMa · 10 weeks ago
  62. 9f4ccde [#1472][part-6] followup: Fix Netty transport time when sending shuffle data requests (#1551) by RickyMa · 2 months ago
  63. 37ec78b [#134][FOLLOWUP] improvement(spark2): Use taskId and attemptNo as taskAttemptId (#1544) by Enrico Minack · 2 months ago
  64. d4c0fc5 [#1549] fix(common): Uniformly throw RssException for external callers (#1550) by RickyMa · 2 months ago
  65. 12f9271 [MINOR] test: Use sensible partition ids in ShuffleReadClientImplTest (#1545) by Enrico Minack · 2 months ago
  66. 045d9ae [#1546] fix(spark): NPE could happen before uncompressing after #1360 (#1547) by RickyMa · 2 months ago
  67. a73dcb9 feat(docker): Add example docker compose Uniffle/Spark cluster (#1532) by Enrico Minack · 3 months ago
  68. 2c3761b [#1472][part-6] fix(netty): Make UTs truly test Netty mode (#1540) by RickyMa · 3 months ago
  69. 903113b [MINOR] improvement(tez): Only invoking LOG.debug when LOG.isDebugEnabled is true (#1541) by RickyMa · 3 months ago
  70. e043479 [#1459] fix(server): Memory leak for exceptional scenarios when flushing events (#1537) by RickyMa · 3 months ago
  71. a549028 [#1472] fix(client): IlegalReferenceCountException for clientReadHandler.readShuffleData (#1536) by RickyMa · 3 months ago
  72. 9142516 [#1472][part-5] Use UnpooledByteBufAllocator to fix inaccurate usedMemory issue causing OOM (#1534) by RickyMa · 3 months ago
  73. 1258407 [MINOR] refactor(common): Move blockId bit logic into common class (#1527) by Enrico Minack · 3 months ago
  74. 59aa30d [#1373][part-1] feat(spark): partition write to multi servers leveraging from reassignment mechanism (#1445) by xumanbu · 3 months ago
  75. ff555c5 [MINOR] Update dashboard pom.xml to take arguments for node and npm download locations (#1530) by Connor Wilkes · 3 months ago
  76. 31cc707 [#1316] improvement(spark): detect OutputTracker API version via Spark version (#1317) by Enrico Minack · 3 months ago
  77. 44eb4e5 [#134] improvement(spark3): Use taskId and attemptNo as taskAttemptId (#1529) by Enrico Minack · 3 months ago
  78. b924aca [MINOR] feat(build): Allow to build distribution without some modules (#1525) by Enrico Minack · 3 months ago
  79. d120f4b [#1407] fix(rust): use grpc runtime worker threads and adjust default runtime config (#1517) by Junfan Zhang · 3 months ago
  80. 9291a27 [#1407] feat(rust): fix + add total grpc request metrics (#1516) by Junfan Zhang · 3 months ago
  81. 197e4f6 [#1407] chore(rust): add cpu profile doc (#1515) by Junfan Zhang · 3 months ago
  82. 7fbe7c9 [#1472][part-2] fix(server): Reuse ByteBuf when decoding shuffle blocks instead of reallocating it (#1521) by RickyMa · 3 months ago
  83. 62f9a3a [MINOR] fix(CI): Improve dashboard across the CI (#1526) by Enrico Minack · 3 months ago
  84. bc60c12 [#1472][part-3] fix(client): Fix occasional IllegalReferenceCountException issues in extremely rare scenarios (#1522) by RickyMa · 3 months ago
  85. 3954ce7 [MINOR] fix(pom): Add missing shuffle-server dependencies to work with -Ptez by Enrico Minack · 3 months ago
  86. 72d85a7 [#1472][part-4] feature(server): Add metrics for Netty's pinnedDirectMemory and usedDirectMemory (#1524) by RickyMa · 3 months ago
  87. d87dc90 [#1472][part-1] fix(server): Upgrade Netty and GRPC (#1520) by RickyMa · 3 months ago
  88. 866f5ff [MINOR] fix(deploy): Fix invocation of kubernetes bash scripts (#1513) by Enrico Minack · 3 months ago
  89. f6d1e7a [#1476] feat(rust): Provide dedicated unregister app rpc interface (#1511) by Junfan Zhang · 3 months ago
  90. 9471cba [#1476] feat(spark): Provide dedicated unregister app rpc interface (#1510) by Yiqi You · 3 months ago
  91. 2be8215 [MINOR] improvement(CI): Rework build and rust workflow events (#1508) by Enrico Minack · 3 months ago
  92. 3c196eb [#1407] fix(rust): drop events and release memory when errors happened (#1509) by Junfan Zhang · 3 months ago
  93. cc5a038 [#1267][FOLLOWUP] improvement(client): INFO log level should be used in RetryUtils (#1500) by RickyMa · 3 months ago
  94. 4dacb1e [MINOR] feat(CI): Report test results in github comments (#1506) by Enrico Minack · 3 months ago
  95. aca0203 [#1407] fix(rust): return error when getting data from hdfs by client (#1507) by Junfan Zhang · 3 months ago
  96. 576a925 [#1501] fix(server): storage selection cache accidentally deleted when clearing stage level data. (#1505) by dingshun3016 · 3 months ago
  97. 18fa146 [#1407] fix(rust): dont panic when no available local disks (#1504) by Junfan Zhang · 3 months ago
  98. acb2f3f fix(rust): avoid checking storage type in runtime (#1503) by Junfan Zhang · 3 months ago
  99. e3b4618 [MINOR] build: Move dashboard module into profile and disable it by default (#1498) by Enrico Minack · 3 months ago
  100. 464553e [#1497] improvement(spark): flushing buffer if the memoryUsed of the first record of `WriterBuffer` larger than bufferSize (#1485) by xianjingfeng · 3 months ago