Google Git Google Git
Sign in
apache/spark/HEAD
  1. 098b064 [SPARK-61280][PYTHON][TEST] Start the in-process UDF probe JVMs with Spark's module options by Max Gekk · 5 hours ago master
  2. 49620b9 [SPARK-61159][INFRA] Reduce and stagger scheduled workflow runs by Ruifeng Zheng · 6 hours ago
  3. 341c2ad [SPARK-60879][INFRA] Speed up build status update workflow by Nicholas Chammas · 7 hours ago
  4. 749cf78 [SPARK-59243][SQL] Splice nested JSON constructors through routed/qualified calls by Ganesha S · 7 hours ago
  5. 3644a7b [SPARK-61032][SQL] Do not push TopN to MySQL when ONLY_FULL_GROUP_BY rejects its sort keys by aleksandar-trajkovic-db · 7 hours ago
  6. a8bae20 [SPARK-61331][INFRA] Read every page of the GitHub list responses in merge_spark_pr.py by Hyukjin Kwon · 8 hours ago
  7. 8754d79 [SPARK-60382][SQL] CoalesceBucketsInJoin should see only the streamed side of a broadcast join by Yuming Wang · 10 hours ago
  8. fea3ac7 [SPARK-61232][SQL] UnionExec whole-stage codegen fails when a child output repeats an ExprId by Xiduo You · 10 hours ago
  9. d3df7c9 [MINOR][BUILD] Quote checksum file path in build/mvn to support directories with spaces by Narendra Singh · 10 hours ago
  10. e540d56 [SPARK-61277][SQL] Avoid quadratic allocations in `ColumnPruning` when pruning the children of a `Union` by Dongjoon Hyun · 12 hours ago
  11. dbea6d2 [SPARK-60743][SQL] Fix make_timestamp silently wrapping an out-of-range seconds value by Max Gekk · 13 hours ago
  12. cb6cf5b [SPARK-61256][SQL] Fix wrong results by stale partitioning and ordering when a checkpointed Dataset is joined with its source by Dongjoon Hyun · 13 hours ago
  13. f90fdcb [SPARK-58776][K8S] Propagate spark.ssl.rpc.* passwords to executors by Florian Müller · 14 hours ago
  14. 06a62a3 [SPARK-61295][SQL] Fix a performance regression in `RelationalGroupedDataset` when aggregating many columns of a wide DataFrame by Dongjoon Hyun · 16 hours ago
  15. bb0d4b7 [SPARK-60926][SS] Push the filters of streaming queries down to the scans of Data Source V2 streaming sources by Hyukjin Kwon · 16 hours ago
  16. b955b7d [SPARK-61247][SQL] Fix ASOF join results for a NOT NULL left ON key and a nullable right ON key by Luka Zdravić · 16 hours ago
  17. 71e0de6 [SPARK-61248][SQL] Close the spill readers of the sort-merge ASOF join's buffered scan by Luka Zdravić · 17 hours ago
  18. 3317f95 [SPARK-61281][SQL][TEST] Add large union and cube cases to `WideSchemaBenchmark` by Dongjoon Hyun · 17 hours ago
  19. 59ca65d [SPARK-61257][SQL] Align the growing on-heap pages of hash join maps with heap regions by Dongjoon Hyun · 17 hours ago
  20. 1f563ab [SPARK-61254][SQL] Fix wrong results by stale LogicalRDD constraints in checkpoints and recursive CTEs by Dongjoon Hyun · 18 hours ago
  21. 77dd98b [SPARK-60160][PS][TEST] Improve test coverage of complex_ops in pandas API by Zhen-Lun (Kevin) Hong · 18 hours ago
  22. 29816da [SPARK-60162][PYTHON] Correct DataFrame debugging configuration type narrowing by Matthew M.M · 18 hours ago
  23. 0ec7b70 [SPARK-60599][PYTHON] Avoid materializing per-row argument tuples when evaluating Arrow-optimized Python UDFs by Tian Gao · 18 hours ago
  24. 5886a02 [SPARK-60270][CONNECT] Preserve streaming source names for table reads by Eric Marnadi · 19 hours ago
  25. 3bbf07f [SPARK-58982][PYTHON] Remove unused _is_namedtuple_ attribute in serializers by Yicong Huang · 19 hours ago
  26. 8aac2b7 [SPARK-61175][SQL] Make rint return a canonical NaN regardless of the JIT tier by Max Gekk · 20 hours ago
  27. e46c694 [SPARK-61200][SQL] Push the domains of filtered columns down to native data sources by Hyukjin Kwon · 21 hours ago
  28. a2f49fa [SPARK-58975][CORE] Add failure messages to MemoryPool require checks by Uros · 24 hours ago
  29. 5f62e55 [SPARK-61131][SQL] Fix wrong results of decimal `div` in ANSI mode when the quotient overflows `BIGINT` by Dongjoon Hyun · 25 hours ago
  30. 4686647 [SPARK-59779][DOC] Document the whole-stage codegen method limit by Deepak Jain (DJ) · 30 hours ago
  31. f6b469a [SPARK-45438][SQL] Negate a decimal exactly so -x and abs(x) keep all 38 digits by Max Gekk · 30 hours ago
  32. ed83bbf [SPARK-60746][SQL] Raise `INTERVAL_ARITHMETIC_OVERFLOW` for an overflowing interval division in every evaluation mode by Max Gekk · 34 hours ago
  33. 76ddf55 [SPARK-59756][CORE] Make Utils.chmod700 atomic on POSIX FS by Holden Karau · 2 days ago
  34. 224eb32 [SPARK-60882][SQL] Accept more expressions that can not fail in ExprUtils.canEvaluateUnconditionally by Kousuke Saruta · 2 days ago
  35. 4a4e21f [SPARK-60814][INFRA] Determine revert vs reapply by wrapper parity in merge_spark_pr.py by Kousuke Saruta · 2 days ago
  36. fceb157 [SPARK-61114][INFRA] Run the full matrix in sampled post-merge CI by Ruifeng Zheng · 3 days ago
  37. 2af0404 [SPARK-61088][SQL] Fix wrong results by stale partitioning and constraints when a checkpointed Dataset is self-joined by Dongjoon Hyun · 3 days ago
  38. 874fd21 [SPARK-61082][SQL] Fix UnsafeHashedRelation build failure when many small relations are alive in one task by Dongjoon Hyun · 3 days ago
  39. 84db3ed [SPARK-60702][SQL][FOLLOWUP] Expect no bloom filter from a non-deterministic creation side without DPP by Peter Toth · 3 days ago
  40. 00ce94f [SPARK-61050][SQL] Fix `ArithmeticException` of decimal remainder, `pmod` and `div` when the integral quotient has more than 39 digits by Dongjoon Hyun · 3 days ago
  41. da165c1 [SPARK-60702][SQL] Don't skip a runtime bloom filter for a DPP filter that physical planning drops by Peter Toth · 3 days ago
  42. dad84ea [SPARK-60608][ML][CONNECT][TEST][FOLLOWUP] Strengthen nested model allowlist regression coverage by Ruifeng Zheng · 3 days ago
  43. fce8967 [SPARK-61017][ML][PYTHON] Support configurable intermediate storage levels in iterative classifiers by Ruifeng Zheng · 3 days ago
  44. c8f07d4 [SPARK-61076][ML][PYTHON] Accept intermediate storage level keyword arguments in PySpark KMeans by Ruifeng Zheng · 3 days ago
  45. f6165dd [SPARK-61016][INFRA] Move post-merge CI sampling into the merge script by Ruifeng Zheng · 3 days ago
  46. b06b99c [SPARK-61078][SQL] Skip the throwaway allocations in `LongToUnsafeRowMap`'s deserialization constructor by Dongjoon Hyun · 3 days ago
  47. 3c58e92 [SPARK-61033][SQL] Fix query errors by ConstantPropagation when a rewritten operand of AND, OR, COALESCE or IN guards an expression that can fail by Dongjoon Hyun · 3 days ago
  48. a11fd25 [SPARK-60734][SS] Prune the columns that the scans of Data Source V2 streaming sources read by Hyukjin Kwon · 4 days ago
  49. 1d3149f [MINOR][PYTHON] Reject empty memory strings with ValueError by Aditya Vaish · 4 days ago
  50. ef3f5a3 [SPARK-61051][SQL] Fix LongHashedRelation build failure when the dense key array does not fit in execution memory by Dongjoon Hyun · 4 days ago
  51. 0d4e240 [SPARK-60998][SQL] Do not round LongToUnsafeRowMap pages up to the page size by Liang-Chi Hsieh · 4 days ago
  52. 23bf4c4 [SPARK-60983][SQL] Fix query errors by ConstantPropagation when a constant is substituted into an expression that can fail by Dongjoon Hyun · 4 days ago
  53. 3a6d5ee [SPARK-60985][SQL] Fix query failures when a filter inferred from data constraints can fail by Dongjoon Hyun · 4 days ago
  54. 56e63a4 [SPARK-60621][SQL] Add ANALYZE mode to parse_sql by Serge Rielau · 4 days ago
  55. 678c475 [SPARK-60808][SQL] Fix lost join rows when a runtime bloom filter's creation side is non-deterministic by Peter Toth · 4 days ago
  56. b2fc1be [SPARK-60996][BUILD] Upgrade Netty to 4.2.20.Final by Dongjoon Hyun · 4 days ago
  57. 6f91235 [SPARK-60992][CORE] Fix marking a succeeded task as failed when a post-status-update listener fails by Dongjoon Hyun · 4 days ago
  58. 498b36d [SPARK-60941][SQL] Move JoinSelection's choice for non-equi joins into JoinSelectionHelper by Prashanth Menon · 4 days ago
  59. a1dc1d3 [SPARK-60979][SQL] Fix wrong results by nested schema pruning when column names differ only by case by Dongjoon Hyun · 4 days ago
  60. 352ac9b [SPARK-59970][SQL] Reject a temporary variable read through an IDENTIFIER clause in a persistent SQL function by Anshul Baliga · 4 days ago
  61. 279946b [SPARK-60859][SQL] Show KeyedPartitioning partition keys in plan strings by Xiduo You · 4 days ago
  62. 8717a3d [SPARK-60741][SQL] Keep the build side's keyed partitioning in the DPP subquery by Xiduo You · 4 days ago
  63. 0042c2b [SPARK-60980][SQL] Fix query failures by `CombineFilters` when a condition that can fail follows a non-deterministic or throwable one by Dongjoon Hyun · 4 days ago
  64. f646a6e [SPARK-60978][SQL] Fix wrong results by DSv2 DELETE, UPDATE and MERGE when column names differ only by case by Dongjoon Hyun · 4 days ago
  65. f610c51 [SPARK-60987][INFRA] Fix `NoClassDefFoundError` when running Kafka benchmarks in the benchmark workflow by Dongjoon Hyun · 4 days ago
  66. 7af0d94 [SPARK-60984][CORE][TEST] Fix `HighlyCompressedMapStatusBenchmark` failure when `mockito` is not on the classpath by Dongjoon Hyun · 4 days ago
  67. 0bb7ac6 [SPARK-60970][SQL] Use `Cast.canUpCast` for the nullability of `try_cast` from decimal to integral types by Dongjoon Hyun · 5 days ago
  68. 9a33153 [SPARK-60973][SQL] Remove unused `VariableAssignmentUtils` from `sql/core` by Dongjoon Hyun · 5 days ago
  69. 08914dd [SPARK-60975][SQL] Remove unused `PythonSQLUtils.addJarToCurrentClassLoader` by Dongjoon Hyun · 5 days ago
  70. 1c2f4a4 [SPARK-60969][SQL] Keep pulling up correlated equalities on a cast from a scale-0 decimal to an integral type by Dongjoon Hyun · 5 days ago
  71. e657651 [SPARK-59614][SQL] Compile the sort-merge ASOF join conditions and drop the output row copy by Luka Zdravić · 5 days ago
  72. f7e0832 [SPARK-60932][INFRA][TEST] Fix npm vulnerabilities in dev and ui-test by YangJie · 5 days ago
  73. df06f97 [SPARK-60924][INFRA] Use GraphQL to count commits for post-merge CI sampling by Ruifeng Zheng · 5 days ago
  74. 241dd22 [SPARK-60943][SQL] Fix wrong results when a cast from `DECIMAL(19, 0)` to `BIGINT` overflows by Dongjoon Hyun · 5 days ago
  75. 8faf7fd [SPARK-60194][PYTHON] Improve type annotation for StreamingQueryListener sessions by Tim Hsiung · 5 days ago
  76. 4e530b4 [SPARK-60183][PYTHON] Improve type annotation for pandas-on-Spark datetime callbacks by Tim Hsiung · 5 days ago
  77. 7080556 [SPARK-60604][PYTHON] Add sampling profiler for Python UDFs by Tian Gao · 5 days ago
  78. 6bb3918 [SPARK-60939][DOC] Fix stale Java 17 comments now that Java 21 is the minimum by Dongjoon Hyun · 5 days ago
  79. 278f961 [SPARK-60936][INFRA][TEST] Use JDK 21 in CI test images and docs container helper by Dongjoon Hyun · 5 days ago
  80. 3aa4fe9 [SPARK-60744][SQL] Read the right side once with a cursor in the sort-merge ASOF join by Luka Zdravić · 5 days ago
  81. e05ead5 [SPARK-60937][INFRA] Use Java 21 in Binder Dockerfile by Dongjoon Hyun · 5 days ago
  82. 2284fb3 [SPARK-60176][ML] Replace remote identifier type ignores with assertions by Tim Hsiung · 5 days ago
  83. 076d39b [SPARK-60174][PYTHON][TEST] Remove type: ignore[union-attr] in pyspark.sql.worker.utils by Anna · 5 days ago
  84. 39652d8 [SPARK-60525][SQL] Wrap RelationChanges directly in NamedStreamingRelation for streaming CHANGES queries by AnishMahto · 5 days ago
  85. 3fc46b03 [SPARK-60935][SQL] Remove unused `Shim.getAllPartitions` from `HiveShim` by Dongjoon Hyun · 5 days ago
  86. 11c1407 [SPARK-60170][PYTHON][TEST] Cover GC state restoration in disable_gc by Tim Hsiung · 5 days ago
  87. f45fbe9 [SPARK-60171][PYTHON] Declare validator parameter dependency in Connect persistence by Tim Hsiung · 5 days ago
  88. b45e730 [SPARK-60938][CORE] Remove unused isJavaVersionAtLeast21 by Dongjoon Hyun · 5 days ago
  89. 0e6bae7 [SPARK-60855][CORE] Remove the Spark JAR from the Python worker PYTHONPATH by Tian Gao · 5 days ago
  90. a11d7fc [SPARK-60905][SS] Fix streaming query restarts from checkpoints before Spark 4.4 when a filter uses a Python UDF by Dongjoon Hyun · 5 days ago
  91. 8283f29 [SPARK-60713][SQL] Report the actual size limit in `VARIANT_CONSTRUCTOR_SIZE_LIMIT` by bajka · 5 days ago
  92. 5235794 [SPARK-60711][SQL] `is_valid_variant` does not validate the final offset of objects and arrays by bajka · 5 days ago
  93. 4b7c3d5 [SPARK-60880][SQL] Extract shared CREATE TABLE analysis helpers by Vladan Vasić · 5 days ago
  94. 81a93ab [SPARK-60656][PS] Fix NumPy maximum/minimum NaN propagation by FNU Aditya Ranjan · 5 days ago
  95. 5ca2b2d [SPARK-60506][ML][DOC] Remove the false promise that deprecated StringIndexerModel.labels will be removed in 3.1.0 by Ruifeng Zheng · 5 days ago
  96. f319963 [SPARK-60421][SQL] Fix overflow and non-finite handling in vector_avg for float vectors by Uros Stankovic · 5 days ago
  97. f68f5fd [SPARK-60881][SQL][TEST] Add CREATE TABLE and REPLACE TABLE SQL golden coverage by Vladan Vasić · 5 days ago
  98. c165bce [SPARK-60732][SQL] Support admission control for streaming reads of native data sources by Hyukjin Kwon · 5 days ago
  99. e06d5d3 [SPARK-60726][SQL] Add an API to read a partition of a native data source as an Arrow C stream by Hyukjin Kwon · 5 days ago
  100. d96cafb [SPARK-60725][SQL] Write the columnar batches of a query to native data sources without converting them to rows by Hyukjin Kwon · 5 days ago