Google GitGoogle Git
Sign in
apache/spark/HEAD
  1. 3910fb5 [SPARK-59894][BUILD][TEST] Upgrade bouncycastle to 1.85 by YangJie · 3 hours ago master
  2. 019ad6b [SPARK-59893][INFRA][TEST] Fix npm vulnerabilities in dev and ui-test by YangJie · 3 hours ago
  3. 913175e [SPARK-59918][K8S] Support `deployment` pods allocator in `ExecutorResizePlugin` by Dongjoon Hyun · 4 hours ago
  4. 3e49951 [SPARK-59916][CORE] Support `hold` and `resume` in REST Submission API by Dongjoon Hyun · 4 hours ago
  5. d23987f [SPARK-58300][SQL][PROTOBUF] Add from_protobuf option to keep Timestamp/Duration as struct by bhollis-dbx · 5 hours ago
  6. b1f606c [SPARK-59844][SS][RTM] Preserve root causes for RTM async operation failures by Boyang Jerry Peng · 6 hours ago
  7. 990671c [SPARK-58979][SS] Preserve event time through streaming dedup pruning by Jonathan Gao · 6 hours ago
  8. f868de6 [SPARK-59831][SQL] Validate bounds in the vectorized BYTE_STREAM_SPLIT reader by Liang-Chi Hsieh · 8 hours ago
  9. 6ed637f [SPARK-59914][K8S] Make `ExecutorResizePlugin` skip executor pods with the placeholder `EXECID` label by Dongjoon Hyun · 9 hours ago
  10. ac2831c [SPARK-59915][DOC] Document how to hold and resume applications via scripted HTTP requests by Dongjoon Hyun · 9 hours ago
  11. 56da062 [SPARK-59886][UDF] Route external UDF dispatch through worker specifications by Yossi Eliaz · 9 hours ago
  12. 2b1d78b [SPARK-59727][PYTHON] Migrate Arrow incremental aggregate and window UDF eval types to the EvalTypeHandler pipeline by Yicong Huang · 9 hours ago
  13. e85102e [SPARK-59773][PYTHON] Report Python worker metrics as JSON by Spenser Sun · 10 hours ago
  14. 3d5202b [SPARK-59899][SQL] Restrict DSv2 scan output ordering to sort orders that hold over the scan output by Dongjoon Hyun · 13 hours ago
  15. f27eab5 [SPARK-59885][PYTHON][TEST] Fix flaky WorkerMemoryTest by pinning spark.task.cpus by Tian Gao · 15 hours ago
  16. 67ba9c1 [SPARK-59777][PYTHON] Fix timing metrics for reused Python workers by Spenser Sun · 15 hours ago
  17. 719947a [SPARK-59804][UI] Fix UTF-8 byte limits and physical line numbers during event log replay by Liang-Chi Hsieh · 15 hours ago
  18. 92d5127 [SPARK-59274][SQL] Enforce CHAR/VARCHAR semantics in schema-driven text parsing by Serge Rielau · 17 hours ago
  19. 6f0c479 [SPARK-59749][SQL] Accept empty STRUCT operands in ASOF JOIN MATCH_CONDITION by Luka Zdravić · 20 hours ago
  20. 14141b9 [SPARK-59857][BUILD] Ensure test module names are unique by Nicholas Chammas · 24 hours ago
  21. e0761c3 [SPARK-59086][SPARK-54466][BUILD] Extract common build env setup into composite action by Nicholas Chammas · 25 hours ago
  22. 5781052 [SPARK-59825][SQL][TEST] Fix `HiveClientSuites` to work with sbt `testOnly` and `-z` filtering by Kousuke Saruta · 28 hours ago
  23. a32c06b [SPARK-59841][SQL] Align changelog state options and metadata reuse by Gengliang Wang · 30 hours ago
  24. a026a0b [SPARK-59808][INFRA] Remove JIRA fix versions and reopen tickets when merging reverts by Szehon Ho · 34 hours ago
  25. 1d9f798 [SPARK-59822][UDF] Make the external UDF worker dispatcher factory configurable by Yossi Eliaz · 35 hours ago
  26. b2dd3e4 [SPARK-59847][CONNECT][SS][PYTHON] Fix deadlock in StreamingQueryListenerBus when removing the last listener by Tian Gao · 36 hours ago
  27. 09ecd0b [SPARK-59427][SQL] Avoid a redundant map lookup in CollectFrequentItems.add by david-mollitor-db · 2 days ago
  28. 409b37e [SPARK-59823][SQL] Deduplicate variant manipulation expressions by bojana-db · 2 days ago
  29. 186c433 [SPARK-59597][SQL] Avoid quadratic CTE attribute restoration by bhollis-dbx · 2 days ago
  30. 0bebce9 [SPARK-59762][PYTHON][FOLLOWUP] Stop UDTFWithPartitions from keeping udtf_info alive for the whole task by Constantin-Tiberiu Craiu · 2 days ago
  31. ef61d20 [SPARK-59323][SQL] Record temp variables read by an IDENTIFIER clause as referred by the view by Stevo Mitric · 2 days ago
  32. 038ca6a [SPARK-59869][INFRA] Update GitHub Actions to the latest approved versions by Dongjoon Hyun · 2 days ago
  33. f9358a5 [SPARK-59529][SQL][FOLLOWUP] Restore refs1/refs2 parameter names for ASOF_JOIN_MATCH_CONDITION_TABLE_REFERENCE by Luka Zdravić · 2 days ago
  34. 8582186 [SPARK-59842][K8S] Fix `spark.kubernetes.executor.resizeInterval` default value and `0` handling by Dongjoon Hyun · 2 days ago
  35. 0ccd727 [SPARK-59839][K8S] Prune PVC usage reports of removed and inactive executors in `ExecutorPVCResizePlugin` by Dongjoon Hyun · 2 days ago
  36. 916fba0 [SPARK-59840][K8S] Fix `ExecutorResizePlugin` to exclude inactive executor pods by Dongjoon Hyun · 2 days ago
  37. bc1642a [SPARK-59843][K8S] Make `ExecutorResizePlugin` validate `resizeThreshold` and `resizeFactor` by Dongjoon Hyun · 2 days ago
  38. 9395170 [SPARK-59373][SQL][PYTHON][DOC] Fix the documented return type of ceil and floor with a scale argument by Varun Bhandary · 2 days ago
  39. 5b7d3fe [SPARK-59845][CORE] Register an accumulator with the TaskContext only after it is fully deserialized by Ziqi Liu · 2 days ago
  40. b03b53d [SPARK-59801][SQL] Fix internal error for non-foldable options maps by Wenchen Fan · 2 days ago
  41. 897e434 Revert "[SPARK-58623][SQL] Extend ExpandBenchmark with CSE/rewrite matrix" by Wenchen Fan · 2 days ago
  42. e3e7720 Revert "[SPARK-56898][SQL] Rewrite COUNT(DISTINCT IF) to COUNT(DISTINCT) FILTER for Expand reduction" by Wenchen Fan · 2 days ago
  43. 8f6d613 [SPARK-59122][SQL] Take UnionExec's plain-union decision once instead of re-deriving it per caller by YangJie · 2 days ago
  44. b9d2c9b [SPARK-59851][K8S] Add `ACTIVE_TASKS` executor roll policy by Dongjoon Hyun · 2 days ago
  45. 5a05bff [SPARK-59757][CORE] Harden BytesToBytesMap after failed reset allocation by Wenchen Fan · 2 days ago
  46. 36c9287 [SPARK-59624][PYTHON][FOLLOWUP] Drop zero-row batches in concat_batches and accept an optional schema by Spenser Sun · 2 days ago
  47. dc9702e [SPARK-59837][SQL][TEST] Add Parquet v2 writer test cases to `ParquetColumnIndexSuite` by Dongjoon Hyun · 2 days ago
  48. 80fb49a [SPARK-59835][BUILD] Upgrade Jackson to 2.22.3 by Dongjoon Hyun · 2 days ago
  49. aeda065 [SPARK-59821][CORE] Make Maven utility tests safe for concurrent runs by qianlan717 · 2 days ago
  50. 7a1bcfa [SPARK-59812][SQL] Validate value lengths and skip amounts in the vectorized PLAIN, DELTA_LENGTH_BYTE_ARRAY and DELTA_BYTE_ARRAY readers by Liang-Chi Hsieh · 3 days ago
  51. a648b6b [SPARK-59708][CONNECT] Tolerate serialVersionUID drift of sql.types classes when deserializing Scala UDF payloads by Yicong Huang · 3 days ago
  52. 9e33960 [SPARK-59828][SQL] Support `skipFixedLenByteArray` in `VectorizedDeltaByteArrayReader` by Dongjoon Hyun · 3 days ago
  53. abc7955 [SPARK-59640][SDP] SCD2 Ignore-null support; add version-map authorship operations by AnishMahto · 3 days ago
  54. 29acd89 [SPARK-59817][BUILD] Upgrade `scala-xml` to 2.5.0 by Dongjoon Hyun · 3 days ago
  55. c585d12 [SPARK-59820][BUILD] Upgrade `lz4-java` to 1.12.0 by Dongjoon Hyun · 3 days ago
  56. 9523945 [SPARK-59183][SDP] SCD2 Ignore-null support; Populate version map per event row at ingest by AnishMahto · 3 days ago
  57. b1b2685 [SPARK-59819][CORE] Fix `Resubmitted` task end accounting in `AppStatusListener` by Dongjoon Hyun · 3 days ago
  58. edc90a1 [SPARK-58881][CORE] Ignore non-numeric checkpoint part files by Charlie Chen · 3 days ago
  59. 5157813 [SPARK-59761][SQL][TEST] Add SET VARIABLE DEFAULT golden tests by Vladan Vasić · 3 days ago
  60. 535175b [SPARK-51264][SQL][JDBC] Close driver connection before writing by Xinyao Zhang · 3 days ago
  61. 56a654d [SPARK-57128][SQL][TEST] Preserve commas in SQL test settings by Xinyao Zhang · 3 days ago
  62. e05de28 [SPARK-59039][INFRA][BUILD] Add a README for our GitHub workflows by Nicholas Chammas · 3 days ago
  63. cb9463e [SPARK-59785][CONNECT][TEST] Fix SparkConnectResultSetSuite failure when ANSI mode is off by Sepuri Sai Krishna · 3 days ago
  64. 47301f9 [SPARK-55214][PYTHON][SQL] Transpile string len() to Catalyst length by Monica G · 3 days ago
  65. eb6c705 [SPARK-59487][CORE] Add task attempt spans to executor profiling by Zhen Wang · 3 days ago
  66. ded027d [SPARK-59534][SQL] Support implicit casting of DATE and STRING to TIMESTAMP in time_bucket by Nikolina Vraneš · 3 days ago
  67. 29da84a [SPARK-59553][CONNECT] Make SparkSession.addArtifact honor spark.jars.ivySettings by qianlan717 · 3 days ago
  68. 4c06f49a [SPARK-59762][PYTHON] Release Python UDF init message before processing rows by Constantin-Tiberiu Craiu · 3 days ago
  69. f5498a9 [SPARK-59798][K8S] Support `spark.executor.extraLibraryPath` for K8s executors by Dongjoon Hyun · 5 days ago
  70. f06bbad [SPARK-59744][UDF] Execute scalar external UDFs through worker sessions by Haiyang Sun · 5 days ago
  71. 01bce98 [SPARK-59783][SQL] Keep the caller of split functions JIT-compilable by Max Gekk · 5 days ago
  72. 8ee38e3 [SPARK-59028][PYTHON] Make UDF category inference linear by Charlie Chen · 5 days ago
  73. 9cf426e [SPARK-56925][PYTHON][SQL] Support bare `if x` in UDF transpilation by jzhan-2026 · 5 days ago
  74. 414f738 [SPARK-59333][CORE] Apply a serialization filter when recovering Master state from ZooKeeper by Holden Karau · 5 days ago
  75. 13107ce [SPARK-59404][CORE] Match REST environment filtering in standalone Client submission by Holden Karau · 5 days ago
  76. f4327af [SPARK-59417][SQL] Stream multiline top-level JSON arrays by Timothy Meehan · 5 days ago
  77. 9b37040 [SPARK-55014][SQL] Split projection for expensive filters by Holden Karau · 5 days ago
  78. f54fe52 [SPARK-59448][SQL] Support IGNORE NULL UPDATES in Auto CDC SQL syntax by Andreas Neumann · 5 days ago
  79. 0864b2a [SPARK-59087][CONNECT] Authenticate before the other gRPC interceptors run by Holden Karau · 6 days ago
  80. e985bd4 [SPARK-58966][SQL] Resolve SQL variables in UPDATE and MERGE INTO conditions by Joel Robin P · 6 days ago
  81. 9b25ad2 [SPARK-59774][SQL] Warn once, and name the remedy, when a whole-stage codegen method is too long to be JIT compiled by Max Gekk · 6 days ago
  82. 5ffc3e9 [SPARK-59673][SQL] Floor the NAAJ broadcast threshold by Wenchen Fan · 6 days ago
  83. 3d9598b [SPARK-59685][SQL] Keep clause-free SQL/JSON constructor canonical SQL bound to the built-in by Ganesha S · 6 days ago
  84. 600b8b0 [SPARK-59746][SQL][TEST] Improve golden file testing for hints by Mihailo Aleksic · 6 days ago
  85. 3fa4831 [SPARK-59765][SQL][TEST] Generate broadcast joins in full when measuring benchmark query codegen by Max Gekk · 6 days ago
  86. 73054c7 [SPARK-59764][SQL][TEST] Check generated code of benchmark queries with AQE disabled by Max Gekk · 6 days ago
  87. 366d78b [SPARK-59005][INFRA][FOLLOWUP] Suggest JIRA affects versions for unreleased major and minor releases by Szehon Ho · 6 days ago
  88. e91d22d [SPARK-59334][CORE] Handle invalid application/worker links by Holden Karau · 6 days ago
  89. 9907192 [SPARK-58626][PYTHON][SQL] Optimize evaluating inputs to transpiled UDFs by Holden Karau · 6 days ago
  90. 55bd2b6 [SPARK-59069][PYTHON] Transpile Python UDFs with positional-only params by Holden Karau · 6 days ago
  91. 7e4861e [SPARK-59118][SQL] Error when doAs is used and not supported by Holden Karau · 6 days ago
  92. 38258cb [SPARK-59407][UI] Improve compressed line handling in Spark History server by Holden Karau · 6 days ago
  93. 08d777a [SPARK-59352][SQL] Validate prefix lengths in the vectorized DELTA_BYTE_ARRAY reader by Holden Karau · 6 days ago
  94. c4ef971 [SPARK-59353][UI] Avoid pre-fetch and crawlers triggering actions in UI by Holden Karau · 6 days ago
  95. c7080fc [SPARK-59755][PYTHON] Add ASV benchmarks for Arrow incremental aggregate and window UDF eval types by Yicong Huang · 6 days ago
  96. f07d18c [SPARK-59405][SQL] XSD Validation improvements by Holden Karau · 6 days ago
  97. b3149c6 [SPARK-59406][UI] Fix UI display on weird custom log names by Holden Karau · 6 days ago
  98. ca847b0 [SPARK-59763][CORE] Annotate `TokenIngestor` with `@Private` instead of `@DeveloperApi` by Kousuke Saruta · 7 days ago
  99. 269bae3 [SPARK-59631][SQL] Preserve cached V1 time-travel snapshots after table writes by Joel Robin P · 7 days ago
  100. 4cfbd41 [SPARK-57897][BUILD][FOLLOWUP] Use AWS SDK bundle in credential-aws by Wenjun · 7 days ago