Google Git
Sign in
apache/spark/HEAD
  1. bdcb08a [SPARK-58632][CONNECT] Send Spark Connect operation ID in gRPC metadata by Wenchen Fan · 3 hours ago master
  2. 5d5b647 [SPARK-58213][SQL] corr should return NULL when a column has zero variance by StormSpirit · 3 hours ago
  3. eaf9d3a [SPARK-51356][SQL] Emit IsNotNull on a complex child before the FilterExec predicate that uses it by Eric Yang · 3 hours ago
  4. 4998b77 [SPARK-58887][CORE] Fix barrier job to be cancellable during slot check retries by Dongjoon Hyun · 5 hours ago
  5. 3ac19a0 [SPARK-58880][INFRA] Make precompile a hard requirement by Ruifeng Zheng · 5 hours ago
  6. eab92f0 [SPARK-58765][PYTHON][TEST][FOLLOWUP] Add tests for pa.Array.from_pandas with nested target types by Spenser Sun · 5 hours ago
  7. e068d11 [SPARK-58890][SQL][PYTHON][CONNECT] Support incremental Python aggregators over window functions by Hyukjin Kwon · 5 hours ago
  8. a37e9ea [SPARK-49442][SS][FOLLOWUP] Use monotonic clock for Kafka partition cache TTL by Wenchen Fan · 6 hours ago
  9. 350df6c [SPARK-58857][K8S] Bind the result of Utils.randomize in LocalDirsFeatureStep by YangJie · 6 hours ago
  10. ebb4941 [SPARK-58738][SQL] Add parse_sql function for SQL statement JSON analysis by Serge Rielau · 6 hours ago
  11. 7c2f2c4 [SPARK-58389][SQL][FOLLOWUP] Pass table-state options while loading write targets by yyanyy · 6 hours ago
  12. 8565f0d [SPARK-58757][SQL] Allow CollapseWindow to merge windows with an empty order spec by Xiduo You · 7 hours ago
  13. 87a6055 [SPARK-58863][ML] Make tree leaf attribute uncached by Ruifeng Zheng · 8 hours ago
  14. 6ae3196 [SPARK-58870][ML] Make KMeans distance measures singleton by Ruifeng Zheng · 9 hours ago
  15. d8403fe [SPARK-58871][INFRA] Add timeout to disk cleanup steps by Ruifeng Zheng · 9 hours ago
  16. 326eec2 [SPARK-58765][PYTHON][TEST][FOLLOWUP] Regenerate the type-scalar from_pandas golden for the temporal-overflow repr by Spenser Sun · 9 hours ago
  17. 77a4f75 [SPARK-58886][CORE] Fix Int overflow in `CoarseGrainedSchedulerBackend.requestExecutors` by Dongjoon Hyun · 10 hours ago
  18. 592def6 [SPARK-57897][BUILD][FOLLOWUP] Add `credential-aws` profile to `assembly/pom.xml` by Kousuke Saruta · 12 hours ago
  19. a96d947 [SPARK-57898][CORE][TEST][FOLLOWUP] Clean up AwsStsCredentialProvider tests by Kousuke Saruta · 12 hours ago
  20. e424fc6 [SPARK-58789][CORE] Add CredentialProvider.additionalSparkProperties() SPI and auto-config wiring by Shrirang Mhalgi · 12 hours ago
  21. de14ec8 [SPARK-58844][UDF] Fix a Cancel-after-Finish flake in the UDF worker protocol test client by Mohamed Gallab · 13 hours ago
  22. 1459a7c [SPARK-58765][PYTHON][TEST] Add tests for pa.Array.from_pandas with the type and safe arguments by Spenser Sun · 13 hours ago
  23. 80abf76 [SPARK-58862][INFRA] Recognize UDF as a primary component tag in the merge script by Yicong Huang · 14 hours ago
  24. f167d37 [SPARK-58629][CONNECT] Avoid empty fallback gRPC errors by haoyangeng-db · 15 hours ago
  25. 31f5f5a [SPARK-57818][SQL] Support nanosecond-precision NTZ timestamps in convert_timezone by Rakesh Raushan · 15 hours ago
  26. 763b7c9 [SPARK-58794][SQL] Add standardSemantics foundation for CHAR/VARCHAR by Serge Rielau · 16 hours ago
  27. 9d2f0b3 [SPARK-58664][PYTHON] Factor out repeated paths in PySpark Classic's setup.py by Nicholas Chammas · 18 hours ago
  28. 75ac74b [SPARK-58282][PYTHON][DOC] Refresh PySpark README and clarify project scope by Nicholas Chammas · 19 hours ago
  29. 12f3843 [SPARK-58842][ML] Add descriptive messages to bare require checks in ALS by Uros · 20 hours ago
  30. 33effd5 [SPARK-58845][PYTHON] Collapse check-then-create-dir pattern into single call by Nicholas Chammas · 20 hours ago
  31. 1938bcf [SPARK-58859][PYTHON][TEST] Add BarrierTaskContext negative tests for SQL map APIs by Ruifeng Zheng · 23 hours ago
  32. 2b030fa [SPARK-58855][ML] Optimize IsotonicRegressionModel transform closure by Ruifeng Zheng · 23 hours ago
  33. 1f0641f [SPARK-58854][ML] Optimize GeneralizedLinearRegressionModel transform closure by Ruifeng Zheng · 23 hours ago
  34. 9b290e0 [SPARK-58853][ML] Optimize IDFModel transform closure by Ruifeng Zheng · 23 hours ago
  35. 9c5094a [SPARK-58736][SQL][PYTHON][CONNECT] Support incremental Python aggregators via Arrow by Hyukjin Kwon · 23 hours ago
  36. 1591e2f [SPARK-58202][K8S] Skip driver containerPort declaration when the port is 0 by zhengchenyu · 28 hours ago
  37. cd687e6 [SPARK-58658][CONNECT] Do not return redacted configurations from the Config RPC by Aleksandr Efimov · 31 hours ago
  38. 01b0663 [SPARK-58782][SQL] Fix DSv2 pushdown null literal serialization bug by Pratham Manja · 32 hours ago
  39. f0c247a [SPARK-58827][DOC] Document SPARK_LOCAL_IP for local RemoteClassLoaderError test failures by Szehon Ho · 34 hours ago
  40. 6f67160 [SPARK-58826][SQL] Hoist repeated session.implicits imports in AutoCDC tests by Szehon Ho · 34 hours ago
  41. c854ed8 [SPARK-34254][SQL][DOC] Document CREATE EXTERNAL TABLE for data source tables by deepinsight coder · 2 days ago
  42. deeadfe [SPARK-58082][SQL] Add DSv2 relation and row-level command tree patterns by yyanyy · 2 days ago
  43. 51d0894 [SPARK-58778][DOC] Document authority-based routing for Spark Connect behind a shared ingress by Liang-Chi Hsieh · 2 days ago
  44. fc7caa4 [SPARK-58711][SQL] Use StructType.getFieldIndex in Parquet and ORC aggregate push down by Uros · 2 days ago
  45. 6c24c56 [SPARK-58690][CORE] Fix typos in storage package comments by Uros · 2 days ago
  46. 67e7317 [SPARK-58822][SQL][TEST] Extract a nonEmptyLines helper in LogicalPlanDifferenceSuite by Uros · 2 days ago
  47. f2cb571 [SPARK-58843][DOC] Fix grammar errors in the SQL tuning, GraphX and MLlib clustering guides by Uros · 2 days ago
  48. 9d32c14 [SPARK-58725][K8S] Resolve the pod before deciding whether --kill found it by YangJie · 2 days ago
  49. aa6743a [SPARK-58841][K8S][DOC] Update `YuniKorn` docs with `1.9.0` by Dongjoon Hyun · 2 days ago
  50. 5fd608b [SPARK-57411][INFRA] Add a daily build with the JDK codegen backend by YangJie · 2 days ago
  51. 07495f4 [SPARK-58741][SQL][TEST] Add nanosecond-timestamp coverage for collect_list by Stevo Mitric · 2 days ago
  52. c67e787 [SPARK-58823][SQL][TEST] Add nanos-timestamp tests for scalar subquery / EXISTS / NOT IN (SELECT) by Stevo Mitric · 2 days ago
  53. 6e695dd [SPARK-58689][CORE][TEST] Add tests for SparkStringUtils padding and abbreviation helpers by Uros · 2 days ago
  54. 0790be9 [SPARK-58771][INFRA][FOLLOWUP] Add build-context for classic-only image by Tian Gao · 2 days ago
  55. 4e0b430 [SPARK-58833][INFRA] Make the build, pyspark and docker job timeouts callable inputs by YangJie · 2 days ago
  56. cccb6a0 [SPARK-58834][INFRA] Bump docker CI actions to latest ASF-allowlisted versions by Tian Gao · 2 days ago
  57. ff26d01 [SPARK-58771][INFRA] Clean up the dependency list for classic-only docker image by Tian Gao · 2 days ago
  58. 46241ca [SPARK-58817][DOC] Eliminate absolute line references for `literalinclude` by Tian Gao · 2 days ago
  59. bdf0122 [SPARK-58766][PYTHON][TEST] Represent out-of-range temporal PyArrow scalars in golden files by Spenser Sun · 2 days ago
  60. dc9ad12 [MINOR][DOC] Fix broken submitting-applications link in Kafka guide by David Dallakyan · 2 days ago
  61. 51b231c [SPARK-58724][SS] Incremental state cleanup for streaming dropDuplicates by Boyang Jerry Peng · 2 days ago
  62. 8b61d20 [SPARK-38794][K8S] Create executor ConfigMap before requesting executors by DongjunHwang · 3 days ago
  63. 95d93a0 [SPARK-58784][PYTHON] Merge the batched-UDF mapper into an explicit SQL_BATCHED_UDF branch in read_udfs by Yicong Huang · 3 days ago
  64. b94bbfb [SPARK-58089][SQL][FOLLOWUP] Preserve join extraction semantics by Wenchen Fan · 3 days ago
  65. 918a0fa [SPARK-58687][SQL] Support the ANSI SQL/JSON JSON_EXISTS function by Ganesha S · 3 days ago
  66. 5623395 [SPARK-57956][SQL] Fix AQE incorrectly eliminating a global LIMIT over a non-materialized query stage by Vaibhav Garg · 3 days ago
  67. a21b145 [SPARK-58709][CORE][TEST] Use assert(!x) instead of assert(x === false) in SecurityManagerSuite by Uros · 3 days ago
  68. 5bcd5f5 [SPARK-58511][SQL] Bypass ineffective pre-shuffle partial aggregation at runtime by Xiduo You · 3 days ago
  69. 5460c10 [SPARK-58772][SQL] Make SelectedField pass column metadata by Shixiong Zhu · 3 days ago
  70. f76717f [SPARK-58619][CONNECT][FOLLOWUP] Map JDBC connection errors by SQLSTATE class 08 instead of hard-coded condition names by Jiwon Park · 3 days ago
  71. a2da292 [SPARK-58761][SQL][TEST] Add dedicated e2e test coverage for GROUP BY over nanosecond-precision timestamp keys by Stevo Mitric · 5 days ago
  72. 8ca77e0 [SPARK-58742][SQL][TEST] Add nanosecond-timestamp coverage for collect_set by Stevo Mitric · 5 days ago
  73. f95d79c [MINOR][SQL][DOC] Mention bin/spark-connect-shell in docs by Nicholas Chammas · 5 days ago
  74. dc15294 [SPARK-58747][PYTHON] Move include commands from MANIFEST.in into setup.py files by Nicholas Chammas · 5 days ago
  75. 76735aa [SPARK-58768][PYTHON][TEST] Fix monkey-patch in test_parity_udf and test_parity_udtf by Tian Gao · 5 days ago
  76. 1c78b91 [SPARK-57896][CORE][TEST] Add Kerberos coexistence and per-user token integration tests by Shrirang Mhalgi · 5 days ago
  77. 59a50f8 [SPARK-58684][PYTHON] Make PySpark error sub-conditions inherit the parent condition error state by Jiwon Park · 6 days ago
  78. bb8b4d9 [SPARK-58619][CORE][CONNECT] Assign SQLSTATE 08003 to the INVALID_HANDLE session sub-conditions by Jiwon Park · 6 days ago
  79. 2acd4b6 [SPARK-58228][SQL] Convert unreachable error condition _LEGACY_ERROR_TEMP_1058 to an internal error by Matthew B. · 6 days ago
  80. 08d7c51 [SPARK-57228][SS] Support transformWithState in Real-Time Mode by Boyang Jerry Peng · 6 days ago
  81. de97fd4 [SPARK-58720][PYTHON][TEST][FOLLOWUP] Move the pandas DataFrame golden repr into GoldenFileTestMixin by Spenser Sun · 6 days ago
  82. c5e2a39 [SPARK-58761][SQL][TEST] Add dedicated e2e test coverage for DISTINCT over nanosecond-precision timestamp columns by Stevo Mitric · 6 days ago
  83. d303100 [SPARK-58761][SQL][TEST] Add DESCRIBE / SHOW CREATE TABLE tests for nanosecond-timestamp columns by Stevo Mitric · 6 days ago
  84. f4c3faa [SPARK-58743][SQL][TEST] Add nanosecond-timestamp coverage for mode by Stevo Mitric · 6 days ago
  85. eb7a51e [SPARK-58393][PYTHON][INFRA] Smart select tests for PySpark test framework by Tian Gao · 6 days ago
  86. 3b39c59 [SPARK-58751][SS][PYTHON] Stop leaking Python workers on TransformWithState init failure by jon-gao-db · 6 days ago
  87. 311a451 [SPARK-58748][CORE][K8S] Preserve advertised driver host for wildcard bind addresses by Chao Sun · 6 days ago
  88. 4b4a2f7 [SPARK-58389][SQL][FOLLOWUP] Pin DSv2 table instances by state options during analysis by yyanyy · 6 days ago
  89. 6b6e910 [SPARK-58746][INFRA] Remove a dead lsof workaround and fix stale references in release tooling by Uros Bojanic · 7 days ago
  90. c828ea1 [SPARK-58760][SQL] Use consistent colName interpolation in CatalogColumnStat by Uros Bojanic · 7 days ago
  91. 8516d1c [SPARK-58759][BUILD] Fix grammar in build file comments by Uros Bojanic · 7 days ago
  92. 99b57f9 [SPARK-58758][DOC] Remove the stale Highlights in 3.0 section from the ML guide by Uros Bojanic · 7 days ago
  93. ebd6a69 [SPARK-58134][BUILD] Upgrade janino to 3.1.12 by Mingliang Zhu · 7 days ago
  94. ed16a7e [SPARK-58352][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_2070 by Xiao Li · 7 days ago
  95. d8797af [SPARK-58351][CORE] Assign a name to the error condition _LEGACY_ERROR_TEMP_3014 by Xiao Li · 7 days ago
  96. 449efe6 [SPARK-58349][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1081 by Xiao Li · 7 days ago
  97. d23432e [SPARK-58734][INFRA] Skip a declined cherry-pick instead of aborting the merge in merge_spark_pr.py by Uros Bojanic · 7 days ago
  98. 7e2a407 [MINOR][INFRA] Skip JIRA prompt when merging MINOR PRs by Cheng Pan · 7 days ago
  99. d96ad72 [MINOR][INFRA] Add spacing before JIRA update prompt by Ruifeng Zheng · 7 days ago
  100. df1646c [SPARK-58720][PYTHON][TEST] Add tests for pa.Table.to_pandas by Spenser Sun · 7 days ago