Google Git
Sign in
apache / spark / HEAD
  1. 2ef7246 [SPARK-48142][PYTHON][CONNECT][TESTS] Enable `CogroupedApplyInPandasTests.test_wrong_args` by Ruifeng Zheng · 2 weeks ago
  2. 7290000 [SPARK-48035][SQL] Fix try_add/try_multiply being semantic equal to add/multiply by Supun Nakandala · 2 weeks ago
  3. c94fe37 [MINOR][SQL][DOCS] Correct comments for UnresolvedRelation by beliefer · 2 weeks ago
  4. 9dc5599 [SPARK-48105][SS] Fix the race condition between state store unloading and snapshotting by Huanli Wang · 2 weeks ago
  5. 13c7bdcf [SPARK-48112][CONNECT] Expose session in SparkConnectPlanner to plugins by Tom van Bussel · 2 weeks ago
  6. d67752a [SPARK-47681][SQL][FOLLOWUP] Fix variant decimal handling by Chenhao Li · 2 weeks ago
  7. 4c68842 [SPARK-48149][INFRA] Serialize `build_python.yml` to run a single Python version per cron schedule by Dongjoon Hyun · 2 weeks ago
  8. de8ba85 [SPARK-48145][CORE] Remove logDebug and logTrace with MDC in JAVA structured logging framework by Gengliang Wang · 2 weeks ago
  9. 526e414 [SPARK-45220][FOLLOWUP][DOCS][TESTS] Make a `dataframe.join` doctest deterministic by Ruifeng Zheng · 2 weeks ago
  10. 7c728b2 [SPARK-48137][INFRA] Run `yarn` test only in PR builders and Daily CIs by Dongjoon Hyun · 3 weeks ago
  11. 8294c59 [SPARK-48138][CONNECT][TESTS] Disable a flaky `SparkSessionE2ESuite.interrupt tag` test by Dongjoon Hyun · 3 weeks ago
  12. 8094535 [SPARK-48054][INFRA][FOLLOW-UP] Rename SPARK_SKIP_JVM_REQUIRED_TESTS to SPARK_SKIP_CONNECT_COMPAT_TESTS by Hyukjin Kwon · 3 weeks ago
  13. d09f174 [SPARK-48136][INFRA][CONNECT] Always upload Spark Connect log files in scheduled build for Spark Connect by Hyukjin Kwon · 3 weeks ago
  14. 4e69857 Revert "[SPARK-47777][PYTHON][SS][TESTS] Add spark connect test for python streaming data source" by Hyukjin Kwon · 3 weeks ago
  15. 8b22517 [SPARK-48135][INFRA] Run `buf` and `ui` only in PR builders and Java 21 Daily CI by Dongjoon Hyun · 3 weeks ago
  16. 32ba5c1 [SPARK-48133][INFRA] Run `sparkr` only in PR builders and Daily CIs by Dongjoon Hyun · 3 weeks ago
  17. bf2e254 [SPARK-48019][SQL][FOLLOWUP] Use primitive arrays over object arrays when nulls exist by Gene Pang · 3 weeks ago
  18. a0f6239 [SPARK-48132][INFRA] Run `k8s-integration-tests` only in PR builder and Daily CIs by Dongjoon Hyun · 3 weeks ago
  19. b924e68 [SPARK-48124][CORE] Disable structured logging for Connect-Repl by default by panbingkun · 3 weeks ago
  20. 8443672 [SPARK-48131][CORE] Unify MDC key `mdc.taskName` and `task_name` by Gengliang Wang · 3 weeks ago
  21. 9a45da2 [SPARK-48129][PYTHON] Provide a constant table schema in PySpark for querying structured logs by Gengliang Wang · 3 weeks ago
  22. 356aca5 [SPARK-46009][SQL][FOLLOWUP] Remove unused golden file by beliefer · 3 weeks ago
  23. 96f65c9 [SPARK-48128][SQL] For BitwiseCount / bit_count expression, fix codegen syntax error for boolean type inputs by Josh Rosen · 3 weeks ago
  24. ca8c269 [SPARK-48124][CORE] Disable structured logging for Interpreters by default by Gengliang Wang · 3 weeks ago
  25. 3b8c004 [SPARK-48116][INFRA][FOLLOW-UP] Deduplicate pyspark.pandas skipping logic by Hyukjin Kwon · 3 weeks ago
  26. e4453b4 [SPARK-48123][CORE] Provide a constant table schema for querying structured logs by Gengliang Wang · 3 weeks ago
  27. 111529e [SPARK-47578][CORE] Migrate logWarning with variables to structured logging framework by Daniel Tenedorio · 3 weeks ago
  28. 454fcbb [SPARK-48116][INFRA][FOLLOWUP] Fix `if` statement to check repository by Dongjoon Hyun · 3 weeks ago
  29. 2be447f Revert "[SPARK-48116][INFRA][FOLLOWUP] Simplify the build with fixing the if condition" by Hyukjin Kwon · 3 weeks ago
  30. 2cb6ea7 [SPARK-48116][INFRA][FOLLOWUP] Simplify the build with fixing the if condition by Hyukjin Kwon · 3 weeks ago
  31. c0ef527 [SPARK-48127][INFRA] Fix `dev/scalastyle` to check `hadoop-cloud` and `jvm-profiler` modules by Dongjoon Hyun · 3 weeks ago
  32. 1904dee [SPARK-48116][INFRA] Run `pyspark-pandas*` only in PR builder and Daily Python CIs by Dongjoon Hyun · 3 weeks ago
  33. be99822 [SPARK-48056][PYTHON][CONNECT][FOLLOW-UP] Use `assertEqual` instead of `assertEquals` for Python 3.12 by Dongjoon Hyun · 3 weeks ago
  34. 5d1f976 [SPARK-47969][PYTHON][TESTS][FOLLOWUP] Make Test `test_creation_index` deterministic by Ruifeng Zheng · 3 weeks ago
  35. 7f08df4 [SPARK-47097][CONNECT][TESTS][FOLLOWUP] Increase timeout to `1 minute` for `interrupt tag` test by Dongjoon Hyun · 3 weeks ago
  36. 5c01f19 [SPARK-48059][CORE] Implement the structured log framework on the java side by panbingkun · 3 weeks ago
  37. c3a462c [SPARK-48121][K8S] Promote `KubernetesDriverConf` to `DeveloperApi` by zhou-jiang · 3 weeks ago
  38. b42d235 [SPARK-48114][CORE] Precompile template regex to avoid unnecessary work by Vladimir Golubev · 3 weeks ago
  39. 8590288 [SPARK-48119][K8S] Promote `KubernetesDriverSpec` to `DeveloperApi` by zhou-jiang · 3 weeks ago
  40. d6ca2c5 [SPARK-48118][SQL] Support `SPARK_SQL_LEGACY_CREATE_HIVE_TABLE` env variable by Dongjoon Hyun · 3 weeks ago
  41. aa00b00 [SPARK-48115][INFRA] Remove `Python 3.11` from `build_python.yml` by Dongjoon Hyun · 3 weeks ago
  42. f450272 [SPARK-43046][FOLLOWUP][SS][CONNECT] Remove not used line in deduplicateWithinWatermark by Wei Liu · 3 weeks ago
  43. cd789ac [SPARK-48088][PYTHON][CONNECT][TESTS] Prepare backward compatibility test 4.0 <> above by Hyukjin Kwon · 3 weeks ago
  44. aaf3995 [MINOR][INFRA] Clean up the worker heatup that are unnecessary by Hyukjin Kwon · 3 weeks ago
  45. 2d346fb [SPARK-48111][INFRA] Disable Docker integration test and TPC-DS in commit builder by Hyukjin Kwon · 3 weeks ago
  46. defda86 [SPARK-48110][INFRA] Remove all Maven compilation build by Hyukjin Kwon · 3 weeks ago
  47. 8d70f4b [SPARK-48107][PYTHON] Exclude tests from Python distribution by Nicholas Chammas · 3 weeks ago
  48. ddc1f6b [SPARK-48106][INFRA] Use `Python 3.11` in `pyspark` tests of `build_and_test.yml` by Dongjoon Hyun · 3 weeks ago
  49. f044748 [SPARK-48103][K8S] Promote `KubernetesDriverBuilder` to `DeveloperApi` by zhou-jiang · 3 weeks ago
  50. 6383702 [SPARK-48109][INFRA] Enable `k8s-integration-tests` only for `kubernetes` module change by Dongjoon Hyun · 3 weeks ago
  51. df63309 [SPARK-48054][PYTHON][CONNECT][INFRA] Backward compatibility test for Spark Connect by Hyukjin Kwon · 3 weeks ago
  52. 111df27 [SPARK-48108][INFRA] Skip `tpcds-1g` and `docker-integration-tests` tests from `RocksDB UI-Backend` job by Dongjoon Hyun · 3 weeks ago
  53. 7b472e3 [SPARK-48104][INFRA] Run `publish_snapshot.yml` once per day by Dongjoon Hyun · 3 weeks ago
  54. c6696cd [SPARK-47671][CORE] Enable structured logging in log4j2.properties.template and update docs by Gengliang Wang · 3 weeks ago
  55. d9d79a5 [SPARK-48102][SS] Track duration for acquiring source/sink metrics while reporting streaming query progress by Anish Shrigondekar · 3 weeks ago
  56. 8d9e7c9 [SPARK-48099][INFRA] Run `maven-build` test only on `Java 21 on MacOS14 (Apple Silicon)` by Dongjoon Hyun · 3 weeks ago
  57. 7f6a139 [SPARK-48098][INFRA] Enable `NOLINT_ON_COMPILE` for all except `lint` job by Dongjoon Hyun · 3 weeks ago
  58. f156db2 [SPARK-48048][CONNECT][SS] Added client side listener support for Scala by bogao007 · 3 weeks ago
  59. 5ec62a7 [SPARK-48065][SQL] SPJ: allowJoinKeysSubsetOfPartitionKeys is too strict by Szehon Ho · 3 weeks ago
  60. 1321dd6 [SPARK-48097][INFRA] Limit GHA job execution time to up to 3 hours in `build_and_test.yml` by Dongjoon Hyun · 3 weeks ago
  61. 53d4cdb [SPARK-48096][INFRA] Run `build_maven_java21_macos14.yml` every two days by Dongjoon Hyun · 3 weeks ago
  62. 48df28f [SPARK-48095][INFRA] Run `build_non_ansi.yml` once per day by Dongjoon Hyun · 3 weeks ago
  63. ffa4d19 [SPARK-48067][SQL] Fix variant default columns by Richard Chen · 3 weeks ago
  64. bf13008 [SPARK-48079][BUILD] Upgrade maven-install/deploy-plugin to 3.1.2 by panbingkun · 3 weeks ago
  65. b99a64b [SPARK-48081] Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type by Josh Rosen · 3 weeks ago
  66. 5bbbc6c [SPARK-48072][SQL][TESTS] Improve SQLQuerySuite test output - use `===` instead of `sameElements` for Arrays by Vladimir Golubev · 3 weeks ago
  67. 2f31d05 [SPARK-48056][CONNECT][PYTHON] Re-execute plan if a SESSION_NOT_FOUND error is raised and no partial response was received by Niranjan Jayakar · 3 weeks ago
  68. ae5da18 [SPARK-48075][SS] Add type checking for PySpark avro functions by fanyue-xia · 3 weeks ago
  69. 66e2a35 [SPARK-48080][K8S] Promote `*MainAppResource` and `NonJVMResource` to `DeveloperApi` by Dongjoon Hyun · 3 weeks ago
  70. 9e12bd7 [SPARK-48064][SQL] Update error messages for routine related error classes by allisonwang-db · 3 weeks ago
  71. 2b76ef4 [SPARK-47683][PYTHON][BUILD][FOLLOW-UP] Exclude `lib/py4j*zip` in `pyspark-connect` package by Hyukjin Kwon · 3 weeks ago
  72. 2fbfb21 [SPARK-48058][SPARK-43727][PYTHON][CONNECT] UserDefinedFunction.returnType` parse the DDL string by Ruifeng Zheng · 3 weeks ago
  73. 4b16238 [SPARK-48078][K8S] Promote `o.a.s.d.k8s.Constants` to `DeveloperApi` by Dongjoon Hyun · 3 weeks ago
  74. 918c50a [SPARK-46894][PYTHON][FOLLOW-UP] Includes `error-conditions.json` into PyPI package by Hyukjin Kwon · 3 weeks ago
  75. a42eef9 [SPARK-48077][K8S] Promote `KubernetesClientUtils` to `DeveloperApi` by Dongjoon Hyun · 3 weeks ago
  76. 0fc7c4a [SPARK-45891][SQL][FOLLOW-UP] Added length check to the is_variant_null expression by Harsh Motwani · 3 weeks ago
  77. 04f3a93 [SPARK-48076][K8S] Promote `KubernetesVolumeUtils` to `DeveloperApi` by Dongjoon Hyun · 3 weeks ago
  78. e521d3c [MINOR] Fix the grammar of some comments on renaming error classes by Nicholas Chammas · 3 weeks ago
  79. f86a519 [SPARK-48062][PYTHON][SS][TESTS] Add pyspark test for SimpleDataSourceStreamingReader by Chaoqin Li · 3 weeks ago
  80. fd57c34 [SPARK-47911][SQL] Introduces a universal BinaryFormatter to make binary output consistent by Kent Yao · 3 weeks ago
  81. 69ea082 [SPARK-47934][CORE] Ensure trailing slashes in `HistoryServer` URL redirections by huangzhir · 3 weeks ago
  82. 5ac8030 [SPARK-48074][CORE] Improve the readability of JSON loggings by Gengliang Wang · 3 weeks ago
  83. 35767bb [SPARK-48070][SQL][TESTS] Support `AdaptiveQueryExecSuite.runAdaptiveAndVerifyResult` to skip check results by sychen · 3 weeks ago
  84. ad63eef [SPARK-46009][SQL][FOLLOWUP] Remove unused PERCENTILE_CONT and PERCENTILE_DISC in g4 by beliefer · 3 weeks ago
  85. 26c871f [SPARK-48068][PYTHON] `mypy` should have `--python-executable` parameter by Dongjoon Hyun · 3 weeks ago
  86. ff401dd [SPARK-48069][INFRA] Handle `PEP-632` by checking `ModuleNotFoundError` on `setuptools` in Python 3.12 by Dongjoon Hyun · 3 weeks ago
  87. 65cf5b1 [SPARK-48016][SQL][TESTS][FOLLOWUP] Update Java 21 golden file by Dongjoon Hyun · 3 weeks ago
  88. 02206cd [SPARK-48047][SQL] Reduce memory pressure of empty TreeNode tags by Nick Young · 3 weeks ago
  89. 991763c [SPARK-46894][PYTHON] Move PySpark error conditions into standalone JSON file by Nicholas Chammas · 3 weeks ago
  90. c71d02a [SPARK-48028][TESTS] Regenerate benchmark results after turning ANSI on by Kent Yao · 3 weeks ago
  91. f3cc8f9 [SPARK-48063][CORE] Enable `spark.stage.ignoreDecommissionFetchFailure` by default by Dongjoon Hyun · 3 weeks ago
  92. faab553 [SPARK-48060][SS][TESTS] Fix `StreamingQueryHashPartitionVerifySuite` to update golden files correctly by Dongjoon Hyun · 3 weeks ago
  93. dab20b3 [SPARK-48057][PYTHON][CONNECT][TESTS] Enable `GroupedApplyInPandasTests.test_grouped_with_empty_partition` by Ruifeng Zheng · 3 weeks ago
  94. 9caa6f7 [SPARK-48061][SQL][TESTS] Parameterize max limits of `spark.sql.test.randomDataGenerator` by Dongjoon Hyun · 3 weeks ago
  95. 0329479 [SPARK-47359][SQL] Support TRANSLATE function to work with collated strings by Milan Dankovic · 3 weeks ago
  96. c8c2492 [SPARK-47793][SS][PYTHON] Implement SimpleDataSourceStreamReader for python streaming data source by Chaoqin Li · 3 weeks ago
  97. 3aea6c2 [SPARK-48003][SQL] Add collation support for hll sketch aggregate by Uros Bojanic · 3 weeks ago
  98. 9476343 [SPARK-48050][SS] Log logical plan at query start by fanyue-xia · 3 weeks ago
  99. 332570f [SPARK-48052][PYTHON][CONNECT] Recover `pyspark-connect` CI by parent classes by Hyukjin Kwon · 3 weeks ago
  100. 12a5074 [SPARK-47566][SQL] Support SubstringIndex function to work with collated strings by Milan Dankovic · 3 weeks ago