Google Git
Sign in
apache / spark / HEAD
  1. a0f6239 [SPARK-48132][INFRA] Run `k8s-integration-tests` only in PR builder and Daily CIs by Dongjoon Hyun · 13 hours ago master
  2. b924e68 [SPARK-48124][CORE] Disable structured logging for Connect-Repl by default by panbingkun · 13 hours ago
  3. 8443672 [SPARK-48131][CORE] Unify MDC key `mdc.taskName` and `task_name` by Gengliang Wang · 18 hours ago
  4. 9a45da2 [SPARK-48129][PYTHON] Provide a constant table schema in PySpark for querying structured logs by Gengliang Wang · 24 hours ago
  5. 356aca5 [SPARK-46009][SQL][FOLLOWUP] Remove unused golden file by beliefer · 24 hours ago
  6. 96f65c9 [SPARK-48128][SQL] For BitwiseCount / bit_count expression, fix codegen syntax error for boolean type inputs by Josh Rosen · 24 hours ago
  7. ca8c269 [SPARK-48124][CORE] Disable structured logging for Interpreters by default by Gengliang Wang · 24 hours ago
  8. 3b8c004 [SPARK-48116][INFRA][FOLLOW-UP] Deduplicate pyspark.pandas skipping logic by Hyukjin Kwon · 32 hours ago
  9. e4453b4 [SPARK-48123][CORE] Provide a constant table schema for querying structured logs by Gengliang Wang · 35 hours ago
  10. 111529e [SPARK-47578][CORE] Migrate logWarning with variables to structured logging framework by Daniel Tenedorio · 36 hours ago
  11. 454fcbb [SPARK-48116][INFRA][FOLLOWUP] Fix `if` statement to check repository by Dongjoon Hyun · 2 days ago
  12. 2be447f Revert "[SPARK-48116][INFRA][FOLLOWUP] Simplify the build with fixing the if condition" by Hyukjin Kwon · 2 days ago
  13. 2cb6ea7 [SPARK-48116][INFRA][FOLLOWUP] Simplify the build with fixing the if condition by Hyukjin Kwon · 2 days ago
  14. c0ef527 [SPARK-48127][INFRA] Fix `dev/scalastyle` to check `hadoop-cloud` and `jvm-profiler` modules by Dongjoon Hyun · 2 days ago
  15. 1904dee [SPARK-48116][INFRA] Run `pyspark-pandas*` only in PR builder and Daily Python CIs by Dongjoon Hyun · 2 days ago
  16. be99822 [SPARK-48056][PYTHON][CONNECT][FOLLOW-UP] Use `assertEqual` instead of `assertEquals` for Python 3.12 by Dongjoon Hyun · 2 days ago
  17. 5d1f976 [SPARK-47969][PYTHON][TESTS][FOLLOWUP] Make Test `test_creation_index` deterministic by Ruifeng Zheng · 2 days ago
  18. 7f08df4 [SPARK-47097][CONNECT][TESTS][FOLLOWUP] Increase timeout to `1 minute` for `interrupt tag` test by Dongjoon Hyun · 2 days ago
  19. 5c01f19 [SPARK-48059][CORE] Implement the structured log framework on the java side by panbingkun · 2 days ago
  20. c3a462c [SPARK-48121][K8S] Promote `KubernetesDriverConf` to `DeveloperApi` by zhou-jiang · 2 days ago
  21. b42d235 [SPARK-48114][CORE] Precompile template regex to avoid unnecessary work by Vladimir Golubev · 2 days ago
  22. 8590288 [SPARK-48119][K8S] Promote `KubernetesDriverSpec` to `DeveloperApi` by zhou-jiang · 2 days ago
  23. d6ca2c5 [SPARK-48118][SQL] Support `SPARK_SQL_LEGACY_CREATE_HIVE_TABLE` env variable by Dongjoon Hyun · 2 days ago
  24. aa00b00 [SPARK-48115][INFRA] Remove `Python 3.11` from `build_python.yml` by Dongjoon Hyun · 2 days ago
  25. f450272 [SPARK-43046][FOLLOWUP][SS][CONNECT] Remove not used line in deduplicateWithinWatermark by Wei Liu · 2 days ago
  26. cd789ac [SPARK-48088][PYTHON][CONNECT][TESTS] Prepare backward compatibility test 4.0 <> above by Hyukjin Kwon · 2 days ago
  27. aaf3995 [MINOR][INFRA] Clean up the worker heatup that are unnecessary by Hyukjin Kwon · 2 days ago
  28. 2d346fb [SPARK-48111][INFRA] Disable Docker integration test and TPC-DS in commit builder by Hyukjin Kwon · 2 days ago
  29. defda86 [SPARK-48110][INFRA] Remove all Maven compilation build by Hyukjin Kwon · 2 days ago
  30. 8d70f4b [SPARK-48107][PYTHON] Exclude tests from Python distribution by Nicholas Chammas · 2 days ago
  31. ddc1f6b [SPARK-48106][INFRA] Use `Python 3.11` in `pyspark` tests of `build_and_test.yml` by Dongjoon Hyun · 2 days ago
  32. f044748 [SPARK-48103][K8S] Promote `KubernetesDriverBuilder` to `DeveloperApi` by zhou-jiang · 3 days ago
  33. 6383702 [SPARK-48109][INFRA] Enable `k8s-integration-tests` only for `kubernetes` module change by Dongjoon Hyun · 3 days ago
  34. df63309 [SPARK-48054][PYTHON][CONNECT][INFRA] Backward compatibility test for Spark Connect by Hyukjin Kwon · 3 days ago
  35. 111df27 [SPARK-48108][INFRA] Skip `tpcds-1g` and `docker-integration-tests` tests from `RocksDB UI-Backend` job by Dongjoon Hyun · 3 days ago
  36. 7b472e3 [SPARK-48104][INFRA] Run `publish_snapshot.yml` once per day by Dongjoon Hyun · 3 days ago
  37. c6696cd [SPARK-47671][CORE] Enable structured logging in log4j2.properties.template and update docs by Gengliang Wang · 3 days ago
  38. d9d79a5 [SPARK-48102][SS] Track duration for acquiring source/sink metrics while reporting streaming query progress by Anish Shrigondekar · 3 days ago
  39. 8d9e7c9 [SPARK-48099][INFRA] Run `maven-build` test only on `Java 21 on MacOS14 (Apple Silicon)` by Dongjoon Hyun · 3 days ago
  40. 7f6a139 [SPARK-48098][INFRA] Enable `NOLINT_ON_COMPILE` for all except `lint` job by Dongjoon Hyun · 3 days ago
  41. f156db2 [SPARK-48048][CONNECT][SS] Added client side listener support for Scala by bogao007 · 3 days ago
  42. 5ec62a7 [SPARK-48065][SQL] SPJ: allowJoinKeysSubsetOfPartitionKeys is too strict by Szehon Ho · 3 days ago
  43. 1321dd6 [SPARK-48097][INFRA] Limit GHA job execution time to up to 3 hours in `build_and_test.yml` by Dongjoon Hyun · 3 days ago
  44. 53d4cdb [SPARK-48096][INFRA] Run `build_maven_java21_macos14.yml` every two days by Dongjoon Hyun · 3 days ago
  45. 48df28f [SPARK-48095][INFRA] Run `build_non_ansi.yml` once per day by Dongjoon Hyun · 3 days ago
  46. ffa4d19 [SPARK-48067][SQL] Fix variant default columns by Richard Chen · 3 days ago
  47. bf13008 [SPARK-48079][BUILD] Upgrade maven-install/deploy-plugin to 3.1.2 by panbingkun · 3 days ago
  48. b99a64b [SPARK-48081] Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type by Josh Rosen · 3 days ago
  49. 5bbbc6c [SPARK-48072][SQL][TESTS] Improve SQLQuerySuite test output - use `===` instead of `sameElements` for Arrays by Vladimir Golubev · 3 days ago
  50. 2f31d05 [SPARK-48056][CONNECT][PYTHON] Re-execute plan if a SESSION_NOT_FOUND error is raised and no partial response was received by Niranjan Jayakar · 3 days ago
  51. ae5da18 [SPARK-48075][SS] Add type checking for PySpark avro functions by fanyue-xia · 4 days ago
  52. 66e2a35 [SPARK-48080][K8S] Promote `*MainAppResource` and `NonJVMResource` to `DeveloperApi` by Dongjoon Hyun · 4 days ago
  53. 9e12bd7 [SPARK-48064][SQL] Update error messages for routine related error classes by allisonwang-db · 4 days ago
  54. 2b76ef4 [SPARK-47683][PYTHON][BUILD][FOLLOW-UP] Exclude `lib/py4j*zip` in `pyspark-connect` package by Hyukjin Kwon · 4 days ago
  55. 2fbfb21 [SPARK-48058][SPARK-43727][PYTHON][CONNECT] UserDefinedFunction.returnType` parse the DDL string by Ruifeng Zheng · 4 days ago
  56. 4b16238 [SPARK-48078][K8S] Promote `o.a.s.d.k8s.Constants` to `DeveloperApi` by Dongjoon Hyun · 4 days ago
  57. 918c50a [SPARK-46894][PYTHON][FOLLOW-UP] Includes `error-conditions.json` into PyPI package by Hyukjin Kwon · 4 days ago
  58. a42eef9 [SPARK-48077][K8S] Promote `KubernetesClientUtils` to `DeveloperApi` by Dongjoon Hyun · 4 days ago
  59. 0fc7c4a [SPARK-45891][SQL][FOLLOW-UP] Added length check to the is_variant_null expression by Harsh Motwani · 4 days ago
  60. 04f3a93 [SPARK-48076][K8S] Promote `KubernetesVolumeUtils` to `DeveloperApi` by Dongjoon Hyun · 4 days ago
  61. e521d3c [MINOR] Fix the grammar of some comments on renaming error classes by Nicholas Chammas · 4 days ago
  62. f86a519 [SPARK-48062][PYTHON][SS][TESTS] Add pyspark test for SimpleDataSourceStreamingReader by Chaoqin Li · 4 days ago
  63. fd57c34 [SPARK-47911][SQL] Introduces a universal BinaryFormatter to make binary output consistent by Kent Yao · 4 days ago
  64. 69ea082 [SPARK-47934][CORE] Ensure trailing slashes in `HistoryServer` URL redirections by huangzhir · 4 days ago
  65. 5ac8030 [SPARK-48074][CORE] Improve the readability of JSON loggings by Gengliang Wang · 4 days ago
  66. 35767bb [SPARK-48070][SQL][TESTS] Support `AdaptiveQueryExecSuite.runAdaptiveAndVerifyResult` to skip check results by sychen · 4 days ago
  67. ad63eef [SPARK-46009][SQL][FOLLOWUP] Remove unused PERCENTILE_CONT and PERCENTILE_DISC in g4 by beliefer · 4 days ago
  68. 26c871f [SPARK-48068][PYTHON] `mypy` should have `--python-executable` parameter by Dongjoon Hyun · 4 days ago
  69. ff401dd [SPARK-48069][INFRA] Handle `PEP-632` by checking `ModuleNotFoundError` on `setuptools` in Python 3.12 by Dongjoon Hyun · 4 days ago
  70. 65cf5b1 [SPARK-48016][SQL][TESTS][FOLLOWUP] Update Java 21 golden file by Dongjoon Hyun · 5 days ago
  71. 02206cd [SPARK-48047][SQL] Reduce memory pressure of empty TreeNode tags by Nick Young · 5 days ago
  72. 991763c [SPARK-46894][PYTHON] Move PySpark error conditions into standalone JSON file by Nicholas Chammas · 5 days ago
  73. c71d02a [SPARK-48028][TESTS] Regenerate benchmark results after turning ANSI on by Kent Yao · 5 days ago
  74. f3cc8f9 [SPARK-48063][CORE] Enable `spark.stage.ignoreDecommissionFetchFailure` by default by Dongjoon Hyun · 5 days ago
  75. faab553 [SPARK-48060][SS][TESTS] Fix `StreamingQueryHashPartitionVerifySuite` to update golden files correctly by Dongjoon Hyun · 5 days ago
  76. dab20b3 [SPARK-48057][PYTHON][CONNECT][TESTS] Enable `GroupedApplyInPandasTests.test_grouped_with_empty_partition` by Ruifeng Zheng · 5 days ago
  77. 9caa6f7 [SPARK-48061][SQL][TESTS] Parameterize max limits of `spark.sql.test.randomDataGenerator` by Dongjoon Hyun · 5 days ago
  78. 0329479 [SPARK-47359][SQL] Support TRANSLATE function to work with collated strings by Milan Dankovic · 5 days ago
  79. c8c2492 [SPARK-47793][SS][PYTHON] Implement SimpleDataSourceStreamReader for python streaming data source by Chaoqin Li · 5 days ago
  80. 3aea6c2 [SPARK-48003][SQL] Add collation support for hll sketch aggregate by Uros Bojanic · 5 days ago
  81. 9476343 [SPARK-48050][SS] Log logical plan at query start by fanyue-xia · 5 days ago
  82. 332570f [SPARK-48052][PYTHON][CONNECT] Recover `pyspark-connect` CI by parent classes by Hyukjin Kwon · 5 days ago
  83. 12a5074 [SPARK-47566][SQL] Support SubstringIndex function to work with collated strings by Milan Dankovic · 5 days ago
  84. 9e8c4aa [SPARK-46122][SQL] Set `spark.sql.legacy.createHiveTableByDefault` to `false` by default by Dongjoon Hyun · 5 days ago
  85. ed5aa56 [SPARK-48055][PYTHON][CONNECT][TESTS] Enable `PandasUDFScalarParityTests.{test_vectorized_udf_empty_partition, test_vectorized_udf_struct_with_empty_partition}` by Ruifeng Zheng · 5 days ago
  86. e0af824 [SPARK-48053][PYTHON][CONNECT] SparkSession.createDataFrame should warn for unsupported options by Hyukjin Kwon · 6 days ago
  87. 87b20b1 [SPARK-47585][SQL] SQL core: Migrate logInfo with variables to structured logging framework by panbingkun · 6 days ago
  88. e6217c1 [SPARK-48030][SQL] SPJ: cache rowOrdering and structType for InternalRowComparableWrapper by Xianjin · 6 days ago
  89. da92293 [SPARK-48033][SQL] Fix `RuntimeReplaceable` expressions being used in default columns by Richard Chen · 6 days ago
  90. fe05eb8 [SPARK-47741] Added stack overflow handling in parser by milastdbx · 6 days ago
  91. 3fbcb26 [SPARK-48016][SQL] Fix a bug in try_divide function when with decimals by Gengliang Wang · 6 days ago
  92. c9ed9df [SPARK-48042][SQL] Use a timestamp formatter with timezone at class level instead of making copies at method level by Kent Yao · 6 days ago
  93. c35a21e [SPARK-48044][PYTHON][CONNECT] Cache `DataFrame.isStreaming` by Ruifeng Zheng · 6 days ago
  94. f781d15 [SPARK-48046][K8S] Remove `clock` parameter from `DriverServiceFeatureStep` by Dongjoon Hyun · 6 days ago
  95. d42c10d [SPARK-47693][TESTS][FOLLOWUP] Reduce CollationBenchmarks time by Kent Yao · 6 days ago
  96. ccb0eb6 [SPARK-48038][K8S] Promote driverServiceName to KubernetesDriverConf by Cheng Pan · 6 days ago
  97. d913d1b [SPARK-47148][SQL] Avoid to materialize AQE ExchangeQueryStageExec on the cancellation by erenavsarogullari · 6 days ago
  98. 3f15ad4 [SPARK-47994][SQL] Fix bug with CASE WHEN column filter push down in SQLServer by Stefan Bukorovic · 6 days ago
  99. c74f584 [SPARK-48039][PYTHON][CONNECT] Update the error class for `group.apply` by Ruifeng Zheng · 6 days ago
  100. 7b1147a [SPARK-47567][SQL] Support LOCATE function to work with collated strings by Milan Dankovic · 6 days ago