Google Git
Sign in
apache / spark / HEAD
  1. 1cecdc7 [SPARK-48481][SQL][SS] Do not apply OptimizeOneRowPlan against streaming Dataset by Jungtaek Lim · 14 hours ago master
  2. 114164b [SPARK-48490][CORE] Unescapes any literals for message of MessageWithContext by panbingkun · 20 hours ago
  3. 3cd35f8 [SPARK-48391][CORE] Using addAll instead of add function in fromAccumulatorInfos method of TaskMetrics Class by Dereck Li · 21 hours ago
  4. 96365c8 [SPARK-48465][SQL] Avoid no-op empty relation propagation by Ziqi Liu · 23 hours ago
  5. 844821c [SPARK-47578][R] Migrate RPackageUtils with variables to structured logging framework by Daniel Tenedorio · 27 hours ago
  6. f083e61 [SPARK-48430][SQL] Fix map value extraction when map contains collated strings by Nikola Mandic · 28 hours ago
  7. 747437c [SPARK-48476][SQL] fix NPE error message for null delmiter csv by milastdbx · 28 hours ago
  8. 67d11b1 [SPARK-48484][SQL] Fix: V2Write use the same TaskAttemptId for different task attempts by jackylee-ch · 30 hours ago
  9. 4360ec7 [SPARK-48172][SQL][FOLLOWUP] Fix escaping issues in JDBCDialects by Mihailo Milosevic · 2 days ago
  10. 80addbb [SPARK-48474][CORE] Fix the class name of the log in `SparkSubmitArguments` & `SparkSubmit` by panbingkun · 2 days ago
  11. f64646c [SPARK-48467][BUILD] Upgrade Maven to 3.9.7 by panbingkun · 2 days ago
  12. c00742b [SPARK-47716][SQL] Avoid view name conflict in SQLQueryTestSuite semantic sort test case by Jack Chen · 2 days ago
  13. 3e27543 [SPARK-48419][SQL] Foldable propagation replace foldable column shoul… by KnightChess · 2 days ago
  14. ce7a889 [SPARK-48461][SQL] Replace NullPointerExceptions with error class in AssertNotNull expression by Daniel Tenedorio · 2 days ago
  15. 9e35b00 [SPARK-48446][SS][DOCS] Update SS doc of dropDuplicates to use the right syntax by Yuchen Liu · 2 days ago
  16. bb1f026 [SPARK-48475][PYTHON] Optimize _get_jvm_function in PySpark by Chenhao Li · 2 days ago
  17. 6b4f97e [SPARK-48468] Add LogicalQueryStage interface in catalyst by Ziqi Liu · 2 days ago
  18. e1f5a7c [SPARK-48477][SQL][TESTS] Use withSQLConf in tests: Refactor CollationSuite, CoalesceShufflePartitionsSuite, SQLExecutionSuite by Rui Wang · 2 days ago
  19. a7da9b6 [SPARK-48008][1/2] Support UDAFs in Spark Connect by Paddy Xu · 2 days ago
  20. f68d761 [SPARK-48292][CORE] Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status by Angerszhuuuu · 2 days ago
  21. 69afd4b [SPARK-47361][SQL] Derby: Calculate suitable precision and scale for DECIMAL type by Kent Yao · 2 days ago
  22. df15c8d [SPARK-48471][CORE] Improve documentation and usage guide for history server by Kent Yao · 2 days ago
  23. b477ef4 [SPARK-47260][SQL] Assign name to error class _LEGACY_ERROR_TEMP_3250 by Wei Guo · 2 days ago
  24. 910c373 Revert "[SPARK-48415][PYTHON] Refactor TypeName to support parameterized datatypes" by Ruifeng Zheng · 2 days ago
  25. 772d7d3 [SPARK-47579][CORE][PART4] Migrate logInfo with variables to structured logging framework by Tuan Pham · 3 days ago
  26. 51d4f64 [SPARK-48464][SQL][TESTS] Use withSQLConf in tests: Refactor SQLConfSuite and StatisticsSuite by Rui Wang · 3 days ago
  27. 1f83f4d [MINOR][DOCS] Fix usage doc for mod by Kent Yao · 3 days ago
  28. 47c55f4 [SPARK-48454][PS] Directly use the parent dataframe class by Ruifeng Zheng · 3 days ago
  29. 935f092 [SPARK-48442][PYTHON][TESTS] Add parenthesis to awaitTermination by Riya Verma · 3 days ago
  30. a3b8420 [SPARK-48431][SQL] Do not forward predicates on collated columns to file readers by Ole Sasse · 3 days ago
  31. cf47293 [SPARK-48273][SQL][FOLLOWUP] Explicitly create non-Hive table in identifier-clause.sql by Wenchen Fan · 3 days ago
  32. dc6b493 [SPARK-48462][SQL][TESTS] Use withSQLConf in tests: Refactor HiveQuerySuite and HiveTableScanSuite by Rui Wang · 3 days ago
  33. 0461745 [SPARK-48281][SQL] Alter string search logic for UTF8_BINARY_LCASE collation (StringInStr, SubstringIndex) by Uros Bojanic · 3 days ago
  34. 49204b1 [SPARK-48444][SQL][TESTS] Use withSQLConf in tests: Refactor SQLQuerySuite by Rui Wang · 3 days ago
  35. ed43613 [MINOR][CORE][TESTS] Make SparkLoggerSuiteBase code more concise by panbingkun · 3 days ago
  36. f5d9b80 [MINOR][PS] Fallback code clean up by Ruifeng Zheng · 3 days ago
  37. cfbed99 Revert "[SPARK-48322][SPARK-42965][SQL][CONNECT][PYTHON] Drop internal metadata in `DataFrame.schema`" by Ruifeng Zheng · 3 days ago
  38. 8bbbde7 [SPARK-48426][SQL][DOCS] Add documentation for SQL operator precedence by Kent Yao · 4 days ago
  39. eac413a [SPARK-48392][CORE] Also load `spark-defaults.conf` when provided `--properties-file` by Chao Sun · 4 days ago
  40. e6236af [SPARK-48000][SQL] Enable hash join support for all collations (StringType) by Uros Bojanic · 4 days ago
  41. a86bca1 [SPARK-48445][SQL] Don't inline UDFs with expensive children by Kelvin Jiang · 4 days ago
  42. 56c65d5 [SPARK-23015][WINDOWS] Fix bug in Windows where starting multiple Spark instances within the same second causes a failure by Zachary Steudel · 4 days ago
  43. 99ffcaa [SPARK-48436][SQL][TESTS] Use `c.m.c.j.Driver` instead of `c.m.j.Driver` in `MySQLNamespaceSuite` by panbingkun · 4 days ago
  44. 279f5be [SPARK-48322][SPARK-42965][SQL][CONNECT][PYTHON] Drop internal metadata in `DataFrame.schema` by Ruifeng Zheng · 4 days ago
  45. e2a588c9 [SPARK-48438][PS][CONNECT] Directly use the parent column class by Ruifeng Zheng · 4 days ago
  46. 2493900 [SPARK-48221][SQL] Alter string search logic for UTF8_BINARY_LCASE collation (Contains, StartsWith, EndsWith, StringLocate) by Uros Bojanic · 4 days ago
  47. e9a3ed8 [SPARK-48159][SQL] Extending support for collated strings on datetime expressions by Nebojsa Savic · 4 days ago
  48. 731a2cf [SPARK-48273][SQL] Fix late rewrite of PlanWithUnresolvedIdentifier by Nikola Mandic · 4 days ago
  49. 7fe1b93 [SPARK-46841][SQL] Add collation support for ICU locales and collation specifiers by Nikola Mandic · 4 days ago
  50. a78ef73 [SPARK-48168][SQL][FOLLOWUP] Match expression strings of shift operators & functions with user inputs by Kent Yao · 4 days ago
  51. f164e4a [SPARK-48425][INFRA][FOLLOWUP] Do not copy the base spark folder by Wenchen Fan · 5 days ago
  52. df5ef91 [SPARK-48425][INFRA][FOLLOWUP] copy spark connect release tarballs by Wenchen Fan · 5 days ago
  53. af1ac1e [SPARK-41049][SQL][FOLLOW-UP] Mark map related expressions as stateful expressions by Rui Wang · 5 days ago
  54. a88cc1a [SPARK-48420][BUILD] Upgrade netty to `4.1.110.Final` by panbingkun · 5 days ago
  55. d863503 [SPARK-48434][PYTHON][CONNECT] Make `printSchema` use the cached schema by Ruifeng Zheng · 5 days ago
  56. fc1435d [SPARK-48415][PYTHON] Refactor `TypeName` to support parameterized datatypes by Ruifeng Zheng · 5 days ago
  57. de8d968 [SPARK-48370][CONNECT][FOLLOW-UP] Use JDK's Cleaner instead by Hyukjin Kwon · 5 days ago
  58. cc3bf36 [SPARK-48432][SQL] Avoid unboxing integers in UnivocityParser by Vladimir Golubev · 5 days ago
  59. b526456 [SPARK-48168][SQL][FOLLOWUP] Fix bitwise shifting operator's precedence by Kent Yao · 5 days ago
  60. 48a4bdb [SPARK-48427][BUILD] Upgrade `scala-parser-combinators` to 2.4 by yangjie01 · 5 days ago
  61. 49da3a4 [SPARK-48340][PYTHON][FOLLOWUP] Support TimestampNTZ infer schema miss prefer_timestamp_ntz by Angerszhuuuu · 5 days ago
  62. 90c1637 [MINOR][INFRA] Make pure Python build compatible with other setuptools versions by Hyukjin Kwon · 6 days ago
  63. 8f678a4 [SPARK-48425][PYTHON][BUILD] Replaces pyspark-connect to pyspark_connect for its output name by Hyukjin Kwon · 6 days ago
  64. 4ef5ec9 [SPARK-48424][INFRA] Make dev/is-changed.py to return true it it fails by Hyukjin Kwon · 6 days ago
  65. 541158f [SPARK-47579][CORE][PART3][FOLLOWUP] Fix KubernetesSuite by panbingkun · 6 days ago
  66. 468aa842 [SPARK-48320][CORE][DOCS] Add structured logging guide to the scala and java doc by panbingkun · 7 days ago
  67. 416d7f2 [SPARK-48239][INFRA][FOLLOWUP] install the missing `jq` library by Wenchen Fan · 8 days ago
  68. cff7014 [SPARK-47579][CORE][PART3] Spark core: Migrate logInfo with variables to structured logging framework by Gengliang Wang · 8 days ago
  69. 6cd1ccc [SPARK-48394][CORE] Cleanup mapIdToMapIndex on mapoutput unregister by Yi Wu · 8 days ago
  70. 1a536f0 [SPARK-48407][SQL][DOCS] Teradata: Document Type Conversion rules between Spark SQL and teradata by Kent Yao · 8 days ago
  71. 7d96334 [SPARK-48325][CORE] Always specify messages in ExecutorRunner.killProcess by Bo Zhang · 8 days ago
  72. 3cb30c2 [SPARK-47579][SQL][FOLLOWUP] Restore the `--help` print format of spark sql shell by Kent Yao · 8 days ago
  73. 7ae939a [SPARK-48168][SQL] Add bitwise shifting operators support by Kent Yao · 8 days ago
  74. bd95040 [SPARK-48412][PYTHON] Refactor data type json parse by Ruifeng Zheng · 8 days ago
  75. b15b6cf [SPARK-48409][BUILD][TESTS] Upgrade MySQL & Postgres & Mariadb docker image version by panbingkun · 8 days ago
  76. ef43bbb [SPARK-48384][BUILD] Exclude `io.netty:netty-tcnative-boringssl-static` from `zookeeper` by panbingkun · 8 days ago
  77. 3346afd [SPARK-46090][SQL][FOLLOWUP] Add DeveloperApi import by ulysses-you · 9 days ago
  78. a29c965 [SPARK-46090][SQL] Support plan fragment level SQL configs in AQE by ulysses-you · 9 days ago
  79. f42ed6c [SPARK-48406][BUILD] Upgrade commons-cli to 1.8.0 by yangjie01 · 9 days ago
  80. 3b9b52d [SPARK-48405][BUILD] Upgrade `commons-compress` to 1.26.2 by panbingkun · 9 days ago
  81. 6afa6cc [SPARK-48399][SQL] Teradata: ByteType should map to BYTEINT instead of BYTE(binary) by Kent Yao · 9 days ago
  82. 2516fd8 [SPARK-45009][SQL][FOLLOW UP] Add error class and tests for decorrelation of predicate subqueries in join condition which reference both join child by Andy Lam · 9 days ago
  83. 4a471cc [MINOR][TESTS] Add a helper function for `spark.table` in dsl by Ruifeng Zheng · 9 days ago
  84. 14d3f44 [SPARK-48395][PYTHON] Fix `StructType.treeString` for parameterized types by Ruifeng Zheng · 9 days ago
  85. e8f58a9 [SPARK-48370][SPARK-48258][CONNECT][PYTHON][FOLLOW-UP] Refactor local and eager required fields in CheckpointCommand by Hyukjin Kwon · 10 days ago
  86. a393d6c [SPARK-48370][CONNECT] Checkpoint and localCheckpoint in Scala Spark Connect client by Hyukjin Kwon · 10 days ago
  87. 5df9a08 [SPARK-48386][TESTS] Replace JVM assert with JUnit Assert in tests by panbingkun · 10 days ago
  88. a48365d [SPARK-48387][SQL] Postgres: Map TimestampType to TIMESTAMP WITH TIME ZONE by Kent Yao · 10 days ago
  89. d96ab44 [SPARK-48393][PYTHON] Move a group of constants to `pyspark.util` by Ruifeng Zheng · 10 days ago
  90. 06aafb1 [SPARK-48258][PYTHON][CONNECT][FOLLOW-UP] Bind relation ID to the plan instead of DataFrame by Hyukjin Kwon · 10 days ago
  91. 6be3560 [SPARK-48364][SQL] Add AbstractMapType type casting and fix RaiseError parameter map to work with collated strings by Uros Bojanic · 10 days ago
  92. e04d3d7 [SPARK-48215][SQL] Extending support for collated strings on date_format expression by Nebojsa Savic · 10 days ago
  93. 9fd85d9 Revert "[SPARK-48379][INFRA] Cancel previous builds on a PR when new commit is pushed" by Hyukjin Kwon · 10 days ago
  94. 1188887 [SPARK-48389][INFRA] Remove obsolete workflow cancel_duplicate_workflow_runs by Hyukjin Kwon · 10 days ago
  95. 93d83c3 [SPARK-48379][INFRA] Cancel previous builds on a PR when new commit is pushed by Stefan Kandic · 10 days ago
  96. 366a052 [SPARK-47920][DOCS][SS][PYTHON] Add doc for python streaming data source API by Chaoqin Li · 11 days ago
  97. e55875b [SPARK-48372][SPARK-45716][PYTHON] Implement `StructType.treeString` by Ruifeng Zheng · 11 days ago
  98. bf7f664 [SPARK-47515][SPARK-47406][SQL][FOLLOWUP] Add legacy config spark.sql.legacy.mysql.timestampNTZMapping.enabled by Kent Yao · 11 days ago
  99. f4958ba [SPARK-48367][CONNECT][FOLLOWUP] Replace keywords that identify `lint-scala` detection results by panbingkun · 11 days ago
  100. a886121 [MINOR][TESTS] Fix `DslLogicalPlan.as` by Ruifeng Zheng · 11 days ago