Apache Spark

This file provides context and guidelines for AI coding assistants working with the Apache Spark codebase.

Build and Test

Prefer building in sbt over maven:

• Building Spark: docs/building-spark.md

  • SBT build instructions: See the “Building with SBT” section
  • SBT testing: See the “Testing with SBT” section
  • Running individual tests: See the “Running Individual Tests” section

• PySpark Testing: python/docs/source/development/testing.rst