layout: post title: Spark Release 0.5.1 categories:
Spark 0.5.1 is a maintenance release that adds several important bug fixes and usability features. You can download it as a tar.gz file.
Spark is now available in Maven Central, making it easier to link into your programs without having to build it as a JAR. Use the following Maven identifiers to add it to a project:
Spark now builds against Scala 2.9.2 by default.
The new Accumulable class generalizes Accumulators for the case when the type being accumulated is not the same as the types of elements being added (e.g. you wish to accumulate a collection, such as a Set, by adding individual elements). This interface is also more efficient in avoiding the creation of temporary objects. (Contributed by Imran Rashid.)
Spark‘s EC2 launch script now configures Spark’s memory limit automatically based on the machine's available RAM.