Title: Spark Incubation Status

This page tracks the project status, incubator-wise. For more general project status, look on the project website.

The Spark project graduated on 2014-02-19

The Apache Spark is an open source system for fast and flexible large-scale data analysis. Spark provides a general purpose runtime that supports low-latency execution in several forms. These include interactive exploration of very large datasets, near real-time stream processing, and ad-hoc SQL analytics (through higher layer extensions).

itemtypereference
Websitewwwhttp://spark.incubator.apache.org
.wiki.
Mailing listdevdev @ spark.incubator.apache.org
.commitscommits @ spark.incubator.apache.org
Bug tracking.http://issues.apache.org/jira/browse/SPARK
Source codeGithttps://gitbox.apache.org/repos/asf/incubator-spark.git
MentorsmattmannChris Mattmann
.pramirezPaul Ramirez
.ahartAndrew Hart
.tomdzThomas Dudziak
.smarruSuresh Marru
.hsaputraHenry Saputra
.rvsRoman Shaposhnik
CommittersmateiMatei Zaharia
.ankurdaveAnkur Dave
.tdasTathagata Das
.haoyuanHaoyuan Li
.joshrosenJosh Rosen
.rxinReynold Xin
.shivaramShivaram Venkataraman
.mosharafMosharaf Chowdhury
.woggleCharles Reiss
.andrewAndy Konwinski
.pwendellPatrick Wendell
.irashidImran Rashid
.ryanlecompteRyan LeCompte
.harshaRam Sriharsha
.bobbyRobert Evans
.mridulm80Mridul Muralidharan
.tomdzThomas Dudziak
.markhamstraMark Hamstra
.stephenhStephen Haberman
.jasondaiJason Dai
.shane_huangShane Huang
.xiajunluanAndrew Xia
.mlnickNick Pentreath
.mcnamaraSean McNamara
.prashantPrashant Sharma
.tgravesThomas Graves
.kayousterhoutKay Ousterhout
.adavAaron Davidson
Extra..

Project Setup

This is the first phase on incubation, needed to start the project at Apache.

Item assignment is shown by the Apache id. Completed tasks are shown by the completion date (YYYY-MM-dd).

Identify the project to be incubated

dateitem
2013-06-19Make sure that the requested project name does not already exist. Please follow the guide to ensure a suitable project/product name.
N/AIf request from an existing Apache project to adopt an external package, then ask the Apache project for the SVN module and mail address names.
2013-06-01If request from outside Apache to enter an existing Apache project, then post a message to that project for them to decide on acceptance.
2013-06-19If request from anywhere to become a stand-alone PMC, then assess the fit with the ASF, and create the lists and modules under the incubator address/module names if accepted.

Infrastructure

dateitem
2013-06-19Ask infrastructure to create source repository modules and grant the committers karma.
2013-06-19Ask infrastructure to set up and archive mailing lists.
2013-06-19Ask infrastructure to set up issue tracker (JIRA, Bugzilla).
2013-06-29.Ask infrastructure to set up wiki (Confluence, Moin).
2013-06-19Migrate the project to our infrastructure.

Mentor-related responsibility/oversight

dateitem
2013-06-19Identify all the Mentors for the incubation, by asking all that can be Mentors.
2014-01-30Subscribe all Mentors on the pmc and general lists.
2014-01-30Give all Mentors access to the incubator SVN repository. (to be done by the Incubator PMC chair or an Incubator PMC Member wih karma for the authorizations file)
2013-06-19Tell Mentors to track progress in the file ‘incubator/projects/{project.name}.html’

Copyright

dateitem
2013-06-20Check and make sure that the papers that transfer rights to the ASF been received. It is only necessary to transfer rights for the package, the core code, and any new code produced by the project.
2014-01-30Check and make sure that the files that have been donated have been updated to reflect the new ASF copyright.

Verify distribution rights

dateitem
2014-01-30Check and make sure that for all code included with the distribution that is not under the Apache license, we have the right to combine with Apache-licensed code and redistribute.
2014-01-30Check and make sure that all source code distributed by the project is covered by one or more of the following approved licenses: Apache, BSD, Artistic, MIT/X, MIT/W3C, MPL 1.1, or something with essentially the same terms.

Establish a list of active committers

dateitem
2014-01-30Check that all active committers have submitted a contributors agreement.
2014-01-30Add all active committers in the STATUS file.
2014-01-30Ask root for the creation of committers' accounts on people.apache.org.

Project specific

Add project specific tasks here.

Incubation

These action items have to be checked for during the whole incubation process.

These items are not to be signed as done during incubation, as they may change during incubation. They are to be looked into and described in the status reports and completed in the request for incubation signoff.

Collaborative Development

  • Have all of the active long-term volunteers been identified and acknowledged as committers on the project?

  • Are there three or more independent committers? (The legal definition of independent is long and boring, but basically it means that there is no binding relationship between the individuals, such as a shared employer, that is capable of overriding their free will as individuals, directly or indirectly.)

  • Are project decisions being made in public by the committers?

  • Are the decision-making guidelines published and agreed to by all of the committers?

Licensing awareness

  • Are all licensing, trademark, credit issues being taken care of and acknowleged by all committers?

Project Specific

Add project specific tasks here.

Exit

Things to check for before voting the project out.

Organizational acceptance of responsibility for the project

dateitem
2014-02-15If graduating to an existing PMC, has the PMC voted to accept it? see here
2014-02-19If graduating to a new PMC, has the board voted to accept it? see here

Incubator sign-off

  • Has the Incubator decided that the project has accomplished all of the above tasks?