blob: b8246d329aa0a98da78d9279576999706ec25f2e [file] [log] [blame]
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<link rel="stylesheet" href="../style/bootstrap-1-3-0-min.css" type="text/css" />
<link rel="stylesheet" href="../style/style.css" type="text/css" />
<script src="https://www.apachecon.com/event-images/snippet.js"></script>
<title>Pig Incubation Status - Apache Incubator</title>
</head>
<body>
<div class="container">
<div class="row"><div class="span6"><a href="https://www.apache.org/"><img src="http://www.apache.org/img/asf_logo.png" alt="The Apache Software Foundation" border="0" style="margin-top: 2px" height="88"/></a></div>
<div class="span7"><a href="/"><img src="https://incubator.apache.org/images/incubator_feather_egg_logo_sm.png" alt="The Apache Software Foundation Incubator" border="0" style="margin-top: 2px" height="88"/></a></div>
<div class="span2"><a href="https://www.apache.org/foundation/contributing.html"><img src="https://www.apache.org/images/SupportApache-small.png" height="100" width="100"/></a></div>
</div>
<div class="row"><div class="span16"><hr noshade="noshade" size="1"/></div></div>
<div class="row">
<div class="span4">
<form action="http://www.google.com/search" method="get">
<input value="incubator.apache.org" name="sitesearch" type="hidden"/>
<input size="20" name="q" id="query" type="text" value="search..."
onclick="if(this.value == 'search...') {this.value = ''}"/>
<input name="Search" value="Go" type="submit"/>
</form>
<div class="menuheader">General</div>
<menu compact="compact">
<li><a href="../index.html">Welcome</a></li>
<li><a href="../cookbook/">Incubator Cookbook</a></li>
<li><a href="../policy/incubation.html">Incubation Policy</a></li>
<li><a href="../guides/roles_and_responsibilities.html">Roles and Responsibilities</a></li>
<li><a href="../faq.html">General FAQ</a></li>
<li><a href="http://wiki.apache.org/incubator">Incubator Wiki</a></li>
<li><a href="../whoweare.html">Who We Are</a></li>
</menu>
<div class="menuheader">Status</div>
<menu compact="compact">
<li><a href="../projects">Project List</a></li>
<li><a href="../clutch">Clutch Report</a></li>
<li><a href="../ip-clearance">IP Clearance</a></li>
</menu>
<div class="menuheader">Entry Guides</div>
<menu compact="compact">
<li><a href="../guides/proposal.html">Proposal Guide</a></li>
</menu>
<div class="menuheader">Podling Guides</div>
<menu compact="compact">
<li><a href="../guides/committer.html">Podling Committers</a></li>
<li><a href="../guides/ppmc.html">Podling PMC (PPMC)</a></li>
<li><a href="../guides/mentor.html">Podling Mentor</a></li>
<li><a href="../guides/releasemanagement.html">Podling Releases</a></li>
<li><a href="../guides/branding.html">Podling Branding/Publicity</a></li>
<li><a href="../guides/sites.html">Podling Websites</a></li>
<li><a href="../guides/graduation.html">Graduation</a></li>
<li><a href="../guides/retirement.html">Retirement</a></li>
</menu>
<div class="menuheader">Other Guides</div>
<menu compact="compact">
<li><a href="../guides/participation.html">Participation</a></li>
<li><a href="../faq.html">General FAQ</a></li>
<li><a href="../guides/chair.html">IPMC Chair</a></li>
<li><a href="../guides/lists.html">Mailing Lists</a></li>
<li><a href="../guides/website.html">Incubator Website</a></li>
</menu>
<div class="menuheader">ASF</div>
<menu compact="compact">
<li><a href="http://www.apache.org/foundation/how-it-works.html">How Apache Works</a></li>
<li><a href="http://www.apache.org/dev/">Developer Documentation</a></li>
<li><a href="http://www.apache.org/foundation/">Foundation</a></li>
<li><a href="http://www.apache.org/foundation/sponsorship.html">Sponsor Apache</a></li>
<li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
</menu>
<div id="menuheader">
<a class="acevent" data-format="square" data-width="135" data-mode="light" data-event="random"></a>
</div>
</div>
<div class="span12">
<h2 id='Pig+Project+Incubation+Status'><img src="../images/redarrow.gif" />Pig Project Incubation Status</h2>
<div class="section-content">
<p>Pig is a platform for analyzing large data sets that consists of a high-level language for expressing data analysis programs, coupled with infrastructure for evaluating these programs. The salient property of Pig programs is that their structure is amenable to substantial parallelization, which in turns enables them to handle very large data sets.</p>
<p>Pig has <b>graduated as a Hadoop subproject</b>, see Message-ID: &lt;f767f0600810171144w3aaff127p65766a0a2a1a9662@mail.gmail.com&gt; on general@incubator.apache.org</p>
<p><span class="graduated">The Pig project graduated on 2008-10-22</span></p>
</div>
<h2 id='Description'><img src="../images/redarrow.gif" />Description</h2>
<div class="section-content">
<p>
<strong>Pig</strong> is a platform for analyzing large data sets that consists of a high-level language for expressing data analysis programs, coupled with infrastructure for evaluating these programs. The salient property of Pig programs is that their structure is amenable to substantial parallelization, which in turns enables them to handle very large data sets.
</p>
<p>
At the present time, Pig's infrastructure layer consists of a compiler that produces sequences of Map-Reduce programs, for which large-scale parallel implementations already exist (e.g., the Hadoop subproject). Pig's language layer currently consists of a textual language called Pig Latin, which has the following key properties:
</p>
<ul>
<li>
<strong>Ease of programming.</strong> It is trivial to achieve parallel execution of simple, "embarrassingly parallel" data analysis tasks. Complex tasks comprised of multiple interrelated data transformations are explicitly encoded as data flow sequences, making them easy to write, understand, and maintain.</li>
<li>
<strong>Optimization opportunities.</strong> The way in which tasks are encoded permits the system to optimize their execution automatically, allowing the user to focus on semantics rather than efficiency.</li>
<li>
<strong>Extensibility.</strong> Users can create their own functions to do special-purpose processing.</li>
</ul>
</div>
<h2 id='News'><img src="../images/redarrow.gif" />News</h2>
<div class="section-content">
<ul>
<li>October 22, 2008: Pig has graduated as a Hadoop subproject.</li>
<li>September 2008: Daniel Dai voted in as a Pig committer</li>
<li>September 2008: Pig 0.1.0 released</li>
<li>June 2008: Pi Song voted in as a Pig committer</li>
<li>October 2007: <a href="http://www.mail-archive.com/general@incubator.apache.org/msg15348.html">Pig formally accepted into Apache Incubator</a></li>
</ul>
</div>
<h2 id='Project+info'><img src="../images/redarrow.gif" />Project info</h2>
<div class="section-content">
<ul>
<li><a href="http://incubator.apache.org/pig/">Pig website</a></li>
<li><a href="http://incubator.apache.org/pig/whoweare.html">Pig committers and mentors</a></li>
<li><a href="http://wiki.apache.org/pig/">Pig wiki</a></li>
</ul>
</div>
<h2 id='Incubation+status+reports'><img src="../images/redarrow.gif" />Incubation status reports</h2>
<div class="section-content">
<ul>
<li><a href="http://wiki.apache.org/incubator/June2008">June 2008</a></li>
<li><a href="http://wiki.apache.org/incubator/September2008">September 2008</a></li>
</ul>
</div>
<h2 id='Incubation+work+items'><img src="../images/redarrow.gif" />Incubation work items</h2>
<div class="section-content">
<h3 id='Project+Setup'>Project Setup</h3>
<div class="section-content">
<p>This is the first phase on incubation, needed to start the project at Apache.</p>
<p>
<em>Item assignment is shown by the Apache id.</em>
<em>Completed tasks are shown by the completion date (YYYY-MM-dd).</em>
</p>
<h4 id='Identify+the+project+to+be+incubated'>Identify the project to be incubated</h4>
<div class="section-content">
<table class="colortable" width="100%">
<tr>
<th>date</th>
<th>item</th>
</tr>
<tr>
<td>October 2007</td>
<td>Make sure that the requested project name does not already exist and
check www.nameprotect.com to be sure that the name is not already
trademarked for an existing software product.</td>
</tr>
<tr>
<td>Existing project (Lucene) pre-approved Fall 2007</td>
<td>If request from outside Apache to enter an existing Apache project,
then post a message to that project for them to decide on acceptance.</td>
</tr>
</table>
<p><strong>DONE</strong></p>
</div>
<h4 id='Interim+responsibility'>Interim responsibility</h4>
<div class="section-content">
<table class="colortable" width="100%">
<tr>
<th>date</th>
<th>item</th>
</tr>
<tr>
<td>October 2007</td>
<td>Identify all the Mentors for the incubation, by asking all that can
be Mentors.</td>
</tr>
<tr>
<td>November 2007</td>
<td>Subscribe all Mentors on the pmc and general lists.</td>
</tr>
<tr>
<td>November 2007</td>
<td>Give all Mentors access to the incubator SVN repository.
(to be done by the Incubator PMC chair or an Incubator PMC
Member wih karma for the authorizations file)</td>
</tr>
<tr>
<td>November 2007 (re-done June 2008)</td>
<td>Tell Mentors to track progress in the file 'incubator/projects/{project.name}.xml'</td>
</tr>
</table>
<p><strong>DONE</strong></p>
</div>
<h4 id='Copyright'>Copyright</h4>
<div class="section-content">
<table class="colortable" width="100%">
<tr>
<th>date</th>
<th>item</th>
</tr>
<tr>
<td>Not applicable (I think)</td>
<td>Check and make sure that the papers that transfer rights to the ASF
been received. It is only necessary to transfer rights for the
package, the core code, and any new code produced by the project.
</td>
</tr>
<tr>
<td>Not applicble (new project)</td>
<td>Check and make sure that the files that have been donated have been
updated to reflect the new ASF copyright.</td>
</tr>
</table>
</div>
<h4 id='Verify+distribution+rights'>Verify distribution rights</h4>
<div class="section-content">
<table class="colortable" width="100%">
<tr>
<th>date</th>
<th>item</th>
</tr>
<tr>
<td>August 2008</td>
<td>Check and make sure that for all code included with the distribution
that is not under the Apache license, e have the right to combine
with Apache-licensed code and redistribute.
</td>
</tr>
<tr>
<td>August 2008</td>
<td>Check and make sure that all source code distributed by the project
is covered by one or more of the following approved licenses: Apache,
BSD, Artistic, MIT/X, MIT/W3C, MPL 1.1, or something with essentially
the same terms.</td>
</tr>
</table>
<p><strong>DONE</strong></p>
</div>
<h4 id='Establish+a+list+of+active+committers'>Establish a list of active committers</h4>
<div class="section-content">
<table class="colortable" width="100%">
<tr>
<th>date</th>
<th>item</th>
</tr>
<tr>
<td>October 2007 (and ongoing)</td>
<td>Check that all active committers have submitted a contributors
agreement.</td>
</tr>
<tr>
<td>September 2008 </td>
<td>Add all active committers in the STATUS file.</td>
</tr>
<tr>
<td>September 2008</td>
<td>Ask root for the creation of committers' accounts on
people.apache.org.</td>
</tr>
</table>
<p><strong>DONE</strong></p>
<p> Active Committers Are </p>
<table class="colortable" width="100%">
<tr>
<th> Committer </th>
<th> Email Address </th>
</tr>
<tr>
<td> Daniel Dai </td>
<td> daijyc@gmail.com </td>
</tr>
<tr>
<td> Nigel Daley </td>
<td> nigel@apache.org </td>
</tr>
<tr>
<td> Alan Gates </td>
<td> gates@yahoo-inc.com </td>
</tr>
<tr>
<td> Olga Natkovich </td>
<td> olgan@yahoo-inc.com </td>
</tr>
<tr>
<td> Owen O'Malley </td>
<td> omalley@apache.org </td>
</tr>
<tr>
<td> Chris Olston </td>
<td> olston@yahoo-inc.com </td>
</tr>
<tr>
<td> Ben Reed </td>
<td> breed@yahoo-inc.com </td>
</tr>
<tr>
<td> Pi Song </td>
<td> pi.songs@gmail.com </td>
</tr>
<tr>
<td> Utkarsh Srivastava </td>
<td> utkarsh@yahoo-inc.com </td>
</tr>
</table>
</div>
<h4 id='Infrastructure'>Infrastructure</h4>
<div class="section-content">
<table class="colortable" width="100%">
<tr>
<th>date</th>
<th>item</th>
</tr>
<tr>
<td>October 2007</td>
<td>Ask infrastructure to create source repository modules and grant the
committers karma.</td>
</tr>
<tr>
<td>October 2007</td>
<td>Ask infrastructure to set up and archive Mailing lists.</td>
</tr>
<tr>
<td>October 2007</td>
<td>Decide about and then ask infrastructure to setup an issuetracking
system (Bugzilla, Scarab, Jira).</td>
</tr>
<tr>
<td>Not applicable (project starts in Apache)</td>
<td>Migrate the project to our infrastructure.</td>
</tr>
</table>
<p><strong>DONE</strong></p>
</div>
<h4 id='Project+specific'>Project specific</h4>
<div class="section-content">
<p>
<em>Add project specific tasks here.</em>
</p>
</div>
</div>
<h3 id='Incubation'>Incubation</h3>
<div class="section-content">
<p>These action items have to be checked for during the whole incubation process.</p>
<p>
<em>These items are not to be signed as done during incubation, as they
may change during incubation.</em>
<em>They are to be looked into and described in the status reports and
completed in the request for incubation signoff.</em>
</p>
<h4 id='Collaborative+Development'>Collaborative Development</h4>
<div class="section-content">
<ul>
<li>Have all of the active long-term volunteers been identified and
acknowledged as committers on the project? <strong>Yes</strong>
</li>
<li>Are there three or more independent committers? (The legal definition
of independent is long and boring, but basically it means that there
is no binding relationship between the individuals, such as a shared
employer, that is capable of overriding their free will as
individuals, directly or indirectly.)<strong>Yes</strong>
</li>
<li>Are project decisions being made in public by the committers?<strong>Yes</strong></li>
<li>Are the decision-making guidelines published and agreed to by all of
the committers?<strong>Yes</strong>
</li>
</ul>
</div>
<h4 id='Licensing+awareness'>Licensing awareness</h4>
<div class="section-content">
<ul>
<li>Are all licensing, trademark, credit issues being taken care of and
acknowleged by all committers?<strong>Yes</strong></li>
</ul>
</div>
<h4 id='Project+Specific'>Project Specific</h4>
<div class="section-content">
<p>
<em>Add project specific tasks here.</em>
</p>
</div>
</div>
<h3 id='Exit'>Exit</h3>
<div class="section-content">
<p>
<em>Things to check for before voting the project out.</em>
</p>
<h4 id='Organizational+acceptance+of+responsibility+for+the+project'>Organizational acceptance of responsibility for the project</h4>
<div class="section-content">
<ul>
<li>If graduating to an existing PMC, has the PMC voted to accept it?</li>
<li>If graduating to a new PMC, has the board voted to accept it?</li>
</ul>
</div>
<h4 id='Incubator+sign-off'>Incubator sign-off</h4>
<div class="section-content">
<ul>
<li>Has the Incubator decided that the project has accomplished all of
the above tasks?</li>
</ul>
</div>
</div>
</div>
</div>
</div>
<div class="row"><div class="span16"><hr noshade="noshade" size="1"/></div></div>
<div class="row">
<div class="span16 footer">
Copyright &#169; 2009-2024 The Apache Software Foundation<br />
Licensed under the <a href="http://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.<br/>
Apache Incubator, Apache, the Apache feather logo, and the Apache Incubator project logo are trademarks of The Apache Software Foundation.
</div>
</div>
</div>
</body>
</html>