blob: 93f713d69973f4dee59311c9ffa1ef93dac6f18c [file] [log] [blame]
Apache Pig
Pig is a dataflow programming environment for processing very large files. Pig's
language is called Pig Latin. A Pig Latin program consists of a directed
acyclic graph where each node represents an operation that transforms data.
Operations are of two flavors: (1) relational-algebra style operations such as
join, filter, project; (2) functional-programming style operators such as map,
Pig compiles these dataflow programs into (sequences of) map-reduce jobs and
executes them using Hadoop. It is also possible to execute Pig Latin programs
in a "local" mode (without Hadoop cluster), in which case all processing takes
place in a single local JVM.
General Info
For the latest information about Pig, please visit our website at:
and our wiki, at:
Getting Started
1. To learn about Pig, try
2. To build and run Pig, try and
3. To check out the function library, try
Contributing to the Project
We welcome all contributions. For the details, please, visit
Incubator Disclaimer
Apache Pig is an effort undergoing incubation at The Apache Software
Foundation (ASF). Incubation is required of all newly accepted projects
until a further review indicates that the infrastructure, communications,
and decision making process have stabilized in a manner consistent with
other successful ASF projects. While incubation status is not necessarily
a reflection of the completeness or stability of the code, it does indicate
that the project has yet to be fully endorsed by the ASF.