<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<!--
   Licensed to the Apache Software Foundation (ASF) under one or more
   contributor license agreements.  See the NOTICE file distributed with
   this work for additional information regarding copyright ownership.
   The ASF licenses this file to You under the Apache License, Version 2.0
   (the "License"); you may not use this file except in compliance with
   the License.  You may obtain a copy of the License at

       http://www.apache.org/licenses/LICENSE-2.0

   Unless required by applicable law or agreed to in writing, software
   distributed under the License is distributed on an "AS IS" BASIS,
   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
   See the License for the specific language governing permissions and
   limitations under the License.
-->
<head>
   <title>Chukwa</title>
</head>
<body>

Hadoop MapReduce and HDFS are designed to support efficient batch processing of large datasets.  Many organizations accumulate huge volumes of log files and system metrics data, and it's tempting to use MapReduce to do the processing. However, this data has certain unfortunate characteristics. It's updated incrementally, and spread across many machines. This makes it a difficult to use MapReduce on this data.  Chukwa is a Hadoop subproject aiming to bridge this gap, and to facilitate MapReduce processing of monitoring data.  


Chukwa is an open source data collection system for monitoring and analyzing large distributed systems.  
Chukwa is built on top of the Hadoop distributed filesystem (HDFS) and MapReduce framework and inherits Hadoop's
scalability and robustness.  Chukwa also includes a flexible and powerful toolkit for displaying monitoring
and analyzing results, in order to make the best use of this collected data.
</body>
</html>