| <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"> |
| <html> |
| <!-- |
| Licensed to the Apache Software Foundation (ASF) under one or more |
| contributor license agreements. See the NOTICE file distributed with |
| this work for additional information regarding copyright ownership. |
| The ASF licenses this file to You under the Apache License, Version 2.0 |
| (the "License"); you may not use this file except in compliance with |
| the License. You may obtain a copy of the License at |
| |
| http://www.apache.org/licenses/LICENSE-2.0 |
| |
| Unless required by applicable law or agreed to in writing, software |
| distributed under the License is distributed on an "AS IS" BASIS, |
| WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| See the License for the specific language governing permissions and |
| limitations under the License. |
| --> |
| <head> |
| <title>Chukwa</title> |
| </head> |
| <body> |
| |
| Hadoop MapReduce and HDFS are designed to support efficient batch processing of large datasets. Many organizations accumulate huge volumes of log files and system metrics data, and it's tempting to use MapReduce to do the processing. However, this data has certain unfortunate characteristics. It's updated incrementally, and spread across many machines. This makes it a difficult to use MapReduce on this data. Chukwa is a Hadoop subproject aiming to bridge this gap, and to facilitate MapReduce processing of monitoring data. |
| |
| |
| Chukwa is an open source data collection system for monitoring and analyzing large distributed systems. |
| Chukwa is built on top of the Hadoop distributed filesystem (HDFS) and MapReduce framework and inherits Hadoop's |
| scalability and robustness. Chukwa also includes a flexible and powerful toolkit for displaying monitoring |
| and analyzing results, in order to make the best use of this collected data. |
| </body> |
| </html> |
| |
