Google Git
Sign in
apache / incubator-pinot / refs/heads/hot_fix
commita992e74a40061cdd8b1177c358b37a6c1c5a97ed[log] [tgz]
authorXiang Fu <fx19880617@gmail.com>Thu Aug 22 15:22:12 2019 -0700
committerSeunghyun Lee <snlee@linkedin.com>Thu Aug 22 17:47:35 2019 -0700
tree8f1fcad51c37262847b7e850d990a4246b119cf8
parentb2466b12c65df4f5447700bbdafa7ed1d45440c8 [diff]
Fixing the issue of selection order-by won't give correct ordering (#4540)

Fixing the issue of selection order-by won't give correct ordering
Enhance the integration test to check the order of the result for selection order-by queries

(cherry picked from commit cf9974c3fb418e33a020d547824a31b454f1ff91)
5 files changed
tree: 8f1fcad51c37262847b7e850d990a4246b119cf8
  1. .codecov.yml
  2. .codecov_bash
  3. .gitignore
  4. .travis.yml
  5. .travis_install.sh
  6. .travis_test.sh
  7. DISCLAIMER
  8. HEADER
  9. LICENSE
  10. LICENSE-binary
  11. NOTICE
  12. NOTICE-binary
  13. README.md
  14. config/
  15. contrib/
  16. docker/
  17. docs/
  18. licenses-binary/
  19. licenses/
  20. pinot-api/
  21. pinot-azure-filesystem/
  22. pinot-broker/
  23. pinot-common/
  24. pinot-connectors/
  25. pinot-controller/
  26. pinot-core/
  27. pinot-distribution/
  28. pinot-hadoop-filesystem/
  29. pinot-hadoop/
  30. pinot-integration-tests/
  31. pinot-minion/
  32. pinot-orc/
  33. pinot-parquet/
  34. pinot-perf/
  35. pinot-server/
  36. pinot-tools/
  37. pinot-transport/
  38. pom.xml
  39. rstheaderdefinition.xml
  40. thirdeye/
README.md

Apache Pinot (incubating)

Build Status codecov.io Join the chat at https://gitter.im/linkedin/pinot license

Apache Pinot is a realtime distributed OLAP datastore, which is used to deliver scalable real time analytics with low latency. It can ingest data from offline data sources (such as Hadoop and flat files) as well as online sources (such as Kafka). Pinot is designed to scale horizontally.

These presentations on Pinot give an overview of Pinot:

Looking for the ThirdEye anomaly detection and root-cause analysis platform? Check out the Pinot/ThirdEye project

Key Features

  • A column-oriented database with various compression schemes such as Run Length, Fixed Bit Length
  • Pluggable indexing technologies - Sorted Index, Bitmap Index, Inverted Index
  • Ability to optimize query/execution plan based on query and segment metadata
  • Near real time ingestion from Kafka and batch ingestion from Hadoop
  • SQL like language that supports selection, aggregation, filtering, group by, order by, distinct queries on fact data
  • Support for multivalued fields
  • Horizontally scalable and fault tolerant

Because of the design choices we made to achieve these goals, there are certain limitations present in Pinot:

  • Pinot is not a replacement for database i.e it cannot be used as source of truth store, cannot mutate data
  • Not a replacement for search engine i.e full text search, relevance not supported
  • Query cannot span across multiple tables

Pinot works very well for querying time series data with lots of Dimensions and Metrics. Example - Query (profile views, ad campaign performance, etc.) in an analytical fashion (who viewed this profile in the last weeks, how many ads were clicked per campaign).

Instructions to build Pinot

More detailed instructions can be found at Quick Demo section in the documentation.

# Clone a repo
$ git clone https://github.com/apache/incubator-pinot.git
$ cd incubator-pinot

# Build Pinot
$ mvn clean install -DskipTests -Pbin-dist

# Run Quck Demo
$ cd pinot-distribution/target/apache-pinot-incubating-<version>-SNAPSHOT-bin
$ bin/quick-start-offline.sh

Getting Involved

Documentation

Check out Pinot documentation for a complete description of Pinot's features.

License

Apache Pinot is under Apache License, Version 2.0