StreamPark, Make stream processing easier! easy-to-use streaming application development framework and operation platform

Clone this repo:
  1. 86c5a9a [improve] official website url improve (#1695) by benjobs · 6 hours ago dev
  2. 7ea373d Chinese Notes to English Notes (#1690) by ChunFu Wu · 16 hours ago
  3. a1c45d8 [Feature] Update the username index for t_user table (#1685) by 1996fanrui · 26 hours ago
  4. d84c21a jobStatuses use appId as key (#1686) by 阿洋 · 26 hours ago
  5. 7454222 [polish] polish code. (#1674) by gongzhongqiang · 26 hours ago

Official Website | Document

English | 中文

Apache StreamPark (Incubating)

Make stream processing easier

A magical framework that make stream processing easier!

🚀 Introduction

Apache Flink and Apache Spark are widely used as the next generation of big data streaming computing engines. Based on a bench of excellent experiences combined with best practices, we extracted the task deployment and runtime parameters into the configuration files. In this way, an easy-to-use RuntimeContext with out-of-the-box connectors would bring easier and more efficient task development experience. It reduces the learning cost and development barriers, hence developers can focus on the business logic. On the other hand, It can be challenge for enterprises to use Flink & Spark if there is no professional management platform for Flink & Spark tasks during the deployment phase. StreamPark provides such a professional task management platform, including task development, scheduling, interactive query, deployment, operation, maintenance, etc.

🎉 Features

  • Apache Flink & Spark application development scaffolding
  • Out-of-the-box connectors
  • Support maven compilation
  • Support multiple versions of Flink & Spark
  • Scala 2.11 / 2.12 support
  • One-stop stream processing operation platform
  • Support catalog、olap、streaming-warehouse etc.
  • ...

🚀 Quick Start

click Document for more information

💋 our users

Various companies and organizations use StreamPark for research, production and commercial products. Are you using this project ? you can add your company

Our users

🤝 Contribution

PRs Welcome

You can submit any ideas as pull requests or as GitHub issues.

If you're new to posting issues, we ask that you read How To Ask Questions The Smart Way (This guide does not provide actual support services for this project!), How to Report Bugs Effectively prior to posting. Well written bug reports help us help you!

Thank you to all the people who already contributed to StreamPark!

⏰ Contributor Over Time

Stargazers Over Time

👍Stargazers Over Time

Stargazers over time

💬 Join us (微信公众号)