website/generated-content/about/index.html - beam - Git at Google

 <!doctype html><html lang=en class=no-js><head><meta charset=utf-8><meta http-equiv=x-ua-compatible content="IE=edge"><meta name=viewport content="width=device-width,initial-scale=1"><title>About</title><meta name=description content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow (a cloud service). Beam also brings DSL in different languages, allowing users to easily implement their data integration processes."><link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400,500,700" rel=stylesheet><link rel=preload href=/scss/main.min.408fddfe3e8a45f87a5a8c9a839d77db667c1c534e5e5cd0d957ffc3dd6c14cf.css as=style><link href=/scss/main.min.408fddfe3e8a45f87a5a8c9a839d77db667c1c534e5e5cd0d957ffc3dd6c14cf.css rel=stylesheet integrity><script src=https://code.jquery.com/jquery-2.2.4.min.js></script><style>.body__contained img{max-width:100%}</style><script type=text/javascript src=/js/bootstrap.min.2979f9a6e32fc42c3e7406339ee9fe76b31d1b52059776a02b4a7fa6a4fd280a.js defer></script>
 <script type=text/javascript src=/js/language-switch-v2.min.121952b7980b920320ab229551857669209945e39b05ba2b433a565385ca44c6.js defer></script>
 <script type=text/javascript src=/js/fix-menu.min.039174b67107465f2090a493f91e126f7aa797f29420f9edab8a54d9dd4b3d2d.js defer></script>
 <script type=text/javascript src=/js/section-nav.min.1405fd5e70fab5f6c54037c269b1d137487d8f3d1b3009032525f6db3fbce991.js defer></script>
 <script type=text/javascript src=/js/page-nav.min.af231204c9c52c5089d53a4c02739eacbb7f939e3be1c6ffcc212e0ac4dbf879.js defer></script>
 <script type=text/javascript src=/js/expandable-list.min.75a4526624a3b8898fe7fb9e3428c205b581f8b38c7926922467aef17eac69f2.js defer></script>
 <script type=text/javascript src=/js/copy-to-clipboard.min.364c06423d7e8993fc42bb4abc38c03195bc8386db26d18774ce775d08d5b18d.js defer></script>
 <script type=text/javascript src=/js/calendar.min.336664054fa0f52b08bbd4e3c59b5cb6d63dcfb2b4d602839746516b0817446b.js defer></script>
 <script type=text/javascript src=/js/fix-playground-nested-scroll.min.0283f1037cb1b9d5074c6eaf041292b524a8148a7cdb803d5ccd6d1fc4eb3253.js defer></script>
 <script type=text/javascript src=/js/anchor-content-jump-fix.min.22d3240f81632e4c11179b9d2aaf37a40da9414333c43aa97344e8b21a7df0e4.js defer></script>
 <link rel=alternate type=application/rss+xml title="Apache Beam" href=/feed.xml><link rel=canonical href=/about/ data-proofer-ignore><link rel="shortcut icon" type=image/x-icon href=/images/favicon.ico><link rel=stylesheet href=https://use.fontawesome.com/releases/v5.4.1/css/all.css integrity=sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz crossorigin=anonymous><link rel=stylesheet href=https://unpkg.com/swiper@8/swiper-bundle.min.css><script async src=https://platform.twitter.com/widgets.js></script>
 <script>(function(e,t,n,s,o,i,a){e.GoogleAnalyticsObject=o,e[o]=e[o]||function(){(e[o].q=e[o].q||[]).push(arguments)},e[o].l=1*new Date,i=t.createElement(n),a=t.getElementsByTagName(n)[0],i.async=1,i.src=s,a.parentNode.insertBefore(i,a)})(window,document,"script","//www.google-analytics.com/analytics.js","ga"),ga("create","UA-73650088-1","auto"),ga("send","pageview")</script><script>(function(e,t,n,s,o,i){e.hj=e.hj||function(){(e.hj.q=e.hj.q||[]).push(arguments)},e._hjSettings={hjid:2182187,hjsv:6},o=t.getElementsByTagName("head")[0],i=t.createElement("script"),i.async=1,i.src=n+e._hjSettings.hjid+s+e._hjSettings.hjsv,o.appendChild(i)})(window,document,"https://static.hotjar.com/c/hotjar-",".js?sv=")</script></head><body class=body data-spy=scroll data-target=.page-nav data-offset=0><nav class="navigation-bar-mobile header navbar navbar-fixed-top"><div class=navbar-header><a href=/ class=navbar-brand><img alt=Brand style=height:46px;width:43px src=/images/beam_logo_navbar_mobile.png></a>
 <a class=navbar-link href=/get-started/>Get Started</a>
 <a class=navbar-link href=/documentation/>Documentation</a>
 <button type=button class="navbar-toggle menu-open" aria-expanded=false aria-controls=navbar onclick=openMenu()>
 <span class=sr-only>Toggle navigation</span>
 <span class=icon-bar></span>
 <span class=icon-bar></span>
 <span class=icon-bar></span></button></div><div class="navbar-mask closed"></div><div id=navbar class="navbar-container closed"><button type=button class=navbar-toggle aria-expanded=false aria-controls=navbar id=closeMenu>
 <span class=sr-only>Toggle navigation</span>
 <span class=icon-bar></span>
 <span class=icon-bar></span>
 <span class=icon-bar></span></button><ul class="nav navbar-nav"><li><div class=searchBar-mobile><script>(function(){var t,n="012923275103528129024:4emlchv9wzi",e=document.createElement("script");e.type="text/javascript",e.async=!0,e.src="https://cse.google.com/cse.js?cx="+n,t=document.getElementsByTagName("script")[0],t.parentNode.insertBefore(e,t)})()</script><gcse:search></gcse:search></div></li><li><a class=navbar-link href=/about>About</a></li><li><a class=navbar-link href=/get-started/>Get Started</a></li><li><span class=navbar-link>Documentation</span><ul><li><a href=/documentation/>General</a></li><li><a href=/documentation/sdks/java/>Languages</a></li><li><a href=/documentation/runners/capability-matrix/>Runners</a></li><li><a href=/documentation/io/connectors/>I/O Connectors</a></li></ul></li><li><a class=navbar-link href=/roadmap/>Roadmap</a></li><li><a class=navbar-link href=/community/>Community</a></li><li><a class=navbar-link href=/contribute/>Contribute</a></li><li><a class=navbar-link href=/blog/>Blog</a></li><li><a class=navbar-link href=/case-studies/>Case Studies</a></li></ul><ul class="nav navbar-nav navbar-right"><li><a href=https://github.com/apache/beam/edit/master/website/www/site/content/en/about/_index.md data-proofer-ignore><svg xmlns="http://www.w3.org/2000/svg" width="25" height="24" fill="none" viewBox="0 0 25 24"><path stroke="#ff6d00" stroke-linecap="round" stroke-linejoin="round" stroke-width="2.75" d="M4.543 20h4l10.5-10.5c.53-.53.828-1.25.828-2s-.298-1.47-.828-2-1.25-.828-2-.828-1.47.298-2 .828L4.543 16v4zm9.5-13.5 4 4"/></svg></a></li><li class=dropdown><a href=# class=dropdown-toggle id=apache-dropdown data-toggle=dropdown role=button aria-haspopup=true aria-expanded=false><img src=https://www.apache.org/foundation/press/kit/feather_small.png alt="Apache Logo" style=height:20px>
 &nbsp;Apache
 <span class=arrow-icon><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" fill="none" viewBox="0 0 20 20"><circle cx="10" cy="10" r="10" fill="#ff6d00"/><path stroke="#fff" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" d="M8.535 5.28l4.573 4.818-4.573 4.403"/></svg></span></a><ul class="dropdown-menu dropdown-menu-right"><li><a target=_blank href=https://www.apache.org/>ASF Homepage</a></li><li><a target=_blank href=https://www.apache.org/licenses/>License</a></li><li><a target=_blank href=https://www.apache.org/security/>Security</a></li><li><a target=_blank href=https://www.apache.org/foundation/thanks.html>Thanks</a></li><li><a target=_blank href=https://www.apache.org/foundation/sponsorship.html>Sponsorship</a></li><li><a target=_blank href=https://www.apache.org/foundation/policies/conduct>Code of Conduct</a></li></ul></li></ul></div></nav><nav class=navigation-bar-desktop><a href=/ class=navbar-logo><img src=/images/beam_logo_navbar.png alt="Beam Logo"></a><div class=navbar-bar-left><div class=navbar-links><a class=navbar-link href=/about>About</a>
 <a class=navbar-link href=/get-started/>Get Started</a><li class="dropdown navbar-dropdown navbar-dropdown-documentation"><a href=# class="dropdown-toggle navbar-link" role=button aria-haspopup=true aria-expanded=false>Documentation
 <span><svg xmlns="http://www.w3.org/2000/svg" width="12" height="11" fill="none" viewBox="0 0 12 11"><path stroke="#ff6d00" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" d="M10.666 4.535 5.847 9.108 1.444 4.535"/></svg></span></a><ul class=dropdown-menu><li><a class=navbar-dropdown-menu-link href=/documentation/>General</a></li><li><a class=navbar-dropdown-menu-link href=/documentation/sdks/java/>Languages</a></li><li><a class=navbar-dropdown-menu-link href=/documentation/runners/capability-matrix/>Runners</a></li><li><a class=navbar-dropdown-menu-link href=/documentation/io/connectors/>I/O Connectors</a></li></ul></li><a class=navbar-link href=/roadmap/>Roadmap</a>
 <a class=navbar-link href=/community/>Community</a>
 <a class=navbar-link href=/contribute/>Contribute</a>
 <a class=navbar-link href=/blog/>Blog</a>
 <a class=navbar-link href=/case-studies/>Case Studies</a></div><div id=iconsBar><a type=button onclick=showSearch()><svg xmlns="http://www.w3.org/2000/svg" width="25" height="24" fill="none" viewBox="0 0 25 24"><path stroke="#ff6d00" stroke-linecap="round" stroke-linejoin="round" stroke-width="2.75" d="M10.191 17c3.866.0 7-3.134 7-7s-3.134-7-7-7-7 3.134-7 7 3.134 7 7 7zm11 4-6-6"/></svg></a><a target=_blank href=https://github.com/apache/beam/edit/master/website/www/site/content/en/about/_index.md data-proofer-ignore><svg xmlns="http://www.w3.org/2000/svg" width="25" height="24" fill="none" viewBox="0 0 25 24"><path stroke="#ff6d00" stroke-linecap="round" stroke-linejoin="round" stroke-width="2.75" d="M4.543 20h4l10.5-10.5c.53-.53.828-1.25.828-2s-.298-1.47-.828-2-1.25-.828-2-.828-1.47.298-2 .828L4.543 16v4zm9.5-13.5 4 4"/></svg></a><li class="dropdown navbar-dropdown navbar-dropdown-apache"><a href=# class=dropdown-toggle role=button aria-haspopup=true aria-expanded=false><img src=https://www.apache.org/foundation/press/kit/feather_small.png alt="Apache Logo" style=height:20px>
 &nbsp;Apache
 <span class=arrow-icon><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" fill="none" viewBox="0 0 20 20"><circle cx="10" cy="10" r="10" fill="#ff6d00"/><path stroke="#fff" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" d="M8.535 5.28l4.573 4.818-4.573 4.403"/></svg></span></a><ul class=dropdown-menu><li><a class=navbar-dropdown-menu-link target=_blank href=https://www.apache.org/>ASF Homepage</a></li><li><a class=navbar-dropdown-menu-link target=_blank href=https://www.apache.org/licenses/>License</a></li><li><a class=navbar-dropdown-menu-link target=_blank href=https://www.apache.org/security/>Security</a></li><li><a class=navbar-dropdown-menu-link target=_blank href=https://www.apache.org/foundation/thanks.html>Thanks</a></li><li><a class=navbar-dropdown-menu-link target=_blank href=https://www.apache.org/foundation/sponsorship.html>Sponsorship</a></li><li><a class=navbar-dropdown-menu-link target=_blank href=https://www.apache.org/foundation/policies/conduct>Code of Conduct</a></li></ul></li></div><div class="searchBar disappear"><script>(function(){var t,n="012923275103528129024:4emlchv9wzi",e=document.createElement("script");e.type="text/javascript",e.async=!0,e.src="https://cse.google.com/cse.js?cx="+n,t=document.getElementsByTagName("script")[0],t.parentNode.insertBefore(e,t)})()</script><gcse:search></gcse:search>
 <a type=button onclick=endSearch()><svg xmlns="http://www.w3.org/2000/svg" width="25" height="25" fill="none" viewBox="0 0 25 25"><path stroke="#ff6d00" stroke-linecap="round" stroke-linejoin="round" stroke-width="2.75" d="M21.122 20.827 4.727 4.432M21.122 4.43 4.727 20.827"/></svg></a></div></div></nav><div class=header-push></div><div class="top-banners swiper"><div class=swiper-wrapper><div class=swiper-slide><a href=https://tour.beam.apache.org><img class=banner-img-desktop src=/images/banners/tour-of-beam/tour-of-beam-desktop.png alt="Start Tour of Beam">
 <img class=banner-img-mobile src=/images/banners/tour-of-beam/tour-of-beam-mobile.png alt="Start Tour of Beam"></a></div><div class=swiper-slide><a href=https://beam.apache.org/documentation/ml/overview/><img class=banner-img-desktop src=/images/banners/machine-learning/machine-learning-desktop.jpg alt="Machine Learning">
 <img class=banner-img-mobile src=/images/banners/machine-learning/machine-learning-mobile.jpg alt="Machine Learning"></a></div></div><div class=swiper-pagination></div><div class=swiper-button-prev></div><div class=swiper-button-next></div></div><script src=/js/swiper-bundle.min.min.e0e8f81b0b15728d35ff73c07f42ddbb17a108d6f23df4953cb3e60df7ade675.js></script>
 <script src=/js/sliders/top-banners.min.afa7d0a19acf7a3b28ca369490b3d401a619562a2a4c9612577be2f66a4b9855.js></script>
 <script>function showSearch(){addPlaceholder();var e,t=document.querySelector(".searchBar");t.classList.remove("disappear"),e=document.querySelector("#iconsBar"),e.classList.add("disappear")}function addPlaceholder(){$("input:text").attr("placeholder","What are you looking for?")}function endSearch(){var e,t=document.querySelector(".searchBar");t.classList.add("disappear"),e=document.querySelector("#iconsBar"),e.classList.remove("disappear")}function blockScroll(){$("body").toggleClass("fixedPosition")}function openMenu(){addPlaceholder(),blockScroll()}</script><div class="clearfix container-main-content center"><nav class="page-nav clearfix" data-offset-top=90 data-offset-bottom=500><nav id=TableOfContents><ul><li><a href=#why-apache-beam>Why Apache Beam?</a></li><li><a href=#about-apache-beam-project>About Apache Beam Project</a></li></ul></nav></nav><div class="body__contained body__section-nav"><h1 id=about>About</h1><h2 id=why-apache-beam>Why Apache Beam?</h2><p>Apache Beam is an open-source, unified programming model for batch and streaming data processing pipelines that simplifies large-scale data processing dynamics. Thousands of organizations around the world choose Apache Beam due to its unique data processing features, proven scale, and powerful yet extensible capabilities.</p><div class=about-graph-container><img class=about-graph-img-desktop src=/images/batch_stream_processing_desktop.png alt="Batch and Stream Processing">
 <img class=about-graph-img-mobile src=/images/batch_stream_processing_mobile.png alt="Batch and Stream Processing"></div><br><br><p>Apache Beam is the future of data processing because it provides:<br><br></p><div class="icon-list list--about"><div class=list-item><div class="list-item-icon list-item-icon--about"><svg width="96" height="96" viewBox="0 0 96 96" fill="none" xmlns="http://www.w3.org/2000/svg"><rect width="96" height="96" rx="8" fill="#f8f8f8"/><g clip-path="url(#clip0_1889_8360)"><path d="M8 16c0-4.4183 3.5817-8 8-8H80c4.4183.0 8 3.5817 8 8V80c0 4.4183-3.5817 8-8 8H16c-4.4183.0-8-3.5817-8-8V16z" fill="#f8f8f8"/><circle cx="34.8" cy="35.5594" r="13.2" stroke="#e74d1a" stroke-width="3.2"/><circle cx="34.8" cy="35.5594" r="6" stroke="#e74d1a" stroke-width="3.2"/><circle cx="52" cy="18.3594" r="4" stroke="#e74d1a" stroke-width="3.2"/><circle cx="66.4" cy="65.5594" r="4" stroke="#e74d1a" stroke-width="3.2"/><circle cx="20.8" cy="57.5594" r="4" stroke="#e74d1a" stroke-width="3.2"/><path d="M53.9496 32.6804C53.3392 30.9367 54.8454 29.186 56.6607 29.5293L77.777 33.5221C79.5924 33.8654 80.3554 36.0451 79.1504 37.4456L65.1344 53.7365C63.9294 55.137 61.6602 54.7079 61.0498 52.9641L53.9496 32.6804z" stroke="#e74d1a" stroke-width="3.2"/><path d="M62.4657 38.1795C62.2622 37.5982 62.7643 37.0147 63.3694 37.1291l5.3874 1.0187C69.3619 38.2622 69.6162 38.9888 69.2146 39.4556l-3.5759 4.1563C65.237 44.0787 64.4806 43.9357 64.2772 43.3544l-1.8115-5.1749z" stroke="#e74d1a" stroke-width="3.2"/><rect x="30.4" y="57.6177" width="22.6839" height="22.6839" rx="3.2" transform="rotate(-10.3062 30.4 57.6177)" stroke="#e74d1a" stroke-width="3.2"/><rect x="37.6" y="61.8631" width="10.6407" height="10.6407" rx="3.2" transform="rotate(-10.3062 37.6 61.8631)" stroke="#e74d1a" stroke-width="3.2"/></g><defs><clipPath id="clip0_1889_8360"><path d="M8 16c0-4.4183 3.5817-8 8-8H80c4.4183.0 8 3.5817 8 8V80c0 4.4183-3.5817 8-8 8H16c-4.4183.0-8-3.5817-8-8V16z" fill="#fff"/></clipPath></defs></svg></div><div><h3 class=list-item-header>Powerful Abstraction</h3><p class=list-item-text>The Apache Beam model offers powerful abstractions that insulate you from low-level details of distributed data processing, such as coordinating individual workers, reading from sources and writing to sinks, etc.<br><br>The pipeline abstraction encapsulates all the data and steps in your data processing task. You can think of your data processing tasks in terms of these abstractions.<br><br>The higher level abstractions neatly separate data from runtime characteristics and simplify the mechanics of large-scale distributed data processing. You focus on creating value for customers and business while the Dataflow model handles the rest.</p></div></div><div class=list-item><div class="list-item-icon list-item-icon--about"><svg width="96" height="96" viewBox="0 0 96 96" fill="none" xmlns="http://www.w3.org/2000/svg"><rect width="96" height="96" rx="8" fill="#f8f8f8"/><path d="M8 16c0-4.4183 3.5817-8 8-8H80c4.4183.0 8 3.5817 8 8V80c0 4.4183-3.5817 8-8 8H16c-4.4183.0-8-3.5817-8-8V16z" fill="#f8f8f8"/><path d="M27.7333 20V31.6281m0 8.5947v4.2443m0 9.1329v-2M37.8667 20v5.3085m0 7.078v2.7806M48 28.2155v3.4126m0 7.078v5.3085M37.8667 42.8517v5.5736M48 20v1.1628M17.6 47.4915V52.8m0-20.0711v3.7918M17.6 20v3.9434M58.1333 20V34.4642m0 10.691v4.7166M68.2667 20v6.6032m0 8.8043v3.4589M78.4 30.2193v4.2449M78.4 43.2685v6.6033M68.2667 48.4253v1.4465M78.4 20v1.4464" stroke="#e74d1a" stroke-width="4" stroke-linecap="round" stroke-linejoin="round"/><path d="M17.6 63.6152v8.193C17.6 73.0257 18.0843 74.1943 18.9474 75.056 19.8093 75.9165 20.9798 76.4 22.1992 76.4H73.9988C75.2194 76.4 76.3887 75.9165 77.2518 75.056 78.115 74.1943 78.5992 73.0269 78.5992 71.8082v-8.193" stroke="#e74d1a" stroke-width="4" stroke-linecap="round" stroke-linejoin="round"/><path d="M42.4 62l5.5989 5.2L53.6 62m-5.5989-9.2V67.1988" stroke="#e74d1a" stroke-width="4" stroke-linecap="round" stroke-linejoin="round"/></svg></div><div><h3 class=list-item-header>Unified Batch and Streaming Programming Model</h3><p class=list-item-text>Apache Beam provides flexibility to express the business logic just once and execute it for both batch and streaming data pipelines, on-premises via OSS runners or in the cloud via managed services such as Google Cloud Dataflow or AWS Kinesis Data Analytics.<br><br>Apache Beam unifies multiple data processing engines and SDKs around its distinctive Beam model. This offers a way to easily create a large-scale common data infrastructure across different applications that consume the data.</p></div></div><div class=list-item><div class="list-item-icon list-item-icon--about"><svg width="96" height="96" viewBox="0 0 96 96" fill="none" xmlns="http://www.w3.org/2000/svg"><rect width="96" height="96" rx="8" fill="#f8f8f8"/><path d="M8 16c0-4.4183 3.5817-8 8-8H80c4.4183.0 8 3.5817 8 8V80c0 4.4183-3.5817 8-8 8H16c-4.4183.0-8-3.5817-8-8V16z" fill="#f8f8f8"/><path d="M56 59.2 58.4 48l2.4-11.2" stroke="#e74d1a" stroke-width="4" stroke-linecap="round" stroke-linejoin="round"/><path d="M46.4 59.2 48.8 48 51.2 36.8" stroke="#e74d1a" stroke-width="4" stroke-linecap="round" stroke-linejoin="round"/><path d="M36.8 59.2 39.2 48l2.4-11.2" stroke="#e74d1a" stroke-width="4" stroke-linecap="round" stroke-linejoin="round"/><path d="M71.2 29.6H71.8316c2.20910000000001.0 4 1.7909 4 4v8.2573C75.8316 42.8501 76.2008 43.8075 76.8675 44.5432L77.5661 45.3141C78.9473 46.8383 78.9473 49.1617 77.5661 50.686L76.8675 51.4568C76.2008 52.1925 75.8316 53.1499 75.8316 54.1428V62.4C75.8316 64.6092 74.0407 66.4 71.8316 66.4H71.2" stroke="#e74d1a" stroke-width="4" stroke-linecap="round" stroke-linejoin="round"/><path d="M25.6 29.6H24.5474c-2.2092.0-4 1.7909-4 4v8.1566C20.5474 42.8095 20.1322 43.82 19.392 44.5687L18.7799 45.1879c-1.5404 1.5583-1.5404 4.0659.0 5.6242L19.392 51.4313C20.1322 52.1801 20.5474 53.1905 20.5474 54.2434V62.4C20.5474 64.6092 22.3382 66.4 24.5474 66.4H25.6" stroke="#e74d1a" stroke-width="4" stroke-linecap="round" stroke-linejoin="round"/><path d="M16.8 80h64" stroke="#e74d1a" stroke-width="4" stroke-linecap="round" stroke-linejoin="round"/><path d="M16.8 16h64" stroke="#e74d1a" stroke-width="4" stroke-linecap="round" stroke-linejoin="round"/></svg></div><div><h3 class=list-item-header>Cross-language Capabilities</h3><p class=list-item-text>You can select a programming language from a variety of language SDKs: Java, Python, Go, SQL, TypeScript, Scala (via Scio), or leverage multi-language capabilities to empower every team member to write transforms in their favorite programming language and use them together in one robust, multi-language pipeline. Apache Beam eliminates the skill set dependency and helps avoid becoming tied to a specific technology skill set and stack.</p></div></div><div class=list-item><div class="list-item-icon list-item-icon--about"><svg width="96" height="96" viewBox="0 0 96 96" fill="none" xmlns="http://www.w3.org/2000/svg"><rect width="96" height="96" rx="8" fill="#f8f8f8"/><path d="M8 16c0-4.4183 3.5817-8 8-8H80c4.4183.0 8 3.5817 8 8V80c0 4.4183-3.5817 8-8 8H16c-4.4183.0-8-3.5817-8-8V16z" fill="#f8f8f8"/><path d="M73.6 74.4H22.4c-2.651.0-4.8-2.1491-4.8-4.8001V36c0-2.651 2.149-4.8 4.8-4.8H73.6C76.251 31.2 78.4 33.349 78.4 36V69.6C78.4 72.2509 76.251 74.4 73.6 74.4z" stroke="#e74d1a" stroke-width="4" stroke-linecap="round" stroke-linejoin="round"/><path d="M68 74.4H28C27.5582 74.4 27.2 74.0418 27.2 73.6V32C27.2 31.5581 27.5582 31.2 28 31.2H68C68.4418 31.2 68.8 31.5581 68.8 32V73.6C68.8 74.0418 68.4418 74.4 68 74.4z" stroke="#e74d1a" stroke-width="4" stroke-linecap="round" stroke-linejoin="round"/><path d="M59.2 31.2H36.8C36.3582 31.2 36 30.8419 36 30.4V21.6C36 21.1582 36.3582 20.8 36.8 20.8H59.2C59.6418 20.8 60 21.1582 60 21.6v8.8001C60 30.8419 59.6418 31.2 59.2 31.2z" stroke="#e74d1a" stroke-width="4" stroke-linecap="round" stroke-linejoin="round"/><path d="M48 44.8l9.6697 6.1242C58.3466 51.3529 58.0429 52.4 57.2417 52.4H48 38.7583C37.9571 52.4 37.6534 53.4472 38.3303 53.8759L48 60" stroke="#e74d1a" stroke-width="4" stroke-linecap="round" stroke-linejoin="round"/></svg></div><div><h3 class=list-item-header>Portability</h3><p class=list-item-text>Apache Beam provides freedom to choose between various execution engines, easily switch between a variety of runners, and remain vendor-independent. Apache Beam is built to “write once, run anywhere”, and you can write data pipelines that are portable across languages and runtime environments, both open-source (e.g. Apache Flink and Spark) and proprietary (e.g. Google Cloud Dataflow and AWS KDA).</p></div></div><div class=list-item><div class="list-item-icon list-item-icon--about"><svg width="96" height="96" viewBox="0 0 96 96" fill="none" xmlns="http://www.w3.org/2000/svg"><rect width="96" height="96" rx="8" fill="#f8f8f8"/><path d="M8 16c0-4.4183 3.5817-8 8-8H80c4.4183.0 8 3.5817 8 8V80c0 4.4183-3.5817 8-8 8H16c-4.4183.0-8-3.5817-8-8V16z" fill="#f8f8f8"/><path d="M40.2892 62.4505v-2 2zM39.998 62.3295l1.3894-1.4386-1.3894 1.4386zM40.8487 62.4505v-2 2zM40.0055 68.6223 41.3984 70.0575 40.0055 68.6223zM57.8227 53.5481v-2 2zm-7.8489 1.794-1.6639-1.1097 1.6639 1.1097zM66 53.5481v2-2zM68.4 53.9481V77.8672h-4V53.9481h4zm-10.5773-2.4H66v4H57.8227v-4zM55.905 57.7403C55.905 57.2603 55.7619 56.8198 55.5164 56.4517l3.3278-2.2193C59.5144 55.2373 59.905 56.4462 59.905 57.7403h-4zm-2.3279 2.328c1.2856.0 2.3279-1.0423 2.3279-2.328h4c0 3.49480000000001-2.8331 6.328-6.3279 6.328V60.0683zm-2.328-2.328c0 1.28570000000001 1.0423 2.328 2.328 2.328V64.0683c-3.4949.0-6.328-2.83319999999999-6.328-6.328h4zM51.6377 56.4517C51.3922 56.8199 51.2491 57.2603 51.2491 57.7403h-4c0-1.2941.390599999999999-2.503 1.0608-3.5079l3.3278 2.2193zm-9.989-4.9036h7.6827v4H41.6487v-4zm-2.4 10.5024V53.9481h4v8.1024h-4zM40.8487 64.4505h-.5595V60.4505h.5595V64.4505zM38.6086 63.7681C38.1787 63.3529 37.599 63.1007 36.9563 63.1007v-4c1.7206.0 3.2855.683799999999998 4.4311 1.7902l-2.7788 2.8772zM36.9563 63.1007c-1.3138.0-2.3788 1.065-2.3788 2.3788h-4c0-3.5229 2.8559-6.3788 6.3788-6.3788v4zm-2.3788 2.3788c0 1.3138 1.065 2.3789 2.3788 2.3789v4C33.4334 71.8584 30.5775 69.0025 30.5775 65.4795h4zm2.3788 2.3789C37.6011 67.8584 38.1824 67.6045 38.6127 67.187L41.3984 70.0575C40.2518 71.1702 38.6824 71.8584 36.9563 71.8584v-4zm3.3411-1.3578H40.8487v4H40.2974v-4zM39.2487 77.8672V68.9006h4v8.9666h-4zM66 80.2672H41.6487v-4H66v4zM43.2487 77.8672C43.2487 76.9836 42.5324 76.2672 41.6487 76.2672v4C40.3233 80.2672 39.2487 79.1927 39.2487 77.8672h4zm-2.4-11.3666c1.3255.0 2.4 1.0745 2.4 2.39999999999999h-4C39.2487 69.7842 39.9651 70.5006 40.8487 70.5006v-4zm-.5595-2.0501C39.6215 64.4505 39.0299 64.175 38.6086 63.7681l2.7788-2.8772C41.123 60.6355 40.7388 60.4505 40.2892 60.4505V64.4505zM43.2487 62.0505C43.2487 63.3759 42.1742 64.4505 40.8487 64.4505V60.4505C39.9651 60.4505 39.2487 61.1668 39.2487 62.0505h4zm-1.6-6.5024C42.5324 55.5481 43.2487 54.8318 43.2487 53.9481h-4c0-1.3255 1.0746-2.4 2.4-2.4v4zM38.6127 67.187C39.0344 66.7778 39.6276 66.5006 40.2974 66.5006v4C40.7485 70.5006 41.1337 70.3144 41.3984 70.0575L38.6127 67.187zm19.21-11.6389C58.2778 55.5481 58.6108 55.3765 58.7903 55.2519 58.9643 55.131 59.0582 55.0124 59.0905 54.9692 59.1529 54.8855 59.1471 54.8643 59.123 54.9361 59.1021 54.9982 59.0998 55.0354 59.1009 55.0173 59.1015 55.0071 59.1054 54.941 59.0883 54.8347 59.0735 54.7428 59.0249 54.5032 58.8442 54.2324l-3.3278 2.2193C55.072 55.7853 55.091 55.0605 55.1082 54.7762 55.1318 54.3851 55.2182 53.9982 55.3318 53.6606 55.442 53.3329 55.6164 52.9366 55.8841 52.5777 56.076 52.3205 56.7114 51.5481 57.8227 51.5481v4zm-9.5128-1.3157C48.1293 54.5032 48.0806 54.7428 48.0658 54.8347 48.0487 54.941 48.0526 55.0071 48.0532 55.0173 48.0543 55.0354 48.052 54.9982 48.0311 54.9361 48.007 54.8643 48.0012 54.8855 48.0636 54.9692 48.0959 55.0124 48.1898 55.131 48.3639 55.2519 48.5433 55.3765 48.8763 55.5481 49.3314 55.5481v-4C50.4428 51.5481 51.0782 52.3205 51.27 52.5777 51.5377 52.9366 51.7121 53.3329 51.8223 53.6606 51.9359 53.9982 52.0223 54.3851 52.046 54.7762 52.0631 55.0605 52.0821 55.7853 51.6377 56.4517l-3.3278-2.2193zM68.4 77.8672C68.4 79.1927 67.3255 80.2672 66 80.2672v-4C65.1163 76.2672 64.4 76.9835 64.4 77.8672h4zm-4-23.9191C64.4 54.8318 65.1163 55.5481 66 55.5481v-4C67.3255 51.5481 68.4 52.6226 68.4 53.9481h-4z" fill="#e74d1a"/><path d="M80.4716 34.9495 79.3871 33.269 80.4716 34.9495zM72.5202 40.081 73.6047 41.7614 72.5202 40.081zM68.2333 43.8289 70.1256 44.4764 68.2333 43.8289zm4.5292-2.9415L72.5844 42.8794 72.7625 40.8874zM52.8912 33.754 54.7259 34.5502 52.8912 33.754zm3.9076 6.0549L56.829 37.8091 56.7988 39.8089zm10.0346-25.992L67.9179 15.4973 66.8334 13.8169zm-20.0973 12.97 1.0845 1.6804-1.0845-1.6804zm-1.0845-1.6804L65.7489 12.1364l2.169 3.3609-20.0973 12.97-2.169-3.3608zm3.7037 10.1649-4.4188-6.847 3.3609-2.169 4.4188 6.8471-3.3609 2.1689zm6.2426-1.7465C55.1946 33.7852 54.902 34.1443 54.7259 34.5502L51.0565 32.9577C51.5375 31.8497 52.3415 30.8658 53.4289 30.164l2.169 3.3609zm3.2183.6937C58.119 33.1383 56.6781 32.8277 55.5979 33.5249l-2.169-3.3609c2.9364-1.895 6.8531-1.0508 8.7482 1.8856l-3.3609 2.169zm-.6937 3.2183C59.2028 36.7397 59.5133 35.2988 58.8162 34.2186l3.3609-2.169C64.0721 34.986 63.2279 38.9027 60.2915 40.7978l-2.169-3.3609zM56.829 37.8091C57.2715 37.8158 57.7192 37.6972 58.1225 37.4369l2.169 3.3609C59.2041 41.4995 57.9764 41.8269 56.7686 41.8086L56.829 37.8091zm1.3118 11.0757-4.1813-6.4791 3.3609-2.169 4.1813 6.4791-3.3609 2.169zm10.5319-3.9405L61.4588 49.5999l-2.169-3.3609 7.2139-4.6555L68.6727 44.9443zm1.1489-2.6457L69.8733 42.3788l-3.3608 2.169L66.4607 44.4676l3.3609-2.169zM70.1256 44.4764C69.8962 45.1469 69.9664 45.9033 70.3768 46.5393l-3.3609 2.1689C65.9134 46.9999 65.7322 44.9607 66.341 43.1815L70.1256 44.4764zM70.3768 46.5393C71.0892 47.6432 72.5616 47.9605 73.6655 47.2481L75.8345 50.609C72.8744 52.5193 68.9262 51.6683 67.0159 48.7082l3.3609-2.1689zM73.6655 47.2481C74.7694 46.5357 75.0868 45.0633 74.3744 43.9594L77.7352 41.7904C79.6455 44.7505 78.7945 48.6987 75.8345 50.609L73.6655 47.2481zm.7089-3.2887C73.9613 43.3194 73.2949 42.943 72.5844 42.8794L72.9405 38.8953C74.826 39.0639 76.6255 40.0709 77.7352 41.7904L74.3744 43.9594zM70.763 41.7843 70.7205 41.7185l3.3609-2.169L74.1239 39.6153l-3.3609 2.169zm10.7931-5.1544L73.6047 41.7614l-2.169-3.3609L79.3871 33.269l2.169 3.3609zM69.0668 12.8516 82.2712 33.312 78.9103 35.481 65.706 15.0206l3.3608-2.169zM79.3871 33.269C78.6446 33.7482 78.4312 34.7385 78.9103 35.481L82.2712 33.312C82.9899 34.4257 82.6698 35.9112 81.5561 36.6299l-2.169-3.3609zm-8.6666 8.4495C70.0018 40.6048 70.322 39.1193 71.4357 38.4005l2.169 3.3609C74.3471 41.2823 74.5606 40.2919 74.0814 39.5495l-3.3609 2.169zM69.8733 42.3788C70.3023 43.0434 70.3489 43.8237 70.1256 44.4764L66.341 43.1815C66.2012 43.59 66.2235 44.1 66.5125 44.5478l3.3608-2.169zM66.5037 41.5835C67.6174 40.8647 69.1029 41.1849 69.8216 42.2986l-3.3609 2.169C66.9399 45.2101 67.9302 45.4235 68.6727 44.9443L66.5037 41.5835zm-5.002 5.1323C61.0226 45.9733 60.0322 45.7599 59.2898 46.239l2.169 3.3609C60.3451 50.3187 58.8596 49.9985 58.1408 48.8848l3.3609-2.169zm11.0827-3.8364C71.8929 42.8176 71.1948 42.4534 70.763 41.7843l3.3609-2.169C73.8329 39.1644 73.3733 38.934 72.9405 38.8953L72.5844 42.8794zM52.7162 33.1025C52.4694 32.7201 52.1447 32.5334 51.9427 32.4502 51.7467 32.3695 51.5962 32.3549 51.5423 32.3512 51.4381 32.3441 51.4234 32.3605 51.4968 32.3418 51.5602 32.3257 51.5927 32.3075 51.5769 32.3164 51.568 32.3214 51.5103 32.354 51.4302 32.4261 51.361 32.4883 51.1861 32.6591 51.0565 32.9577L54.7259 34.5502C54.407 35.285 53.7876 35.6621 53.5395 35.8019 53.198 35.9941 52.8261 36.1313 52.4809 36.2189 52.1458 36.3039 51.7182 36.3723 51.2715 36.342 50.9513 36.3203 49.9579 36.2052 49.3553 35.2714l3.3609-2.1689zm4.0524 8.7061C57.0941 41.8136 57.3217 41.7245 57.407 41.6871 57.5057 41.6439 57.5591 41.6047 57.5673 41.5987 57.5819 41.5879 57.5519 41.61 57.5112 41.6612 57.4639 41.7204 57.4849 41.7137 57.5214 41.6159 57.5402 41.5653 57.5889 41.422 57.5961 41.2103 57.6035 40.9919 57.5671 40.6191 57.3204 40.2367l-3.3609 2.169C53.3569 41.472 53.6612 40.5194 53.7733 40.2187 53.9297 39.7991 54.1682 39.4377 54.3837 39.1673 54.6058 38.8889 54.884 38.6065 55.1998 38.3746 55.4294 38.206 56.0281 37.797 56.829 37.8091L56.7686 41.8086zM65.7489 12.1364C66.8626 11.4177 68.3481 11.7379 69.0668 12.8516l-3.3608 2.169C66.1851 15.763 67.1754 15.9765 67.9179 15.4973l-2.169-3.3609zM47.8206 28.4673C48.5631 27.9882 48.7765 26.9979 48.2974 26.2554l-3.3609 2.169C44.2177 27.3107 44.5379 25.8252 45.6516 25.1065l2.169 3.3608z" fill="#e74d1a"/><path d="M42.3164 43.8618 43.8939 42.6324 42.3164 43.8618zM42.2974 38.5074 43.8836 39.7257 42.2974 38.5074zM25.4911 51.2219 23.8008 52.291l1.6903-1.0691zm7.3208.0-1.6903-1.069 1.6903 1.069zM14.4432 52.716V28.7968h4V52.716h-4zm10.3563 2.4H16.8432v-4h7.9563v4zm2.0241-6.2044C26.8236 49.3716 26.955 49.7948 27.1814 50.1529L23.8008 52.291C23.1817 51.3121 22.8236 50.1506 22.8236 48.9116h4zm2.3279-2.3279c-1.2857.0-2.3279 1.0423-2.3279 2.3279h-4c0-3.4948 2.8331-6.3279 6.3279-6.3279v4zm2.328 2.3279c0-1.2856-1.0423-2.3279-2.328-2.3279v-4c3.4949.0 6.328 2.8331 6.328 6.3279h-4zM31.1216 50.1529C31.3481 49.7948 31.4795 49.3716 31.4795 48.9116h4c0 1.239-.3581 2.4005-.9773 3.3794L31.1216 50.1529zM41.2809 55.116H33.5036v-4h7.7773v4zm2.4-11.049v8.649h-4V44.067h4zM43.8939 42.6324C44.3326 43.1952 45.0103 43.5512 45.7723 43.5512v4c-2.0471.0-3.8695-.966500000000004-5.0334-2.46l3.155-2.4588zM45.7723 43.5512c1.3138.0 2.3788-1.0651 2.3788-2.3789h4c0 3.523-2.8559 6.3789-6.3788 6.3789v-4zm2.3788-2.3789c0-1.3138-1.065-2.3788-2.3788-2.3788v-4c3.5229.0 6.3788 2.8559 6.3788 6.3788h-4zm-2.3788-2.3788C45.0044 38.7935 44.3218 39.1551 43.8836 39.7257l-3.1723-2.4365c1.1627-1.5138 2.9976-2.4957 5.061-2.4957v4zm-2.0914-9.9967v9.5137h-4V28.7968h4zM16.8432 26.3969 41.2809 26.3968v4L16.8432 30.3969v-4zm22.8377 2.3999c0 .883699999999998.7164 1.6 1.6 1.6v-4c1.3255.0 2.4 1.0746 2.4 2.4h-4zm2.3378 11.8514C40.7276 40.6482 39.6809 39.6016 39.6809 38.3105h4C43.6809 37.3924 42.9367 36.6482 42.0187 36.6482v4zM42.0298 41.7181C42.8024 41.7181 43.4734 42.0927 43.8939 42.6324l-3.155 2.4588C41.0211 45.4533 41.4823 45.7181 42.0298 45.7181v-4zM39.6809 44.067c0-1.2973 1.0516-2.3489 2.3489-2.3489v4C42.9417 45.7181 43.6809 44.9789 43.6809 44.067h-4zm1.6 7.049C40.3973 51.116 39.6809 51.8323 39.6809 52.716h4c0 1.3254-1.0745 2.4-2.4 2.4v-4zm2.6027-11.3903C43.4649 40.2707 42.7925 40.6482 42.0187 40.6482v-4C41.4644 36.6482 40.9963 36.9181 40.7113 37.2892l3.1723 2.4365zM24.7995 51.116C24.3164 51.116 23.9734 51.3076 23.8044 51.4296 23.6377 51.5499 23.5513 51.664 23.5269 51.6975 23.4787 51.7636 23.4939 51.7624 23.5258 51.6694 23.538 51.6339 23.548 51.5979 23.555 51.5664 23.5622 51.5336 23.5633 51.5186 23.5629 51.5236 23.5626 51.5269 23.5616 51.5405 23.5618 51.5635 23.562 51.5858 23.5634 51.6251 23.5704 51.6782 23.5809 51.7581 23.6204 52.0057 23.8008 52.291L27.1814 50.1529C27.6153 50.8388 27.5715 51.5816 27.5496 51.8494 27.5177 52.2392 27.426 52.6278 27.3091 52.9682 27.1956 53.2989 27.0201 53.6962 26.7583 54.055 26.5892 54.2867 25.9482 55.116 24.7995 55.116v-4zm9.7027 1.175C34.6827 52.0057 34.7222 51.7581 34.7327 51.6782 34.7396 51.6251 34.7411 51.5858 34.7413 51.5635 34.7415 51.5405 34.7405 51.5269 34.7402 51.5236 34.7398 51.5186 34.7409 51.5336 34.7481 51.5664 34.7551 51.5979 34.765 51.6339 34.7772 51.6694 34.8091 51.7624 34.8244 51.7636 34.7762 51.6975 34.7518 51.664 34.6653 51.5499 34.4986 51.4296 34.3297 51.3076 33.9867 51.116 33.5036 51.116v4C32.3549 55.116 31.7138 54.2867 31.5448 54.055 31.283 53.6962 31.1075 53.2989 30.994 52.9682 30.8771 52.6278 30.7853 52.2392 30.7535 51.8494 30.7316 51.5816 30.6878 50.8388 31.1216 50.1529L34.5022 52.291zM14.4432 28.7968c0-1.3254 1.0746-2.3999 2.4-2.3999v4c.883700000000001.0 1.6-.7164 1.6-1.6001h-4zm4 23.9192c0-.883700000000005-.7163-1.6-1.6-1.6v4c-1.3255.0-2.4-1.0746-2.4-2.4h4z" fill="#e74d1a"/><path d="M26.7007 52.716h2-2zM31.9349 52.2883l1.2388 1.5701-1.2388-1.5701zm9.2706 1.2277h-2 2zM26.5344 52.3038l1.2298-1.5772-1.2298 1.5772zm.1663.3307h2-2zM38.8436 69.369 37.974 67.568 38.8436 69.369zm0-7.7992L39.7133 59.7688 38.8436 61.5698zM41.2055 60.6204h-2 2zM40.8055 80.2672H16.8v-4H40.8055v4zm2.4-9.9487v7.5487h-4V70.3185h4zM36.964 67.7974C37.33 67.7974 37.6709 67.7144 37.974 67.568l1.7393 3.602C38.8795 71.5727 37.9452 71.7974 36.964 71.7974v-4zm-2.3279-2.328c0 1.28570000000001 1.0422 2.328 2.3279 2.328v4c-3.4948.0-6.3279-2.83319999999999-6.3279-6.328h4zM36.964 63.1415C35.6783 63.1415 34.6361 64.1837 34.6361 65.4694h-4C30.6361 61.9746 33.4692 59.1415 36.964 59.1415v4zM37.974 63.3708C37.6709 63.2245 37.33 63.1415 36.964 63.1415v-4C37.9452 59.1415 38.8795 59.3662 39.7133 59.7688l-1.7393 3.602zm5.2315-9.8548v7.1044h-4V53.516h4zm-11.035-2.4H40.8055v4H32.1705v-4zm-2.4 1.6V52.6175h4V52.716h-4zM30.6961 50.7182C31.2524 50.2792 31.6036 49.6056 31.6036 48.8487h4c0 2.0332-.953499999999998 3.8449-2.4299 5.0097l-2.4776-3.1402zM31.6036 48.8487c0-1.3138-1.065-2.3789-2.3789-2.3789v-4c3.523.0 6.3789 2.8559 6.3789 6.3789h-4zm-2.3789-2.3789c-1.3138.0-2.3788 1.0651-2.3788 2.3789h-4c0-3.523 2.8559-6.3789 6.3788-6.3789v4zm-2.3788 2.3789C26.8459 49.6104 27.2017 50.288 27.7642 50.7266L25.3045 53.881c-1.4927-1.164-2.4586-2.9859-2.4586-5.0323h4zm1.8548 3.7858V52.716h-4V52.6345h4zM16.8 51.116h9.5007v4H16.8v-4zM14.4 77.8672V53.516h4V77.8672h-4zM16.8 55.116c.883700000000001.0 1.6-.7164 1.6-1.6h-4c0-1.3255 1.0745-2.4 2.4-2.4v4zm11.9007-2.4c0 1.3254-1.0746 2.4-2.4 2.4v-4C25.417 51.116 24.7007 51.8323 24.7007 52.716h4zM29.7705 52.6175c0-.7911.384-1.472.925600000000003-1.8993l2.4776 3.1402C33.5127 53.591 33.7705 53.1504 33.7705 52.6175h-4zm2.4 2.4985c-1.3254.0-2.4-1.0746-2.4-2.4h4C33.7705 51.8323 33.0542 51.116 32.1705 51.116v4zm7.035-1.6c0 .883600000000001.7164 1.6 1.6 1.6v-4c1.3255.0 2.4 1.0745 2.4 2.4h-4zM27.7642 50.7266C28.3117 51.1536 28.7007 51.8381 28.7007 52.6345h-4C24.7007 53.171 24.9619 53.6138 25.3045 53.881l2.4597-3.1544zM39.2055 70.3185C39.2055 70.9229 39.4958 71.3034 39.5853 71.4108 39.6448 71.4822 39.6953 71.5282 39.7219 71.5511 39.7499 71.5752 39.7676 71.5873 39.7698 71.5888 39.7719 71.5902 39.7468 71.5734 39.6874 71.5441 39.6309 71.5162 39.5598 71.4851 39.4785 71.4542 39.3065 71.389 39.15 71.348 39.0578 71.3322 39.0102 71.324 39.023 71.3301 39.0832 71.3297 39.1152 71.3295 39.1835 71.3274 39.2766 71.3116 39.3645 71.2966 39.5242 71.2614 39.7133 71.17L37.974 67.568C38.4235 67.3509 38.8515 67.3312 39.0565 67.3298 39.3052 67.3282 39.5399 67.3565 39.7342 67.3898 40.1255 67.457 40.5323 67.576 40.8965 67.714 41.2515 67.8486 41.6629 68.0379 42.0254 68.2854 42.203 68.4067 42.4428 68.5916 42.6584 68.8503 42.855 69.0862 43.2055 69.5935 43.2055 70.3185h-4zM39.7133 59.7688C39.5242 59.6775 39.3645 59.6422 39.2766 59.6273 39.1835 59.6114 39.1152 59.6093 39.0832 59.6091 39.0231 59.6087 39.0102 59.6148 39.0578 59.6066 39.15 59.5908 39.3065 59.5498 39.4785 59.4846 39.5598 59.4538 39.6309 59.4227 39.6874 59.3948 39.7468 59.3655 39.7719 59.3486 39.7698 59.3501 39.7676 59.3516 39.7499 59.3636 39.7219 59.3877 39.6953 59.4106 39.6448 59.4566 39.5853 59.528 39.4958 59.6354 39.2055 60.0159 39.2055 60.6204h4C43.2055 61.3454 42.855 61.8526 42.6584 62.0886 42.4428 62.3473 42.203 62.5322 42.0254 62.6534 41.6629 62.901 41.2515 63.0902 40.8965 63.2248 40.5323 63.3629 40.1255 63.4819 39.7342 63.549 39.5399 63.5823 39.3052 63.6107 39.0565 63.609 38.8515 63.6076 38.4235 63.5879 37.974 63.3708l1.7393-3.602zM16.8 80.2672C15.4745 80.2672 14.4 79.1927 14.4 77.8672h4C18.4 76.9836 17.6836 76.2672 16.8 76.2672v4zm24.0055-4C39.9219 76.2672 39.2055 76.9836 39.2055 77.8672h4C43.2055 79.1927 42.131 80.2672 40.8055 80.2672v-4z" fill="#e74d1a"/></svg></div><div><h3 class=list-item-header>Extensibility</h3><p class=list-item-text>Apache Beam is open source and extensible. Multiple projects, such as TensorFlow Extended and Apache Hop, are built on top of Apache Beam and leverage its ability to “write once, run anywhere”.<br><br>New and emerging products expand the number of use cases and create additional value-adds for Apache Beam users.</p></div></div><div class=list-item><div class="list-item-icon list-item-icon--about"><svg width="96" height="96" viewBox="0 0 96 96" fill="none" xmlns="http://www.w3.org/2000/svg"><rect width="96" height="96" rx="8" fill="#f8f8f8"/><path d="M8 16c0-4.4183 3.5817-8 8-8H80c4.4183.0 8 3.5817 8 8V80c0 4.4183-3.5817 8-8 8H16c-4.4183.0-8-3.5817-8-8V16z" fill="#f8f8f8"/><path d="M20 78.4H62.7333C65.4211 78.4 67.6 76.2211 67.6 73.5333v0C67.6 70.8455 65.4211 68.6666 62.7333 68.6666H31.2667c-2.6878.0-4.8667-2.1789-4.8667-4.8667v0c0-2.6877 2.1789-4.8666 4.8667-4.8666H62.7333C65.4211 58.9333 67.6 56.7544 67.6 54.0666v0C67.6 51.3788 65.4211 49.2 62.7333 49.2H31.2667C28.5789 49.2 26.4 47.0211 26.4 44.3333v0c0-2.6878 2.1789-4.8667 4.8667-4.8667H62.7333C65.4211 39.4666 67.6 37.2877 67.6 34.6v0C67.6 31.9122 65.4211 29.7333 62.7333 29.7333H31.2667c-2.6878.0-4.8667-2.1789-4.8667-4.8667v0C26.4 22.1788 28.5789 20 31.2667 20H77.2m0 0-4.8 4.8M77.2 20l-4.8-4.8" stroke="#e74d1a" stroke-width="4" stroke-linecap="round"/></svg></div><div><h3 class=list-item-header>Flexibility</h3><p class=list-item-text>Apache Beam is easy to adopt and implement because it abstracts you from low-level details and provides freedom of choice between programming languages.<br><br>The Apache Beam data pipelines are expressed with generic transforms, thus they are understandable and maintainable, which helps accelerate Apache Beam adoption and onboarding of new team members.<br><br>Apache Beam users report that they experience impressive time-to-value. Most notably, they noted a reduction in the time needed to develop and deploy a pipeline, going down from several days to just a few hours.</p></div></div><div class=list-item><div class="list-item-icon list-item-icon--about"><svg width="96" height="96" viewBox="0 0 96 96" fill="none" xmlns="http://www.w3.org/2000/svg"><rect width="96" height="96" rx="8" fill="#f8f8f8"/><path d="M46.2784 35.125 44.2784 35.1251v0L46.2784 35.125zM53.0275 33.125c-1.1045.0-2 .895400000000002-2 2s.895499999999998 2 2 2v-4zm0 24.75c-1.1045.0-2 .895400000000002-2 2s.895499999999998 2 2 2v-4zM50.7529 49.5C51.8575 49.5 52.7529 48.6046 52.7529 47.5s-.895399999999995-2-2-2v4zm15.8184-4C65.4667 45.5 64.5713 46.3955 64.5713 47.5c0 1.1046.895400000000009 2 2 2v-4zM57.5322 45.5c-1.1045.0-2 .895499999999998-2 2 0 1.1046.895499999999998 2 2 2v-4zm2.2598 4c1.1046.0 2-.895400000000002 2-2 0-1.1045-.895400000000002-2-2-2v4zM37.4756 35.9577C36.6929 35.1784 35.4266 35.1811 34.6472 35.9639 33.8678 36.7466 33.8706 38.0129 34.6533 38.7923L37.4756 35.9577zm2.7452 17.6574C39.8701 52.5676 38.7367 52.0028 37.6893 52.3535 36.6419 52.7041 36.077 53.8375 36.4277 54.8849l3.7931-1.2698zM27.4979 48.8525C27.0022 49.8396 27.4006 51.0416 28.3877 51.5373 29.3748 52.033 30.5768 51.6346 31.0725 50.6475l-3.5746-1.795zM25.7446 36.8791 25.0224 38.7441h0L25.7446 36.8791zm-7.4241 9.4685-1.6458 1.1364 1.6458-1.1364zM33.2866 27.6472 32.4297 29.4543 33.2866 27.6472zm-7.1953 8.4101 1.6315-1.1567-1.6315 1.1567zm9.8033-10.6555L37.801 24.7972 35.8946 25.4018zm8.8438-6.1025 1.2303-1.5769v0l-1.2303 1.5769zM23.2183 58.3111 22.5295 56.4334 23.2183 58.3111zm-6.1886-7.978 1.6103 1.186-1.6103-1.186zm8.2283 10.494-1.6618-1.1127 1.6618 1.1127zm6.5296 7.3646L30.8963 66.4013 31.7876 68.1917zM18.2891 48.623l-1.6103-1.186 1.6103 1.186zM45.867 74.7147l.9268 1.7723-.9268-1.7723zM64.3039 37.625c-1.4071.0-2.5272-1.1306-2.5272-2.5h-4c0 3.6012 2.9337 6.5 6.5272 6.5v-4zm-2.5272-2.5c0-1.3694 1.1201-2.5 2.5272-2.5v-4c-3.5935.0-6.5272 2.8988-6.5272 6.5h4zm2.5272-2.5C65.711 32.625 66.8311 33.7556 66.8311 35.125h4c0-3.6012-2.9337-6.5-6.52720000000001-6.5v4zM66.8311 35.125C66.8311 36.4944 65.711 37.625 64.3039 37.625v4C67.8974 41.625 70.8311 38.7262 70.8311 35.125h-4zM64.3039 62.375c-1.4071.0-2.5272-1.1306-2.5272-2.5h-4c0 3.6012 2.9337 6.5 6.5272 6.5v-4zm-2.5272-2.5c0-1.3694 1.1201-2.5 2.5272-2.5v-4c-3.5935.0-6.5272 2.8988-6.5272 6.5h4zm2.5272-2.5C65.711 57.375 66.8311 58.5056 66.8311 59.875h4c0-3.6012-2.9337-6.5-6.52720000000001-6.5v4zM66.8311 59.875C66.8311 61.2444 65.711 62.375 64.3039 62.375v4C67.8974 66.375 70.8311 63.4762 70.8311 59.875h-4zM48.2776 74.5001 48.2792 47.5001 44.2792 47.4999 44.2776 74.4999 48.2776 74.5001zm-2.9269-1.7724L44.9401 72.9425l1.8537 3.5445L47.2044 76.2723l-1.8537-3.5446zM36.303 63.7096l-5.4067 2.6917 1.7826 3.5808 5.4068-2.6917L36.303 63.7096zM18.64 51.5191l1.2595-1.71-3.2207-2.3721-1.2595 1.71L18.64 51.5191zM24.4597 37.214 25.3938 38.5317l3.2632-2.3134L27.7228 34.9006 24.4597 37.214zm3.2879-1.7041L26.4668 35.014l-1.4444 3.7301L26.3033 39.2401l1.4443-3.7302zM43.5082 20.8762l1.5391 1.2007 2.4605-3.1538-1.5391-1.2007-2.4605 3.1538zm4.7702 14.2487L48.2776 20.4999 44.2776 20.5001 44.2784 35.1251 48.2784 35.1249zM74.4728 50.0001C73.0657 50.0001 71.9456 48.8694 71.9456 47.5h-4c0 3.6012 2.9337 6.5001 6.52720000000001 6.5001v-4zM71.9456 47.5C71.9456 46.1307 73.0657 45 74.4728 45V41C70.8793 41 67.9456 43.8989 67.9456 47.5h4zM74.4728 45C75.8799 45 77 46.1307 77 47.5h4C81 43.8989 78.0663 41 74.4728 41v4zM77 47.5C77 48.8694 75.8799 50.0001 74.4728 50.0001v4C78.0663 54.0001 81 51.1012 81 47.5H77zM59.7688 23c-1.4071.0-2.5272-1.1306-2.5272-2.5h-4c0 3.6012 2.9337 6.5 6.5272 6.5V23zm-2.5272-2.5c0-1.3694 1.1201-2.5 2.5272-2.5V14c-3.5935.0-6.5272 2.8988-6.5272 6.5h4zM59.7688 18c1.4071.0 2.5272 1.1306 2.5272 2.5H66.296C66.296 16.8988 63.3623 14 59.7688 14v4zm2.5272 2.5c0 1.3694-1.1201 2.5-2.5272 2.5v4C63.3623 27 66.296 24.1012 66.296 20.5H62.296zM59.7688 77c-1.4071.0-2.5272-1.1306-2.5272-2.5h-4C53.2416 78.1012 56.1753 81 59.7688 81V77zm-2.5272-2.5c0-1.3694 1.1201-2.5 2.5272-2.5V68C56.1753 68 53.2416 70.8988 53.2416 74.5h4zM59.7688 72c1.4071.0 2.5272 1.1306 2.5272 2.5H66.296C66.296 70.8988 63.3623 68 59.7688 68v4zm2.5272 2.5c0 1.3694-1.1201 2.5-2.5272 2.5v4C63.3623 81 66.296 78.1012 66.296 74.5H62.296zm-16.0184-52h8.964v-4h-8.964v4zm0 54h8.964v-4h-8.964v4zm6.7499-39.375h6.7492v-4H53.0275v4zm0 24.75h6.7492v-4H53.0275v4zM46.2792 49.5H50.7529v-4H46.2792v4zm20.2921.0H69.9456v-4H66.5713v4zM57.5322 49.5H59.792v-4H57.5322v4zm-9.253-2.0001L48.2787 40.7499 44.2787 40.7501 44.2792 47.5001 48.2792 47.4999zM48.2787 40.7499 48.2784 35.1249 44.2784 35.1251 44.2787 40.7501 48.2787 40.7499zm-2-1.9999C45.2985 38.75 43.5943 38.5998 41.8428 38.1404 40.058 37.6723 38.4686 36.9464 37.4756 35.9577L34.6533 38.7923C36.3721 40.5036 38.7524 41.4652 40.828 42.0096 42.937 42.5627 44.9842 42.75 46.2787 42.75v-4zM38.7919 66.7033c1.48-1.9648 3.469-6.9943 1.4289-13.0882l-3.7931 1.2698C38.0032 59.5909 36.3766 63.2615 35.5969 64.2967l3.195 2.4066zM25.6143 38.7923C26.4471 39.6215 27.4192 41.2496 27.9103 43.2058 28.396 45.1402 28.3524 47.1508 27.4979 48.8525l3.5746 1.795C32.4777 47.8492 32.4341 44.7973 31.7899 42.2317 31.1512 39.688 29.8636 37.3786 28.4366 35.9577L25.6143 38.7923zM26.4668 35.014C18.8156 32.0514 12.0647 40.8075 16.6747 47.484l3.2916-2.2728c-2.4155-3.4982 1.1495-7.9797 5.0561-6.4671l1.4444-3.7301zm7.6766-9.174c-7.0866-3.36-14.3358 4.8121-9.6837 11.374l3.2631-2.3134c-2.147-3.0285 1.1487-7.1333 4.7069-5.4463L34.1434 25.84zM33.9882 26.0065C33.9888 26.0084 33.9852 25.997 33.9852 25.9753 33.9851 25.9541 33.9886 25.9325 33.9947 25.9129 34.0063 25.8757 34.0226 25.8599 34.0277 25.8555 34.0328 25.8511 34.0465 25.841 34.0756 25.8364 34.0912 25.8339 34.1082 25.8337 34.1243 25.8359 34.1409 25.8383 34.1479 25.8421 34.1434 25.84l-1.7137 3.6143C35.4449 30.8839 38.8387 28.069 37.801 24.7972l-3.8128 1.2093zm3.8128-1.2093c-1.063-3.3516 2.8724-6.1326 5.7072-3.921l2.4605-3.1538c-5.8813-4.5882-14.2519 1.1224-11.9805 8.2841l3.8128-1.2093zM22.5295 56.4334c-3.1938 1.1716-5.7012-2.4544-3.8895-4.9143L15.4193 49.147c-4.3612 5.9214 1.8867 13.4632 8.4877 11.0417l-1.3775-3.7553zm4.3904 5.5064c2.0729-3.0958-1.166-6.6892-4.3904-5.5064l1.3775 3.7553C23.8778 60.1994 23.8076 60.2088 23.7311 60.1853 23.6685 60.1661 23.6312 60.1345 23.6093 60.1076 23.5873 60.0807 23.5555 60.0268 23.5485 59.939 23.5401 59.8345 23.573 59.7489 23.5962 59.7144l3.3237 2.2254zM30.8963 66.4013C28.0136 67.8364 25.181 64.537 26.9199 61.9398l-3.3237-2.2254c-4.0678 6.0753 2.6023 13.4939 9.0827 10.2677l-1.7826-3.5808zM19.8995 49.8091C20.9051 48.4438 20.9219 46.5951 19.9663 45.2112L16.6747 47.484C16.6704 47.4778 16.6686 47.4702 16.6687 47.4645 16.6688 47.4584 16.6712 47.4473 16.6788 47.437l3.2207 2.3721zM44.9401 72.9425C40.7911 75.1122 36.4996 70.4554 38.8989 66.5462l-3.4091-2.0924c-4.5657 7.4389 3.6278 16.0476 11.304 12.0332l-1.8537-3.5445z" fill="#f24e1e"/></svg></div><div><h3 class=list-item-header>Ease of Adoption</h3><p class=list-item-text>Apache Beam is easy to adopt and implement because it abstracts you from low-level details and provides freedom of choice between programming languages.<br><br>The Apache Beam data pipelines are expressed with generic transforms, thus they are understandable and maintainable, which helps accelerate Apache Beam adoption and onboarding of new team members. Apache Beam users report that they experience impressive time-to-value.<br><br>Most notably, they noted a reduction in the time needed to develop and deploy a pipeline, going down from several days to just a few hours.</p></div></div></div><p>Learn more about how Apache Beam enables custom use cases and orchestrates complex business logic for Big Data ecosystems of frontrunners in various industries by diving into our <a href=/case-studies/index.html>Case Studies</a> section.</p><h2 id=about-apache-beam-project>About Apache Beam Project</h2><div class=about-cards-container><div class=about-card-container><div class=about-card-img-container><div class=about-card-img></div></div><div class=about-card-text><p>Apache Beam is a top-level project at Apache - the world’s largest, most welcoming open source community. Data processing leaders around the world contribute to Apache Beam’s development and make an impact by bringing next-gen distributed data processing and advanced technology solutions into reality.</p></div></div><div class=about-card-container><div class=about-card-img-container><div class=about-card-img></div></div><div class=about-card-text><p>Apache Beam was founded in early 2016 when Google and other partners (contributors on Cloud Dataflow) made the decision to move the Google Cloud Dataflow SDKs and runners to the Apache Beam Incubator.</p></div></div><div class=about-card-container><div class=about-card-img-container><div class=about-card-img></div></div><div class=about-card-text><p>Apache Beam was released in 2016 and has become a readily available and well-defined unified programming model that can express business logic in batch and streaming pipelines and allow for a unified engine-independent execution.</p></div></div><div class=about-card-container><div class=about-card-img-container><div class=about-card-img></div></div><div class=about-card-text><p>The vision behind Apache Beam is to allow developers to easily express data pipelines based on the Beam model (=Dataflow model) and to have a freedom of choice between engines and programming languages.</p></div></div><div class=about-card-container><div class=about-card-img-container><div class=about-card-img></div></div><div class=about-card-text><p>The Apache Beam unified programming model is evolving very fast, continuously expanding the number of use cases, runners, language SDKs, and built-in and custom pluggable I/O transforms that it supports.</p></div></div></div><div class=feedback><p class=update>Last updated on 2024/05/03</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="https://docs.google.com/forms/d/e/1FAIpQLSfID7abne3GE6k6RdJIyZhPz2Gef7UkpggUEhTIDjjplHuxSA/viewform?usp=header_link" target=_blank>SEND FEEDBACK</a></button></div></div></div><footer class=footer><div class=footer__contained><div class=footer__cols><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col__logo><img src=/images/beam_logo_circle.svg class=footer__logo alt="Beam logo"></div><div class=footer__cols__col__logo><img src=/images/apache_logo_circle.svg class=footer__logo alt="Apache logo"></div></div><div class=footer-wrapper><div class=wrapper-grid><div class=footer__cols__col><div class=footer__cols__col__title>Start</div><div class=footer__cols__col__link><a href=/get-started/beam-overview/>Overview</a></div><div class=footer__cols__col__link><a href=/get-started/quickstart-java/>Quickstart (Java)</a></div><div class=footer__cols__col__link><a href=/get-started/quickstart-py/>Quickstart (Python)</a></div><div class=footer__cols__col__link><a href=/get-started/quickstart-go/>Quickstart (Go)</a></div><div class=footer__cols__col__link><a href=/get-started/downloads/>Downloads</a></div></div><div class=footer__cols__col><div class=footer__cols__col__title>Docs</div><div class=footer__cols__col__link><a href=/documentation/programming-guide/>Concepts</a></div><div class=footer__cols__col__link><a href=/documentation/pipelines/design-your-pipeline/>Pipelines</a></div><div class=footer__cols__col__link><a href=/documentation/runners/capability-matrix/>Runners</a></div></div><div class=footer__cols__col><div class=footer__cols__col__title>Community</div><div class=footer__cols__col__link><a href=/contribute/>Contribute</a></div><div class=footer__cols__col__link><a href=https://projects.apache.org/committee.html?beam target=_blank>Team<img src=/images/external-link-icon.png width=14 height=14 alt="External link."></a></div><div class=footer__cols__col__link><a href=/community/presentation-materials/>Media</a></div><div class=footer__cols__col__link><a href=/community/in-person/>Events/Meetups</a></div><div class=footer__cols__col__link><a href=/community/contact-us/>Contact Us</a></div></div><div class=footer__cols__col><div class=footer__cols__col__title>Resources</div><div class=footer__cols__col__link><a href=/blog/>Blog</a></div><div class=footer__cols__col__link><a href=https://github.com/apache/beam>GitHub</a></div></div></div><div class=footer__bottom>&copy;
 <a href=https://www.apache.org>The Apache Software Foundation</a>
 | <a href=/privacy_policy>Privacy Policy</a>
 | <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><img src=/images/logos/social-icons/github-logo-150.png class=footer__logo alt="Github logo"></a></div><div class=footer__cols__col__logo><a href=https://www.linkedin.com/company/apache-beam/><img src=/images/logos/social-icons/linkedin-logo-150.png class=footer__logo alt="Linkedin logo"></a></div></div><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://twitter.com/apachebeam><img src=/images/logos/social-icons/twitter-logo-150.png class=footer__logo alt="Twitter logo"></a></div><div class=footer__cols__col__logo><a href=https://www.youtube.com/channel/UChNnb_YO_7B0HlW6FhAXZZQ><img src=/images/logos/social-icons/youtube-logo-150.png class=footer__logo alt="Youtube logo"></a></div></div></div></div></div></footer></body></html>