| <!doctype html><html lang=en class=no-js><head><meta name=generator content="Hugo 0.117.0"><meta charset=utf-8><meta http-equiv=x-ua-compatible content="IE=edge"><meta name=viewport content="width=device-width,initial-scale=1"><title>Apache Beam®</title><meta name=description content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow (a cloud service). Beam also brings DSL in different languages, allowing users to easily implement their data integration processes."><link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400,500,700" rel=stylesheet><link rel=preload href=/scss/main.min.408fddfe3e8a45f87a5a8c9a839d77db667c1c534e5e5cd0d957ffc3dd6c14cf.css as=style><link href=/scss/main.min.408fddfe3e8a45f87a5a8c9a839d77db667c1c534e5e5cd0d957ffc3dd6c14cf.css rel=stylesheet integrity><script src=https://code.jquery.com/jquery-2.2.4.min.js></script><style>.body__contained img{max-width:100%}</style><script type=text/javascript src=/js/bootstrap.min.2979f9a6e32fc42c3e7406339ee9fe76b31d1b52059776a02b4a7fa6a4fd280a.js defer></script> |
| <script type=text/javascript src=/js/language-switch-v2.min.121952b7980b920320ab229551857669209945e39b05ba2b433a565385ca44c6.js defer></script> |
| <script type=text/javascript src=/js/section-nav.min.1405fd5e70fab5f6c54037c269b1d137487d8f3d1b3009032525f6db3fbce991.js defer></script> |
| <script type=text/javascript src=/js/expandable-list.min.75a4526624a3b8898fe7fb9e3428c205b581f8b38c7926922467aef17eac69f2.js defer></script> |
| <script type=text/javascript src=/js/copy-to-clipboard.min.364c06423d7e8993fc42bb4abc38c03195bc8386db26d18774ce775d08d5b18d.js defer></script> |
| <script type=text/javascript src=/js/calendar.min.336664054fa0f52b08bbd4e3c59b5cb6d63dcfb2b4d602839746516b0817446b.js defer></script> |
| <script type=text/javascript src=/js/fix-playground-nested-scroll.min.0283f1037cb1b9d5074c6eaf041292b524a8148a7cdb803d5ccd6d1fc4eb3253.js defer></script> |
| <link rel=alternate type=application/rss+xml title="Apache Beam" href=/feed.xml><link rel=canonical href=/ data-proofer-ignore><link rel="shortcut icon" type=image/x-icon href=/images/favicon.ico><link rel=stylesheet href=https://use.fontawesome.com/releases/v5.4.1/css/all.css integrity=sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz crossorigin=anonymous><link rel=stylesheet href=https://unpkg.com/swiper@8/swiper-bundle.min.css><script async src=https://platform.twitter.com/widgets.js></script> |
| <script>(function(e,t,n,s,o,i,a){e.GoogleAnalyticsObject=o,e[o]=e[o]||function(){(e[o].q=e[o].q||[]).push(arguments)},e[o].l=1*new Date,i=t.createElement(n),a=t.getElementsByTagName(n)[0],i.async=1,i.src=s,a.parentNode.insertBefore(i,a)})(window,document,"script","//www.google-analytics.com/analytics.js","ga"),ga("create","UA-73650088-1","auto"),ga("send","pageview")</script><script>(function(e,t,n,s,o,i){e.hj=e.hj||function(){(e.hj.q=e.hj.q||[]).push(arguments)},e._hjSettings={hjid:2182187,hjsv:6},o=t.getElementsByTagName("head")[0],i=t.createElement("script"),i.async=1,i.src=n+e._hjSettings.hjid+s+e._hjSettings.hjsv,o.appendChild(i)})(window,document,"https://static.hotjar.com/c/hotjar-",".js?sv=")</script></head><body class="body body--index"><nav class="navigation-bar-mobile header navbar navbar-fixed-top"><div class=navbar-header><a href=/ class=navbar-brand><img alt=Brand style=height:46px;width:43px src=/images/beam_logo_navbar_mobile.png></a> |
| <a class=navbar-link href=/get-started/>Get Started</a> |
| <a class=navbar-link href=/documentation/>Documentation</a> |
| <button type=button class="navbar-toggle menu-open" aria-expanded=false aria-controls=navbar onclick=openMenu()> |
| <span class=sr-only>Toggle navigation</span> |
| <span class=icon-bar></span> |
| <span class=icon-bar></span> |
| <span class=icon-bar></span></button></div><div class="navbar-mask closed"></div><div id=navbar class="navbar-container closed"><button type=button class=navbar-toggle aria-expanded=false aria-controls=navbar id=closeMenu> |
| <span class=sr-only>Toggle navigation</span> |
| <span class=icon-bar></span> |
| <span class=icon-bar></span> |
| <span class=icon-bar></span></button><ul class="nav navbar-nav"><li><div class=searchBar-mobile><script>(function(){var t,n="012923275103528129024:4emlchv9wzi",e=document.createElement("script");e.type="text/javascript",e.async=!0,e.src="https://cse.google.com/cse.js?cx="+n,t=document.getElementsByTagName("script")[0],t.parentNode.insertBefore(e,t)})()</script><gcse:search></gcse:search></div></li><li><a class=navbar-link href=/about>About</a></li><li><a class=navbar-link href=/get-started/>Get Started</a></li><li><span class=navbar-link>Documentation</span><ul><li><a href=/documentation/>General</a></li><li><a href=/documentation/sdks/java/>Languages</a></li><li><a href=/documentation/runners/capability-matrix/>Runners</a></li><li><a href=/documentation/io/connectors/>I/O Connectors</a></li></ul></li><li><a class=navbar-link href=/roadmap/>Roadmap</a></li><li><a class=navbar-link href=/community/>Community</a></li><li><a class=navbar-link href=/contribute/>Contribute</a></li><li><a class=navbar-link href=/blog/>Blog</a></li><li><a class=navbar-link href=/case-studies/>Case Studies</a></li></ul><ul class="nav navbar-nav navbar-right"><li><a href=https://github.com/apache/beam/edit/master/website/www/site/content/en/_index.md data-proofer-ignore><svg xmlns="http://www.w3.org/2000/svg" width="25" height="24" fill="none" viewBox="0 0 25 24"><path stroke="#ff6d00" stroke-linecap="round" stroke-linejoin="round" stroke-width="2.75" d="M4.543 20h4l10.5-10.5c.53-.53.828-1.25.828-2s-.298-1.47-.828-2-1.25-.828-2-.828-1.47.298-2 .828L4.543 16v4zm9.5-13.5 4 4"/></svg></a></li><li class=dropdown><a href=# class=dropdown-toggle id=apache-dropdown data-toggle=dropdown role=button aria-haspopup=true aria-expanded=false><img src=https://www.apache.org/foundation/press/kit/feather_small.png alt="Apache Logo" style=height:20px> |
| Apache |
| <span class=arrow-icon><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" fill="none" viewBox="0 0 20 20"><circle cx="10" cy="10" r="10" fill="#ff6d00"/><path stroke="#fff" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" d="M8.535 5.28l4.573 4.818-4.573 4.403"/></svg></span></a><ul class="dropdown-menu dropdown-menu-right"><li><a target=_blank href=https://www.apache.org/>ASF Homepage</a></li><li><a target=_blank href=https://www.apache.org/licenses/>License</a></li><li><a target=_blank href=https://www.apache.org/security/>Security</a></li><li><a target=_blank href=https://www.apache.org/foundation/thanks.html>Thanks</a></li><li><a target=_blank href=https://www.apache.org/foundation/sponsorship.html>Sponsorship</a></li><li><a target=_blank href=https://www.apache.org/foundation/policies/conduct>Code of Conduct</a></li></ul></li></ul></div></nav><nav class=navigation-bar-desktop><a href=/ class=navbar-logo><img src=/images/beam_logo_navbar.png alt="Beam Logo"></a><div class=navbar-bar-left><div class=navbar-links><a class=navbar-link href=/about>About</a> |
| <a class=navbar-link href=/get-started/>Get Started</a><li class="dropdown navbar-dropdown navbar-dropdown-documentation"><a href=# class="dropdown-toggle navbar-link" role=button aria-haspopup=true aria-expanded=false>Documentation |
| <span><svg xmlns="http://www.w3.org/2000/svg" width="12" height="11" fill="none" viewBox="0 0 12 11"><path stroke="#ff6d00" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" d="M10.666 4.535 5.847 9.108 1.444 4.535"/></svg></span></a><ul class=dropdown-menu><li><a class=navbar-dropdown-menu-link href=/documentation/>General</a></li><li><a class=navbar-dropdown-menu-link href=/documentation/sdks/java/>Languages</a></li><li><a class=navbar-dropdown-menu-link href=/documentation/runners/capability-matrix/>Runners</a></li><li><a class=navbar-dropdown-menu-link href=/documentation/io/connectors/>I/O Connectors</a></li></ul></li><a class=navbar-link href=/roadmap/>Roadmap</a> |
| <a class=navbar-link href=/community/>Community</a> |
| <a class=navbar-link href=/contribute/>Contribute</a> |
| <a class=navbar-link href=/blog/>Blog</a> |
| <a class=navbar-link href=/case-studies/>Case Studies</a></div><div id=iconsBar><a type=button onclick=showSearch()><svg xmlns="http://www.w3.org/2000/svg" width="25" height="24" fill="none" viewBox="0 0 25 24"><path stroke="#ff6d00" stroke-linecap="round" stroke-linejoin="round" stroke-width="2.75" d="M10.191 17c3.866.0 7-3.134 7-7s-3.134-7-7-7-7 3.134-7 7 3.134 7 7 7zm11 4-6-6"/></svg></a><a target=_blank href=https://github.com/apache/beam/edit/master/website/www/site/content/en/_index.md data-proofer-ignore><svg xmlns="http://www.w3.org/2000/svg" width="25" height="24" fill="none" viewBox="0 0 25 24"><path stroke="#ff6d00" stroke-linecap="round" stroke-linejoin="round" stroke-width="2.75" d="M4.543 20h4l10.5-10.5c.53-.53.828-1.25.828-2s-.298-1.47-.828-2-1.25-.828-2-.828-1.47.298-2 .828L4.543 16v4zm9.5-13.5 4 4"/></svg></a><li class="dropdown navbar-dropdown navbar-dropdown-apache"><a href=# class=dropdown-toggle role=button aria-haspopup=true aria-expanded=false><img src=https://www.apache.org/foundation/press/kit/feather_small.png alt="Apache Logo" style=height:20px> |
| Apache |
| <span class=arrow-icon><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" fill="none" viewBox="0 0 20 20"><circle cx="10" cy="10" r="10" fill="#ff6d00"/><path stroke="#fff" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" d="M8.535 5.28l4.573 4.818-4.573 4.403"/></svg></span></a><ul class=dropdown-menu><li><a class=navbar-dropdown-menu-link target=_blank href=https://www.apache.org/>ASF Homepage</a></li><li><a class=navbar-dropdown-menu-link target=_blank href=https://www.apache.org/licenses/>License</a></li><li><a class=navbar-dropdown-menu-link target=_blank href=https://www.apache.org/security/>Security</a></li><li><a class=navbar-dropdown-menu-link target=_blank href=https://www.apache.org/foundation/thanks.html>Thanks</a></li><li><a class=navbar-dropdown-menu-link target=_blank href=https://www.apache.org/foundation/sponsorship.html>Sponsorship</a></li><li><a class=navbar-dropdown-menu-link target=_blank href=https://www.apache.org/foundation/policies/conduct>Code of Conduct</a></li></ul></li></div><div class="searchBar disappear"><script>(function(){var t,n="012923275103528129024:4emlchv9wzi",e=document.createElement("script");e.type="text/javascript",e.async=!0,e.src="https://cse.google.com/cse.js?cx="+n,t=document.getElementsByTagName("script")[0],t.parentNode.insertBefore(e,t)})()</script><gcse:search></gcse:search> |
| <a type=button onclick=endSearch()><svg xmlns="http://www.w3.org/2000/svg" width="25" height="25" fill="none" viewBox="0 0 25 25"><path stroke="#ff6d00" stroke-linecap="round" stroke-linejoin="round" stroke-width="2.75" d="M21.122 20.827 4.727 4.432M21.122 4.43 4.727 20.827"/></svg></a></div></div></nav><div class=header-push></div><div class="top-banners swiper"><div class=swiper-wrapper><div class=swiper-slide><a href=https://tour.beam.apache.org><img class=banner-img-desktop src=/images/banners/tour-of-beam/tour-of-beam-desktop.png alt="Start Tour of Beam"> |
| <img class=banner-img-mobile src=/images/banners/tour-of-beam/tour-of-beam-mobile.png alt="Start Tour of Beam"></a></div><div class=swiper-slide><a href=https://beam.apache.org/documentation/ml/overview/><img class=banner-img-desktop src=/images/banners/machine-learning/machine-learning-desktop.jpg alt="Machine Learning"> |
| <img class=banner-img-mobile src=/images/banners/machine-learning/machine-learning-mobile.jpg alt="Machine Learning"></a></div></div><div class=swiper-pagination></div><div class=swiper-button-prev></div><div class=swiper-button-next></div></div><script src=/js/swiper-bundle.min.min.e0e8f81b0b15728d35ff73c07f42ddbb17a108d6f23df4953cb3e60df7ade675.js></script> |
| <script src=/js/sliders/top-banners.min.afa7d0a19acf7a3b28ca369490b3d401a619562a2a4c9612577be2f66a4b9855.js></script> |
| <script>function showSearch(){addPlaceholder();var e,t=document.querySelector(".searchBar");t.classList.remove("disappear"),e=document.querySelector("#iconsBar"),e.classList.add("disappear")}function addPlaceholder(){$("input:text").attr("placeholder","What are you looking for?")}function endSearch(){var e,t=document.querySelector(".searchBar");t.classList.add("disappear"),e=document.querySelector("#iconsBar"),e.classList.remove("disappear")}function blockScroll(){$("body").toggleClass("fixedPosition")}function openMenu(){addPlaceholder(),blockScroll()}</script><div class="body__contained no__padding"><div id=hero-desktop class=hero-desktop><div class=hero-content><h3>Introducing Apache Beam</h3><h1>The Unified Apache Beam Model</h1><h2>The easiest way to do batch and streaming data processing. Write once, run anywhere data processing for mission-critical production workloads.</h2><a href=https://github.com/apache/beam><button><svg xmlns="http://www.w3.org/2000/svg" width="16" height="18" fill="none" viewBox="0 0 16 18"><path stroke="#f26628" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" d="M1 13v2c0 .53.184 1.04.513 1.414.328.375.773.586 1.237.586h10.5c.464.0.91-.21 1.237-.586.329-.375.513-.884.513-1.414v-2M3 7l5 5 5-5M8 1v11"/></svg> |
| <span>Link to GitHub Repo</span></button></a></div></div><div id=hero-mobile class=hero-mobile><div class=hero-content><h3>Introducing Apache Beam</h3><h1>The Unified Apache Beam Model</h1><h2>The easiest way to do batch and streaming data processing. Write once, run anywhere data processing for mission-critical production workloads.</h2></div></div><div class=ctas><div class=ctas_row><a class=ctas_button href=/get-started/beam-overview/><img src=images/info_icon.svg> Learn more</a></div><div class=ctas_row><a class=ctas_button href=/get-started/quickstart-java/>Java Quickstart</a></div><div class=ctas_row><a class=ctas_button href=/get-started/quickstart-py/>Python Quickstart</a></div><div class=ctas_row><a class=ctas_button href=/get-started/quickstart-go/>Go Quickstart</a></div><div class=ctas_row><a class=ctas_button href=https://play.beam.apache.org>Try Playground</a></div><div class=ctas_row><a class=ctas_button href=https://tour.beam.apache.org>Tour of Beam</a></div></div><div class=graphic><div class=quotes><h2 class=margin>How Does It Work?</h2><div class="margin section"><img class=row-image src=/images/graphic-background.png><div class=row><div class=column><img src=/images/model-sources-icon.svg class='icon mobile'><h4>Data Sourcing</h4><p>Beam reads your data from a diverse set of supported sources, no matter if it’s on-prem or in the cloud.</p></div><div class=column><img src=/images/model-processing-icon.svg class='icon mobile'><h4>Data Processing</h4><p>Beam executes your business logic for both batch and streaming use cases.</p></div><div class=column><img src=/images/model-sinks-icon.svg class='icon mobile'><h4>Data Writing</h4><p>Beam writes the results of your data processing logic to the most popular data sinks in the industry.</p></div></div></div></div></div><div class=pillars><h2 class=pillars-title>Apache Beam Features</h2><div class=pillars-content><div class=pillars-item><div class=pillars-item-icon><svg xmlns="http://www.w3.org/2000/svg" width="112" height="112" fill="none" viewBox="0 0 112 112"><path fill="#ffe5d9" d="M56 112c30.928.0 56-25.072 56-56S86.928.0 56 0 0 25.072.0 56s25.072 56 56 56z"/><path fill="#ff570b" d="M51.413 81.43c11.869-2.347 19.269-15.483 16.529-29.34S53.359 28.903 41.49 31.25C29.62 33.597 22.22 46.733 24.962 60.59c2.74 13.856 14.583 23.187 26.451 20.84z"/><path fill="#ffc400" d="M89.034 59.006C90.869 45 82.632 32.373 70.636 30.802 58.641 29.23 47.43 39.31 45.594 53.315 43.759 67.32 51.996 79.947 63.99 81.519 75.987 83.09 87.2 73.01 89.034 59.006z"/><path fill="#fff" fill-rule="evenodd" d="M57.19 79.268c8.366-4.793 13.013-15.74 10.751-27.178-1.519-7.68-5.834-13.971-11.4-17.653-5.68 3.978-9.885 10.77-10.947 18.878C44.132 64.47 49.06 74.752 57.19 79.268z" clip-rule="evenodd"/><path stroke="#000" stroke-linecap="round" stroke-linejoin="round" stroke-width="3" d="M92.28 55.712h-15.5M77.113 50.212l-3.334 5.824 4 5.176"/></svg></div><div class=pillars-item-description><h5 class=pillars-item-header>Unified</h5><p class=pillars-item-text>A simplified, single programming model for both batch and streaming use cases for every member of your data and application teams.</p></div></div><div class=pillars-item><div class=pillars-item-icon><svg xmlns="http://www.w3.org/2000/svg" width="112" height="113" fill="none" viewBox="0 0 112 113"><path fill="#ffe5d9" d="M56 112.445c30.928.0 56-25.072 56-56s-25.072-56-56-56-56 25.072-56 56 25.072 56 56 56z"/><path fill="#fbc23e" d="M80.493 38.334c-.543-.1-.995-.538-.995-1.09v-5.83c0-.553-.448-1-1-1h-5.56c-.542.0-.978-.438-1.076-.972-.5-2.707-2.786-4.755-5.54-4.755-2.75.0-5.04 2.048-5.54 4.755-.1.534-.535.971-1.078.971h-5.56c-.552.0-1 .448-1 1v5.83c0 .553.452.991.995 1.091 2.644.49 4.652 2.892 4.652 5.78.0 2.89-2.008 5.292-4.652 5.781-.543.1-.995.539-.995 1.091v5.83c0 .553.448 1 1 1h5.531c.552.0.991.451 1.081.996.455 2.768 2.774 4.876 5.565 4.876 2.792.0 5.11-2.108 5.566-4.876.09-.545.528-.996 1.08-.996h5.531c.552.0 1-.447 1-1v-5.83c0-.552.452-.99.995-1.09 2.644-.49 4.651-2.892 4.651-5.781.0-2.89-2.003-5.293-4.65-5.78z"/><path fill="#ff570b" d="M66.882 89.353c.201-.52.72-.886 1.267-.78l5.37 1.05c.547.106 1.076-.255 1.176-.803l.952-5.217c.098-.54.613-.889 1.161-.89 2.611-.005 4.902-1.801 5.38-4.405.478-2.613-1.037-5.161-3.48-6.147-.498-.2-.842-.703-.746-1.232l.961-5.267c.098-.538-.255-1.056-.792-1.16l-5.394-1.054c-.547-.107-1.067.26-1.268.779-.933 2.407-3.524 3.858-6.227 3.334-2.711-.531-4.613-2.877-4.622-5.484-.002-.547-.345-1.066-.881-1.17l-5.395-1.054c-.547-.107-1.076.254-1.176.802l-.945 5.188c-.1.548-.631.9-1.188.89-2.658-.05-5.012 1.769-5.496 4.413-.485 2.655 1.08 5.244 3.587 6.196.512.194.87.703.771 1.241l-.954 5.238c-.098.539.255 1.056.792 1.16l5.418 1.059c.537.105.88.625.882 1.172.006 2.605 1.913 4.952 4.623 5.483 2.698.522 5.29-.934 6.224-3.342z"/><path fill="#fff" d="M54.06 38.33c-.545-.095-.996-.534-.996-1.086v-5.83c0-.553-.448-1-1-1h-5.796c-.543.0-.977-.438-1.08-.971-.515-2.707-2.878-4.756-5.713-4.756s-5.197 2.049-5.713 4.756c-.102.533-.537.97-1.08.97h-5.795c-.553.0-1 .448-1 1v5.83c0 .553.451.992.995 1.086 2.741.477 4.827 2.886 4.827 5.786s-2.085 5.31-4.827 5.785c-.544.095-.995.534-.995 1.086v5.83c0 .553.447 1 1 1h5.766c.552.0.99.451 1.083.996.47 2.768 2.86 4.876 5.74 4.876 2.878.0 5.27-2.108 5.739-4.876.092-.544.53-.996 1.083-.996h5.766c.552.0 1-.447 1-1v-5.83c0-.552.451-.991.995-1.085 2.742-.477 4.828-2.886 4.828-5.786s-2.086-5.31-4.828-5.786z"/><path stroke="#000" stroke-linecap="round" stroke-width="3" d="M85.144 53.688l5-3M85.55 62.161l4.191 4.053m-2.596-8.22 7.423.394"/></svg></div><div class=pillars-item-description><h5 class=pillars-item-header>Extensible</h5><p class=pillars-item-text>Apache Beam is extensible, with projects such as TensorFlow Extended and Apache Hop built on top of Apache Beam.</p></div></div><div class=pillars-item><div class=pillars-item-icon><svg xmlns="http://www.w3.org/2000/svg" width="112" height="112" fill="none" viewBox="0 0 112 112"><path fill="#ffe5d9" d="M56 112c30.928.0 56-25.072 56-56S86.928.0 56 0 0 25.072.0 56s25.072 56 56 56z"/><path stroke="#1d1d1b" stroke-linecap="round" stroke-miterlimit="10" stroke-width="3" d="M40 27v5.719C40 36.188 43.475 39 47.762 39h17.475C69.526 39 73 36.188 73 32.719V27M57 22v44M73 87v-5.719C73 77.812 69.525 75 65.238 75H47.763C43.474 75 40 77.812 40 81.281V87m17 3V48"/><path fill="#fbc23e" d="M61 20h-8c-1.105.0-2 .895-2 2v8c0 1.105.895 2 2 2h8c1.105.0 2-.895 2-2v-8c0-1.105-.895-2-2-2zM40 33c3.314.0 6-2.686 6-6s-2.686-6-6-6-6 2.686-6 6 2.686 6 6 6z"/><path fill="#ff570b" d="M68 92h10c1.105.0 2-.895 2-2v-5c0-1.105-.895-2-2-2H68c-1.105.0-2 .895-2 2v5c0 1.105.895 2 2 2zM35 92h10c1.105.0 2-.895 2-2v-5c0-1.105-.895-2-2-2H35c-1.105.0-2 .895-2 2v5c0 1.105.895 2 2 2zm17 0h10c1.105.0 2-.895 2-2v-5c0-1.105-.895-2-2-2H52c-1.105.0-2 .895-2 2v5c0 1.105.895 2 2 2z"/><path fill="#fff" d="M57 70c7.18.0 13-5.82 13-13s-5.82-13-13-13-13 5.82-13 13 5.82 13 13 13z"/><path fill="#fbc23e" d="M71.792 21.802c.78-1.279 2.636-1.279 3.416.0l4.666 7.657c.812 1.333-.147 3.041-1.708 3.041h-9.332c-1.561.0-2.52-1.708-1.708-3.04l4.666-7.658z"/></svg></div><div class=pillars-item-description><h5 class=pillars-item-header>Portable</h5><p class=pillars-item-text>Execute pipelines on multiple execution environments (runners), providing flexibility and avoiding lock-in.</p></div></div><div class=pillars-item><div class=pillars-item-icon><svg xmlns="http://www.w3.org/2000/svg" width="112" height="112" fill="none" viewBox="0 0 112 112"><path fill="#ffe5d9" d="M56 112c30.928.0 56-25.072 56-56S86.928.0 56 0 0 25.072.0 56s25.072 56 56 56z"/><path fill="#ff570b" d="M76.344 52.516s-7.312-19.178-20.61-31.439c-.089-.12-.221-.2-.369-.223-.147-.022-.297.016-.417.105-.12.09-.2.223-.221.37-.022.15.015.3.104.42 2.925 5.381 9.93 17.97 16.8 28.74"/><path fill="#ff570b" d="M52.953 85.709S32.288 83.09 33.913 63.53c.966-11.442 2.709-12.97 1.22-19.45-.06-.269-.057-.548.007-.816s.187-.518.361-.73c.174-.213.394-.383.643-.498.248-.115.52-.17.794-.164 8.802.2 39.289 1.917 43.839 15.633 4.667 14.042 1.083 29.22-17.252 28.857.009.0-7.9-.091-10.572-.654z"/><path fill="#1d1d1b" d="M73.637 79.565c-.584-.005-1.164-.106-1.715-.3-.713-.237-3.485-1.654-3.467-3 .005-.357.15-.698.404-.949.253-.25.595-.39.95-.387.203.002.403.05.584.142.182.091.34.223.464.385.772.793 1.8 1.283 2.897 1.382.417-.05.817-.196 1.168-.428.35-.232.644-.543.855-.908.105-.145.238-.267.39-.36.153-.092.322-.154.498-.18.176-.028.355-.02.528.023.173.043.336.12.48.226.143.106.264.24.356.393.093.154.154.324.18.501.028.177.02.358-.023.532-.043.174-.119.338-.225.483-.468.73-1.107 1.336-1.86 1.762-.754.426-1.6.66-2.464.683z"/><path fill="#fff" d="M78.639 67.749c.108 4.399.442 8.453 2.14 8.516.848-.645 2.915-3.508 3.114-8.398.0-5.453-1.472-8.907-3.476-10.343-2.121 1.554-1.634 6.808-1.778 10.225z"/><path fill="#1d1d1b" d="M82.737 66.213c0 3.826-1.201 6.934-2.709 6.934-1.507.0-2.329-2.899-2.329-6.725.0-3.827.849-7.144 2.33-7.144 1.48.0 2.708 3.1 2.708 6.935z"/><path fill="#fff" d="M80.375 62.936c.547-.428.532-1.37-.035-2.103-.566-.733-1.469-.98-2.016-.551-.547.428-.53 1.37.035 2.103.567.733 1.47.98 2.016.551zM65.185 75.522c3.747-2.966 3.758-9.245.026-14.023-3.732-4.778-9.795-6.247-13.542-3.281s-3.759 9.245-.026 14.023c3.732 4.778 9.795 6.247 13.542 3.281z"/><path fill="#1d1d1b" d="M63.34 71.87c2.508-2.488 2.172-6.924-.75-9.91-2.923-2.985-7.324-3.389-9.832-.901-2.507 2.487-2.17 6.924.752 9.91 2.922 2.985 7.324 3.388 9.83.9z"/><path fill="#fff" d="M53.38 64.356c.719-.434.889-1.477.381-2.33-.508-.852-1.502-1.19-2.22-.757-.718.434-.889 1.477-.38 2.33.507.851 1.501 1.19 2.22.757z"/><path fill="#ff570b" d="M59.38 51.907S52.8 33.11 32.885 19.096c-.106-.071-.233-.104-.36-.094-.127.01-.247.063-.34.15-.094.087-.156.203-.177.33-.02.126.003.256.064.368 3.693 6.244 16.666 24.431 20.8 29.721"/></svg></div><div class=pillars-item-description><h5 class=pillars-item-header>Open Source</h5><p class=pillars-item-text>Open, community-based development and support to help evolve your application and meet the needs of your specific use cases.</p></div></div></div></div><div class=logos><div class=logos-title>Write Once, Run Anywhere</div><div class=logos-logos><div class=logos-logo><a href=/documentation/runners/flink/><img src=/images/logo_flink.png alt=Flink></a></div><div class=logos-logo><a href=/documentation/runners/spark/><img src=/images/logo_spark.png alt=Spark></a></div><div class=logos-logo><a href=/documentation/runners/dataflow/><img src=/images/logo_google_cloud.png alt="Google Cloud Dataflow"></a></div><div class=logos-logo><a href=/documentation/runners/samza/><img src=/images/logo_samza.png alt=Samza></a></div><div class=logos-logo><a href=/documentation/runners/twister2/><img src=/images/logo_twister2.png alt=Twister2></a></div><div class=logos-logo><a href=https://docs.aws.amazon.com/kinesisanalytics/latest/java/examples-beam.html><img src=/images/logo_amazon-kinesis.png alt="Amazon Kinesis Data Analytics"></a></div></div></div><div class=pipelines><div class=pipelines-title>Create Multi-language Pipelines</div><div class=pipelines-logos><div class=pipelines-logo><a href=/documentation/sdks/python/><img src=/images/logos/sdks/python_pipelines.png alt=Python></a></div><div class=pipelines-logo><a href=/documentation/sdks/java/><img src=/images/logos/sdks/java_pipelines.png alt=Java></a></div><div class=pipelines-logo><a href=/documentation/sdks/go/><img src=/images/logos/sdks/go_pipelines.png alt=Go></a></div><div class=pipelines-logo><a href=/documentation/sdks/typescript/><img src=/images/logos/sdks/typescript_pipelines.png alt=Typescript></a></div><div class=pipelines-logo><a href=/documentation/sdks/scala/><img src=/images/logos/sdks/scala_pipeline.png alt=Scala></a></div><div class=pipelines-logo><a href=/documentation/sdks/yaml/><img src=/images/logos/sdks/yaml.png alt=YAML></a></div><div class=pipelines-logo><a href=/documentation/dsls/sql/overview/><img src=/images/logos/sdks/sql_pipelines.png alt=SQL></a></div></div></div><div class="body__contained body__section-nav playground-section" tabindex=-1><h1>Try Beam Playground</h1><p>Beam Playground is an interactive environment to try out Beam transforms and examples without having to install Apache Beam in your environment. |
| You can try the Apache Beam examples at <a href=https://play.beam.apache.org/>Beam Playground</a>.</p><br><br><div class=playground_or_image><a class=playground__mobile href=https://play.beam.apache.org/><img src=images/playground.png alt="beam playground"></a><div class=playground-wrapper><div class=playground-snippets><div class="language-java playground-snippet" data-sdk=java></div><div class="language-py playground-snippet" data-sdk=python></div><div class="language-go playground-snippet" data-sdk=go></div><div class="language-scio playground-snippet" data-sdk=scio></div></div><div class="code-snippet code-snippet-playground" data-src="https://play.beam.apache.org/embedded?examples=%5b%7b%22path%22%3a%22SDK_JAVA_MinimalWordCount%22%2c%22sdk%22%3a%22java%22%7d%2c%7b%22path%22%3a%22SDK_PYTHON_WordCountWithMetrics%22%2c%22sdk%22%3a%22python%22%7d%2c%7b%22path%22%3a%22SDK_GO_MinimalWordCount%22%2c%22sdk%22%3a%22go%22%7d%2c%7b%22path%22%3a%22SDK_SCIO_MinimalWordCount%22%2c%22sdk%22%3a%22scio%22%7d%5d" data-width=100% data-height=700px></div><div class=playground-iframe-overlay></div></div></div></div><div class=quotes><div class=quotes-inner><div class=quotes-title>Case Studies Powered by Apache Beam</div><div class=swiper-container><div class=swiper-button-prev-custom><img src=/images/swiper-button-prev.png alt="previous button"></div><div class="quotes-desktop swiper"><div class=swiper-wrapper><div class=swiper-slide><div class=wrap-slide><div class=quote-card><div class=quote-icon><svg xmlns="http://www.w3.org/2000/svg" width="73" height="26" fill="none" viewBox="0 0 73 26"><path fill="#ff6d05" d="M13.248 19.058c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L7.968.291C3.36 3.324.0 10.149.0 16.689c0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zm18.048.0c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L26.016.291c-4.608 3.033-7.968 9.858-7.968 16.398.0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zM41.499 6.926c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.76 9.952l5.088 2.654c4.704-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161zm18.048.0c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.856 9.952l5.184 2.654c4.608-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161z"/></svg></div><h5 class=quote-text>Apache Beam fuels LinkedIn’s streaming infrastructure, processing 4 trillion events daily through 3K+ pipelines in near-real time. Beam enabled unified pipelines, yielding 2x cost savings and remarkable improvements for many use cases.</h5><div class=quote-card-link-container><a class=quote-card-link href=case-studies/linkedin/index.html><span>Learn more</span> |
| <img src=/images/arrow-right.svg alt="Go to the case study"></a></div><div class=case-study-row-button-container><a href=https://github.com/apache/beam/blob/master/website/ADD_CASE_STUDY.md class=case-study-primary-button target=_blank rel="noopener noreferrer">Share your story</a></div><div class=quote-img-container><div class=quote-img><img src=images/logos/powered-by/linkedin.png alt="Quote Logo"></div></div></div></div></div><div class=swiper-slide><div class=wrap-slide><div class=quote-card><div class=quote-icon><svg xmlns="http://www.w3.org/2000/svg" width="73" height="26" fill="none" viewBox="0 0 73 26"><path fill="#ff6d05" d="M13.248 19.058c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L7.968.291C3.36 3.324.0 10.149.0 16.689c0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zm18.048.0c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L26.016.291c-4.608 3.033-7.968 9.858-7.968 16.398.0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zM41.499 6.926c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.76 9.952l5.088 2.654c4.704-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161zm18.048.0c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.856 9.952l5.184 2.654c4.608-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161z"/></svg></div><h5 class=quote-text>With Apache Beam, OCTO accelerated the migration of one of France’s largest grocery retailers to streaming processing for transactional data, achieving 5x reduced infrastructure costs and 4x improved performance.</h5><div class=quote-card-link-container><a class=quote-card-link href=case-studies/octo/index.html><span>Learn more</span> |
| <img src=/images/arrow-right.svg alt="Go to the case study"></a></div><div class=case-study-row-button-container><a href=https://github.com/apache/beam/blob/master/website/ADD_CASE_STUDY.md class=case-study-primary-button target=_blank rel="noopener noreferrer">Share your story</a></div><div class=quote-img-container><div class=quote-img><img src=images/logos/powered-by/octo.png alt="Quote Logo"></div></div></div></div></div><div class=swiper-slide><div class=wrap-slide><div class=quote-card><div class=quote-icon><svg xmlns="http://www.w3.org/2000/svg" width="73" height="26" fill="none" viewBox="0 0 73 26"><path fill="#ff6d05" d="M13.248 19.058c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L7.968.291C3.36 3.324.0 10.149.0 16.689c0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zm18.048.0c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L26.016.291c-4.608 3.033-7.968 9.858-7.968 16.398.0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zM41.499 6.926c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.76 9.952l5.088 2.654c4.704-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161zm18.048.0c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.856 9.952l5.184 2.654c4.608-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161z"/></svg></div><h5 class=quote-text>HSBC leveraged Apache Beam as a computational platform and a risk engine that enabled 100x scaling, 2x faster performance, and simplified data distribution for assessing and managing XVA and counterparty credit risk at HSBC’s global scale.</h5><div class=quote-card-link-container><a class=quote-card-link href=case-studies/hsbc/index.html><span>Learn more</span> |
| <img src=/images/arrow-right.svg alt="Go to the case study"></a></div><div class=case-study-row-button-container><a href=https://github.com/apache/beam/blob/master/website/ADD_CASE_STUDY.md class=case-study-primary-button target=_blank rel="noopener noreferrer">Share your story</a></div><div class=quote-img-container><div class=quote-img><img src=images/logos/powered-by/hsbc.png alt="Quote Logo"></div></div></div></div></div><div class=swiper-slide><div class=wrap-slide><div class=quote-card><div class=quote-icon><svg xmlns="http://www.w3.org/2000/svg" width="73" height="26" fill="none" viewBox="0 0 73 26"><path fill="#ff6d05" d="M13.248 19.058c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L7.968.291C3.36 3.324.0 10.149.0 16.689c0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zm18.048.0c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L26.016.291c-4.608 3.033-7.968 9.858-7.968 16.398.0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zM41.499 6.926c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.76 9.952l5.088 2.654c4.704-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161zm18.048.0c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.856 9.952l5.184 2.654c4.608-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161z"/></svg></div><h5 class=quote-text>Apache Beam supports Project Shield’s mission to protect freedom of speech and make the web a safer space by enabling ~2x streaming efficiency at >10,000 QPS and real-time visibility into attack data for their >3K customers.</h5><div class=quote-card-link-container><a class=quote-card-link href=case-studies/projectshield/index.html><span>Learn more</span> |
| <img src=/images/arrow-right.svg alt="Go to the case study"></a></div><div class=case-study-row-button-container><a href=https://github.com/apache/beam/blob/master/website/ADD_CASE_STUDY.md class=case-study-primary-button target=_blank rel="noopener noreferrer">Share your story</a></div><div class=quote-img-container><div class=quote-img><img src=images/logos/powered-by/project_shield.png alt="Quote Logo"></div></div></div></div></div><div class=swiper-slide><div class=wrap-slide><div class=quote-card><div class=quote-icon><svg xmlns="http://www.w3.org/2000/svg" width="73" height="26" fill="none" viewBox="0 0 73 26"><path fill="#ff6d05" d="M13.248 19.058c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L7.968.291C3.36 3.324.0 10.149.0 16.689c0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zm18.048.0c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L26.016.291c-4.608 3.033-7.968 9.858-7.968 16.398.0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zM41.499 6.926c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.76 9.952l5.088 2.654c4.704-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161zm18.048.0c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.856 9.952l5.184 2.654c4.608-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161z"/></svg></div><h5 class=quote-text>Apache Beam powers the Booking.com global ad bidding for performance marketing and scans 2PB+ of data daily, accelerating processing by an eye-opening 36x and expediting time-to-market by as much as 4x.</h5><div class=quote-card-link-container><a class=quote-card-link href=case-studies/booking/index.html><span>Learn more</span> |
| <img src=/images/arrow-right.svg alt="Go to the case study"></a></div><div class=case-study-row-button-container><a href=https://github.com/apache/beam/blob/master/website/ADD_CASE_STUDY.md class=case-study-primary-button target=_blank rel="noopener noreferrer">Share your story</a></div><div class=quote-img-container><div class=quote-img><img src=images/logos/powered-by/booking.png alt="Quote Logo"></div></div></div></div></div><div class=swiper-slide><div class=wrap-slide><div class=quote-card><div class=quote-icon><svg xmlns="http://www.w3.org/2000/svg" width="73" height="26" fill="none" viewBox="0 0 73 26"><path fill="#ff6d05" d="M13.248 19.058c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L7.968.291C3.36 3.324.0 10.149.0 16.689c0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zm18.048.0c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L26.016.291c-4.608 3.033-7.968 9.858-7.968 16.398.0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zM41.499 6.926c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.76 9.952l5.088 2.654c4.704-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161zm18.048.0c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.856 9.952l5.184 2.654c4.608-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161z"/></svg></div><h5 class=quote-text>Apache Beam has future-proofed Credit Karma’s data and ML platform for scalability and efficiency, enabling MLOps with unified pipelines, processing 5-10 TB daily at 5K events per second, and managing 20K+ ML features.</h5><div class=quote-card-link-container><a class=quote-card-link href=case-studies/creditkarma/index.html><span>Learn more</span> |
| <img src=/images/arrow-right.svg alt="Go to the case study"></a></div><div class=case-study-row-button-container><a href=https://github.com/apache/beam/blob/master/website/ADD_CASE_STUDY.md class=case-study-primary-button target=_blank rel="noopener noreferrer">Share your story</a></div><div class=quote-img-container><div class=quote-img><img src=images/logos/powered-by/credit-karma.png alt="Quote Logo"></div></div></div></div></div><div class=swiper-slide><div class=wrap-slide><div class=quote-card><div class=quote-icon><svg xmlns="http://www.w3.org/2000/svg" width="73" height="26" fill="none" viewBox="0 0 73 26"><path fill="#ff6d05" d="M13.248 19.058c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L7.968.291C3.36 3.324.0 10.149.0 16.689c0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zm18.048.0c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L26.016.291c-4.608 3.033-7.968 9.858-7.968 16.398.0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zM41.499 6.926c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.76 9.952l5.088 2.654c4.704-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161zm18.048.0c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.856 9.952l5.184 2.654c4.608-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161z"/></svg></div><h5 class=quote-text>Apache Beam is a central component to Intuit’s Stream Processing Platform, which has driven 3x faster time-to-production for authoring a stream processing pipeline.</h5><div class=quote-card-link-container><a class=quote-card-link href=case-studies/intuit/index.html><span>Learn more</span> |
| <img src=/images/arrow-right.svg alt="Go to the case study"></a></div><div class=case-study-row-button-container><a href=https://github.com/apache/beam/blob/master/website/ADD_CASE_STUDY.md class=case-study-primary-button target=_blank rel="noopener noreferrer">Share your story</a></div><div class=quote-img-container><div class=quote-img><img src=images/case-study/intuit/intuit-quote.png alt="Quote Logo"></div></div></div></div></div><div class=swiper-slide><div class=wrap-slide><div class=quote-card><div class=quote-icon><svg xmlns="http://www.w3.org/2000/svg" width="73" height="26" fill="none" viewBox="0 0 73 26"><path fill="#ff6d05" d="M13.248 19.058c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L7.968.291C3.36 3.324.0 10.149.0 16.689c0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zm18.048.0c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L26.016.291c-4.608 3.033-7.968 9.858-7.968 16.398.0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zM41.499 6.926c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.76 9.952l5.088 2.654c4.704-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161zm18.048.0c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.856 9.952l5.184 2.654c4.608-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161z"/></svg></div><h5 class=quote-text>Apache Beam enabled real-time ML streaming feature generation and model execution playing a pivotal role in optimizing Lyft’s Marketplace ML predictions, processing ~4mil events per minute to generate ~100 features.</h5><div class=quote-card-link-container><a class=quote-card-link href=case-studies/lyft/index.html><span>Learn more</span> |
| <img src=/images/arrow-right.svg alt="Go to the case study"></a></div><div class=case-study-row-button-container><a href=https://github.com/apache/beam/blob/master/website/ADD_CASE_STUDY.md class=case-study-primary-button target=_blank rel="noopener noreferrer">Share your story</a></div><div class=quote-img-container><div class=quote-img><img src=images/case-study/lyft/lyft-quote.png alt="Quote Logo"></div></div></div></div></div><div class=swiper-slide><div class=wrap-slide><div class=quote-card><div class=quote-icon><svg xmlns="http://www.w3.org/2000/svg" width="73" height="26" fill="none" viewBox="0 0 73 26"><path fill="#ff6d05" d="M13.248 19.058c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L7.968.291C3.36 3.324.0 10.149.0 16.689c0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zm18.048.0c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L26.016.291c-4.608 3.033-7.968 9.858-7.968 16.398.0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zM41.499 6.926c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.76 9.952l5.088 2.654c4.704-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161zm18.048.0c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.856 9.952l5.184 2.654c4.608-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161z"/></svg></div><h5 class=quote-text>Seznam, a Czech search engine, has been an early contributor and adopter of Apache Beam, and they migrated several petabyte-scale workloads to Apache Beam pipelines.</h5><div class=quote-card-link-container><a class=quote-card-link href=case-studies/seznam/index.html><span>Learn more</span> |
| <img src=/images/arrow-right.svg alt="Go to the case study"></a></div><div class=case-study-row-button-container><a href=https://github.com/apache/beam/blob/master/website/ADD_CASE_STUDY.md class=case-study-primary-button target=_blank rel="noopener noreferrer">Share your story</a></div><div class=quote-img-container><div class=quote-img><img src=images/logos/powered-by/seznam.png alt="Quote Logo"></div></div></div></div></div><div class=swiper-slide><div class=wrap-slide><div class=quote-card><div class=quote-icon><svg xmlns="http://www.w3.org/2000/svg" width="73" height="26" fill="none" viewBox="0 0 73 26"><path fill="#ff6d05" d="M13.248 19.058c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L7.968.291C3.36 3.324.0 10.149.0 16.689c0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zm18.048.0c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L26.016.291c-4.608 3.033-7.968 9.858-7.968 16.398.0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zM41.499 6.926c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.76 9.952l5.088 2.654c4.704-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161zm18.048.0c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.856 9.952l5.184 2.654c4.608-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161z"/></svg></div><h5 class=quote-text>Palo Alto Networks, Inc. is a global cybersecurity leader that uses Apache Beam to process ~10 millions of security log events per second for their real-time streaming infrastructure.</h5><div class=quote-card-link-container><a class=quote-card-link href=case-studies/paloalto/index.html><span>Learn more</span> |
| <img src=/images/arrow-right.svg alt="Go to the case study"></a></div><div class=case-study-row-button-container><a href=https://github.com/apache/beam/blob/master/website/ADD_CASE_STUDY.md class=case-study-primary-button target=_blank rel="noopener noreferrer">Share your story</a></div><div class=quote-img-container><div class=quote-img><img src=images/logos/powered-by/paloalto.png alt="Quote Logo"></div></div></div></div></div><div class=swiper-slide><div class=wrap-slide><div class=quote-card><div class=quote-icon><svg xmlns="http://www.w3.org/2000/svg" width="73" height="26" fill="none" viewBox="0 0 73 26"><path fill="#ff6d05" d="M13.248 19.058c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L7.968.291C3.36 3.324.0 10.149.0 16.689c0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zm18.048.0c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L26.016.291c-4.608 3.033-7.968 9.858-7.968 16.398.0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zM41.499 6.926c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.76 9.952l5.088 2.654c4.704-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161zm18.048.0c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.856 9.952l5.184 2.654c4.608-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161z"/></svg></div><h5 class=quote-text>Apache Beam provides Ricardo, a leading Swiss second hand marketplace, with a scalable and reliable data processing framework that supports fundamental business scenarios and enables real-time and ML data processing.</h5><div class=quote-card-link-container><a class=quote-card-link href=case-studies/ricardo/index.html><span>Learn more</span> |
| <img src=/images/arrow-right.svg alt="Go to the case study"></a></div><div class=case-study-row-button-container><a href=https://github.com/apache/beam/blob/master/website/ADD_CASE_STUDY.md class=case-study-primary-button target=_blank rel="noopener noreferrer">Share your story</a></div><div class=quote-img-container><div class=quote-img><img src=images/logos/powered-by/ricardo.png alt="Quote Logo"></div></div></div></div></div><div class=swiper-slide><div class=wrap-slide><div class=quote-card><div class=quote-icon><svg xmlns="http://www.w3.org/2000/svg" width="73" height="26" fill="none" viewBox="0 0 73 26"><path fill="#ff6d05" d="M13.248 19.058c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L7.968.291C3.36 3.324.0 10.149.0 16.689c0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zm18.048.0c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L26.016.291c-4.608 3.033-7.968 9.858-7.968 16.398.0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zM41.499 6.926c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.76 9.952l5.088 2.654c4.704-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161zm18.048.0c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.856 9.952l5.184 2.654c4.608-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161z"/></svg></div><h5 class=quote-text>Apache Hop, an open-source data orchestration platform, uses Apache Beam to “design once, run anywhere” and creates a value-add for Apache Beam users by enabling visual pipeline development and lifecycle management.</h5><div class=quote-card-link-container><a class=quote-card-link href=case-studies/hop/index.html><span>Learn more</span> |
| <img src=/images/arrow-right.svg alt="Go to the case study"></a></div><div class=case-study-row-button-container><a href=https://github.com/apache/beam/blob/master/website/ADD_CASE_STUDY.md class=case-study-primary-button target=_blank rel="noopener noreferrer">Share your story</a></div><div class=quote-img-container><div class=quote-img><img src=images/logos/powered-by/hop.png alt="Quote Logo"></div></div></div></div></div><div class=swiper-slide><div class=wrap-slide><div class=quote-card><div class=quote-icon><svg xmlns="http://www.w3.org/2000/svg" width="73" height="26" fill="none" viewBox="0 0 73 26"><path fill="#ff6d05" d="M13.248 19.058c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L7.968.291C3.36 3.324.0 10.149.0 16.689c0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zm18.048.0c0-3.696-2.4-6.16-5.952-6.16.0-3.413 2.4-7.489 5.856-9.953L26.016.291c-4.608 3.033-7.968 9.858-7.968 16.398.0 5.118 2.784 8.53 6.912 8.53 3.648.0 6.336-2.559 6.336-6.16zM41.499 6.926c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.76 9.952l5.088 2.654c4.704-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161zm18.048.0c0 3.697 2.4 6.161 5.952 6.161.0 3.412-2.4 7.488-5.856 9.952l5.184 2.654c4.608-3.033 7.968-9.857 7.968-16.397.0-5.119-2.784-8.531-6.912-8.531-3.648.0-6.336 2.56-6.336 6.161z"/></svg></div><h5 class=quote-text>Have a story to share? Your logo could be here.</h5><div class=quote-card-link-container><a class=quote-card-link href="mailto:dev@beam.apache.org?subject=Beam"><span>Share your story</span> |
| <img src=/images/arrow-right.svg alt="Go to the case study"></a></div><div class=case-study-row-button-container><a href=https://github.com/apache/beam/blob/master/website/ADD_CASE_STUDY.md class=case-study-primary-button target=_blank rel="noopener noreferrer">Share your story</a></div><div class=quote-img-container><div class=quote-img><img src=images/logos/powered-by/blank.jpg alt="Quote Logo"></div></div></div></div></div></div><div id=swiper-pagination-id class=swiper-pagination></div></div><div class=swiper-button-next-custom><img src=/images/swiper-button-next.png alt="next button"></div></div></div></div><div class=calendar><h2 class=calendar-title>Stay Up To Date with Beam</h2><div class=calendar-content><div class="calendar-card-box post"><a class=post-card href=/blog/beam-2.56.0/ data-categories="blog release "><div class="post-info post-category"><p>blog & release |
| |
| </p><p>2024/05/01</p></div><div><p class=post-title>Apache Beam 2.56.0</p><p class=post-info>Danny McCormick</p></div></a><a class=post-card href=/blog/beam-yaml-release/ data-categories="blog "><div class="post-info post-category"><p>blog</p><p>2024/04/11</p></div><div><p class=post-title>Introducing Beam YAML: Apache Beam's First No-code SDK</p><p class=post-info>Jeff Kinard</p></div></a></div></div></div></div><div class=main-padding><footer class=footer><div class=footer__contained><div class=footer__cols><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col__logo><img src=/images/beam_logo_circle.svg class=footer__logo alt="Beam logo"></div><div class=footer__cols__col__logo><img src=/images/apache_logo_circle.svg class=footer__logo alt="Apache logo"></div></div><div class=footer-wrapper><div class=wrapper-grid><div class=footer__cols__col><div class=footer__cols__col__title>Start</div><div class=footer__cols__col__link><a href=/get-started/beam-overview/>Overview</a></div><div class=footer__cols__col__link><a href=/get-started/quickstart-java/>Quickstart (Java)</a></div><div class=footer__cols__col__link><a href=/get-started/quickstart-py/>Quickstart (Python)</a></div><div class=footer__cols__col__link><a href=/get-started/quickstart-go/>Quickstart (Go)</a></div><div class=footer__cols__col__link><a href=/get-started/downloads/>Downloads</a></div></div><div class=footer__cols__col><div class=footer__cols__col__title>Docs</div><div class=footer__cols__col__link><a href=/documentation/programming-guide/>Concepts</a></div><div class=footer__cols__col__link><a href=/documentation/pipelines/design-your-pipeline/>Pipelines</a></div><div class=footer__cols__col__link><a href=/documentation/runners/capability-matrix/>Runners</a></div></div><div class=footer__cols__col><div class=footer__cols__col__title>Community</div><div class=footer__cols__col__link><a href=/contribute/>Contribute</a></div><div class=footer__cols__col__link><a href=https://projects.apache.org/committee.html?beam target=_blank>Team<img src=/images/external-link-icon.png width=14 height=14 alt="External link."></a></div><div class=footer__cols__col__link><a href=/community/presentation-materials/>Media</a></div><div class=footer__cols__col__link><a href=/community/in-person/>Events/Meetups</a></div><div class=footer__cols__col__link><a href=/community/contact-us/>Contact Us</a></div></div><div class=footer__cols__col><div class=footer__cols__col__title>Resources</div><div class=footer__cols__col__link><a href=/blog/>Blog</a></div><div class=footer__cols__col__link><a href=https://github.com/apache/beam>GitHub</a></div></div></div><div class=footer__bottom>© |
| <a href=https://www.apache.org>The Apache Software Foundation</a> |
| | <a href=/privacy_policy>Privacy Policy</a> |
| | <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><img src=/images/logos/social-icons/github-logo-150.png class=footer__logo alt="Github logo"></a></div><div class=footer__cols__col__logo><a href=https://www.linkedin.com/company/apache-beam/><img src=/images/logos/social-icons/linkedin-logo-150.png class=footer__logo alt="Linkedin logo"></a></div></div><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://twitter.com/apachebeam><img src=/images/logos/social-icons/twitter-logo-150.png class=footer__logo alt="Twitter logo"></a></div><div class=footer__cols__col__logo><a href=https://www.youtube.com/channel/UChNnb_YO_7B0HlW6FhAXZZQ><img src=/images/logos/social-icons/youtube-logo-150.png class=footer__logo alt="Youtube logo"></a></div></div></div></div></div></footer></div><script src=/js/hero/lottie-light.min.min.832986b6fa677af1699abcf9a57bb10be04898296891c1c07aca2883bc9c83fd.js></script> |
| <script src=/js/hero/hero-desktop.min.23396859d264eae345b71d55fc4e5b66de9362d21cf1f572ff088aeb10e2e27b.js></script> |
| <script src=/js/hero/hero-mobile.min.432efd2e7d0c71441390a8768a5fd91e957e1cf73d596e4a34f3268b357f1bda.js></script> |
| <script src=/js/sliders/quotes.min.3df74d614338a81176c6903c6035cd8441ad2411c1b888ac575210fc50ca3f43.js></script></body></html> |
