| <?xml version="1.0" encoding="UTF-8"?> |
| <rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"> |
| <channel> |
| <title>Apache Storm</title> |
| <description></description> |
| <link>http://storm.apache.org/</link> |
| <atom:link href="https://storm.apache.org/feed.xml" rel="self" type="application/rss+xml"/> |
| <pubDate>Fri, 25 Mar 2022 10:25:27 -0500</pubDate> |
| <lastBuildDate>Fri, 25 Mar 2022 10:25:27 -0500</lastBuildDate> |
| <generator>Jekyll v3.6.2</generator> |
| |
| <item> |
| <title>Apache Storm 2.4.0 Released</title> |
| <description><p>The Apache Storm community is pleased to announce that version 2.4.0 has been released and is available from <a href="/downloads.html">the downloads page</a>.</p> |
| |
| <p>This release includes a number of code improvements and important bug fixes that improve Apache Storm&#39;s performance, stability and fault tolerance. We encourage users of previous versions to upgrade to this latest release.</p> |
| |
| <h2 id="thanks">Thanks</h2> |
| |
| <p>Special thanks are due to all those who have contributed to Apache Storm -- whether through direct code contributions, documentation, bug reports, or helping other users on the mailing lists. Your efforts are much appreciated.</p> |
| |
| <h2 id="changes-in-this-release">Changes in this Release</h2> |
| |
| <h2>Improvement</h2> |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3799">STORM-3799</a>] - Logging user information for blob delete req</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3801">STORM-3801</a>] - newWorkerEvent doesn't report properly for multiple reporters</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3802">STORM-3802</a>] - Allow adding metrics reporters to all topologies</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3803">STORM-3803</a>] - Format large integers in Storm UI with commas for readability</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3804">STORM-3804</a>] - Don't allow deleting blobs if they are required for an active topology</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3807">STORM-3807</a>] - Topology Stats columns show NaN</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3815">STORM-3815</a>] - allow option to disable sending of __send-iconnection metrics</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3824">STORM-3824</a>] - upgrade httpclient due to security issues</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3828">STORM-3828</a>] - upgrade org/glassfish/javax.el due to build problems</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3829">STORM-3829</a>] - Remove log4j version 1 (1.2.17) from storm-core</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3831">STORM-3831</a>] - exclude all old log4j</li> |
| </ul> |
| <h2>Dependency upgrade</h2> |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3811">STORM-3811</a>] - Upgrade log4j version to 2.17.1</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3817">STORM-3817</a>] - Upgrading to Zookeeper 3.5.x, 3.6.x or 3.7.x</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3821">STORM-3821</a>] - use commons-compress 1.21 due to security issues</li> |
| </ul> |
| </description> |
| <pubDate>Fri, 25 Mar 2022 00:00:00 -0500</pubDate> |
| <link>https://storm.apache.org/2022/03/25/storm240-released.html</link> |
| <guid isPermaLink="true">https://storm.apache.org/2022/03/25/storm240-released.html</guid> |
| </item> |
| |
| <item> |
| <title>Apache Storm 2.1.1 Released</title> |
| <description><p>The Apache Storm community is pleased to announce that version 2.1.1 has been released and is available from <a href="/downloads.html">the downloads page</a>.</p> |
| |
| <p>This is a maintenance release that includes a number of important bug fixes that improve Apache Storm&#39;s performance, stability and fault tolerance. We encourage users of previous versions to upgrade to this latest release.</p> |
| |
| <h2 id="thanks">Thanks</h2> |
| |
| <p>Special thanks are due to all those who have contributed to Apache Storm -- whether through direct code contributions, documentation, bug reports, or helping other users on the mailing lists. Your efforts are much appreciated.</p> |
| |
| <h2 id="changes-in-this-release">Changes in this Release</h2> |
| |
| <h2>Improvement</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3581">STORM-3581</a>] - Change log level to info to show the config classes being used for validation</li> |
| </ul> |
| |
| <h2>Bug</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2483">STORM-2483</a>] - wrong parameters order</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3511">STORM-3511</a>] - Nimbus logs got flood with TTransportException Error messages (because of thrift 0.12.0)</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3552">STORM-3552</a>] - Storm CLI set_log_level no longer updates the log level</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3567">STORM-3567</a>] - Topology UI page is showing total resources for each component if not scheduled</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3568">STORM-3568</a>] - Topology UI page "Change Log Level" should not allow empty logger name</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3577">STORM-3577</a>] - upload-credentials Breaks Topology in secure cluster</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3580">STORM-3580</a>] - Config overrides supplied using -c in storm.py not passed to all commands</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3598">STORM-3598</a>] - Storm UI visualization throws NullPointerException</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3602">STORM-3602</a>] - loadaware shuffle can overload local worker</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3606">STORM-3606</a>] - AutoTGT shouldn't invoke TGT renewal thread (from UserGroupInformation.loginUserFromSubject)</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3609">STORM-3609</a>] - ClassCastException when credentials are updated for ICredentialsListener spout/bolt instances</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3613">STORM-3613</a>] - storm.py should include lib-worker instead of lib directory in the classpath while submitting a topology</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3626">STORM-3626</a>] - storm-kafka-migration should pull in storm-client as "provided" dependency</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3629">STORM-3629</a>] - Logviewer should always allow admins to access logs</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3767">STORM-3767</a>] - NPE on getComponentPendingProfileActions </li> |
| </ul> |
| |
| <h2>Sub-task</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3578">STORM-3578</a>] - ClientAuthUtils.insertWorkerTokens removes exiting and new WorkerToken altogether if they are equal</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3579">STORM-3579</a>] - Fix Kerberos connection from Worker to Nimbus/Supervisor</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3607">STORM-3607</a>] - Document the exceptions topologies will see from TGT renewal thread</li> |
| </ul> |
| </description> |
| <pubDate>Thu, 14 Oct 2021 00:00:00 -0500</pubDate> |
| <link>http://storm.apache.org/2021/10/14/storm211-released.html</link> |
| <guid isPermaLink="true">http://storm.apache.org/2021/10/14/storm211-released.html</guid> |
| |
| |
| </item> |
| |
| <item> |
| <title>Apache Storm 2.2.1 Released</title> |
| <description><p>The Apache Storm community is pleased to announce that version 2.2.1 has been released and is available from <a href="/downloads.html">the downloads page</a>.</p> |
| |
| <p>This is a maintenance release that includes a number of important bug fixes that improve Apache Storm&#39;s performance, stability and fault tolerance. We encourage users of previous versions to upgrade to this latest release.</p> |
| |
| <h2 id="thanks">Thanks</h2> |
| |
| <p>Special thanks are due to all those who have contributed to Apache Storm -- whether through direct code contributions, documentation, bug reports, or helping other users on the mailing lists. Your efforts are much appreciated.</p> |
| |
| <h2 id="changes-in-this-release">Changes in this Release</h2> |
| |
| <h2>Bug</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3553">STORM-3553</a>] - Upgrade JQuery to 3.5.1</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3663">STORM-3663</a>] - Topology with Mockito 1.x fails to run unit tests </li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3704">STORM-3704</a>] - Cosmetic: columns shifted in "Topology summary" table</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3763">STORM-3763</a>] - Backpressure message ignored by the receiver caused the topology to not progress</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3767">STORM-3767</a>] - NPE on getComponentPendingProfileActions </li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3785">STORM-3785</a>] - Rate metrics are wrongly divided by 1000000</li> |
| </ul> |
| </description> |
| <pubDate>Mon, 11 Oct 2021 00:00:00 -0500</pubDate> |
| <link>http://storm.apache.org/2021/10/11/storm221-released.html</link> |
| <guid isPermaLink="true">http://storm.apache.org/2021/10/11/storm221-released.html</guid> |
| |
| |
| </item> |
| |
| <item> |
| <title>Apache Storm 1.2.4 Released</title> |
| <description><p>The Apache Storm community is pleased to announce that version 1.2.4 has been released and is available from <a href="/downloads.html">the downloads page</a>.</p> |
| |
| <p>This is a maintenance release that includes a number of important bug fixes that improve Apache Storm&#39;s performance, stability and fault tolerance. We encourage users of previous versions to upgrade to this latest release.</p> |
| |
| <h2 id="thanks">Thanks</h2> |
| |
| <p>Special thanks are due to all those who have contributed to Apache Storm -- whether through direct code contributions, documentation, bug reports, or helping other users on the mailing lists. Your efforts are much appreciated.</p> |
| |
| <h2 id="changes-in-this-release">Changes in this Release</h2> |
| |
| <h2>Bug</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2483">STORM-2483</a>] - wrong parameters order</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3348">STORM-3348</a>] - Incorrect message when group id is not provided as kafka spout config on storm ui</li> |
| </ul> |
| </description> |
| <pubDate>Mon, 11 Oct 2021 00:00:00 -0500</pubDate> |
| <link>http://storm.apache.org/2021/10/11/storm124-released.html</link> |
| <guid isPermaLink="true">http://storm.apache.org/2021/10/11/storm124-released.html</guid> |
| |
| |
| </item> |
| |
| <item> |
| <title>Apache Storm 2.3.0 Released</title> |
| <description><p>The Apache Storm community is pleased to announce that version 2.3.0 has been released and is available from <a href="/downloads.html">the downloads page</a>.</p> |
| |
| <p>This release includes a number of code improvements and important bug fixes that improve Apache Storm&#39;s performance, stability and fault tolerance. We encourage users of previous versions to upgrade to this latest release.</p> |
| |
| <h2 id="thanks">Thanks</h2> |
| |
| <p>Special thanks are due to all those who have contributed to Apache Storm -- whether through direct code contributions, documentation, bug reports, or helping other users on the mailing lists. Your efforts are much appreciated.</p> |
| |
| <h2 id="changes-in-this-release">Changes in this Release</h2> |
| |
| <h2>New Feature</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3271">STORM-3271</a>] - Launch storm workers in docker containers</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3388">STORM-3388</a>] - Launch workers inside container using runc runtime</li> |
| </ul> |
| |
| <h2>Improvement</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3638">STORM-3638</a>] - Add fast and more reliable process liveness check</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3641">STORM-3641</a>] - switch JCQueue metrics to new metrics API</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3642">STORM-3642</a>] - update AutoTGT metric to new API</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3644">STORM-3644</a>] - improve PacemakerClient error messaging</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3647">STORM-3647</a>] - Add OFF-HEAP macro for worker childopts similar to LIMIT-MEM</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3648">STORM-3648</a>] - Add meter to track worker heartbeat rate</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3650">STORM-3650</a>] - Ackers and metricComponents are not distributed evenly</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3653">STORM-3653</a>] - Document treatment of common nodes in favored/unfavored nodes in scheduling</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3654">STORM-3654</a>] - JCQueue shouldn't include executor string in the metric name</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3656">STORM-3656</a>] - Change handling of Hadoop TGT renewal exception</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3657">STORM-3657</a>] - storm.messaging.netty.authentication should be true if it is true in either the topology conf or cluster conf</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3659">STORM-3659</a>] - User page should show storm Version in the Owner topologies table</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3660">STORM-3660</a>] - Remove messaging queue for updating Executor credentials</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3661">STORM-3661</a>] - Netty server should handle incoming messages better</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3662">STORM-3662</a>] - Continue to support Pacemaker for 2.x topologies</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3667">STORM-3667</a>] - Exception message on submitting topology due to incorrect worker max heap size should be more straightforward </li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3670">STORM-3670</a>] - Separate configurations for daemon metric reporters and topology metrics reporters</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3671">STORM-3671</a>] - Add TopologySummary method to NImbus for optimal UI queries</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3673">STORM-3673</a>] - update BuiltinMetrics to use v2 Metrics API</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3675">STORM-3675</a>] - Eliminate ps command and use /proc/<pid> status in ServerUtils</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3676">STORM-3676</a>] - Reduce debug spew to scheduler log</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3682">STORM-3682</a>] - Upgrade netty client metrics to use V2 API</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3685">STORM-3685</a>] - Detect Loops in Topology at Submit</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3691">STORM-3691</a>] - Refactor Resource Aware Strategies (Base, Generic, Default)</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3692">STORM-3692</a>] - Handle UID return from Files.getOwner() at process liveness check</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3694">STORM-3694</a>] - all V2 metric reporters to report metric short names with dimensions</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3697">STORM-3697</a>] - Add metric for capacity</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3706">STORM-3706</a>] - Cluster.needsSchedulingRas always succeeds</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3707">STORM-3707</a>] - Add meter to track update blob failures</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3708">STORM-3708</a>] - ConstraintSolverConfig LOG messages should include topology id</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3709">STORM-3709</a>] - Reject topology submission if missing spout</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3714">STORM-3714</a>] - Add rate information for TaskMetrics</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3715">STORM-3715</a>] - Add Caching to HDFS BlobStore</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3719">STORM-3719</a>] - Add configuration for AsyncLocalizer updateBlobs frequency</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3721">STORM-3721</a>] - Change child pom.xml reference to parent pom.xml</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3724">STORM-3724</a>] - Use blobstore dir modtime to avoid update lookups by HDFSBlobstore</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3737">STORM-3737</a>] - Share Worker Metric Registry For Guice AOP Based Metrics Integeration</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3739">STORM-3739</a>] - Scheduling should sort numa zones by host groups</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3744">STORM-3744</a>] - IntelliJ does not find shaded classes</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3749">STORM-3749</a>] - improve logging on server error in StormServerHandler</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3755">STORM-3755</a>] - While scheduling multiple ackers with executor use best effort basis</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3758">STORM-3758</a>] - Zookeeper reconnect events sometime cause workers to restart</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3774">STORM-3774</a>] - Migrate Cgroup metrics to V2 </li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3778">STORM-3778</a>] - convert SpoutThrottlingMetrics to V2 API</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3780">STORM-3780</a>] - switch ErrorReportingMetrics to V2 API</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3786">STORM-3786</a>] - V2 metrics tick may overreport or not report at all</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3790">STORM-3790</a>] - Add meter to track failures WorkerTokenAuthorizer getPassword</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3791">STORM-3791</a>] - update metric documentation</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3793">STORM-3793</a>] - Add metric to track backpressure status for a task</li> |
| </ul> |
| |
| <h2>Bug</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3553">STORM-3553</a>] - Upgrade JQuery to 3.5.1</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3624">STORM-3624</a>] - Race condition on ArtifactoryConfigLoader.load</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3649">STORM-3649</a>] - Logic error regarding storm.supervisor.medium.memory.grace.period.ms</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3652">STORM-3652</a>] - Last error not displayed in Topology summary storm ui</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3655">STORM-3655</a>] - Worker should commit suicide On Change in its assignment.</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3658">STORM-3658</a>] - Problematic worker stays alive because of a deadlock and race condition caused by ShutdownHooks</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3663">STORM-3663</a>] - Topology with Mockito 1.x fails to run unit tests </li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3666">STORM-3666</a>] - Validate component name in rebalance command and fix --executor option</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3677">STORM-3677</a>] - Fix Worker Suicide Function if assignment is null</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3679">STORM-3679</a>] - misuse of nodeId as hostname in LoadAwareShuffleGrouping</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3684">STORM-3684</a>] - receive-queue V2 metrics shouldn't have "_system" as componentId if it is from a system task</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3690">STORM-3690</a>] - UI has NullPointerException when the scheduler is not ResourceAwareScheduler</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3695">STORM-3695</a>] - Add Timer rates to datapoints for V2 metrics tick</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3696">STORM-3696</a>] - ClientSupervisorUtils.processLauncherAndWait ignores InterruptedException</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3699">STORM-3699</a>] - fix flight.bash to support flight recording on openJDK8u262 or newer</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3701">STORM-3701</a>] - Race Condition between cleanup thread and download tasks</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3704">STORM-3704</a>] - Cosmetic: columns shifted in "Topology summary" table</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3712">STORM-3712</a>] - Check-Updated-License-Files CI job has been broken</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3720">STORM-3720</a>] - BlobStoreFile getModTime() never updates after first call</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3723">STORM-3723</a>] - ServerUtils.isAnyPosixProcessPidDirAlive might return wrong result</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3725">STORM-3725</a>] - DRPC spout will crash when any one of DRPC server is down</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3727">STORM-3727</a>] - SUPERVISOR_SLOTS_PORTS could be list of Longs</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3728">STORM-3728</a>] - Workers are not able to connect to Pacemaker if pacemaker.auth.method is KERBEROS</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3729">STORM-3729</a>] - Assigning memory greater and equal than 2048m will make assgin memory for slot values to 1m</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3731">STORM-3731</a>] - Remove unused nashorn import in storm-loadgen:OutputStream.java</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3733">STORM-3733</a>] - AsyncLocalizer stuck looking for missing topology</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3735">STORM-3735</a>] - Kyro serialization fails on some metric tuples when topology.fall.back.on.java.serialization is false</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3740">STORM-3740</a>] - Asynchronous background blob download can cause orphaned blob references</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3741">STORM-3741</a>] - Maven Surefire plugin corrupts output and creates an excessive log file</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3748">STORM-3748</a>] - prevent concurrent modification when fetching v2 metrics</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3763">STORM-3763</a>] - Backpressure message ignored by the receiver caused the topology to not progress</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3765">STORM-3765</a>] - NPE in DRPCSimpleACLAuthorizer.readAclFromConfig when drpc.authorizer.acl has no values</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3767">STORM-3767</a>] - NPE on getComponentPendingProfileActions </li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3769">STORM-3769</a>] - Failed adding references to blobs: FileNotFoundException</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3775">STORM-3775</a>] - topology.blobstore.map can cause supervisor restarts</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3785">STORM-3785</a>] - Rate metrics are wrongly divided by 1000000</li> |
| </ul> |
| |
| <h2>Comment</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3687">STORM-3687</a>] - Add a warning about possible issues on a mixed cluster if the StormCommon.systemTopology implementation is changed</li> |
| </ul> |
| |
| <h2>Dependency upgrade</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3718">STORM-3718</a>] - Updating the dropwizard dependency</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3757">STORM-3757</a>] - Update jackson version to 2.10.0</li> |
| </ul> |
| |
| <h2>Documentation</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3635">STORM-3635</a>] - Add LocalityAwareness documentation</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3722">STORM-3722</a>] - Update committer list</li> |
| </ul> |
| |
| <h2>Test</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3743">STORM-3743</a>] - Add new topologies for TestLargeCluster</li> |
| </ul> |
| |
| <h2>Sub-task</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3674">STORM-3674</a>] - explicitly specify pip2 and pip3 in travis-install.sh</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3681">STORM-3681</a>] - Enable basic Travis ARM CI job</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3711">STORM-3711</a>] - Enable all the modules in ARM CI</li> |
| </ul> |
| </description> |
| <pubDate>Mon, 27 Sep 2021 00:00:00 -0500</pubDate> |
| <link>http://storm.apache.org/2021/09/27/storm230-released.html</link> |
| <guid isPermaLink="true">http://storm.apache.org/2021/09/27/storm230-released.html</guid> |
| |
| |
| </item> |
| |
| <item> |
| <title>Apache Storm 2.2.0 Released</title> |
| <description><p>The Apache Storm community is pleased to announce that version 2.2.0 has been released and is available from <a href="/downloads.html">the downloads page</a>.</p> |
| |
| <p>This release includes a number of code improvements and important bug fixes that improve Apache Storm&#39;s performance, stability and fault tolerance. We encourage users of previous versions to upgrade to this latest release.</p> |
| |
| <h2 id="thanks">Thanks</h2> |
| |
| <p>Special thanks are due to all those who have contributed to Apache Storm -- whether through direct code contributions, documentation, bug reports, or helping other users on the mailing lists. Your efforts are much appreciated.</p> |
| |
| <h2 id="changes-in-this-release">Changes in this Release</h2> |
| |
| <h2>New Feature</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-1293">STORM-1293</a>] - port backtype.storm.messaging.netty-integration-test to java</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-1304">STORM-1304</a>] - port backtype.storm.submitter-test to java</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3259">STORM-3259</a>] - NUMA support for Storm</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3479">STORM-3479</a>] - HB timeout configurable on a topology level</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3480">STORM-3480</a>] - Implement One Executor Per Worker RAS Option</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3482">STORM-3482</a>] - Implement One Worker Per Component Option</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3492">STORM-3492</a>] - Adding configuration for blacklisting scheduler behavior</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3585">STORM-3585</a>] - Change ConstraintSolverStrategy to allow max co-Location Count for spreading components</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3627">STORM-3627</a>] - Allow use of shortNames for Metrics for worker in Metrics-V2</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3636">STORM-3636</a>] - Enable SSL credentials auto reload for storm UI, LogViewer and DRPC server</li> |
| </ul> |
| |
| <h2>Improvement</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2749">STORM-2749</a>] - Remove state spout since it's never supported by storm</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3066">STORM-3066</a>] - Storm Flux variable substitution</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3071">STORM-3071</a>] - change checkstyle plugin setting logViolationsToConsole to true</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3257">STORM-3257</a>] - 'storm kill' command line should be able to continue on error</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3434">STORM-3434</a>] - server: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3484">STORM-3484</a>] - Add Blacklisted Supervisors Info To UI</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3490">STORM-3490</a>] - Add checkstyle rule RedundantModifier</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3493">STORM-3493</a>] - Allow overriding python interpreter by environment variable</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3494">STORM-3494</a>] - Use UserGroupInformation to login to HDFS only once per process</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3507">STORM-3507</a>] - Need feedback from blacklisting to scheduling</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3509">STORM-3509</a>] - Improved RAS scheduling</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3529">STORM-3529</a>] - Catch and log RetriableException in KafkaOffsetMetric</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3530">STORM-3530</a>] - Improve Scheduling Failure Message</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3534">STORM-3534</a>] - Add generic resources to UI</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3536">STORM-3536</a>] - Add Generic-resources.md</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3538">STORM-3538</a>] - Add Meter for sendSupervisorAssignments exception</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3539">STORM-3539</a>] - Add metric for worker start time out</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3541">STORM-3541</a>] - allow reporting of v2 metrics api using metrics tick</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3543">STORM-3543</a>] - Avoid iterators for task hook info objects</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3545">STORM-3545</a>] - blob update spews errors until cleanup occurs after topology killed</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3548">STORM-3548</a>] - Remove iterator from Task.sendUnanchored</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3555">STORM-3555</a>] - Add meter for tracking errors killing workers</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3557">STORM-3557</a>] - allow health checks to pass on timeout</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3570">STORM-3570</a>] - add config name when validation fails with ClassNotFoundException</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3571">STORM-3571</a>] - Add topology info to slot warning messages</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3575">STORM-3575</a>] - Fix Scheduler Status on failure after multiple attempts</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3581">STORM-3581</a>] - Change log level to info to show the config classes being used for validation</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3584">STORM-3584</a>] - Support getting version info from a wildcard classpath entry</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3587">STORM-3587</a>] - Allow Scheduler futureTask to gracefully exit and register message on timeout</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3588">STORM-3588</a>] - RAS scheduler should not pre-empt and evict topologies due to generic resource</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3589">STORM-3589</a>] - Iterator in BaseResourceStrategy is potentially buggy</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3591">STORM-3591</a>] - Improve GRAS Strategy Log</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3594">STORM-3594</a>] - Add checkstyle rule WhitespaceAfter</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3596">STORM-3596</a>] - Feed send assignment status into blacklist scheduler</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3600">STORM-3600</a>] - ResourceAwareScheduler taking too long to schedule</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3604">STORM-3604</a>] - HealthChecker should print out error message when it fails</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3605">STORM-3605</a>] - add meter to track scheduling timeouts</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3614">STORM-3614</a>] - update SystemBolt metrics to use v2 API</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3616">STORM-3616</a>] - If running upload credentials and no autocreds are found, we should have an option to fail</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3618">STORM-3618</a>] - add meter for tracking internal scheduling errors</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3619">STORM-3619</a>] - Add null check for the topology name</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3625">STORM-3625</a>] - Storm CLI should validate topology name on client side</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3632">STORM-3632</a>] - Reduce SimpleSaslServerCallbackHandler supervisor logging</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3633">STORM-3633</a>] - Add message that supervisor is killing detached workers</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3634">STORM-3634</a>] - validate numa ports are contained in supervisor.slots.ports</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3640">STORM-3640</a>] - timed out health check processes should be killed</li> |
| </ul> |
| |
| <h2>Bug</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2483">STORM-2483</a>] - wrong parameters order</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3498">STORM-3498</a>] - Fix missing cases of invoking bash directly without /bin/env</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3504">STORM-3504</a>] - AsyncLocalizerTest is stubbing file system operations</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3510">STORM-3510</a>] - WorkerState.transferLocalBatch backpressure resend logic fix</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3511">STORM-3511</a>] - Nimbus logs got flood with TTransportException Error messages (because of thrift 0.12.0)</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3512">STORM-3512</a>] - Nimbus failing on startup with `GLIBC_2.12' not found</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3519">STORM-3519</a>] - Change ConstraintSolverStrategy::backtrackSearch to avoid StackOverflowException</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3523">STORM-3523</a>] - supervisor restarts when releasing slot with missing file</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3527">STORM-3527</a>] - Container.getWorkerUser() should check if the user name is empty</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3540">STORM-3540</a>] - Pacemaker race condition can cause continual reconnection</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3549">STORM-3549</a>] - use of topology specific jaas conf doesn't work with kafka</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3551">STORM-3551</a>] - Fix LocalAssignment Equivalency in Slot for Generice Resource Aware Scheduler</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3552">STORM-3552</a>] - Storm CLI set_log_level no longer updates the log level</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3567">STORM-3567</a>] - Topology UI page is showing total resources for each component if not scheduled</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3568">STORM-3568</a>] - Topology UI page "Change Log Level" should not allow empty logger name</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3572">STORM-3572</a>] - Topology visualization can fail if executor is not up</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3577">STORM-3577</a>] - upload-credentials Breaks Topology in secure cluster</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3580">STORM-3580</a>] - Config overrides supplied using -c in storm.py not passed to all commands</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3583">STORM-3583</a>] - Handle exceptions when AsyncLocalizer tries to get local resources</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3598">STORM-3598</a>] - Storm UI visualization throws NullPointerException</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3602">STORM-3602</a>] - loadaware shuffle can overload local worker</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3606">STORM-3606</a>] - AutoTGT shouldn't invoke TGT renewal thread (from UserGroupInformation.loginUserFromSubject)</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3609">STORM-3609</a>] - ClassCastException when credentials are updated for ICredentialsListener spout/bolt instances</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3613">STORM-3613</a>] - storm.py should include lib-worker instead of lib directory in the classpath while submitting a topology</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3620">STORM-3620</a>] - Data corruption can happen when components are multi-threaded because of non thread-safe serializer</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3622">STORM-3622</a>] - Race Condition in CachedThreadStatesGaugeSet registered at SystemBolt</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3623">STORM-3623</a>] - v2 metrics tick reports all worker metrics within each executor</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3626">STORM-3626</a>] - storm-kafka-migration should pull in storm-client as "provided" dependency</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3629">STORM-3629</a>] - Logviewer should always allow admins to access logs</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3631">STORM-3631</a>] - Wrong format of logs.users/groups in topology conf can cause supervisor/logviewer to terminate</li> |
| </ul> |
| |
| <h2>Comment</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3231">STORM-3231</a>] - TopologyBySubmissionTimeComparator does not consider priority</li> |
| </ul> |
| |
| <h2>Dependency upgrade</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3608">STORM-3608</a>] - Upgrade snakeyaml from 1.11 to 1.26 (latest)</li> |
| </ul> |
| |
| <h2>Documentation</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3508">STORM-3508</a>] - The links to download in setting up environmtn page are broken</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3615">STORM-3615</a>] - Add documentation for Storm NUMA support</li> |
| </ul> |
| |
| <h2>Task</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3211">STORM-3211</a>] - WindowedBoltExecutor NPE if wrapped bolt returns null from getComponentConfiguration</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3306">STORM-3306</a>] - Some tests in storm-core/test/jvm/org/apache/storm/integration/TopologyIntegrationTest.java are using Thrift to build topologies. They should use TopologyBuilder instead. </li> |
| </ul> |
| |
| <h2>Test</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3475">STORM-3475</a>] - Add ConstraintSolverStrategy Unit Test</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3495">STORM-3495</a>] - TestConstraintSolverStrategy is not stable on travis</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3503">STORM-3503</a>] - Create unit tests for blacklistOnBadSlot option</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3525">STORM-3525</a>] - Large Contraint Solver test fails on some VM</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3651">STORM-3651</a>] - Give producerTasks in ExecutorTransferMultiThreadingTest.testExecutorTransfer more time to finish</li> |
| </ul> |
| |
| <h2>Sub-task</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2687">STORM-2687</a>] - Group Topology executors by network proximity needs and schedule them on "network wise" close slots</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3486">STORM-3486</a>] - Upgrade to Jersey 2.29</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3578">STORM-3578</a>] - ClientAuthUtils.insertWorkerTokens removes exiting and new WorkerToken altogether if they are equal</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3579">STORM-3579</a>] - Fix Kerberos connection from Worker to Nimbus/Supervisor</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3599">STORM-3599</a>] - Bump the rocksdbjni to 5.18.4</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3607">STORM-3607</a>] - Document the exceptions topologies will see from TGT renewal thread</li> |
| </ul> |
| </description> |
| <pubDate>Tue, 30 Jun 2020 00:00:00 -0500</pubDate> |
| <link>http://storm.apache.org/2020/06/30/storm220-released.html</link> |
| <guid isPermaLink="true">http://storm.apache.org/2020/06/30/storm220-released.html</guid> |
| |
| |
| </item> |
| |
| <item> |
| <title>Apache Storm 2.1.0 Released</title> |
| <description><p>The Apache Storm community is pleased to announce that version 2.1.0 has been released and is available from <a href="/downloads.html">the downloads page</a>.</p> |
| |
| <p>This release includes a number of code improvements and important bug fixes that improve Apache Storm&#39;s performance, stability and fault tolerance. We encourage users of previous versions to upgrade to this latest release.</p> |
| |
| <h2 id="thanks">Thanks</h2> |
| |
| <p>Special thanks are due to all those who have contributed to Apache Storm -- whether through direct code contributions, documentation, bug reports, or helping other users on the mailing lists. Your efforts are much appreciated.</p> |
| |
| <h2 id="changes-in-this-release">Changes in this Release</h2> |
| |
| <h2>Improvement</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2720">STORM-2720</a>] - Add timestamp based FirstPollOffsetStrategy in KafkaTridentSpoutOpaque</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3370">STORM-3370</a>] - Make StormMetricRegistry non-static</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3392">STORM-3392</a>] - Topology page should show components even if workers haven't started</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3394">STORM-3394</a>] - Fix placeholder system bolt filtering for Topology page</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3395">STORM-3395</a>] - Modifiy Topology page placeholder components to show task counts</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3396">STORM-3396</a>] - uploading dependency jars too slow when StormSubmitter and Nimbus located in different IDC</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3402">STORM-3402</a>] - Scan code quality at build time</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3409">STORM-3409</a>] - Wipe Storm artifacts from local Maven repo before building, and fix build order for storm-shaded-deps</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3411">STORM-3411</a>] - Worker Log Download Only Create Generic Name Worker.log</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3412">STORM-3412</a>] - Jira and Central Log Links Disappear In Topo Page</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3413">STORM-3413</a>] - Deduplicate Storm site layout documents from main Storm repository</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3414">STORM-3414</a>] - Remove JavadocMethod checkstyle rule</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3415">STORM-3415</a>] - storm-jms-examples: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3416">STORM-3416</a>] - storm-jdbc-examples: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3417">STORM-3417</a>] - storm-sql-core: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3418">STORM-3418</a>] - storm-hdfs-blobstore: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3419">STORM-3419</a>] - storm-opentsdb: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3420">STORM-3420</a>] - storm-mqtt: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3421">STORM-3421</a>] - storm-kinesis: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3423">STORM-3423</a>] - Logviewer Log Is Ambiguous</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3424">STORM-3424</a>] - storm-submit-tools: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3427">STORM-3427</a>] - integration-test: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3428">STORM-3428</a>] - kafka-monitor: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3429">STORM-3429</a>] - closure: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3430">STORM-3430</a>] - flux-wrappers: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3431">STORM-3431</a>] - rocketmq-examples: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3432">STORM-3432</a>] - solr-examples: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3433">STORM-3433</a>] - pmml: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3435">STORM-3435</a>] - Use the Jetty BOM</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3437">STORM-3437</a>] - More license check automation</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3438">STORM-3438</a>] - webapp: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3440">STORM-3440</a>] - client: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3441">STORM-3441</a>] - hbase: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3442">STORM-3442</a>] - Add owner to supervisor summary</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3443">STORM-3443</a>] - hive: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3444">STORM-3444</a>] - redis: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3445">STORM-3445</a>] - metrics: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3446">STORM-3446</a>] - storm-maven-plugins: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3447">STORM-3447</a>] - jms: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3448">STORM-3448</a>] - core: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3449">STORM-3449</a>] - autocreds: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3450">STORM-3450</a>] - perf: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3451">STORM-3451</a>] - jdbc: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3452">STORM-3452</a>] - blobstore-migration: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3453">STORM-3453</a>] - eventhubs: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3454">STORM-3454</a>] - hbase-examples: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3455">STORM-3455</a>] - solr: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3456">STORM-3456</a>] - cassandra: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3457">STORM-3457</a>] - hdfs: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3458">STORM-3458</a>] - starter: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3460">STORM-3460</a>] - examples-opentsdb: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3461">STORM-3461</a>] - examples-hdfs: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3462">STORM-3462</a>] - examples-hive: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3463">STORM-3463</a>] - examples-pmml: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3464">STORM-3464</a>] - examples-mongodb: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3465">STORM-3465</a>] - examples-redis: fix all checkstyle warnings</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3472">STORM-3472</a>] - STORM-3411 should have tests, and we shouldn't catch NPE for control flow</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3477">STORM-3477</a>] - HDFS blobstore isRemoteBlobExists performs unnecessary file opens</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3506">STORM-3506</a>] - prevent topology from overriding STORM_CGROUP_HIERARCHY_DIR and WORKER_METRICS</li> |
| </ul> |
| |
| <h2>Bug</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-1515">STORM-1515</a>] - LocalState corruption after hard reboot on Windows</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3371">STORM-3371</a>] - Metrics v2 is inaccessible in Trident StateFactory. </li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3372">STORM-3372</a>] - HDFS bolt can throw NPE on shutdown if not using a TimedRotationPolicy</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3376">STORM-3376</a>] - Storm drops messages in the interval between server bind and callback registration</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3379">STORM-3379</a>] - Intermittent NPE during worker boot in local mode</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3385">STORM-3385</a>] - ClientSupervisorUtils.processLauncherAndWait might have two threads reading the process' inputStream concurrently</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3390">STORM-3390</a>] - Lock python test dependencies so we don't get accidentally upgraded</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3408">STORM-3408</a>] - Rocks version shipped with Storm2 doesn't work on Windows 10</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3422">STORM-3422</a>] - TupleCaptureBolt is not thread-safe</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3436">STORM-3436</a>] - TupleInfo.id is not set, making debugging more difficult than it should be</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3466">STORM-3466</a>] - storm-kafka-monitor not found jar</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3470">STORM-3470</a>] - Possible Null Dereference in SimpleSaslServer authentication function</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3481">STORM-3481</a>] - IllegalArgumentException in ConstraintSolverStrategy</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3485">STORM-3485</a>] - VersionInfoMojo fails to run when the sources are built outside the Git repo</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3488">STORM-3488</a>] - Scheduling can cause RAS_Node resources to become negative</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3491">STORM-3491</a>] - BoltReaderRunnable shouldn't throw IllegalArgumentException for sync command</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3500">STORM-3500</a>] - Spelling issue in storm.blobstore.dependency.jar.upload.chuck.size.bytes</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3501">STORM-3501</a>] - Local Cluster worker restarts</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3515">STORM-3515</a>] - Storm CLI config options are passed directly to underlying JAVA cli</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3516">STORM-3516</a>] - Delayed Kill or Rebalance Topology not processed on Nimbus restart</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3520">STORM-3520</a>] - Storm CLI drpc-client incorrectly validating function args</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3521">STORM-3521</a>] - Storm CLI jar command doesn't handle topology arguments correctly</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3524">STORM-3524</a>] - worker fails to launch due to missing parent directory for localized resource</li> |
| </ul> |
| |
| <h2>Dependency upgrade</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3373">STORM-3373</a>] - Use Log4j BOM, ensure SLF4J dependencies use the same version, upgrade SLF4J to latest</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3478">STORM-3478</a>] - Upgrade to JUnit 5.5.1</li> |
| </ul> |
| |
| <h2>Task</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3000">STORM-3000</a>] - Add missing @Override annotations</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3386">STORM-3386</a>] - Set minimum Maven version for build to 3.5.0</li> |
| </ul> |
| </description> |
| <pubDate>Thu, 31 Oct 2019 00:00:00 -0500</pubDate> |
| <link>http://storm.apache.org/2019/10/31/storm210-released.html</link> |
| <guid isPermaLink="true">http://storm.apache.org/2019/10/31/storm210-released.html</guid> |
| |
| |
| </item> |
| |
| <item> |
| <title>Apache Storm 1.2.3 Released</title> |
| <description><p>The Apache Storm community is pleased to announce that version 1.2.3 has been released and is available from <a href="/downloads.html">the downloads page</a>.</p> |
| |
| <p>This is a maintenance release that includes a number of important bug fixes that improve Apache Storm&#39;s performance, stability and fault tolerance. We encourage users of previous versions to upgrade to this latest release.</p> |
| |
| <h2 id="thanks">Thanks</h2> |
| |
| <p>Special thanks are due to all those who have contributed to Apache Storm -- whether through direct code contributions, documentation, bug reports, or helping other users on the mailing lists. Your efforts are much appreciated.</p> |
| |
| <h2 id="changes-in-this-release">Changes in this Release</h2> |
| |
| <h2>New Feature</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3233">STORM-3233</a>] - Upgrade zookeeper client to newest version (3.4.13)</li> |
| </ul> |
| |
| <h2>Improvement</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3077">STORM-3077</a>] - Upgrade Disruptor version to 3.3.11</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3083">STORM-3083</a>] - Upgrade HikariCP version to 2.4.7</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3094">STORM-3094</a>] - Topology name needs to be validated at storm-client</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3222">STORM-3222</a>] - Fix KafkaSpout internals to use LinkedList instead of ArrayList</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3292">STORM-3292</a>] - Trident HiveState must flush writers when the batch commits</li> |
| </ul> |
| |
| <h2>Bug</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3013">STORM-3013</a>] - Deactivated topology restarts if data flows into Kafka</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3028">STORM-3028</a>] - HdfsSpout does not handle empty files in case of ack enabled</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3046">STORM-3046</a>] - Getting a NPE leading worker to die when starting a topology.</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3047">STORM-3047</a>] - Ensure Trident emitter refreshPartitions is only called with partitions assigned to the emitter</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3055">STORM-3055</a>] - never refresh connection</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3068">STORM-3068</a>] - STORM_JAR_JVM_OPTS are not passed to storm-kafka-monitor properly</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3082">STORM-3082</a>] - NamedTopicFilter can't handle topics that don't exist yet</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3087">STORM-3087</a>] - FluxBuilder.canInvokeWithArgs is too permissive when the method parameter type is a primitive</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3090">STORM-3090</a>] - The same offset value is used by the same partition number of different topics.</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3097">STORM-3097</a>] - Remove storm-druid in 2.x and deprecate support for it in 1.x</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3102">STORM-3102</a>] - Storm Kafka Client performance issues with Kafka Client v1.0.0</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3109">STORM-3109</a>] - Wrong canonical path set to STORM_LOCAL_DIR in storm kill_workers</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3110">STORM-3110</a>] - Supervisor does not kill all worker processes in secure mode in case of user mismatch</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3121">STORM-3121</a>] - Fix flaky metrics tests in storm-core</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3122">STORM-3122</a>] - FNFE due to race condition between "async localizer" and "update blob" timer thread</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3123">STORM-3123</a>] - Storm Kafka Monitor does not work with Kafka over two-way SSL</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3161">STORM-3161</a>] - Local mode should force setting min replication count to 1</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3164">STORM-3164</a>] - Multilang storm.py uses traceback.format_exc incorrectly</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3184">STORM-3184</a>] - Storm supervisor log showing keystore and truststore password in plaintext</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3201">STORM-3201</a>] - kafka spout lag on UI needs some cleanup</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3301">STORM-3301</a>] - The KafkaSpout can in some cases still replay tuples that were already committed</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3381">STORM-3381</a>] - Upgrading to Zookeeper 3.4.14 added an LGPL dependency</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3384">STORM-3384</a>] - storm set-log-level command throws wrong exception when the topology is not running</li> |
| </ul> |
| |
| <h2>Task</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3086">STORM-3086</a>] - Update Flux documentation to demonstrate static factory methods (STORM-2796)</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3089">STORM-3089</a>] - Document worker hooks on the hooks page</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3199">STORM-3199</a>] - Metrics-ganglia depends on an LGPL library, so we shouldn't depend on it</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3289">STORM-3289</a>] - Add note about KAFKA-7044 to storm-kafka-client compatibility docs</li> |
| </ul> |
| |
| <h2>Sub-task</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3330">STORM-3330</a>] - Migrate parts of storm-webapp, and reduce use of mocks for files</li> |
| </ul> |
| </description> |
| <pubDate>Thu, 18 Jul 2019 00:00:00 -0500</pubDate> |
| <link>http://storm.apache.org/2019/07/18/storm123-released.html</link> |
| <guid isPermaLink="true">http://storm.apache.org/2019/07/18/storm123-released.html</guid> |
| |
| |
| </item> |
| |
| <item> |
| <title>Apache Storm 2.0.0 Released</title> |
| <description><p>The Apache Storm community is pleased to announce that version 2.0.0 has been released and is available from <a href="/downloads.html">the downloads page</a>. This release represents a major milestone and accomplishment by the Apache Storm community.</p> |
| |
| <p>Apache Storm 2.0.0 includes significant improvements in terms of performance, new features, and integration with external systems. In the coming weeks members will post a series of deep dive articles covering new features improvements. In this post we&#39;ll highlight some of the key features and changes in this release.</p> |
| |
| <p>The full list of changes in this release can be found <a href="https://www.apache.org/dist/storm/apache-storm-2.0.0/RELEASE_NOTES.html">here</a>.</p> |
| |
| <h2 id="new-architecture-implemented-in-java">New Architecture Implemented in Java</h2> |
| |
| <p>In previous releases a large part of Apache Storm&#39;s core functionality was implemented in Clojure. Apache Storm 2.0.0 has been rearchitected with it&#39;s core functionality implemented in pure Java. The new Java-based implementation has improved performance significantly, and made Apache Storm&#39;s internal APIs more maintainable and extensible. While Apache Storm&#39;s Clojure implementation served it well for many years, it was often cited as a barrier for entry to new contributors. Apache Storm&#39;s codebase is now more accessible to developers who don&#39;t want to learn Clojure in order to contribute.</p> |
| |
| <h2 id="new-high-performance-core">New High Performance Core:</h2> |
| |
| <p>Apache Storm 2.0.0 introduces a new core featuring a leaner threading model, a blazing fast messaging subsystem and a lightweight back pressure model. It is designed to push boundaries on throughput, latency and energy consumption while maintaining backward compatibility. The design was motivated by the observation that existing hardware remains capable of much more than what the best streaming engines can deliver. Apache Storm 2.0 is the first streaming engine to break the 1 microsecond latency barrier.</p> |
| |
| <h2 id="new-streams-api">New Streams API</h2> |
| |
| <p>Apache Storm 2.0.0 introduces a new typed API for expressing streaming computations more easily using functional style operations. It builds on top of the Apache Storm&#39;s core spouts and bolt APIs and automatically fuses multiple operations together to optimize the pipeline.</p> |
| |
| <p>For more details and examples see the <a href="https://github.com/apache/storm/blob/master/docs/Stream-API.md">Stream API documentation</a>.</p> |
| |
| <h2 id="windowing-enhancements">Windowing Enhancements</h2> |
| |
| <p>Apache Storm 2.0.0&#39;s Windowing API can save/restore the window state to the configured state backend so that larger continuous windows can be supported. The window boundaries can now be accessed via the APIs.</p> |
| |
| <p>For more details see <a href="https://github.com/apache/storm/blob/master/docs/Windowing.md#stateful-windowing">stateful windowing documentation</a>.</p> |
| |
| <h2 id="kafka-integration-changes">Kafka Integration Changes</h2> |
| |
| <h3 id="removal-of-storm-kafka">Removal of Storm-Kafka</h3> |
| |
| <p>The most significant change to Apache Storm&#39;s Kafka integration since 1.x, is that storm-kafka has been removed. The module was deprecated a while back, due to Kafka&#39;s deprecation of the underlying client library. Users will have to move to the storm-kafka-client module, which uses Kafka&#39;s ´kafka-clients´ library for integration.</p> |
| |
| <p>For the most part, the migration to storm-kafka-client is straightforward. The documentation for storm-kafka-client contains a helpful mapping between the old and new spout configurations. If you are using any of the storm-kafka spouts, you will need to migrate offset checkpoints to the new spout, to avoid the new spout starting from scratch on your partitions. Apache Storm provides a helper tool to do this which can be found <a href="https://github.com/apache/storm/tree/master/external/storm-kafka-migration">here</a>.</p> |
| |
| <p>When performing a migration, you should stop your topology, run the migration tool, then redeploy your topology with the storm-kafka-client spout.</p> |
| |
| <h3 id="move-to-using-the-kafkaconsumer-assign-api">Move to Using the KafkaConsumer.assign API</h3> |
| |
| <p>Storm-kafka-client in Apache Storm 1.x allowed you to use Kafka&#39;s own mechanism to manage which spout tasks were responsible for which partitions. This mechanism was a poor fit for Apache Storm, and was deprecated in 1.2.0. It has been <a href="https://issues.apache.org/jira/browse/STORM-2542">removed entirely in 2.0</a>.</p> |
| |
| <p>The storm-kafka-client Subscription interface has also been removed. It offered too limited control over the subscription behavior. It has been replaced with the TopicFilter and ManualPartitioner interfaces. Unless you were using a custom Subscription implementation, this will likely not |
| affect you. If you were using a custom Subscription, <a href="https://github.com/apache/storm/blob/master/docs/storm-kafka-client.md#manual-partition-assigment-advanced">the storm-kafka-client documentation describes how to customize assignment</a>.</p> |
| |
| <h3 id="other-kafka-highlights">Other Kafka Highlights</h3> |
| |
| <ul> |
| <li>The KafkaBolt now allows you to <a href="https://issues.apache.org/jira/browse/STORM-3175">specify a callback that will be called when a batch is written to Kafka</a>.</li> |
| <li>The FirstPollOffsetStrategy behavior has been made consistent between the non-Trident and Trident spouts. It is now always the case that EARLIEST/LATEST only take effect on topology redeploy, and not when a worker restarts <a href="https://issues.apache.org/jira/browse/STORM-2990">https://issues.apache.org/jira/browse/STORM-2990</a>.</li> |
| <li>Storm-kafka-client now has a transactional non-opaque Trident spout <a href="https://issues.apache.org/jira/browse/STORM-2974">https://issues.apache.org/jira/browse/STORM-2974</a>.</li> |
| <li>There are new example modules for storm-kafka-client. You can find them <a href="https://github.com/apache/storm/tree/master/examples/storm-kafka-client-examples">here</a>.</li> |
| <li>Deprecated methods in KafkaSpoutConfig have been removed. If you are using one of the deprecated methods, check the Javadoc for the latest 1.2.x release, which describes the replacement for each method.</li> |
| </ul> |
| |
| <h2 id="eol-for-1-0-x">EOL for 1.0.x</h2> |
| |
| <p>With the release of 2.0.0 the 1.0.x version line will no longer be maintained. 1.0.x users are strongly encouraged to upgrade to a more recent release.</p> |
| |
| <h2 id="move-to-java-8">Move to Java 8</h2> |
| |
| <p>Java 7 support has been dropped, and Apache Storm 2.0.0 requires Java 8.</p> |
| |
| <h2 id="reorganization-of-apache-storm-maven-artifacts">Reorganization of Apache Storm Maven artifacts</h2> |
| |
| <p>The storm-core artifact has <a href="https://issues.apache.org/jira/browse/STORM-2441">been split</a> into client and server-facing parts. Topology jars should depend on the following artifact as of Apache Storm 2.0.0:</p> |
| <div class="highlight"><pre><code class="language-" data-lang="">&lt;groupId&gt;org.apache.storm&lt;/groupId&gt; |
| &lt;artifactId&gt;storm-client&lt;/artifactId&gt; |
| &lt;version&gt;2.0.0&lt;/version&gt; |
| &lt;scope&gt;provided&lt;/scope&gt; |
| </code></pre></div> |
| <p>Projects using <code>LocalCluster</code> for testing will additionally need to depend on the Apache Storm server jar:</p> |
| <div class="highlight"><pre><code class="language-" data-lang="">&lt;groupId&gt;org.apache.storm&lt;/groupId&gt; |
| &lt;artifactId&gt;storm-server&lt;/artifactId&gt; |
| &lt;version&gt;2.0.0&lt;/version&gt; |
| &lt;scope&gt;test&lt;/scope&gt; |
| </code></pre></div> |
| <h2 id="stay-tuned">Stay Tuned</h2> |
| |
| <p>Keep an eye on the Apache Storm blog for additional posts by Apache Storm contributors for more in-depth discussions of new features in Apache Storm 2.0.0 including:</p> |
| |
| <ul> |
| <li>SQL enhancements</li> |
| <li>Metrics improvements</li> |
| <li>New security features such as nimbus admin groups, delegation tokens, and optional impersonation</li> |
| <li>Module restructuring &amp; dependency resolution improvements</li> |
| <li>API improvements</li> |
| <li>Lambda support</li> |
| <li>Resource Aware Scheduler enhancements</li> |
| <li>New admin commands for debugging cluster state</li> |
| </ul> |
| |
| <h2 id="thanks">Thanks</h2> |
| |
| <p>Special thanks are due to all those who have contributed to Apache Storm -- whether through direct code contributions, documentation, bug reports, or helping other users on the mailing lists. Your efforts are much appreciated.</p> |
| </description> |
| <pubDate>Thu, 30 May 2019 00:00:00 -0500</pubDate> |
| <link>http://storm.apache.org/2019/05/30/storm200-released.html</link> |
| <guid isPermaLink="true">http://storm.apache.org/2019/05/30/storm200-released.html</guid> |
| |
| |
| </item> |
| |
| <item> |
| <title>Apache Storm 1.2.2 Released</title> |
| <description><p>The Apache Storm community is pleased to announce that version 1.2.2 has been released and is available from <a href="/downloads.html">the downloads page</a>.</p> |
| |
| <p>This is a maintenance release that includes a number of important bug fixes that improve Apache Storm&#39;s performance, stability and fault tolerance. We encourage users of previous versions to upgrade to this latest release.</p> |
| |
| <h2 id="thanks">Thanks</h2> |
| |
| <p>Special thanks are due to all those who have contributed to Apache Storm -- whether through direct code contributions, documentation, bug reports, or helping other users on the mailing lists. Your efforts are much appreciated.</p> |
| |
| <h2 id="changes-in-this-release">Changes in this Release</h2> |
| |
| <h2>New Feature</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3026">STORM-3026</a>] - Upgrade ZK instance for security</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3027">STORM-3027</a>] - Make Impersonation Optional</li> |
| </ul> |
| |
| <h2>Improvement</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2896">STORM-2896</a>] - Support automatic migration of offsets from storm-kafka to storm-kafka-client KafkaSpout</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2997">STORM-2997</a>] - Add logviewer ssl module in SECURITY.md </li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3006">STORM-3006</a>] - Distributed RPC documentation needs an update</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3011">STORM-3011</a>] - Use default bin path in flight.bash if $JAVA_HOME is undefined</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3022">STORM-3022</a>] - Decouple storm-hive UTs with Hive</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3039">STORM-3039</a>] - Ports of killed topologies remain in TIME_WAIT state preventing to start new topology</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3069">STORM-3069</a>] - Allow users to specify maven local repository directory for storm submit tool</li> |
| </ul> |
| |
| <h2>Bug</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2911">STORM-2911</a>] - SpoutConfig is serializable but does not declare a serialVersionUID field</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2967">STORM-2967</a>] - Upgrade jackson to latest version 2.9.4</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2968">STORM-2968</a>] - Exclude a few unwanted jars from storm-autocreds</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2978">STORM-2978</a>] - The fix for STORM-2706 is broken, and adds a transitive dependency on Zookeeper 3.5.3-beta for projects that depend on e.g. storm-kafka</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2979">STORM-2979</a>] - WorkerHooks EOFException during run_worker_shutdown_hooks</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2981">STORM-2981</a>] - Upgrade Curator to lastest patch version</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2985">STORM-2985</a>] - Add jackson-annotations to dependency management</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2988">STORM-2988</a>] - "Error on initialization of server mk-worker" when using org.apache.storm.metrics2.reporters.JmxStormReporter on worker</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2989">STORM-2989</a>] - LogCleaner should preserve current worker.log.metrics</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2993">STORM-2993</a>] - Storm HDFS bolt throws ClosedChannelException when Time rotation policy is used</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2994">STORM-2994</a>] - KafkaSpout consumes messages but doesn't commit offsets</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3043">STORM-3043</a>] - NullPointerException thrown in SimpleRecordTranslator.apply()</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3052">STORM-3052</a>] - Let blobs un archive</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3059">STORM-3059</a>] - KafkaSpout throws NPE when hitting a null tuple if the processing guarantee is not AT_LEAST_ONCE</li> |
| </ul> |
| |
| <h2>Documentation</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2960">STORM-2960</a>] - Better to stress importance of setting up proper OS account for Storm processes</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3060">STORM-3060</a>] - Configuration mapping between storm-kafka & storm-kafka-client</li> |
| </ul> |
| |
| <h2>Task</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2952">STORM-2952</a>] - Deprecate storm-kafka in 1.x</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3005">STORM-3005</a>] - [DRPC] LinearDRPCTopologyBuilder shouldn't be deprecated </li> |
| </ul> |
| </description> |
| <pubDate>Mon, 04 Jun 2018 00:00:00 -0500</pubDate> |
| <link>http://storm.apache.org/2018/06/04/storm122-released.html</link> |
| <guid isPermaLink="true">http://storm.apache.org/2018/06/04/storm122-released.html</guid> |
| |
| |
| </item> |
| |
| <item> |
| <title>Apache Storm 1.1.3 Released</title> |
| <description><p>The Apache Storm community is pleased to announce that version 1.1.3 has been released and is available from <a href="/downloads.html">the downloads page</a>.</p> |
| |
| <p>This is a maintenance release that includes a number of important bug fixes that improve Apache Storm&#39;s performance, stability and fault tolerance. We encourage users of previous versions to upgrade to this latest release.</p> |
| |
| <h2 id="thanks">Thanks</h2> |
| |
| <p>Special thanks are due to all those who have contributed to Apache Storm -- whether through direct code contributions, documentation, bug reports, or helping other users on the mailing lists. Your efforts are much appreciated.</p> |
| |
| <h2 id="changes-in-this-release">Changes in this Release</h2> |
| |
| <h2>New Feature</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3026">STORM-3026</a>] - Upgrade ZK instance for security</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3027">STORM-3027</a>] - Make Impersonation Optional</li> |
| </ul> |
| |
| <h2>Improvement</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3011">STORM-3011</a>] - Use default bin path in flight.bash if $JAVA_HOME is undefined</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3039">STORM-3039</a>] - Ports of killed topologies remain in TIME_WAIT state preventing to start new topology</li> |
| </ul> |
| |
| <h2>Bug</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2911">STORM-2911</a>] - SpoutConfig is serializable but does not declare a serialVersionUID field</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2978">STORM-2978</a>] - The fix for STORM-2706 is broken, and adds a transitive dependency on Zookeeper 3.5.3-beta for projects that depend on e.g. storm-kafka</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2979">STORM-2979</a>] - WorkerHooks EOFException during run_worker_shutdown_hooks</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2981">STORM-2981</a>] - Upgrade Curator to lastest patch version</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2985">STORM-2985</a>] - Add jackson-annotations to dependency management</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2989">STORM-2989</a>] - LogCleaner should preserve current worker.log.metrics</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2994">STORM-2994</a>] - KafkaSpout consumes messages but doesn't commit offsets</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3043">STORM-3043</a>] - NullPointerException thrown in SimpleRecordTranslator.apply()</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3052">STORM-3052</a>] - Let blobs un archive</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3059">STORM-3059</a>] - KafkaSpout throws NPE when hitting a null tuple if the processing guarantee is not AT_LEAST_ONCE</li> |
| </ul> |
| |
| <h2>Documentation</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2960">STORM-2960</a>] - Better to stress importance of setting up proper OS account for Storm processes</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3060">STORM-3060</a>] - Configuration mapping between storm-kafka & storm-kafka-client</li> |
| </ul> |
| |
| <h2>Task</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2952">STORM-2952</a>] - Deprecate storm-kafka in 1.x</li> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-3005">STORM-3005</a>] - [DRPC] LinearDRPCTopologyBuilder shouldn't be deprecated </li> |
| </ul> |
| |
| <h2>Test</h2> |
| |
| <ul> |
| <li>[<a href="https://issues.apache.org/jira/browse/STORM-2841">STORM-2841</a>] - testNoAcksIfFlushFails UT fails with NullPointerException</li> |
| </ul> |
| |
| <p></body> |
| </html></p> |
| </description> |
| <pubDate>Mon, 04 Jun 2018 00:00:00 -0500</pubDate> |
| <link>http://storm.apache.org/2018/06/04/storm113-released.html</link> |
| <guid isPermaLink="true">http://storm.apache.org/2018/06/04/storm113-released.html</guid> |
| |
| |
| </item> |
| |
| </channel> |
| </rss> |
