| <rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Apache Dubbo – Diagnostics and Tuning</title><link>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/</link><description>Recent content in Diagnostics and Tuning on Apache Dubbo</description><generator>Hugo -- gohugo.io</generator><language>en</language><atom:link href="https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/index.xml" rel="self" type="application/rss+xml"/><item><title>Docs3-V2: Request time-consuming sampling</title><link>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/profiler/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/profiler/</guid><description> |
| <h2 id="function-description">Function Description</h2> |
| <p>The performance sampling function can detect the time consumption of various parts of the Dubbo processing link. When a timeout occurs, <code>( usageTime / timeout &gt; profilerWarnPercent * 100 )</code> records the time consumption of calls through logs.</p> |
| <p>This function is divided into <code>simple profiler</code> and <code>detail profiler</code> two modes, where <code>simple profiler</code> mode is enabled by default, and <code>detail profiler</code> mode is disabled by default. |
| Compared with the <code>simple profiler</code> mode, the <code>detail profiler</code> collects more time-consuming processing of each filter, specific time-consuming protocols, etc. |
| In the <code>simple profiler</code> mode, if you find that there is a long time-consuming situation inside the Dubbo framework, you can enable the <code>detail profiler</code> mode to better troubleshoot the problem.</p> |
| <h2 id="scenes-to-be-used">scenes to be used</h2> |
| <p>Scenarios that need to collect and analyze the precise time consumption of Dubbo requests, such as service timeouts for unknown reasons, etc.</p> |
| <h2 id="how-to-use">How to use</h2> |
| <p><code>simple profiler</code> is automatically enabled by default, and for requests whose processing time exceeds 3/4 of the timeout time, the slow call information will be printed out through the log. If you need to enable the <code>detail profiler</code> mode or modify the timeout alarm ratio, you can refer to the <a href="../../../reference-manual/qos/profiler/">performance sampling command</a> document.</p> |
| <h3 id="output-example">output example</h3> |
| <h4 id="log-description">Log description</h4> |
| <p>The meaning of each field in the log is as follows:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>[Dubbo-Consumer] execute service interface#method cost actual time-consuming, this invocation almost (maybe already) timeout. Timeout: timeout |
| </span></span><span style="display:flex;"><span>invocation context: |
| </span></span><span style="display:flex;"><span>request context |
| </span></span><span style="display:flex;"><span>thread info: |
| </span></span><span style="display:flex;"><span>Start time: start request time (nano time) |
| </span></span><span style="display:flex;"><span>+-[ Offset: the start time of the current node; Usage: the total time spent on the current node, the time-consuming ratio of the current node ] Description of the current node |
| </span></span><span style="display:flex;"><span> +-[ Offset: the start time of the current node; Usage: the total time spent on the current node, the time-consuming ratio of the current node ] Description of the current node |
| </span></span></code></pre></div><p>For the request time-consuming, here are two examples:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>methodA() { |
| </span></span><span style="display:flex;"><span> do something (1) |
| </span></span><span style="display:flex;"><span> methodB (2) |
| </span></span><span style="display:flex;"><span> do something (3) |
| </span></span><span style="display:flex;"><span>} |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>methodB() { |
| </span></span><span style="display:flex;"><span> do something (4) |
| </span></span><span style="display:flex;"><span> methodC (5) |
| </span></span><span style="display:flex;"><span> do something (6) |
| </span></span><span style="display:flex;"><span>} |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>methodC() { |
| </span></span><span style="display:flex;"><span> do something (7) |
| </span></span><span style="display:flex;"><span>} |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>+-[ Offset: 0 ms; Usage: (1) + (2) + (3) ms] execute methodA |
| </span></span><span style="display:flex;"><span> +-[ Offset: (1) ms; Usage: (4) + (5) + (6) = (2) ms ] execute methodB |
| </span></span><span style="display:flex;"><span> +-[ Offset: (1) + (4) ms; Usage: (7) = (5) ms ] execute methodC |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>(1) (2) (3) ... are all time placeholders |
| </span></span></code></pre></div><div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>methodA() { |
| </span></span><span style="display:flex;"><span> do something (1) |
| </span></span><span style="display:flex;"><span> methodB (2) |
| </span></span><span style="display:flex;"><span> methodE (3) |
| </span></span><span style="display:flex;"><span> do something (4) |
| </span></span><span style="display:flex;"><span>} |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>methodB() { |
| </span></span><span style="display:flex;"><span> do something (5) |
| </span></span><span style="display:flex;"><span> methodC (6) |
| </span></span><span style="display:flex;"><span> method D (7) |
| </span></span><span style="display:flex;"><span> do something (8) |
| </span></span><span style="display:flex;"><span>} |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>methodC() { |
| </span></span><span style="display:flex;"><span> do something (9) |
| </span></span><span style="display:flex;"><span>} |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>methodD() { |
| </span></span><span style="display:flex;"><span> do something (10) |
| </span></span><span style="display:flex;"><span>} |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>methodE() { |
| </span></span><span style="display:flex;"><span> do something (11) |
| </span></span><span style="display:flex;"><span>} |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>+-[ Offset: 0 ms; Usage: (1) + (2) + (3) + (4) ms] execute methodA |
| </span></span><span style="display:flex;"><span> +-[ Offset: (1) ms; Usage: (5) + (6) + (7) + (8) = (2) ms ] execute methodB |
| </span></span><span style="display:flex;"><span> +-[ Offset: (1) + (5) ms; Usage: (9) = (6) ms ] execute methodC |
| </span></span><span style="display:flex;"><span> +-[ Offset: (1) + (5) + (6) ms; Usage: (10) = (7) ms ] execute methodD |
| </span></span><span style="display:flex;"><span> +-[ Offset: (1) + (2) ms; Usage: (11) = (3) ms ] execute methodE |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>(1) (2) (3) ... are all time placeholders |
| </span></span></code></pre></div><h4 id="simple-profiler">simple profiler</h4> |
| <p>Consumer side:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>[19/07/22 07:08:35:035 CST] main WARN proxy.InvokerInvocationHandler: [DUBBO] [Dubbo-Consumer] execute service org.apache.dubbo.samples.api.GreetingsService#sayHi cost 1003.015746 ms, this invocation almost (maybe already) timeout. Timeout: 1000ms |
| </span></span><span style="display:flex;"><span>invocation context: |
| </span></span><span style="display:flex;"><span>path=org.apache.dubbo.samples.api.GreetingsService; |
| </span></span><span style="display:flex;"><span>remote.application=first-dubbo-consumer; |
| </span></span><span style="display:flex;"><span>interface=org.apache.dubbo.samples.api.GreetingsService; |
| </span></span><span style="display:flex;"><span>version=0.0.0; |
| </span></span><span style="display:flex;"><span>timeout=1000; |
| </span></span><span style="display:flex;"><span>thread info: |
| </span></span><span style="display:flex;"><span>Start time: 285821581299853 |
| </span></span><span style="display:flex;"><span>+-[ Offset: 0.000000ms; Usage: 1003.015746ms, 100% ] Receive request. Client invoke begin. ServiceKey: org.apache.dubbo.samples.api.GreetingsService MethodName:sayHi |
| </span></span><span style="display:flex;"><span> +-[ Offset: 7.987015ms; Usage: 994.207928ms, 99% ] Invoker invoke. Target Address: xx.xx.xx.xx:20880, dubbo version: 3.0.10-SNAPSHOT, current host: xx.xx.xx. xx |
| </span></span></code></pre></div><p>Provider side:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>[19/07/22 07:08:35:035 CST] DubboServerHandler-30.227.64.173:20880-thread-2 WARN filter.ProfilerServerFilter: [DUBBO] [Dubbo-Provider] execute service org.apache.dubbo.samples.api .GreetingsService:0.0.0#sayHi cost 808.494672 ms, this invocation almost (maybe already) timeout. Timeout: 1000ms |
| </span></span><span style="display:flex;"><span>client: xx.xx.xx.xx:51604 |
| </span></span><span style="display:flex;"><span>invocation context: |
| </span></span><span style="display:flex;"><span>input=281; |
| </span></span><span style="display:flex;"><span>path=org.apache.dubbo.samples.api.GreetingsService; |
| </span></span><span style="display:flex;"><span>remote.application=first-dubbo-consumer; |
| </span></span><span style="display:flex;"><span>dubbo=2.0.2; |
| </span></span><span style="display:flex;"><span>interface=org.apache.dubbo.samples.api.GreetingsService; |
| </span></span><span style="display:flex;"><span>version=0.0.0; |
| </span></span><span style="display:flex;"><span>timeout=1000; |
| </span></span><span style="display:flex;"><span>thread info: |
| </span></span><span style="display:flex;"><span>Start time: 285821754461125 |
| </span></span><span style="display:flex;"><span>+-[ Offset: 0.000000ms; Usage: 808.494672ms, 100% ] Receive request. Server invoke begin. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 1.030912ms; Usage: 804.236342ms, 99% ] Receive request. Server biz impl invoke begin., dubbo version: 3.0.10-SNAPSHOT, current host: xx.xx.xx.xx |
| </span></span></code></pre></div><h4 id="detail-profiler">detail profiler</h4> |
| <p>Consumer side:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>[19/07/22 07:10:59:059 CST] main WARN proxy.InvokerInvocationHandler: [DUBBO] [Dubbo-Consumer] execute service org.apache.dubbo.samples.api.GreetingsService#sayHi cost 990.828336 ms, this invocation almost (maybe already) timeout. Timeout: 1000ms |
| </span></span><span style="display:flex;"><span>invocation context: |
| </span></span><span style="display:flex;"><span>path=org.apache.dubbo.samples.api.GreetingsService; |
| </span></span><span style="display:flex;"><span>remote.application=first-dubbo-consumer; |
| </span></span><span style="display:flex;"><span>interface=org.apache.dubbo.samples.api.GreetingsService; |
| </span></span><span style="display:flex;"><span>version=0.0.0; |
| </span></span><span style="display:flex;"><span>timeout=1000; |
| </span></span><span style="display:flex;"><span>thread info: |
| </span></span><span style="display:flex;"><span>Start time: 285965458479241 |
| </span></span><span style="display:flex;"><span>+-[ Offset: 0.000000ms; Usage: 990.828336ms, 100% ] Receive request. Client invoke begin. ServiceKey: org.apache.dubbo.samples.api.GreetingsService MethodName:sayHi |
| </span></span><span style="display:flex;"><span> +-[ Offset: 0.852044ms; Usage: 989.899439ms, 99% ] Filter org.apache.dubbo.rpc.cluster.filter.support.ConsumerContextFilter invoke. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 1.814858ms; Usage: 988.924876ms, 99% ] Filter org.apache.dubbo.rpc.protocol.dubbo.filter.FutureFilter invoke. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 1.853211ms; Usage: 988.877928ms, 99% ] Filter org.apache.dubbo.monitor.support.MonitorClusterFilter invoke. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 1.873243ms; Usage: 988.661708ms, 99% ] Filter org.apache.dubbo.rpc.cluster.router.RouterSnapshotFilter invoke. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 2.159140ms; Usage: 0.504939ms, 0% ] Router route. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 8.125823ms; Usage: 981.748366ms, 99% ] Cluster org.apache.dubbo.rpc.cluster.support.FailoverClusterInvoker invoke. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 8.258359ms; Usage: 981.612033ms, 99% ] Invoker invoke. Target Address: xx.xx.xx.xx:20880, dubbo version: 3.0.10-SNAPSHOT, current host: xx.xx.xx. xx |
| </span></span></code></pre></div><p>Provider side:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>[19/07/22 07:10:59:059 CST] DubboServerHandler-30.227.64.173:20880-thread-2 WARN filter.ProfilerServerFilter: [DUBBO] [Dubbo-Provider] execute service org.apache.dubbo.samples.api .GreetingsService:0.0.0#sayHi cost 811.017347 ms, this invocation almost (maybe already) timeout. Timeout: 1000ms |
| </span></span><span style="display:flex;"><span>client: xx.xx.xx.xx:52019 |
| </span></span><span style="display:flex;"><span>invocation context: |
| </span></span><span style="display:flex;"><span>input=281; |
| </span></span><span style="display:flex;"><span>path=org.apache.dubbo.samples.api.GreetingsService; |
| </span></span><span style="display:flex;"><span>remote.application=first-dubbo-consumer; |
| </span></span><span style="display:flex;"><span>dubbo=2.0.2; |
| </span></span><span style="display:flex;"><span>interface=org.apache.dubbo.samples.api.GreetingsService; |
| </span></span><span style="display:flex;"><span>version=0.0.0; |
| </span></span><span style="display:flex;"><span>timeout=1000; |
| </span></span><span style="display:flex;"><span>thread info: |
| </span></span><span style="display:flex;"><span>Start time: 285965612316294 |
| </span></span><span style="display:flex;"><span>+-[ Offset: 0.000000ms; Usage: 811.017347ms, 100% ] Receive request. Server invoke begin. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 1.096880ms; Usage: 809.916668ms, 99% ] Filter org.apache.dubbo.rpc.filter.EchoFilter invoke. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 1.133478ms; Usage: 809.866204ms, 99% ] Filter org.apache.dubbo.rpc.filter.ClassLoaderFilter invoke. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 1.157563ms; Usage: 809.838572ms, 99% ] Filter org.apache.dubbo.rpc.filter.GenericFilter invoke. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 1.202075ms; Usage: 809.736843ms, 99% ] Filter org.apache.dubbo.rpc.filter.ContextFilter invoke. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 1.433193ms; Usage: 809.504401ms, 99% ] Filter org.apache.dubbo.auth.filter.ProviderAuthFilter invoke. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 1.470760ms; Usage: 809.464291ms, 99% ] Filter org.apache.dubbo.rpc.filter.ExceptionFilter invoke. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 1.489103ms; Usage: 809.440183ms, 99% ] Filter org.apache.dubbo.monitor.support.MonitorFilter invoke. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 1.515757ms; Usage: 809.381893ms, 99% ] Filter org.apache.dubbo.rpc.filter.TimeoutFilter invoke. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 1.526632ms; Usage: 809.366553ms, 99% ] Filter org.apache.dubbo.rpc.protocol.dubbo.filter.TraceFilter invoke. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 1.536964ms; Usage: 809.335907ms, 99% ] Filter org.apache.dubbo.rpc.filter.ClassLoaderCallbackFilter invoke. |
| </span></span><span style="display:flex;"><span> +-[ Offset: 1.558545ms; Usage: 804.276436ms, 99% ] Receive request. Server biz impl invoke begin., dubbo version: 3.0.10-SNAPSHOT, current host: xx.xx.xx.xx |
| </span></span></code></pre></div><p>Note: If the log is empty due to the mismatch of the log framework, you can refer to <a href="../../others/logger-management/">Log Framework Adaptation and Runtime Management</a> to dynamically modify the log output framework.</p></description></item><item><title>Docs3-V2: Threading Model</title><link>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/threading-model/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/threading-model/</guid><description/></item><item><title>Docs3-V2: Routing Status Collection</title><link>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/router-snapshot/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/router-snapshot/</guid><description> |
| <h2 id="function-description">Function Description</h2> |
| <h2 id="scenes-to-be-used">scenes to be used</h2> |
| <p>Many of Dubbo&rsquo;s traffic management capabilities are implemented based on Router. In a production environment, if traffic results do not meet expectations, you can use the routing status command to check the routing status to locate possible problems.</p> |
| <h2 id="how-to-use">How to use</h2> |
| <h3 id="view-route-cache-status">View route cache status</h3> |
| <p>When Dubbo receives the address change, it will push the address information to all <code>Routers</code>, and these <code>Routers</code> can calculate the routing packets in advance at this stage and cache them to avoid the need to traverse all provider calculations when calling grouping parameters. |
| The <code>StateRouter</code> introduced in Dubbo 3 provides the ability to obtain the status of each route in real time through the qos command tool.</p> |
| <p>The operation and maintenance personnel can obtain the status of the route through the <code>getRouterSnapshot</code> command. For specific commands, please refer to the <a href="../../../reference-manual/qos/router-snapshot/#getroutersnapshot-command">getRouterSnapshot command</a> document.</p> |
| <p>**Note: This feature only supports <code>StateRoute</code>, and <code>StateRouter</code> needs to implement the <code>doBuildSnapshot</code> interface based on <code>AbstractStateRouter</code>. **</p> |
| <h3 id="view-the-route-calculation-result-of-the-actual-request">View the route calculation result of the actual request</h3> |
| <p>By default in Dubbo 3, the node status of route calculation is printed when the route filter is empty. Operation and maintenance personnel can judge whether the calculation result of each route meets expectations through logs.</p> |
| <h4 id="log-format">Log format</h4> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>No provider available after route for the service service from registry registration center address on the consumer consumer IP using the dubbo version 3.0.7. Router snapshot is below: |
| </span></span><span style="display:flex;"><span>[ Parent (Input: Number of input addresses of the current node) (Current Node Output: Number of calculation results of the current node) (Chain Node Output: Number of intersection results of the current node and subsequent nodes) ] Input: Examples of input addresses (up to 5 are displayed) -&gt; Chain Node Output: Example of addresses output by the current node (up to 5 are displayed) |
| </span></span><span style="display:flex;"><span> [Route name (Input: number of input addresses of the current node) (Current Node Output: number of calculation results of the current node) (Chain Node Output: number of intersection results of the current node and subsequent nodes) Router message: routing log] Current Node Output: current node Example of addresses output (up to 5 displayed) |
| </span></span><span style="display:flex;"><span> [routing name (Input: current node input address number) (Current Node Output: current node calculation result number) (Chain Node Output: current node and subsequent node intersection result number) Router message: routing log] Current Node Output: current input Examples of addresses for (show up to 5) |
| </span></span></code></pre></div><h4 id="notice">Notice:</h4> |
| <ul> |
| <li>The routing log needs to rely on the routing implementation to judge the <code>needToPrintMessage</code> parameter, and write the <code>messageHolder</code> routing log when needed</li> |
| <li>Since the result of multi-level routing is the intersection of the results, the calculation result of the current node may be empty after the intersection with the subsequent level</li> |
| </ul> |
| <h4 id="log-example">Log example</h4> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>[19/07/22 07:42:46:046 CST] main WARN cluster.RouterChain: [DUBBO] No provider available after route for the service org.apache.dubbo.samples.governance.api.DemoService from registry 30.227.64.173 on the consumer 30.227.64.173 using the dubbo version 3.0.7. Router snapshot is below: |
| </span></span><span style="display:flex;"><span>[ Parent (Input: 2) (Current Node Output: 2) (Chain Node Output: 0) ] Input: 30.227.64.173:20881,30.227.64.173:20880 -&gt; Chain Node Output: Empty |
| </span></span><span style="display:flex;"><span> [ MockInvokersSelector (Input: 2) (Current Node Output: 2) (Chain Node Output: 0) Router message: invocation.need.mock not set. Return normal Invokers. ] Current Node Output: 30.227.64.173:20881,30.223.64.17 :20880 |
| </span></span><span style="display:flex;"><span> [ StandardMeshRuleRouter (Input: 2) (Current Node Output: 2) (Chain Node Output: 0) Router message: MeshRuleCache has not been built. Skip route. ] Current Node Output: 30.227.64.173:20881,30.227.624.1803: |
| </span></span><span style="display:flex;"><span> [ TagStateRouter (Input: 2) (Current Node Output: 0) (Chain Node Output: 0) Router message: FAILOVER: return all Providers without any tags ] Current Node Output: Empty, dubbo version: 3.0.7, current host: 30.227 .64.173 |
| </span></span></code></pre></div><h4 id="open-route-full-sampling">Open route full sampling</h4> |
| <p>In some special cases, the request may be called to the wrong server, but because the address selection is not empty, the process information of the route cannot be seen. At this time, you can [Enable full route sampling through qos](../../. ./reference-manual/qos/router-snapshot/). The latest routing snapshot can be obtained remotely through the <code>getRecentRouterSnapshot</code> command of qos.</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>dubbo&gt;getRecentRouterSnapshot |
| </span></span><span style="display:flex;"><span>1658224330156 - Router snapshot service com.dubbo.dubbointegration.BackendService from registry 172.18.111.184 on the consumer 172.18.111.184 using the dubbo version 3.0.9 is below: |
| </span></span><span style="display:flex;"><span>[ Parent (Input: 2) (Current Node Output: 2) (Chain Node Output: 2) ] Input: 172.18.111.187:20880,172.18.111.183:20880 -&gt; Chain Node Output: 172.18.111.187:20880.3172.18 :20880 |
| </span></span><span style="display:flex;"><span> [ MockInvokersSelector (Input: 2) (Current Node Output: 2) (Chain Node Output: 2) Router message: invocation.need.mock not set. Return normal Invokers. ] Current Node Output: 172.18.111.187:20880,172.183.111. :20880 |
| </span></span><span style="display:flex;"><span> [ StandardMeshRuleRouter (Input: 2) (Current Node Output: 2) (Chain Node Output: 2) Router message: MeshRuleCache has not been built. Skip route. ] Current Node Output: 172.18.111.187:20880,172.1803:1121.88 |
| </span></span><span style="display:flex;"><span> [ TagStateRouter (Input: 2) (Current Node Output: 2) (Chain Node Output: 2) Router message: Disable Tag Router. Reason: tagRouterRule is invalid or disabled ] Current Node Output: 172.18.111.187:20880,172.183.111. 20880 |
| </span></span><span style="display:flex;"><span> [ ServiceStateRouter (Input: 2) (Current Node Output: 2) (Chain Node Output: 2) Router message: Directly return. Reason: Invokers from previous router is empty or conditionRouters is empty. ] Current Node Output: 172.18.111.187:20880 ,172.18.111.183:20880 |
| </span></span><span style="display:flex;"><span> [ AppStateRouter (Input: 2) (Current Node Output: 2) (Chain Node Output: 2) Router message: Directly return. Reason: Invokers from previous router is empty or conditionRouters is empty. ] Current Node Output: 172.18.111.187:20880 ,172.18.111.183:20880 |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>1658224330156 - Router snapshot service com.dubbo.dubbointegration.BackendService from registry 172.18.111.184 on the consumer 172.18.111.184 using the dubbo version 3.0.9 is below: |
| </span></span><span style="display:flex;"><span>[ Parent (Input: 2) (Current Node Output: 2) (Chain Node Output: 2) ] Input: 172.18.111.187:20880,172.18.111.183:20880 -&gt; Chain Node Output: 172.18.111.187:20880.3172.18 :20880 |
| </span></span><span style="display:flex;"><span> [ MockInvokersSelector (Input: 2) (Current Node Output: 2) (Chain Node Output: 2) Router message: invocation.need.mock not set. Return normal Invokers. ] Current Node Output: 172.18.111.187:20880,172.183.111. :20880 |
| </span></span><span style="display:flex;"><span> [ StandardMeshRuleRouter (Input: 2) (Current Node Output: 2) (Chain Node Output: 2) Router message: MeshRuleCache has not been built. Skip route. ] Current Node Output: 172.18.111.187:20880,172.1803:1121.88 |
| </span></span><span style="display:flex;"><span> [ TagStateRouter (Input: 2) (Current Node Output: 2) (Chain Node Output: 2) Router message: Disable Tag Router. Reason: tagRouterRule is invalid or disabled ] Current Node Output: 172.18.111.187:20880,172.183.111. 20880 |
| </span></span><span style="display:flex;"><span> [ ServiceStateRouter (Input: 2) (Current Node Output: 2) (Chain Node Output: 2) Router message: Directly return. Reason: Invokers from previous router is empty or conditionRouters is empty. ] Current Node Output: 172.18.111.187:20880 ,172.18.111.183:20880 |
| </span></span><span style="display:flex;"><span> [ AppStateRouter (Input: 2) (Current Node Output: 2) (Chain Node Output: 2) Router message: Directly return. Reason: Invokers from previous router is empty or conditionRouters is empty. ] Current Node Output: 172.18.111.187:20880 ,172.18.111.183:20880 |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>··· |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>dubbo&gt; |
| </span></span></code></pre></div><h4 id="notice-1">Notice:</h4> |
| <p>If the log is empty due to the mismatch of the log framework, you can refer to <a href="../../others/logger-management/">Log Framework Adaptation and Runtime Management</a> to dynamically modify the log output framework.</p></description></item><item><title>Docs3-V2: Service Reference Configuration Object Cache</title><link>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/reference-config-cache/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/reference-config-cache/</guid><description> |
| <h2 id="feature-description">Feature description</h2> |
| <p>The <code>ReferenceConfig</code> instance is heavy, encapsulates the connection to the registry and the connection to the provider, and needs to be cached. Otherwise repeatedly generating <code>ReferenceConfig</code> may cause performance problems and have memory and connection leaks. It&rsquo;s easy to overlook this problem when programming in the API way.</p> |
| <p>Therefore, since <code>2.4.0</code> version, dubbo provides a simple tool class <code>ReferenceConfigCache</code> for caching <code>ReferenceConfig</code> instances.</p> |
| <h2 id="scenes-to-be-used">scenes to be used</h2> |
| <p>There are scenarios such as gateways that dynamically create subscriptions. Because ReferenceConfig itself is very heavy, it will create a lot of intermediate objects, and proxy itself can be reused, so the properties of this part can be cached through ReferenceConfigCache.</p> |
| <h2 id="how-to-use">How to use</h2> |
| <h3 id="eliminate-and-destroy">Eliminate and destroy</h3> |
| <p>Eliminating the <code>ReferenceConfig</code> in the Cache will destroy the <code>ReferenceConfig</code> and release the corresponding resources.</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-java" data-lang="java"><span style="display:flex;"><span>ReferenceConfig<span style="color:#719e07">&lt;</span>XxxService<span style="color:#719e07">&gt;</span> reference <span style="color:#719e07">=</span> <span style="color:#719e07">new</span> ReferenceConfig<span style="color:#719e07">&lt;</span>XxxService<span style="color:#719e07">&gt;();</span> |
| </span></span><span style="display:flex;"><span>reference<span style="color:#719e07">.</span>setInterface<span style="color:#719e07">(</span>XxxService<span style="color:#719e07">.</span>class<span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span>reference<span style="color:#719e07">.</span>setVersion<span style="color:#719e07">(</span><span style="color:#2aa198">&#34;1.0.0&#34;</span><span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> … |
| </span></span><span style="display:flex;"><span>ReferenceConfigCache cache <span style="color:#719e07">=</span> ReferenceConfigCache<span style="color:#719e07">.</span> <span style="color:#268bd2">getCache</span><span style="color:#719e07">();</span> |
| </span></span><span style="display:flex;"><span><span style="color:#586e75">// The reference object will be cached in the cache.get method, and the ReferenceConfig.get method will be called to start the ReferenceConfig |
| </span></span></span><span style="display:flex;"><span><span style="color:#586e75"></span>XxxService xxxService <span style="color:#719e07">=</span> cache<span style="color:#719e07">.</span> <span style="color:#268bd2">get</span><span style="color:#719e07">(</span>reference<span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span><span style="color:#586e75">// Notice! The Cache will hold the ReferenceConfig, do not call the destroy method of the ReferenceConfig outside, causing the ReferenceConfig in the Cache to become invalid! |
| </span></span></span><span style="display:flex;"><span><span style="color:#586e75">// Use the xxxService object |
| </span></span></span><span style="display:flex;"><span><span style="color:#586e75"></span>xxxService<span style="color:#719e07">.</span> <span style="color:#268bd2">sayHello</span><span style="color:#719e07">();</span> |
| </span></span></code></pre></div><div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-java" data-lang="java"><span style="display:flex;"><span>ReferenceConfigCache cache <span style="color:#719e07">=</span> ReferenceConfigCache<span style="color:#719e07">.</span> <span style="color:#268bd2">getCache</span><span style="color:#719e07">();</span> |
| </span></span><span style="display:flex;"><span>cache<span style="color:#719e07">.</span>destroy<span style="color:#719e07">(</span>reference<span style="color:#719e07">);</span> |
| </span></span></code></pre></div><p>The default <code>ReferenceConfigCache</code> considers <code>ReferenceConfig</code> of the same service group, interface, and version to be the same, and caches a copy. That is, the service group, interface, and version are cached keys.</p> |
| <h3 id="modify-strategy">Modify strategy</h3> |
| <p>You can modify this strategy to pass a <code>KeyGenerator</code> when <code>ReferenceConfigCache.getCache</code>. See methods of the <code>ReferenceConfigCache</code> class for details.</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-java" data-lang="java"><span style="display:flex;"><span>KeyGenerator keyGenerator <span style="color:#719e07">=</span> <span style="color:#719e07">new</span><span style="color:#719e07">...</span> |
| </span></span><span style="display:flex;"><span>ReferenceConfigCache cache <span style="color:#719e07">=</span> ReferenceConfigCache<span style="color:#719e07">.</span> <span style="color:#268bd2">getCache</span><span style="color:#719e07">(</span>keyGenerator<span style="color:#719e07">);</span> |
| </span></span></code></pre></div></description></item><item><title>Docs3-V2: Load Balancing</title><link>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/loadbalance/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/loadbalance/</guid><description> |
| <p>When cluster load balancing, Dubbo provides a variety of balancing strategies, the default is <code>random</code> random calls.</p> |
| <p>In terms of specific implementation, Dubbo provides client load balancing, that is, the Consumer uses the load balancing algorithm to determine which Provider instance to submit the request to.</p> |
| <p>You can expand the load balancing strategy by yourself, see: <a href="../../../reference-manual/spi/description/load-balance">Load Balance Extension</a></p> |
| <h2 id="load-balancing-strategy">load balancing strategy</h2> |
| <p>Currently Dubbo has the following built-in load balancing algorithms, which users can directly configure and use:</p> |
| <p>| Algorithms | Features | Remarks | |
| | :&mdash;&mdash;&mdash;&mdash;&mdash;&mdash;&mdash;&mdash;&ndash; | :&mdash;&mdash;&mdash;&mdash;&mdash;&mdash;&ndash; &ndash; | :&mdash;&mdash;&mdash;&mdash;&mdash;&mdash;&mdash;&mdash;&mdash;&mdash;&mdash;&mdash;&mdash;&mdash;&mdash;- | |
| | RandomLoadBalance | Weighted random | Default algorithm, same weight by default | |
| | RoundRobinLoadBalance | Weighted round-robin | Based on Nginx&rsquo;s smooth weighted round-robin algorithm, the default weight is the same, | |
| | LeastActiveLoadBalance | Least Active Priority + Weighted Random | Behind it is the idea that those who can do more work | |
| | ShortestResponseLoadBalance | Shortest Response First + Weighted Random | More focus on response speed | |
| | ConsistentHashLoadBalance | Consistent Hash | Definite input parameters, definite provider, suitable for stateful requests |</p> |
| <h3 id="random">Random</h3> |
| <ul> |
| <li><strong>Weighted random</strong>, set random probability by weight.</li> |
| <li>The probability of collision on a section is high, but the greater the call volume, the more uniform the distribution, and the weight is also more uniform after using the probability, which is conducive to dynamically adjusting the provider weight.</li> |
| <li>Disadvantages: There is a problem of accumulating requests from slow providers. For example: the second machine is very slow, but it is not hung up. When the request is transferred to the second machine, it is stuck there. Over time, all requests are stuck in the second machine. on stage.</li> |
| </ul> |
| <h3 id="roundrobin">RoundRobin</h3> |
| <ul> |
| <li><strong>Weighted polling</strong>, set the polling ratio according to the weight after the convention, and call the node cyclically</li> |
| <li>Disadvantage: There is also the problem of accumulating requests for slow providers.</li> |
| </ul> |
| <p>During the weighted round-robin process, if the weight of a node is too large, there will be a problem of too concentrated calls within a certain period of time. |
| For example, ABC three nodes have the following weights: <code>{A: 3, B: 2, C: 1}</code> |
| Then according to the most primitive polling algorithm, the calling process will become: <code>A A A B B C</code></p> |
| <p>In this regard, Dubbo has optimized it by referring to Nginx&rsquo;s smooth weighted round-robin algorithm. The calling process can be abstracted into the following table:</p> |
| <p>| Pre-round sum weight | Current round winner | Total weight | Post-round weight (winner minus total weight) | |
| | :&mdash;&mdash;&mdash;&mdash;&mdash;&mdash; | :&mdash;&mdash;- | :&mdash;&mdash;- | :&mdash;&mdash;&mdash;- &mdash;&mdash;&mdash;&mdash;&mdash;&ndash; | |
| | Starting round | \ | \ | <code>A(0), B(0), C(0)</code> | |
| | <code>A(3), B(2), C(1)</code> | A | 6 | <code>A(-3), B(2), C(1)</code> | |
| | <code>A(0), B(4), C(2)</code> | B | 6 | <code>A(0), B(-2), C(2)</code> | |
| | <code>A(3), B(0), C(3)</code> | A | 6 | <code>A(-3), B(0), C(3)</code> | |
| | <code>A(0), B(2), C(4)</code> | C | 6 | <code>A(0), B(2), C(-2)</code> | |
| | <code>A(3), B(4), C(-1)</code> | B | 6 | <code>A(3), B(-2), C(-1)</code> | |
| | <code>A(6), B(0), C(0)</code> | A | 6 | <code>A(0), B(0), C(0)</code> |</p> |
| <p>We found that after the total weight (3+2+1) rounds, the cycle returns to the starting point, the node traffic is smooth throughout the process, and even in a short period of time, the probability is distributed according to expectations.</p> |
| <p>If users have the requirement of weighted polling, they can use this algorithm with confidence.</p> |
| <h3 id="leastactive">LeastActive</h3> |
| <ul> |
| <li><strong>Weighted least active call priority</strong>, the lower the active number, the higher the priority call, the same active number will be weighted randomly. The active number refers to the count difference before and after the call (for a specific provider: the number of requests sent - the number of responses returned), which indicates the amount of tasks accumulated by a specific provider. The lower the active number, the stronger the processing capability of the provider.</li> |
| <li>Make the slow provider receive fewer requests, because the slower the provider, the greater the count difference before and after the call; relatively, the node with the stronger processing capacity can handle more requests.</li> |
| </ul> |
| <p>###ShortestResponse</p> |
| <ul> |
| <li><strong>Weighted Shortest Response Priority</strong>, in the latest sliding window, the shorter the response time, the higher the priority to call. The same response time is weighted randomly.</li> |
| <li>Make providers with faster response times handle more requests.</li> |
| <li>Disadvantage: It may cause traffic to be too concentrated on high-performance nodes.</li> |
| </ul> |
| <p>Response time here = the average response time of a provider within the window time, and the default window time is 30s.</p> |
| <p>###ConsistentHash</p> |
| <ul> |
| <li><strong>Consistent Hash</strong>, requests with the same parameters are always sent to the same provider.</li> |
| <li>When a certain provider is down, the request originally sent to the provider will be spread to other providers based on the virtual node, and will not cause drastic changes.</li> |
| <li>Algorithm see: <a href="http://en.wikipedia.org/wiki/Consistent_hashing">Consistent Hashing | WIKIPEDIA</a></li> |
| <li>By default only the first parameter Hash, if you want to modify, please configure <code>&lt;dubbo:parameter key=&quot;hash.arguments&quot; value=&quot;0,1&quot; /&gt;</code></li> |
| <li>160 virtual nodes are used by default, if you want to modify, please configure <code>&lt;dubbo:parameter key=&quot;hash.nodes&quot; value=&quot;320&quot; /&gt;</code></li> |
| </ul> |
| <h2 id="configuration">configuration</h2> |
| <h3 id="server-service-level">Server service level</h3> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:service</span> interface=<span style="color:#2aa198">&#34;...&#34;</span> loadbalance=<span style="color:#2aa198">&#34;roundrobin&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><h3 id="client-service-level">Client service level</h3> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:reference</span> interface=<span style="color:#2aa198">&#34;...&#34;</span> loadbalance=<span style="color:#2aa198">&#34;roundrobin&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><h3 id="server-method-level">Server method level</h3> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:service</span> interface=<span style="color:#2aa198">&#34;...&#34;</span><span style="color:#268bd2">&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;dubbo:method</span> name=<span style="color:#2aa198">&#34;...&#34;</span> loadbalance=<span style="color:#2aa198">&#34;roundrobin&#34;</span><span style="color:#268bd2">/&gt;</span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">&lt;/dubbo:service&gt;</span> |
| </span></span></code></pre></div><h3 id="client-method-level">Client method level</h3> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:reference</span> interface=<span style="color:#2aa198">&#34;...&#34;</span><span style="color:#268bd2">&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;dubbo:method</span> name=<span style="color:#2aa198">&#34;...&#34;</span> loadbalance=<span style="color:#2aa198">&#34;roundrobin&#34;</span><span style="color:#268bd2">/&gt;</span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">&lt;/dubbo:reference&gt;</span> |
| </span></span></code></pre></div></description></item><item><title>Docs3-V2: Registration Information Simplified</title><link>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/simplify-registry-data/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/simplify-registry-data/</guid><description> |
| <h2 id="feature-description">Feature description</h2> |
| <p>There are nearly <a href="https://dubbo.apache.org/zh-cn/docs/references/xml/dubbo-parameter">30 configuration items</a> in the service configuration items in Dubbo provider. Excluding the need for registry service governance, a large part of configuration items are used by the provider itself and do not need to be transparently passed to consumers. This part of data does not need to enter the registry, but only needs to be stored persistently in the form of key-value.</p> |
| <p>The configuration items in Dubbo consumer also have <a href="https://dubbo.apache.org/zh-cn/docs/references/xml/dubbo-consumer">20+ configuration items</a>. In the registration center, only a small amount of configuration such as application, version, group, ip, and dubbo version need to be concerned in the service consumer list, and other configurations can also be stored persistently in the form of key-value. |
| These data are registered into the registration center in the dimension of service, which leads to the expansion of the data volume, which in turn leads to an increase in the network overhead of the registration center (such as zookeeper) and a decrease in performance.</p> |
| <h4 id="design-goals-and-objectives">Design goals and objectives</h4> |
| <p>It is desirable to simplify the number of provider and consumer configurations that go into the registry. |
| It is expected that some configuration items will be stored in other forms. These configuration items need to be satisfied: not on the service call link, and these configuration items are not on the core link of the registration center (service query, service list).</p> |
| <h4 id="configuration">Configuration</h4> |
| <p>Simplify the configuration of the registry, only supported in versions after 2.7. |
| After enabling provider or consumer to simplify the configuration, the default reserved configuration items are as follows:</p> |
| <p>provider:</p> |
| <table> |
| <thead> |
| <tr> |
| <th>Constant Key</th> |
| <th>Key</th> |
| <th>remark</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td>APPLICATION_KEY</td> |
| <td>application</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>CODEC_KEY</td> |
| <td>codec</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>EXCHANGER_KEY</td> |
| <td>exchanger</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>SERIALIZATION_KEY</td> |
| <td>serialization</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>CLUSTER_KEY</td> |
| <td>cluster</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>CONNECTIONS_KEY</td> |
| <td>connections</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>DEPRECATED_KEY</td> |
| <td>deprecated</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>GROUP_KEY</td> |
| <td>group</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>LOADBALANCE_KEY</td> |
| <td>loadbalance</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>MOCK_KEY</td> |
| <td>mock</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>PATH_KEY</td> |
| <td>path</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>TIMEOUT_KEY</td> |
| <td>timeout</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>TOKEN_KEY</td> |
| <td>token</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>VERSION_KEY</td> |
| <td>version</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>WARMUP_KEY</td> |
| <td>warmup</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>WEIGHT_KEY</td> |
| <td>weight</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>DUBBO_VERSION_KEY</td> |
| <td>dubbo</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>RELEASE_KEY</td> |
| <td>release</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>SIDE_KEY</td> |
| <td>side</td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <p>consumer:</p> |
| <table> |
| <thead> |
| <tr> |
| <th>Constant Key</th> |
| <th>Key</th> |
| <th>remark</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td>APPLICATION_KEY</td> |
| <td>application</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>VERSION_KEY</td> |
| <td>version</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>GROUP_KEY</td> |
| <td>group</td> |
| <td></td> |
| </tr> |
| <tr> |
| <td>DUBBO_VERSION_KEY</td> |
| <td>dubbo</td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <p>Constant Key represents a field from the class org.apache.dubbo.common.Constants.</p> |
| <p>The following introduces several commonly used methods. All samples, you can view <a href="https://github.com/dubbo/dubbo-samples/tree/master">sample-2.7</a></p> |
| <h2 id="scenes-to-be-used">scenes to be used</h2> |
| <p>A large amount of data leads to an increase in the network overhead of the registration center and a decrease in performance.</p> |
| <h2 id="how-to-use">How to use</h2> |
| <p><strong>EXISTING FUNCTIONALITY sample</strong> A simple demonstration of the current state of affairs. Through this demonstration, analyze why simplified configuration is needed.</p> |
| <p>Refer to the sample subproject: dubbo-samples-simplified-registry/dubbo-samples-simplified-registry-nosimple (before running the sample, first run ZKClean to clean up the configuration items)</p> |
| <h5 id="dubbo-providerxml-configuration">dubbo-provider.xml configuration:</h5> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>&lt;dubbo:application name=&#34;simplified-registry-nosimple-provider&#34;/&gt; |
| </span></span><span style="display:flex;"><span>&lt;dubbo:registry address=&#34;zookeeper://127.0.0.1:2181&#34;/&gt; |
| </span></span><span style="display:flex;"><span>&lt;bean id=&#34;demoService&#34; class=&#34;org.apache.dubbo.samples.simplified.registry.nosimple.impl.DemoServiceImpl&#34;/&gt; |
| </span></span><span style="display:flex;"><span>&lt;dubbo:service async=&#34;true&#34; interface=&#34;org.apache.dubbo.samples.simplified.registry.nosimple.api.DemoService&#34; |
| </span></span><span style="display:flex;"><span> version=&#34;1.2.3&#34; group=&#34;dubbo-simple&#34; ref=&#34;demoService&#34; |
| </span></span><span style="display:flex;"><span> executes=&#34;4500&#34; retries=&#34;7&#34; owner=&#34;vict&#34; timeout=&#34;5300&#34;/&gt; |
| </span></span></code></pre></div><p>After starting the provider&rsquo;s main method, view the content of the zookeeper leaf node (path: /dubbo/org.apache.dubbo.samples.simplified.registry.nosimple.api.DemoService/providers directory) as follows:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>dubbo%3A%2F%2F30.5.124.158%3A20880%2Forg.apache.dubbo.samples.simplified.registry.nosimple.api.DemoService |
| </span></span><span style="display:flex;"><span>%3Fanyhost%3Dtrue%26application%3Dsimplified-registry-xml-provider%26async%3Dtrue%26dubbo%3D |
| </span></span><span style="display:flex;"><span>2.0.2%26executes%3D4500%26generic%3Dfalse%26group%3Ddubbo-simple%26interface%3D |
| </span></span><span style="display:flex;"><span>org.apache.dubbo.samples.simplified.registry.nosimple.api.DemoService%26methods%3D |
| </span></span><span style="display:flex;"><span>sayHello%26owner%3Dvict%26pid%3D2767%26retries%3D7%26revision%3D1.2.3%26side%3D |
| </span></span><span style="display:flex;"><span>provider%26timeout%3D5300%26timestamp%3D1542361152795%26valid%3Dtrue%26version%3D1.2.3 |
| </span></span></code></pre></div><p>You can see that there are: <code>executes</code>, <code>retries</code>, <code>owner</code>, <code>timeout</code>. But not all these fields need to be passed to dubbo ops or dubbo consumer. Similarly, the consumer also has this problem, which can be viewed by starting the main method of the consumer in the example.</p> |
| <h3 id="method-1-configure-dubboproperties">Method 1. Configure dubbo.properties</h3> |
| <p>The sample is under the dubbo-samples-simplified-registry/dubbo-samples-simplified-registry-xml project (before running the sample, first run ZKClean to clean up the configuration items)</p> |
| <h5 id="dubboproperties">dubbo.properties</h5> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-properties" data-lang="properties"><span style="display:flex;"><span>dubbo.registry.simplified<span style="color:#719e07">=</span><span style="color:#2aa198">true</span> |
| </span></span><span style="display:flex;"><span>dubbo.registry.extra-keys<span style="color:#719e07">=</span><span style="color:#2aa198">retries,owner</span> |
| </span></span></code></pre></div><p>Compared with the <strong>existing function sample</strong> above, in the above sample, the four configuration items of executes, retries, owner, and timeout have all entered the registration center. But this example is not, the configuration is divided into:</p> |
| <ul> |
| <li>Configuration: dubbo.registry.simplified=true, by default, timeout is in the default configuration item list, so it will still enter the registry;</li> |
| <li>Configuration: dubbo.registry.extra-keys=retries,owner, so retries, owner will also enter the registry.</li> |
| </ul> |
| <p>configuration type:</p> |
| <ul> |
| <li>provider side configuration</li> |
| <li>consumer side configuration</li> |
| </ul> |
| <h4 id="provider-side-configuration">Provider side configuration:</h4> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;beans</span> xmlns:xsi=<span style="color:#2aa198">&#34;http://www.w3.org/2001/XMLSchema-instance&#34;</span> |
| </span></span><span style="display:flex;"><span> xmlns:dubbo=<span style="color:#2aa198">&#34;http://dubbo.apache.org/schema/dubbo&#34;</span> |
| </span></span><span style="display:flex;"><span> xmlns=<span style="color:#2aa198">&#34;http://www.springframework.org/schema/beans&#34;</span> |
| </span></span><span style="display:flex;"><span> xsi:schemaLocation=<span style="color:#2aa198">&#34;http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans-4.3.xsd |
| </span></span></span><span style="display:flex;"><span><span style="color:#2aa198"> http://dubbo.apache.org/schema/dubbo http://dubbo.apache.org/schema/dubbo/dubbo.xsd&#34;</span><span style="color:#268bd2">&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#586e75">&lt;!-- optional --&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;dubbo:application</span> name=<span style="color:#2aa198">&#34;simplified-registry-xml-provider&#34;</span><span style="color:#268bd2">/&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;dubbo:registry</span> address=<span style="color:#2aa198">&#34;zookeeper://127.0.0.1:2181&#34;</span><span style="color:#268bd2">/&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;bean</span> id=<span style="color:#2aa198">&#34;demoService&#34;</span> class=<span style="color:#2aa198">&#34;org.apache.dubbo.samples.simplified.registry.nosimple.impl.DemoServiceImpl&#34;</span><span style="color:#268bd2">/&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;dubbo:service</span> async=<span style="color:#2aa198">&#34;true&#34;</span> interface=<span style="color:#2aa198">&#34;org.apache.dubbo.samples.simplified.registry.nosimple.api.DemoService&#34;</span> version=<span style="color:#2aa198">&#34;1.2.3&#34;</span> group=<span style="color:#2aa198">&#34;dubbo-simple&#34;</span> |
| </span></span><span style="display:flex;"><span> ref=<span style="color:#2aa198">&#34;demoService&#34;</span> executes=<span style="color:#2aa198">&#34;4500&#34;</span> retries=<span style="color:#2aa198">&#34;7&#34;</span> owner=<span style="color:#2aa198">&#34;vict&#34;</span> timeout=<span style="color:#2aa198">&#34;5300&#34;</span><span style="color:#268bd2">/&gt;</span> |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">&lt;/beans&gt;</span> |
| </span></span></code></pre></div><p>Get the value of the leaf node of zookeeper:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>dubbo%3A%2F%2F30.5.124.149%3A20880%2Forg.apache.dubbo.samples.simplified.registry.nosimple.api.DemoService%3F |
| </span></span><span style="display:flex;"><span>application%3Dsimplified-registry-xml-provider%26dubbo%3D2.0.2%26group%3Ddubbo-simple%26owner%3D |
| </span></span><span style="display:flex;"><span>vict%26retries%3D7%26timeout%3D5300%26timestamp%3D1542594503305%26version%3D1.2.3 |
| </span></span></code></pre></div><h4 id="consumer-side-configuration">consumer side configuration</h4> |
| <ul> |
| <li>Configuration: dubbo.registry.simplified=true</li> |
| <li>Default: application, version, group, and dubbo are in the default configuration item list, so they will still enter the registration center.</li> |
| </ul> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;beans</span> xmlns:xsi=<span style="color:#2aa198">&#34;http://www.w3.org/2001/XMLSchema-instance&#34;</span> |
| </span></span><span style="display:flex;"><span> xmlns:dubbo=<span style="color:#2aa198">&#34;http://dubbo.apache.org/schema/dubbo&#34;</span> |
| </span></span><span style="display:flex;"><span> xmlns=<span style="color:#2aa198">&#34;http://www.springframework.org/schema/beans&#34;</span> |
| </span></span><span style="display:flex;"><span> xsi:schemaLocation=<span style="color:#2aa198">&#34;http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans-4.3.xsd |
| </span></span></span><span style="display:flex;"><span><span style="color:#2aa198"> http://dubbo.apache.org/schema/dubbo http://dubbo.apache.org/schema/dubbo/dubbo.xsd&#34;</span><span style="color:#268bd2">&gt;</span> |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> <span style="color:#586e75">&lt;!-- optional --&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;dubbo:application</span> name=<span style="color:#2aa198">&#34;simplified-registry-xml-consumer&#34;</span><span style="color:#268bd2">/&gt;</span> |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;dubbo:registry</span> address=<span style="color:#2aa198">&#34;zookeeper://127.0.0.1:2181&#34;</span> username=<span style="color:#2aa198">&#34;xxx&#34;</span> password=<span style="color:#2aa198">&#34;yyy&#34;</span> check=<span style="color:#2aa198">&#34;true&#34;</span><span style="color:#268bd2">/&gt;</span> |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;dubbo:reference</span> id=<span style="color:#2aa198">&#34;demoService&#34;</span> interface=<span style="color:#2aa198">&#34;org.apache.dubbo.samples.simplified.registry.nosimple.api.DemoService&#34;</span> |
| </span></span><span style="display:flex;"><span> owner=<span style="color:#2aa198">&#34;vvv&#34;</span> retries=<span style="color:#2aa198">&#34;4&#34;</span> actives=<span style="color:#2aa198">&#34;6&#34;</span> timeout=<span style="color:#2aa198">&#34;4500&#34;</span> version=<span style="color:#2aa198">&#34;1.2.3&#34;</span> group=<span style="color:#2aa198">&#34;dubbo-simple&#34;</span><span style="color:#268bd2">/&gt;</span> |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">&lt;/beans&gt;</span> |
| </span></span></code></pre></div><p>Get the value of the leaf node of zookeeper:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>consumer%3A%2F%2F30.5.124.149%2Forg.apache.dubbo.samples.simplified.registry.nosimple.api.DemoService%3F |
| </span></span><span style="display:flex;"><span>actives%3D6%26application%3Dsimplified-registry-xml-consumer%26category%3D |
| </span></span><span style="display:flex;"><span>consumers%26check%3Dfalse%26dubbo%3D2.0.2%26group%3Ddubbo-simple%26owner%3Dvvv%26version%3D1.2.3 |
| </span></span></code></pre></div><h3 id="method-2-configuration-declaration-spring-bean">Method 2. Configuration declaration spring bean</h3> |
| <p>The sample is under the dubbo-samples-simplified-registry/dubbo-samples-simplified-registry-annotation project (before running the sample, first run ZKClean to clean up the configuration items)</p> |
| <p>The effect of dubbo.properties in the above sample is the same.</p> |
| <ul> |
| <li>Default: timeout is in the default configuration item list, so it will still enter the registration center;</li> |
| <li>Configuration: retries, owner enter the registry as an additional key, so retries, owner will also enter the registry.</li> |
| </ul> |
| <p>configuration type:</p> |
| <p>-Provider configuration |
| -Consumer configuration</p> |
| <h4 id="provider-configuration">Provider configuration</h4> |
| <h5 id="private-side-bean-configuration">private side bean configuration:</h5> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-java" data-lang="java"><span style="display:flex;"><span><span style="color:#586e75">// Equivalent to dubbo.properties configuration, configured in the form of @Bean |
| </span></span></span><span style="display:flex;"><span><span style="color:#586e75"></span><span style="color:#268bd2">@Bean</span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">public</span> RegistryConfig <span style="color:#268bd2">registryConfig</span><span style="color:#719e07">()</span> <span style="color:#719e07">{</span> |
| </span></span><span style="display:flex;"><span> RegistryConfig registryConfig <span style="color:#719e07">=</span> <span style="color:#719e07">new</span> RegistryConfig<span style="color:#719e07">();</span> |
| </span></span><span style="display:flex;"><span> registryConfig<span style="color:#719e07">.</span>setAddress<span style="color:#719e07">(</span><span style="color:#2aa198">&#34;zookeeper://127.0.0.1:2181&#34;</span><span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> registryConfig<span style="color:#719e07">.</span>setSimplified<span style="color:#719e07">(</span><span style="color:#cb4b16">true</span><span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> registryConfig<span style="color:#719e07">.</span>setExtraKeys<span style="color:#719e07">(</span><span style="color:#2aa198">&#34;retries,owner&#34;</span><span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#719e07">return</span> registryConfig<span style="color:#719e07">;</span> |
| </span></span><span style="display:flex;"><span><span style="color:#719e07">}</span> |
| </span></span></code></pre></div><div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-java" data-lang="java"><span style="display:flex;"><span><span style="color:#586e75">// expose the service |
| </span></span></span><span style="display:flex;"><span><span style="color:#586e75"></span><span style="color:#268bd2">@Service</span><span style="color:#719e07">(</span>version <span style="color:#719e07">=</span> <span style="color:#2aa198">&#34;1.1.8&#34;</span><span style="color:#719e07">,</span> group <span style="color:#719e07">=</span> <span style="color:#2aa198">&#34;d-test&#34;</span><span style="color:#719e07">,</span> executes <span style="color:#719e07">=</span> 4500<span style="color:#719e07">,</span> retries <span style="color:#719e07">=</span> 7<span style="color:#719e07">,</span> owner <span style="color:#719e07">=</span> <span style="color:#2aa198">&#34;victanno&#34;</span><span style="color:#719e07">,</span> timeout <span style="color:#719e07">=</span> 5300<span style="color:#719e07">)</span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">public</span> <span style="color:#268bd2">class</span> <span style="color:#268bd2">AnnotationServiceImpl</span> <span style="color:#268bd2">implements</span> AnnotationService <span style="color:#719e07">{</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">@Override</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">public</span> String <span style="color:#268bd2">sayHello</span><span style="color:#719e07">(</span>String name<span style="color:#719e07">)</span> <span style="color:#719e07">{</span> |
| </span></span><span style="display:flex;"><span> System<span style="color:#719e07">.</span>out<span style="color:#719e07">.</span>println<span style="color:#719e07">(</span><span style="color:#2aa198">&#34;async provider received: &#34;</span> <span style="color:#719e07">+</span> name<span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#719e07">return</span> <span style="color:#2aa198">&#34;annotation: hello, &#34;</span> <span style="color:#719e07">+</span> name<span style="color:#719e07">;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#719e07">}</span> |
| </span></span><span style="display:flex;"><span><span style="color:#719e07">}</span> |
| </span></span></code></pre></div><h4 id="consumer-configuration">Consumer configuration</h4> |
| <p>It is the same as <strong>consumer side configuration</strong> in the sample above.</p> |
| <p>Default: application, version, group, and dubbo are in the default configuration item list, so they will still enter the registration center.</p> |
| <h5 id="consumer-side-bean-configuration">consumer side bean configuration:</h5> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-java" data-lang="java"><span style="display:flex;"><span><span style="color:#268bd2">@Bean</span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">public</span> RegistryConfig <span style="color:#268bd2">registryConfig</span><span style="color:#719e07">()</span> <span style="color:#719e07">{</span> |
| </span></span><span style="display:flex;"><span> RegistryConfig registryConfig <span style="color:#719e07">=</span> <span style="color:#719e07">new</span> RegistryConfig<span style="color:#719e07">();</span> |
| </span></span><span style="display:flex;"><span> registryConfig<span style="color:#719e07">.</span>setAddress<span style="color:#719e07">(</span><span style="color:#2aa198">&#34;zookeeper://127.0.0.1:2181&#34;</span><span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> registryConfig<span style="color:#719e07">.</span>setSimplified<span style="color:#719e07">(</span><span style="color:#cb4b16">true</span><span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#719e07">return</span> registryConfig<span style="color:#719e07">;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#719e07">}</span> |
| </span></span></code></pre></div><p>Consumer Services:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-java" data-lang="java"><span style="display:flex;"><span><span style="color:#268bd2">@Component</span><span style="color:#719e07">(</span><span style="color:#2aa198">&#34;annotationAction&#34;</span><span style="color:#719e07">)</span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">public</span> <span style="color:#268bd2">class</span> <span style="color:#268bd2">AnnotationAction</span> <span style="color:#719e07">{</span> |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">@Reference</span><span style="color:#719e07">(</span>version <span style="color:#719e07">=</span> <span style="color:#2aa198">&#34;1.1.8&#34;</span><span style="color:#719e07">,</span> group <span style="color:#719e07">=</span> <span style="color:#2aa198">&#34;d-test&#34;</span><span style="color:#719e07">,</span> owner <span style="color:#719e07">=</span> <span style="color:#2aa198">&#34;vvvanno&#34;</span><span style="color:#719e07">,</span> retries <span style="color:#719e07">=</span> 4<span style="color:#719e07">,</span> actives <span style="color:#719e07">=</span> 6<span style="color:#719e07">,</span> timeout <span style="color:#719e07">=</span> 4500<span style="color:#719e07">)</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">private</span> AnnotationService annotationService<span style="color:#719e07">;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">public</span> String <span style="color:#268bd2">doSayHello</span><span style="color:#719e07">(</span>String name<span style="color:#719e07">)</span> <span style="color:#719e07">{</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#719e07">return</span> annotationService<span style="color:#719e07">.</span>sayHello<span style="color:#719e07">(</span>name<span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#719e07">}</span> |
| </span></span><span style="display:flex;"><span><span style="color:#719e07">}</span> |
| </span></span></code></pre></div><h4 id="notice">Notice:</h4> |
| <p>If there are both provider and consumer in an application, the configuration needs to be merged into:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-java" data-lang="java"><span style="display:flex;"><span><span style="color:#268bd2">@Bean</span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">public</span> RegistryConfig <span style="color:#268bd2">registryConfig</span><span style="color:#719e07">()</span> <span style="color:#719e07">{</span> |
| </span></span><span style="display:flex;"><span> RegistryConfig registryConfig <span style="color:#719e07">=</span> <span style="color:#719e07">new</span> RegistryConfig<span style="color:#719e07">();</span> |
| </span></span><span style="display:flex;"><span> registryConfig<span style="color:#719e07">.</span>setAddress<span style="color:#719e07">(</span><span style="color:#2aa198">&#34;zookeeper://127.0.0.1:2181&#34;</span><span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> registryConfig<span style="color:#719e07">.</span>setSimplified<span style="color:#719e07">(</span><span style="color:#cb4b16">true</span><span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#586e75">//Only valid for provider |
| </span></span></span><span style="display:flex;"><span><span style="color:#586e75"></span> registryConfig<span style="color:#719e07">.</span>setExtraKeys<span style="color:#719e07">(</span><span style="color:#2aa198">&#34;retries,owner&#34;</span><span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#719e07">return</span> registryConfig<span style="color:#719e07">;</span> |
| </span></span><span style="display:flex;"><span><span style="color:#719e07">}</span> |
| </span></span></code></pre></div><h4 id="hint">hint:</h4> |
| <p>This version also retains a large number of configuration items, and in the next version, all configuration items will be gradually deleted.</p></description></item><item><title>Docs3-V2: Call Result Cache</title><link>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/result-cache/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/result-cache/</guid><description> |
| <h2 id="feature-description">Feature description</h2> |
| <h4 id="cache-type">cache type</h4> |
| <ul> |
| <li><code>lru</code> deletes redundant caches based on the least recently used principle, keeping the hottest data cached.</li> |
| <li><code>threadlocal</code> The current thread cache, such as a page rendering, uses many portals, and each portal needs to check user information. Through thread caching, this redundant access can be reduced.</li> |
| <li><code>jcache</code> integrates with <a href="http://jcp.org/en/jsr/detail?id=107%27">JSR107</a> to bridge various cache implementations.</li> |
| </ul> |
| <p>Cache Type Extensible <a href="../../../reference-manual/spi/description/cache">Cache Extensions</a></p> |
| <p>About <a href="https://github.com/apache/dubbo-samples/tree/master/2-advanced/dubbo-samples-cache">sample code</a></p> |
| <h2 id="scenes-to-be-used">scenes to be used</h2> |
| <p>The result cache is used to speed up access to popular data. Dubbo provides a declarative cache to reduce the workload of users adding cache.</p> |
| <h2 id="how-to-use">How to use</h2> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:reference</span> interface=<span style="color:#2aa198">&#34;com.foo.BarService&#34;</span> cache=<span style="color:#2aa198">&#34;lru&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><p>or:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:reference</span> interface=<span style="color:#2aa198">&#34;com.foo.BarService&#34;</span><span style="color:#268bd2">&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;dubbo:method</span> name=<span style="color:#2aa198">&#34;findBar&#34;</span> cache=<span style="color:#2aa198">&#34;lru&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">&lt;/dubbo:reference&gt;</span> |
| </span></span></code></pre></div></description></item><item><title>Docs3-V2: Concurrency Control</title><link>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/concurrency-control/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/concurrency-control/</guid><description> |
| <h2 id="configuration-example">Configuration example</h2> |
| <h3 id="example-1">Example 1</h3> |
| <p>To limit each method of <code>com.foo.BarService</code>, the concurrent execution on the server side (or the number of threads in the thread pool) cannot exceed 10:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:service</span> interface=<span style="color:#2aa198">&#34;com.foo.BarService&#34;</span> executes=<span style="color:#2aa198">&#34;10&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><h3 id="example-2">Example 2</h3> |
| <p>To limit the <code>sayHello</code> method of <code>com.foo.BarService</code>, the concurrent execution on the server side (or the number of threads in the thread pool) cannot exceed 10:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:service</span> interface=<span style="color:#2aa198">&#34;com.foo.BarService&#34;</span><span style="color:#268bd2">&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;dubbo:method</span> name=<span style="color:#2aa198">&#34;sayHello&#34;</span> executes=<span style="color:#2aa198">&#34;10&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">&lt;/dubbo:service&gt;</span> |
| </span></span></code></pre></div><h3 id="example-3">Example 3</h3> |
| <p>Limit each method of <code>com.foo.BarService</code> to no more than 10 concurrent executions per client (or the number of requests occupying a connection):</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:service</span> interface=<span style="color:#2aa198">&#34;com.foo.BarService&#34;</span> actives=<span style="color:#2aa198">&#34;10&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><p>or</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:reference</span> interface=<span style="color:#2aa198">&#34;com.foo.BarService&#34;</span> actives=<span style="color:#2aa198">&#34;10&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><h3 id="example-4">Example 4</h3> |
| <p>Limit the <code>sayHello</code> method of <code>com.foo.BarService</code> to no more than 10 concurrent executions (or the number of requests that occupy a connection) per client:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:service</span> interface=<span style="color:#2aa198">&#34;com.foo.BarService&#34;</span><span style="color:#268bd2">&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;dubbo:method</span> name=<span style="color:#2aa198">&#34;sayHello&#34;</span> actives=<span style="color:#2aa198">&#34;10&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">&lt;/dubbo:service&gt;</span> |
| </span></span></code></pre></div><p>or</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:reference</span> interface=<span style="color:#2aa198">&#34;com.foo.BarService&#34;</span><span style="color:#268bd2">&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;dubbo:method</span> name=<span style="color:#2aa198">&#34;sayHello&#34;</span> actives=<span style="color:#2aa198">&#34;10&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">&lt;/dubbo:service&gt;</span> |
| </span></span></code></pre></div><p>If both <code>&lt;dubbo:service&gt;</code> and <code>&lt;dubbo:reference&gt;</code> are configured with actives, <code>&lt;dubbo:reference&gt;</code> takes precedence, see: [Configuration override strategy](../../../reference- manual/config/principle/).</p> |
| <h2 id="load-balance">Load Balance</h2> |
| <p>The <code>loadbalance</code> attribute of the client side of the configuration service is <code>leastactive</code>, and this Loadbalance will call the Provider with the smallest number of concurrency (Consumer-side concurrency).</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:reference</span> interface=<span style="color:#2aa198">&#34;com.foo.BarService&#34;</span> loadbalance=<span style="color:#2aa198">&#34;leastactive&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><p>or</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:service</span> interface=<span style="color:#2aa198">&#34;com.foo.BarService&#34;</span> loadbalance=<span style="color:#2aa198">&#34;leastactive&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div></description></item><item><title>Docs3-V2: Connection Control</title><link>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/config-connections/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/config-connections/</guid><description> |
| <h2 id="feature-description">Feature description</h2> |
| <h2 id="scenes-to-be-used">scenes to be used</h2> |
| <h2 id="how-to-use">How to use</h2> |
| <h3 id="server-connection-control">Server connection control</h3> |
| <p>Limit the number of connections accepted by the server to no more than 10 <sup id="fnref:1"><a href="#fn:1" class="footnote-ref" role="doc-noteref">1</a></sup>:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:provider</span> protocol=<span style="color:#2aa198">&#34;dubbo&#34;</span> accepts=<span style="color:#2aa198">&#34;10&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><p>or</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:protocol</span> name=<span style="color:#2aa198">&#34;dubbo&#34;</span> accepts=<span style="color:#2aa198">&#34;10&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><h3 id="client-connection-control">Client connection control</h3> |
| <p>Limit the client service to use no more than 10 connections <sup id="fnref:2"><a href="#fn:2" class="footnote-ref" role="doc-noteref">2</a></sup>:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:reference</span> interface=<span style="color:#2aa198">&#34;com.foo.BarService&#34;</span> connections=<span style="color:#2aa198">&#34;10&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><p>or</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:service</span> interface=<span style="color:#2aa198">&#34;com.foo.BarService&#34;</span> connections=<span style="color:#2aa198">&#34;10&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><p>If both <code>&lt;dubbo:service&gt;</code> and <code>&lt;dubbo:reference&gt;</code> are configured with connections, <code>&lt;dubbo:reference&gt;</code> takes precedence, see: [Configuration override strategy](../../../reference- manual/config/principle/)</p> |
| <div class="footnotes" role="doc-endnotes"> |
| <hr> |
| <ol> |
| <li id="fn:1"> |
| <p>Because it is connected to the Server, it is configured on the Provider&#160;<a href="#fnref:1" class="footnote-backref" role="doc-backlink">&#x21a9;&#xfe0e;</a></p> |
| </li> |
| <li id="fn:2"> |
| <p>If it is a long connection, such as the Dubbo protocol, connections indicates the number of long connections established by the service for each provider&#160;<a href="#fnref:2" class="footnote-backref" role="doc-backlink">&#x21a9;&#xfe0e;</a></p> |
| </li> |
| </ol> |
| </div></description></item><item><title>Docs3-V2: Delayed Connection</title><link>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/lazy-connect/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/lazy-connect/</guid><description> |
| <h2 id="feature-description">Feature description</h2> |
| <h2 id="scenes-to-be-used">scenes to be used</h2> |
| <p>Delayed connections are used to reduce the number of long connections. When a call is initiated, create a persistent connection.</p> |
| <h2 id="how-to-use">How to use</h2> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:protocol</span> name=<span style="color:#2aa198">&#34;dubbo&#34;</span> lazy=<span style="color:#2aa198">&#34;true&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><blockquote> |
| <p>This configuration is only valid for the dubbo protocol that uses long connections.</p> |
| </blockquote></description></item><item><title>Docs3-V2: Stick Connection</title><link>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/stickiness/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/stickiness/</guid><description> |
| <h2 id="feature-description">Feature description</h2> |
| <h2 id="scenes-to-be-used">scenes to be used</h2> |
| <p>Sticky connections are used for stateful services, so that the client always initiates calls to the same provider as much as possible, unless the provider hangs up and connects to another one.</p> |
| <p>Sticky connection will automatically enable <a href="../lazy-connect">Delayed Connection</a> to reduce the number of long connections.</p> |
| <h2 id="how-to-use">How to use</h2> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:reference</span> id=<span style="color:#2aa198">&#34;xxxService&#34;</span> interface=<span style="color:#2aa198">&#34;com.xxx.XxxService&#34;</span> sticky=<span style="color:#2aa198">&#34;true&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><p>Dubbo supports method-level sticky connections, if you want more fine-grained control, you can also configure it like this.</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:reference</span> id=<span style="color:#2aa198">&#34;xxxService&#34;</span> interface=<span style="color:#2aa198">&#34;com.xxx.XxxService&#34;</span><span style="color:#268bd2">&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;dubbo:method</span> name=<span style="color:#2aa198">&#34;sayHello&#34;</span> sticky=<span style="color:#2aa198">&#34;true&#34;</span> <span style="color:#268bd2">/&gt;</span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">&lt;/dubbo:reference&gt;</span> |
| </span></span></code></pre></div></description></item><item><title>Docs3-V2: Support Graal VM</title><link>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/support-graalvm/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/support-graalvm/</guid><description> |
| <p>dubbo3.0 supports native-image document</p> |
| <h2 id="feature-description">Feature description</h2> |
| <p>This document will introduce the process of connecting dubbo3.0 project to GraalVM and compiling native-image into binary.</p> |
| <p>More information about GraalVm can be read <a href="https://www.graalvm.org/docs/getting-started/container-images/">https://www.graalvm.org/docs/getting-started/container-images/</a> this document.</p> |
| <h2 id="scenes-to-be-used">scenes to be used</h2> |
| <h2 id="how-to-use">How to use</h2> |
| <p>Before compiling our dubbo project, we need to make sure that we are based on the graalVm environment.</p> |
| <h3 id="install-graalvm">Install GraalVM</h3> |
| <p>Go to <a href="https://www.graalvm.org/">https://www.graalvm.org/</a> official website and select the latest version to install according to your own system:</p> |
| <p><img src="https://dubbo.apache.org/imgs/blog/dubbo3.0-graalvm-support/graalvmgw.jpg" alt="img"></p> |
| <p>After the installation is complete, modify the path to configure JAVA_HOME, and check the local jdk after it takes effect, you can see the following:</p> |
| <p><img src="https://dubbo.apache.org/imgs/blog/dubbo3.0-graalvm-support/graalvm_env.jpg" alt="img"> |
| Here we use GraalVM based on jdk1.8 version.</p> |
| <ul> |
| <li>To install native-image, just execute gu install native-image.</li> |
| </ul> |
| <ol> |
| <li>Pull the dubbo code and switch to the <a href="https://github.com/apache/dubbo">apache:3.0</a> branch.</li> |
| <li>Manually execute the generated SPI code.</li> |
| </ol> |
| <p>Since the current compilation of native-image does not support code dynamic generation and compilation, the part related to code dynamic generation needs to be generated manually. Here is a tool function:</p> |
| <p><img src="https://dubbo.apache.org/imgs/blog/dubbo3.0-graalvm-support/code_generator.jpg" alt="img"> |
| Execute CodeGenerator to generate SPI code under the dubbo-native module.</p> |
| <h3 id="execute-install-in-the-root-directory">Execute install in the root directory</h3> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-go" data-lang="go"><span style="display:flex;"><span>MacdeMacBook<span style="color:#719e07">-</span>pro<span style="color:#719e07">-</span><span style="color:#2aa198">3</span>:incubator<span style="color:#719e07">-</span>dubbo mac$ pwd |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span><span style="color:#719e07">/</span>Users<span style="color:#719e07">/</span>mac<span style="color:#719e07">/</span>Documents<span style="color:#719e07">/</span>Mi<span style="color:#719e07">/</span>project<span style="color:#719e07">/</span>incubator<span style="color:#719e07">-</span>dubbo |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>MacdeMacBook<span style="color:#719e07">-</span>pro<span style="color:#719e07">-</span><span style="color:#2aa198">3</span>:incubator<span style="color:#719e07">-</span>dubbo mac$ mvn clean <span style="color:#719e07">package</span> install <span style="color:#719e07">-</span>Dmaven.test.skip=<span style="color:#cb4b16">true</span> |
| </span></span></code></pre></div><h3 id="compile-the-demo-project">Compile the demo project</h3> |
| <p>Here we provide a sample project that can be directly compiled, dubbo-demo/dubbo-demo-native. After the above steps are installed, first go to the provider of dubbo-demo-native and execute native-image compilation:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-go" data-lang="go"><span style="display:flex;"><span> mvn clean <span style="color:#719e07">package</span> <span style="color:#719e07">-</span>P native <span style="color:#719e07">-</span>Dmaven.test.skip=<span style="color:#cb4b16">true</span> |
| </span></span></code></pre></div><p>Here, since we have introduced the native-image plug-in in maven, the plug-in can be executed directly -P native.</p> |
| <p><img src="https://dubbo.apache.org/imgs/blog/dubbo3.0-graalvm-support/native_image_build.jpg" alt="img"> |
| After the compilation is successful, you can see the generated binary file under the target, start a zookeeper locally, and execute the binary directly. It can be seen that the startup is successful as follows:</p> |
| <p><img src="https://dubbo.apache.org/imgs/blog/dubbo3.0-graalvm-support/run_provider.jpg" alt="img"> |
| The consumer side also executes compilation, and a binary file is also generated under the consumer target: demo-native-consumer. Execute this binary and you can see the result of the call as follows:</p> |
| <p><img src="https://dubbo.apache.org/imgs/blog/dubbo3.0-graalvm-support/run_consumer.jpg" alt="img"></p> |
| <h3 id="specific-steps">Specific steps</h3> |
| <p>In fact, we have done some work under this demo to ensure that the project can be compiled and executed. There are mainly the following steps</p> |
| <ul> |
| <li>Introduce dubbo-native dependency</li> |
| </ul> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>&lt;dependency&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;groupId&gt;org.apache.dubbo&lt;/groupId&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;artifactId&gt;dubbo-native&lt;/artifactId&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;version&gt;${project.version}&lt;/version&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>&lt;/dependency&gt; |
| </span></span></code></pre></div><p>Under this module is the SPI code we generated.</p> |
| <ul> |
| <li>Introduce native-image plugin</li> |
| </ul> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>&lt;plugin&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;groupId&gt;org.graalvm.nativeimage&lt;/groupId&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;artifactId&gt;native-image-maven-plugin&lt;/artifactId&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;version&gt;21.0.0.2&lt;/version&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;executions&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;execution&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;goals&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;goal&gt;native-image&lt;/goal&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;/goals&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;phase&gt;package&lt;/phase&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;/execution&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;/executions&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;configuration&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;skip&gt;false&lt;/skip&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;imageName&gt;demo-native-provider&lt;/imageName&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;mainClass&gt;org.apache.dubbo.demo.graalvm.provider.Application&lt;/mainClass&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;buildArgs&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --no-fallback |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-build-time=org.slf4j.MDC |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-build-time=org.slf4j.LoggerFactory |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-build-time=org.slf4j.impl.StaticLoggerBinder |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-build-time=org.apache.log4j.helpers.Loader |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-build-time=org.apache.log4j.Logger |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-build-time=org.apache.log4j.helpers.LogLog |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-build-time=org.apache.log4j.LogManager |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-build-time=org.apache.log4j.spi.LoggingEvent |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-build-time=org.slf4j.impl.Log4jLoggerFactory |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-build-time=org.slf4j.impl.Log4jLoggerAdapter |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-build-time=org.eclipse.collections.api.factory.Sets |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-run-time=io.netty.channel.epoll.Epoll |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-run-time=io.netty.channel.epoll.Native |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-run-time=io.netty.channel.epoll.EpollEventLoop |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-run-time=io.netty.channel.epoll.EpollEventArray |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-run-time=io.netty.channel.DefaultFileRegion |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-run-time=io.netty.channel.kqueue.KQueueEventArray |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-run-time=io.netty.channel.kqueue.KQueueEventLoop |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-run-time=io.netty.channel.kqueue.Native |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-run-time=io.netty.channel.unix.Errors |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-run-time=io.netty.channel.unix.IovArray |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-run-time=io.netty.channel.unix.Limits |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-run-time=io.netty.util.internal.logging.Log4JLogger |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-run-time=io.netty.channel.unix.Socket |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --initialize-at-run-time=io.netty.channel.ChannelHandlerMask |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --report-unsupported-elements-at-runtime |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --allow-incomplete-classpath |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> --enable-url-protocols=http |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> -H:+ReportExceptionStackTraces |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;/buildArgs&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> &lt;/configuration&gt; |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span>&lt;/plugin&gt; |
| </span></span></code></pre></div><p>It defines the name of the generated image and some parameters for building the image.</p> |
| <ul> |
| <li>mount native-image-agent</li> |
| </ul> |
| <p>Since we need to specify some reflection, JNI and other classes first, we need to use the agent to run it in a normal way to generate information in the form of json for these classes.</p> |
| <p>In the startup parameters add:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>-agentlib:native-image-agent=config-output-dir=/tmp/config/,config-write-period-secs=300,config-write-initial-delay-secs=5 |
| </span></span></code></pre></div><p>Start in the normal way, create a folder META-INF.native-image under the resources of the project, and paste the files generated in the local directory:</p> |
| <p><img src="https://dubbo.apache.org/imgs/blog/dubbo3.0-graalvm-support/resources.jpg" alt="img"> |
| (There may be missing class information that is not generated, which needs to be added manually according to the error message when compiling or running.)</p> |
| <p>** After completing the above steps, the project can be compiled. **</p></description></item><item><title>Docs3-V2: Export thread stack</title><link>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/dump/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/dump/</guid><description> |
| <h2 id="feature-description">Feature description</h2> |
| <p>Dubbo automatically exports the thread stack through Jstack to keep the scene, which is convenient for troubleshooting.</p> |
| <p>default policy</p> |
| <ul> |
| <li>Export path: the user&rsquo;s home directory identified by user.home</li> |
| <li>Export Interval: The shortest interval allows an export every 10 minutes</li> |
| <li>Export switch: open by default</li> |
| </ul> |
| <h2 id="scenes-to-be-used">scenes to be used</h2> |
| <p>When the business thread pool is full, we need to know which resources and conditions the threads are waiting for in order to find the bottleneck or abnormal point of the system.</p> |
| <h2 id="how-to-use">How to use</h2> |
| <h3 id="export-switch-control">Export switch control</h3> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-properties" data-lang="properties"><span style="display:flex;"><span><span style="color:#586e75"># dubbo.properties</span> |
| </span></span><span style="display:flex;"><span>dubbo.application.dump.enable<span style="color:#719e07">=</span><span style="color:#2aa198">true</span> |
| </span></span></code></pre></div><div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:application</span> name=<span style="color:#2aa198">&#34;demo-provider&#34;</span> dump-enable=<span style="color:#2aa198">&#34;false&#34;</span><span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-yaml" data-lang="yaml"><span style="display:flex;"><span><span style="color:#268bd2">dubbo</span>: |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">application</span>: |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">name</span>: dubbo-springboot-demo-provider |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">dump-enable</span>: <span style="color:#cb4b16">false</span> |
| </span></span></code></pre></div><h3 id="specify-the-export-path">Specify the export path</h3> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-properties" data-lang="properties"><span style="display:flex;"><span><span style="color:#586e75"># dubbo.properties</span> |
| </span></span><span style="display:flex;"><span>dubbo.application.dump.directory<span style="color:#719e07">=</span><span style="color:#2aa198">/tmp</span> |
| </span></span></code></pre></div><div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:application</span> name=<span style="color:#2aa198">&#34;demo-provider&#34;</span> dump-directory=<span style="color:#2aa198">&#34;/tmp&#34;</span><span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-yaml" data-lang="yaml"><span style="display:flex;"><span><span style="color:#268bd2">dubbo</span>: |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">application</span>: |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">name</span>: dubbo-springboot-demo-provider |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">dump-directory</span>: /tmp |
| </span></span></code></pre></div></description></item><item><title>Docs3-V2: Kryo and FST Serialization</title><link>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/serialization/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://dubbo.apache.org/en/docs3-v2/java-sdk/advanced-features-and-usage/performance/serialization/</guid><description> |
| <h2 id="table-of-contents">Table of contents</h2> |
| <ul> |
| <li>Serialization talk</li> |
| <li>Enable Kryo and FST</li> |
| <li>Register the class to be serialized</li> |
| <li>No parameter constructor and Serializable interface</li> |
| <li>Serialization performance analysis and testing |
| <ul> |
| <li>test environment</li> |
| <li>Test script</li> |
| <li>Comparison of byte sizes generated by different serializations in Dubbo RPC</li> |
| <li>Comparison of response time and throughput of different serializations in Dubbo RPC</li> |
| </ul> |
| </li> |
| <li>future</li> |
| </ul> |
| <h2 id="serialization-talk">Serialization talk</h2> |
| <p>dubbo RPC is the core high-performance, high-throughput remote call method in the dubbo system. I like to call it a multiplexed TCP long connection call. Simply put:</p> |
| <ul> |
| <li>Long connection: avoiding the need to create a new TCP connection each time, improving the response speed of the call</li> |
| <li>Multiplexing: A single TCP connection can alternately transmit multiple request and response messages, reducing the waiting idle time of the connection, thereby reducing the number of network connections under the same concurrent number and improving system throughput.</li> |
| </ul> |
| <p>dubbo RPC is mainly used for remote calls between two dubbo systems, especially suitable for Internet scenarios with high concurrency and small data.</p> |
| <p>Serialization also plays a vital role in the response speed, throughput, and network bandwidth consumption of remote calls, and is one of the most critical factors for us to improve the performance of distributed systems.</p> |
| <p>In dubbo RPC, multiple serialization methods are supported at the same time, for example:</p> |
| <ol> |
| <li>Dubbo serialization: Ali has not yet developed a mature and efficient java serialization implementation, and Ali does not recommend using it in a production environment</li> |
| <li>Hessian2 serialization: Hessian is a cross-language efficient binary serialization method. But here is actually not the original hessian2 serialization, but the hessian lite modified by Ali, which is the default serialization method enabled by dubbo RPC</li> |
| <li>JSON serialization: There are currently two implementations, one is to use Ali&rsquo;s fastjson library, and the other is to use the simple json library implemented by dubbo, but the implementation is not particularly mature, and the text sequence of json The serialization performance is generally not as good as the above two binary serializations.</li> |
| <li>Java serialization: It is mainly implemented by using the Java serialization that comes with the JDK, and the performance is not ideal.</li> |
| </ol> |
| <p>In general, the performance of the four main serialization methods decreases from top to bottom. For dubbo RPC, which pursues high-performance remote calls, there are actually only two high-efficiency serialization methods, 1 and 2, that are more suitable, and the first dubbo serialization is still immature, so only 2 is actually available. So dubbo RPC uses hessian2 serialization by default.</p> |
| <p>But hessian is an older serialization implementation, and it is cross-language, so it is not optimized for java alone. In fact, dubbo RPC is a remote call from Java to Java. In fact, there is no need to adopt cross-language serialization (of course, cross-language serialization is certainly not excluded).</p> |
| <p>In recent years, various new efficient serialization methods have emerged one after another, constantly refreshing the upper limit of serialization performance, the most typical ones include:</p> |
| <ul> |
| <li>Specifically for the Java language: Kryo, FST, etc.</li> |
| <li>Cross-language: Protostuff, ProtoBuf, Thrift, Avro, MsgPack, etc.</li> |
| </ul> |
| <p>The performance of most of these serialization methods is significantly better than hessian2 (even including the immature dubbo serialization).</p> |
| <p>In view of this, we introduce two efficient Java serialization implementations, Kryo and FST, for dubbo to gradually replace hessian2.</p> |
| <p>Among them, Kryo is a very mature serialization implementation, which has been widely used in Twitter, Groupon, Yahoo and many famous open source projects (such as Hive and Storm). While FST is a newer serialization implementation, it still lacks enough mature use cases, but I think it is still very promising.</p> |
| <p>In production-oriented applications, I recommend Kryo as the preferred choice for now.</p> |
| <h2 id="enable-kryo-and-fst">Enable Kryo and FST</h2> |
| <p>Using Kryo and FST is very simple, just add the corresponding dependencies first: |
| More plugins: <a href="https://dubbo.apache.org/zh-cn/download/spi-extensions">Dubbo SPI Extensions</a></p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dependency&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;groupId&gt;</span>org.apache.dubbo.extensions<span style="color:#268bd2">&lt;/groupId&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;artifactId&gt;</span>dubbo-serialization-kryo<span style="color:#268bd2">&lt;/artifactId&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;version&gt;</span>1.0.0<span style="color:#268bd2">&lt;/version&gt;</span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">&lt;/dependency&gt;</span> |
| </span></span></code></pre></div><div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dependency&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;groupId&gt;</span>org.apache.dubbo.extensions<span style="color:#268bd2">&lt;/groupId&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;artifactId&gt;</span>dubbo-serialization-fst<span style="color:#268bd2">&lt;/artifactId&gt;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">&lt;version&gt;</span>1.0.0<span style="color:#268bd2">&lt;/version&gt;</span> |
| </span></span><span style="display:flex;"><span><span style="color:#268bd2">&lt;/dependency&gt;</span> |
| </span></span></code></pre></div><p>Then add an attribute in the XML configuration of dubbo RPC:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:protocol</span> name=<span style="color:#2aa198">&#34;dubbo&#34;</span> serialization=<span style="color:#2aa198">&#34;kryo&#34;</span><span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:protocol</span> name=<span style="color:#2aa198">&#34;dubbo&#34;</span> serialization=<span style="color:#2aa198">&#34;fst&#34;</span><span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><h2 id="register-the-class-to-be-serialized">Register the class to be serialized</h2> |
| <p>To make Kryo and FST fully perform with high performance, it is best to register those classes that need to be serialized in the dubbo system. For example, we can implement the following callback interface:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-java" data-lang="java"><span style="display:flex;"><span><span style="color:#268bd2">public</span> <span style="color:#268bd2">class</span> <span style="color:#268bd2">SerializationOptimizerImpl</span> <span style="color:#268bd2">implements</span> SerializationOptimizer <span style="color:#719e07">{</span> |
| </span></span><span style="display:flex;"><span> |
| </span></span><span style="display:flex;"><span> <span style="color:#268bd2">public</span> Collection<span style="color:#719e07">&lt;</span>Class<span style="color:#719e07">&gt;</span> <span style="color:#268bd2">getSerializableClasses</span><span style="color:#719e07">()</span> <span style="color:#719e07">{</span> |
| </span></span><span style="display:flex;"><span> List<span style="color:#719e07">&lt;</span>Class<span style="color:#719e07">&gt;</span> classes <span style="color:#719e07">=</span> <span style="color:#719e07">new</span> LinkedList<span style="color:#719e07">&lt;</span>Class<span style="color:#719e07">&gt;();</span> |
| </span></span><span style="display:flex;"><span> classes<span style="color:#719e07">.</span>add<span style="color:#719e07">(</span>BidRequest<span style="color:#719e07">.</span>class<span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> classes<span style="color:#719e07">.</span> <span style="color:#268bd2">add</span><span style="color:#719e07">(</span>BidResponse<span style="color:#719e07">.</span> class<span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> classes<span style="color:#719e07">.</span> <span style="color:#268bd2">add</span><span style="color:#719e07">(</span>Device<span style="color:#719e07">.</span> class<span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> classes<span style="color:#719e07">.</span> <span style="color:#268bd2">add</span><span style="color:#719e07">(</span>Geo<span style="color:#719e07">.</span> class<span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> classes<span style="color:#719e07">.</span> <span style="color:#268bd2">add</span><span style="color:#719e07">(</span>Impression<span style="color:#719e07">.</span> class<span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> classes<span style="color:#719e07">.</span>add<span style="color:#719e07">(</span>SeatBid<span style="color:#719e07">.</span>class<span style="color:#719e07">);</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#719e07">return</span> classes<span style="color:#719e07">;</span> |
| </span></span><span style="display:flex;"><span> <span style="color:#719e07">}</span> |
| </span></span><span style="display:flex;"><span><span style="color:#719e07">}</span> |
| </span></span></code></pre></div><p>Then add in XML configuration:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-xml" data-lang="xml"><span style="display:flex;"><span><span style="color:#268bd2">&lt;dubbo:protocol</span> name=<span style="color:#2aa198">&#34;dubbo&#34;</span> serialization=<span style="color:#2aa198">&#34;kryo&#34;</span> optimizer=<span style="color:#2aa198">&#34;org.apache.dubbo.demo.SerializationOptimizerImpl&#34;</span><span style="color:#268bd2">/&gt;</span> |
| </span></span></code></pre></div><p>After registering these classes, serialization performance may be greatly improved, especially for small numbers of nested objects.</p> |
| <p>Of course, when serializing a class, many classes may be cascaded, such as Java collection classes. In response to this situation, we have automatically registered common classes in the JDK, so you don&rsquo;t need to register them repeatedly (of course, there is no effect if you register repeatedly), including:</p> |
| <div class="highlight"><pre tabindex="0" style="color:#93a1a1;background-color:#002b36;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-fallback" data-lang="fallback"><span style="display:flex;"><span>Gregorian Calendar |
| </span></span><span style="display:flex;"><span>InvocationHandler |
| </span></span><span style="display:flex;"><span>BigDecimal |
| </span></span><span style="display:flex;"><span>BigInteger |
| </span></span><span style="display:flex;"><span>pattern |
| </span></span><span style="display:flex;"><span>BitSet |
| </span></span><span style="display:flex;"><span>URIs |
| </span></span><span style="display:flex;"><span>UUID |
| </span></span><span style="display:flex;"><span>HashMap |
| </span></span><span style="display:flex;"><span>ArrayList |
| </span></span><span style="display:flex;"><span>LinkedList |
| </span></span><span style="display:flex;"><span>HashSet |
| </span></span><span style="display:flex;"><span>TreeSet |
| </span></span><span style="display:flex;"><span>Hashtable |
| </span></span><span style="display:flex;"><span>date |
| </span></span><span style="display:flex;"><span>Calendar |
| </span></span><span style="display:flex;"><span>ConcurrentHashMap |
| </span></span><span style="display:flex;"><span>SimpleDateFormat |
| </span></span><span style="display:flex;"><span>vector |
| </span></span><span style="display:flex;"><span>BitSet |
| </span></span><span style="display:flex;"><span>StringBuffer |
| </span></span><span style="display:flex;"><span>String Builder |
| </span></span><span style="display:flex;"><span>object |
| </span></span><span style="display:flex;"><span>Object[] |
| </span></span><span style="display:flex;"><span>String[] |
| </span></span><span style="display:flex;"><span>byte[] |
| </span></span><span style="display:flex;"><span>char[] |
| </span></span><span style="display:flex;"><span>int[] |
| </span></span><span style="display:flex;"><span>float[] |
| </span></span><span style="display:flex;"><span>double[] |
| </span></span></code></pre></div><p>Since registering classes to be serialized is only for performance optimization purposes, it doesn&rsquo;t matter if you forget to register some classes. In fact, even without registering any classes, the performance of Kryo and FST is generally better than that of hessian and dubbo serialization.</p> |
| <blockquote> |
| <p>Of course, someone may ask why not use configuration files to register these classes? This is because there are often a large number of classes to be registered, resulting in lengthy configuration files; and without good IDE support, writing and refactoring configuration files are much more troublesome than java classes; finally, these registered classes are generally It is not necessary to make dynamic modifications after the project is compiled and packaged.</p> |
| </blockquote> |
| <blockquote> |
| <p>In addition, some people will also think that manually registering the serialized class is a relatively cumbersome work, can it be marked with annotation, and then the system will automatically discover and register. But the limitation of annotation here is that it can only be used to mark classes that you can modify, and many classes referenced in serialization are likely to be things that you cannot modify (such as third-party libraries or JDK system classes or classes of other projects ). In addition, adding annotation after all slightly &ldquo;polluted&rdquo; the code, making the application code a little bit more dependent on the framework.</p> |
| </blockquote> |
| <blockquote> |
| <p>In addition to annotation, we can also consider other ways to automatically register serialized classes, such as scanning the class path, automatically discovering classes that implement the Serializable interface (even including Externalizable) and registering them. Of course, we know that there may be a lot of Serializable classes on the classpath, so we can also consider using package prefixes to limit the scanning range to a certain extent.</p> |
| </blockquote> |
| <blockquote> |
| <p>Of course, in the automatic registration mechanism, it is especially necessary to consider how to ensure that both the service provider and the consumer register classes in the same order (or ID) to avoid misalignment. After all, the number of classes that can be discovered and registered at both ends may be the same. are different.</p> |
| </blockquote> |
| <h2 id="no-parameter-constructor-and-serializable-interface">No parameter constructor and Serializable interface</h2> |
| <p>If the class to be serialized does not contain a parameterless constructor, the performance of Kryo&rsquo;s serialization will be greatly reduced, because at this time we will use Java&rsquo;s serialization to transparently replace Kryo&rsquo;s serialization at the bottom layer. Therefore, it is a best practice to add a no-argument constructor for each serialized class as much as possible (of course, if a java class does not customize a constructor, it will have a no-argument constructor by default).</p> |
| <p>In addition, Kryo and FST do not require the serialized class to implement the Serializable interface, but we still recommend that every serialized class implement it, because this can maintain compatibility with Java serialization and dubbo serialization. In addition It also makes it possible for us to adopt some of the above automatic registration mechanisms in the future.</p> |
| <h2 id="serialization-performance-analysis-and-testing">Serialization performance analysis and testing</h2> |
| <p>In this article, we mainly discuss serialization, but when doing performance analysis and testing, we do not deal with each serialization method separately, but put them in dubbo RPC for comparison, because this is more realistic.</p> |
| <h3 id="test-environment">test environment</h3> |
| <p>Roughly as follows:</p> |
| <ul> |
| <li>Two independent servers</li> |
| <li>Quad-core Intel(R) Xeon(R) CPU E5-2603 0 @ 1.80GHz</li> |
| <li>8G memory</li> |
| <li>The network between virtual machines passes through a 100M switch</li> |
| <li>CentOS 5</li> |
| <li>JDK 7</li> |
| <li>Tomcat 7</li> |
| <li>JVM parameters -server -Xms1g -Xmx1g -XX:PermSize=64M -XX:+UseConcMarkSweepGC</li> |
| </ul> |
| <p>Of course, the test environment is limited, so the current test results may not be very authoritative and representative.</p> |
| <h3 id="test-script">Test script</h3> |
| <p>Keeping close to dubbo&rsquo;s own benchmarks:</p> |
| <p>10 concurrent clients continuously making requests:</p> |
| <ul> |
| <li>Pass in a nested complex object (but the amount of individual data is small), do not do any processing, and return as it is</li> |
| <li>Pass in 50K strings, do not do any processing, and return as they are (TODO: the result has not been listed yet)</li> |
| </ul> |
| <p>Run a 5-minute performance test. (Quoting dubbo&rsquo;s own test considerations: &ldquo;It mainly examines the performance of serialization and network IO, so the server does not have any business logic. The reason for taking 10 concurrency is to consider that the rpc protocol may have a high CPU usage rate under high concurrency. to the bottleneck.&rdquo;)</p> |
| <h3 id="comparison-of-byte-sizes-generated-by-different-serializations-in-dubbo-rpc">Comparison of byte sizes generated by different serializations in Dubbo RPC</h3> |
| <p>The size of the number of bytes generated by serialization is a relatively deterministic indicator, which determines the network transmission time and bandwidth occupation of the remote call.</p> |
| <p>The results for complex objects are as follows (lower numbers are better):</p> |
| <table> |
| <thead> |
| <tr> |
| <th>Serialization Implementation</th> |
| <th>Request Bytes</th> |
| <th>Response Bytes</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td>Kryo</td> |
| <td>272</td> |
| <td>90</td> |
| </tr> |
| <tr> |
| <td>FST</td> |
| <td>288</td> |
| <td>96</td> |
| </tr> |
| <tr> |
| <td>Dubbo Serialization</td> |
| <td>430</td> |
| <td>186</td> |
| </tr> |
| <tr> |
| <td>Hessian</td> |
| <td>546</td> |
| <td>329</td> |
| </tr> |
| <tr> |
| <td>FastJson</td> |
| <td>461</td> |
| <td>218</td> |
| </tr> |
| <tr> |
| <td>Json</td> |
| <td>657</td> |
| <td>409</td> |
| </tr> |
| <tr> |
| <td>Java Serialization</td> |
| <td>963</td> |
| <td>630</td> |
| </tr> |
| </tbody> |
| </table> |
| <h3 id="comparison-of-different-serialization-response-time-and-throughput-in-dubbo-rpc">Comparison of different serialization response time and throughput in Dubbo RPC</h3> |
| <table> |
| <thead> |
| <tr> |
| <th>Remote call method</th> |
| <th>Average response time</th> |
| <th>Average TPS (transactions per second)</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td>REST: Jetty + JSON</td> |
| <td>7.806</td> |
| <td>1280</td> |
| </tr> |
| <tr> |
| <td>REST: Jetty + JSON + GZIP</td> |
| <td>TODO</td> |
| <td>TODO</td> |
| </tr> |
| <tr> |
| <td>REST: Jetty + XML</td> |
| <td>TODO</td> |
| <td>TODO</td> |
| </tr> |
| <tr> |
| <td>REST: Jetty + XML + GZIP</td> |
| <td>TODO</td> |
| <td>TODO</td> |
| </tr> |
| <tr> |
| <td>REST: Tomcat + JSON</td> |
| <td>2.082</td> |
| <td>4796</td> |
| </tr> |
| <tr> |
| <td>REST: Netty + JSON</td> |
| <td>2.182</td> |
| <td>4576</td> |
| </tr> |
| <tr> |
| <td>Dubbo: FST</td> |
| <td>1.211</td> |
| <td>8244</td> |
| </tr> |
| <tr> |
| <td>Dubbo: kyro</td> |
| <td>1.182</td> |
| <td>8444</td> |
| </tr> |
| <tr> |
| <td>Dubbo: dubbo serialization</td> |
| <td>1.43</td> |
| <td>6982</td> |
| </tr> |
| <tr> |
| <td>Dubbo: hessian2</td> |
| <td>1.49</td> |
| <td>6701</td> |
| </tr> |
| <tr> |
| <td>Dubbo: fastjson</td> |
| <td>1.572</td> |
| <td>6352</td> |
| </tr> |
| </tbody> |
| </table> |
| <p><img src="https://dubbo.apache.org/imgs/user/rt.png" alt="rt"></p> |
| <p><img src="https://dubbo.apache.org/imgs/user/tps.png" alt="tps"></p> |
| <h3 id="test-summary">Test Summary</h3> |
| <p>As far as the current results are concerned, we can see that Kryo and FST have significantly improved compared to the original serialization method in Dubbo RPC, regardless of the size of generated bytes, average response time and average TPS.</p> |
| <h2 id="future">future</h2> |
| <p>In the future, when Kryo or FST is mature enough in dubbo, we will probably change the default serialization of dubbo RPC from hessian2 to one of them.</p></description></item></channel></rss> |
