| </a></div><button type="button" class="clean-btn close announcementBarClose_iXyO" aria-label="Close"><svg viewBox="0 0 15 15" width="14" height="14" style="color:white"><g stroke="currentColor" stroke-width="3.1"><path d="M.75.75l13.5 13.5M14.25.75L.75 14.25"></path></g></svg></button></div><nav aria-label="Main" class="navbar navbar--fixed-top"><div class="navbar__inner" style="padding:"><div class="navbar__items"><div class="navbar-left"><div class="navbar-logo-wrapper flex items-center"><a class="navbar__brand" href="/"><div class="navbar__logo"><img src="https://cdnd.selectdb.com/images/logo.svg" alt="Apache Doris" class="themedImage_ToTc themedImage--light_HNdA"><img src="https://cdnd.selectdb.com/images/logo.svg" alt="Apache Doris" class="themedImage_ToTc themedImage--dark_i4oU"></div><b class="navbar__title text--truncate"></b></a></div><a class="navbar__item navbar__link" style="text-align:center" href="/docs/get-starting/quick-start">Docs</a><a class="navbar__item navbar__link" style="text-align:center" href="/blog">Blog</a><a class="navbar__item navbar__link" style="text-align:center" href="/users">Users</a><a href="https://github.com/apache/doris/discussions" target="_blank" rel="noopener noreferrer" class="navbar__item navbar__link" style="text-align:center">Discussions</a><a class="navbar__item navbar__link" style="text-align:center" href="/ecosystem/cluster-management">Ecosystem</a><a class="navbar__item navbar__link" style="text-align:center" href="/community/join-community">Community</a></div></div><div class="navbar__items navbar__items--right"><button aria-label="Toggle navigation bar" aria-expanded="false" class="navbar__toggle clean-btn" type="button"><svg width="30" height="30" viewBox="0 0 30 30" aria-hidden="true"><path stroke="currentColor" stroke-linecap="round" stroke-miterlimit="10" stroke-width="2" d="M4 7h22M4 15h22M4 23h22"></path></svg></button><div class="docs-search searchBox_H2mL"><div class="navbar__search searchBarContainer_PzyC"><input placeholder="Search" aria-label="Search" class="navbar__search-input navbarSearchInput_tb6T"><div class="loadingRing__K5d searchBarLoadingRing_e2f0"><div></div><div></div><div></div><div></div></div><div class="searchHintContainer_m7ml"><kbd class="searchHint_zuPL">ctrl</kbd><kbd class="searchHint_zuPL">K</kbd></div></div></div><div class="custom-navbar-item navbar__item dropdown dropdown--hoverable dropdown--right"><a href="#" aria-haspopup="true" aria-expanded="false" role="button" class="navbar__link"><svg class="icon-language" xmlns="http://www.w3.org/2000/svg" width="16" height="16" viewBox="0 0 16 16" fill="none"><path d="M7.75756 14.3L10.5816 6.91667H11.8759L14.7 14.3H13.4057L12.7501 12.4167H9.74113L9.06873 14.3H7.75756ZM10.1109 11.35H12.3467L11.254 8.3H11.2036L10.1109 11.35ZM2.84908 12.45L1.97498 11.5833L5.11841 8.48333C4.72618 8.05 4.38439 7.60267 4.09302 7.14133C3.80165 6.68044 3.54389 6.19444 3.31976 5.68333H4.61412C4.80463 6.06111 5.00635 6.39711 5.21927 6.69133C5.43219 6.986 5.68434 7.29444 5.97571 7.61667C6.43519 7.12778 6.81621 6.62511 7.11879 6.10867C7.42137 5.59178 7.67352 5.03889 7.87523 4.45H1V3.23333H5.33694V2H6.58087V3.23333H10.9178V4.45H9.11916C8.89503 5.18333 8.59805 5.89155 8.22824 6.57467C7.85842 7.25822 7.39895 7.90555 6.84983 8.51667L8.3459 10.0167L7.87523 11.2833L5.95891 9.38333L2.84908 12.45Z" fill="#4C576C"></path></svg></a><ul class="dropdown__menu"><li><a href="/docs/admin-manual/config/be-config" target="_self" rel="noopener noreferrer" class="dropdown__link dropdown__link--active" style="text-align:center">English</a></li><li><a href="/zh-CN/docs/admin-manual/config/be-config" target="_self" rel="noopener noreferrer" class="dropdown__link" style="text-align:center">中文</a></li></ul></div><div class="custom-navbar-item navbar__item dropdown dropdown--hoverable dropdown--right"><a class="navbar__link" aria-haspopup="true" aria-expanded="false" role="button" href="/docs/get-starting/what-is-apache-doris"><span class="text-sm">Versions: <!-- -->2.1</span></a><ul class="dropdown__menu"><li><a class="dropdown__link" style="text-align:center" href="/docs/dev/admin-manual/config/be-config">Dev</a></li><li><a aria-current="page" class="dropdown__link dropdown__link--active" style="text-align:center" href="/docs/admin-manual/config/be-config">2.1</a></li><li><a class="dropdown__link" style="text-align:center" href="/docs/2.0/admin-manual/config/be-config">2.0</a></li><li><a class="dropdown__link" style="text-align:center" href="/docs/1.2/admin-manual/config/be-config">1.2</a></li></ul></div><a class="navbar__item navbar__link header-right-button-primary navbar-download-mobile" style="text-align:center" href="/download">Download</a><a href="https://github.com/apache/doris" target="_blank" rel="noopener noreferrer" class="github-btn desktop header-right-button-github"></a><a href="https://join.slack.com/t/apachedoriscommunity/shared_invite/zt-2kl08hzc0-SPJe4VWmL_qzrFd2u2XYQA" target="_blank" rel="noopener noreferrer" class="slack-btn desktop header-right-button-slack"></a><a class="header-right-button-primary navbar-download-desktop" href="/download">Download</a></div></div><div class="navbar__bottom"></div><div role="presentation" class="navbar-sidebar__backdrop"></div></nav><div id="__docusaurus_skipToContent_fallback" class="main-wrapper mainWrapper_z2l0"><div role="region" aria-label="Skip to main content"><a class="skipToContent_fXgn" href="#__docusaurus_skipToContent_fallback">Skip to main content</a></div><div class="main-wrapper docsWrapper_BCFX"><button aria-label="Scroll back to top" class="clean-btn theme-back-to-top-button backToTopButton_sjWU" type="button"></button><div class="docPage__5DB"><aside class="theme-doc-sidebar-container docSidebarContainer_b6E3"><div class="sidebarViewport_Xe31"><div class="sidebar"><nav aria-label="Docs sidebar" class="menu custom-scrollbar menu_Y1UP menuWithAnnouncementBar_fPny"><ul class="theme-doc-sidebar-menu menu__list"><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-1 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a id="menu__group" class="menu__link menu__link_level_1 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" href="/docs/get-starting/what-is-apache-doris">Getting Started</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-1 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a id="menu__group" class="menu__link menu__link_level_1 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" href="/docs/install/source-install/compilation-with-docker">Installation and Deployment</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-1 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a id="menu__group" class="menu__link menu__link_level_1 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" href="/docs/db-connect/database-connect">Database Connection</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-1 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a id="menu__group" class="menu__link menu__link_level_1 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" href="/docs/table-design/data-type">Data Table Design</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-1 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a id="menu__group" class="menu__link menu__link_level_1 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" href="/docs/data-operate/import/load-manual">Data Manipulation</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-1 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a id="menu__group" class="menu__link menu__link_level_1 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" href="/docs/query/query-data/mysql-compatibility">Data Queries</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-1 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a id="menu__group" class="menu__link menu__link_level_1 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" href="/docs/lakehouse/lakehouse-overview">Lakehouse</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-1 menu__list-item"><div class="menu__list-item-collapsible"><a id="menu__group" class="menu__link menu__link_level_1 menu__link--sublist menu__link--sublist-caret menu__link--active" aria-expanded="true" href="/docs/admin-manual/cluster-management/upgrade">Managing Doris</a></div><ul style="display:block;overflow:visible;height:auto" class="menu__list menu__list_level_2"><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-2 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a class="menu__link menu__link_level_2 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" tabindex="0" href="/docs/admin-manual/cluster-management/upgrade">Managing Cluster</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-2 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a class="menu__link menu__link_level_2 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" tabindex="0" href="/docs/admin-manual/data-admin/backup">Managing Data</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-2 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a class="menu__link menu__link_level_2 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" tabindex="0" href="/docs/admin-manual/resource-admin/workload-group">Managing Resource</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-2 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a class="menu__link menu__link_level_2 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" tabindex="0" href="/docs/admin-manual/query-admin/sql-interception">Managing Query</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-2 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a class="menu__link menu__link_level_2 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" tabindex="0" href="/docs/admin-manual/auth/authentication-and-authorization">Managing User Privilege</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-2 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a class="menu__link menu__link_level_2 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" tabindex="0" href="/docs/admin-manual/memory-management/memory-tracker">Managing Memory</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-2 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a class="menu__link menu__link_level_2 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" tabindex="0" href="/docs/admin-manual/log-management/fe-log">Log Management</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-2 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a class="menu__link menu__link_level_2 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" tabindex="0" href="/docs/admin-manual/maint-monitor/monitor-metrics/metrics">Maintenance</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-2 menu__list-item"><div class="menu__list-item-collapsible"><a class="menu__link menu__link_level_2 menu__link--sublist menu__link--sublist-caret menu__link--active" aria-expanded="true" tabindex="0" href="/docs/admin-manual/config/config-dir">Managing Configuration</a></div><ul style="display:block;overflow:visible;height:auto" class="menu__list"><li class="theme-doc-sidebar-item-link theme-doc-sidebar-item-link-level-3 menu__list-item"><a class="menu__link" tabindex="0" href="/docs/admin-manual/config/config-dir">Config Dir</a></li><li class="theme-doc-sidebar-item-link theme-doc-sidebar-item-link-level-3 menu__list-item"><a class="menu__link" tabindex="0" href="/docs/admin-manual/config/fe-config">FE Configuration</a></li><li class="theme-doc-sidebar-item-link theme-doc-sidebar-item-link-level-3 menu__list-item"><a class="menu__link menu__link--active" aria-current="page" tabindex="0" href="/docs/admin-manual/config/be-config">BE Configuration</a></li><li class="theme-doc-sidebar-item-link theme-doc-sidebar-item-link-level-3 menu__list-item"><a class="menu__link" tabindex="0" href="/docs/admin-manual/config/user-property">User Property</a></li></ul></li><li class="theme-doc-sidebar-item-link theme-doc-sidebar-item-link-level-2 menu__list-item"><a class="menu__link" tabindex="0" href="/docs/admin-manual/audit-plugin">Using Audit Log Plugin</a></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-2 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a class="menu__link menu__link_level_2 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" tabindex="0" href="/docs/admin-manual/fe/config-action">FE OPEN API</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-2 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a class="menu__link menu__link_level_2 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" tabindex="0" href="/docs/admin-manual/be/check-rpc-channel">BE OPEN API</a></div></li><li class="theme-doc-sidebar-item-link theme-doc-sidebar-item-link-level-2 menu__list-item"><a class="menu__link" tabindex="0" href="/docs/admin-manual/plugin-development-manual">Developing Plugins</a></li><li class="theme-doc-sidebar-item-link theme-doc-sidebar-item-link-level-2 menu__list-item"><a class="menu__link" tabindex="0" href="/docs/admin-manual/small-file-mgr">Small File Manager</a></li><li class="theme-doc-sidebar-item-link theme-doc-sidebar-item-link-level-2 menu__list-item"><a class="menu__link" tabindex="0" href="/docs/admin-manual/compaction">Compaction</a></li><li class="theme-doc-sidebar-item-link theme-doc-sidebar-item-link-level-2 menu__list-item"><a class="menu__link" tabindex="0" href="/docs/admin-manual/rowsets">Using rowsets</a></li></ul></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-1 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a id="menu__group" class="menu__link menu__link_level_1 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" href="/docs/ecosystem/spark-doris-connector">Ecosystem</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-1 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a id="menu__group" class="menu__link menu__link_level_1 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" href="/docs/sql-manual/sql-functions/array-functions/array">SQL Reference</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-1 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a id="menu__group" class="menu__link menu__link_level_1 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" href="/docs/benchmark/ssb">Benchmark</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-1 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a id="menu__group" class="menu__link menu__link_level_1 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" href="/docs/faq/install-faq">FAQ</a></div></li><li class="theme-doc-sidebar-item-category theme-doc-sidebar-item-category-level-1 menu__list-item menu__list-item--collapsed"><div class="menu__list-item-collapsible"><a id="menu__group" class="menu__link menu__link_level_1 menu__link--sublist menu__link--sublist-caret" aria-expanded="false" href="/docs/releasenotes/release-2.1.3">Release notes</a></div></li></ul></nav></div></div></aside><main class="docMainContainer_gTbr"><div class="container padding-top--md padding-bottom--lg"><div class="row"><div class="col docItemCol_z5aJ"><div class="docItemContainer_c0TR"><article><nav class="theme-doc-breadcrumbs breadcrumbsContainer_Z_bl" aria-label="Breadcrumbs"><ul class="breadcrumbs" itemscope="" itemtype="https://schema.org/BreadcrumbList"><li class="breadcrumbs__item"><a aria-label="Home page" class="breadcrumbs__link" href="/"><svg viewBox="0 0 24 24" class="breadcrumbHomeIcon_YNFT"><path d="M10 19v-5h4v5c0 .55.45 1 1 1h3c.55 0 1-.45 1-1v-7h1.7c.46 0 .68-.57.33-.87L12.67 3.6c-.38-.34-.96-.34-1.34 0l-8.36 7.53c-.34.3-.13.87.33.87H5v7c0 .55.45 1 1 1h3c.55 0 1-.45 1-1z" fill="currentColor"></path></svg></a></li><li class="breadcrumbs__item"><span class="breadcrumbs__link">Managing Doris</span><meta itemprop="position" content="1"></li><li class="breadcrumbs__item"><span class="breadcrumbs__link">Managing Configuration</span><meta itemprop="position" content="2"></li><li itemscope="" itemprop="itemListElement" itemtype="https://schema.org/ListItem" class="breadcrumbs__item breadcrumbs__item--active"><span class="breadcrumbs__link" itemprop="name">BE Configuration</span><meta itemprop="position" content="3"></li></ul></nav><div class="tocCollapsible_ETCw theme-doc-toc-mobile tocMobile_ITEo"><button type="button" class="clean-btn tocCollapsibleButton_TO0P">On this page</button></div><div class="theme-doc-markdown markdown"><header><h1>BE Configuration</h1></header><h1>BE Configuration</h1><p>This document mainly introduces the relevant configuration items of BE.</p><p>The BE configuration file <code>be.conf</code> is usually stored in the <code>conf/</code> directory of the BE deployment path. In version 0.14, another configuration file <code>be_custom.conf</code> will be introduced. The configuration file is used to record the configuration items that are dynamically configured and persisted by the user during operation.</p><p>After the BE process is started, it will read the configuration items in <code>be.conf</code> first, and then read the configuration items in <code>be_custom.conf</code>. The configuration items in <code>be_custom.conf</code> will overwrite the same configuration items in <code>be.conf</code>.</p><p>The location of the <code>be_custom.conf</code> file can be configured in <code>be.conf</code> through the <code>custom_config_dir</code> configuration item.</p><h2 class="anchor anchorWithStickyNavbar_LWe7" id="view-configuration-items">View configuration items<a href="#view-configuration-items" class="hash-link" aria-label="Direct link to View configuration items" title="Direct link to View configuration items"></a></h2><p>Users can view the current configuration items by visiting BE's web page:</p><p><code>http://be_host:be_webserver_port/varz</code></p><h2 class="anchor anchorWithStickyNavbar_LWe7" id="set-configuration-items">Set configuration items<a href="#set-configuration-items" class="hash-link" aria-label="Direct link to Set configuration items" title="Direct link to Set configuration items"></a></h2><p>There are two ways to configure BE configuration items:</p><ol><li><p>Static configuration</p><p>Add and set configuration items in the <code>conf/be.conf</code> file. The configuration items in <code>be.conf</code> will be read when BE starts. Configuration items not in <code>be.conf</code> will use default values.</p></li><li><p>Dynamic configuration</p><p>After BE starts, the configuration items can be dynamically set with the following commands.</p><div class="codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-text codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token plain">curl -X POST http://{be_ip}:{be_http_port}/api/update_config?{key}={value}</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg viewBox="0 0 24 24" class="copyButtonIcon_y97N"><path fill="currentColor" d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg viewBox="0 0 24 24" class="copyButtonSuccessIcon_LjdS"><path fill="currentColor" d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div><p>In version 0.13 and before, the configuration items modified in this way will become invalid after the BE process restarts. In 0.14 and later versions, the modified configuration can be persisted through the following command. The modified configuration items are stored in the <code>be_custom.conf</code> file.</p><div class="codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-text codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token plain">curl -X POST http://{be_ip}:{be_http_port}/api/update_config?{key}={value}\&persist=true</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg viewBox="0 0 24 24" class="copyButtonIcon_y97N"><path fill="currentColor" d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg viewBox="0 0 24 24" class="copyButtonSuccessIcon_LjdS"><path fill="currentColor" d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div></li></ol><h2 class="anchor anchorWithStickyNavbar_LWe7" id="examples">Examples<a href="#examples" class="hash-link" aria-label="Direct link to Examples" title="Direct link to Examples"></a></h2><ol><li><p>Modify <code>max_base_compaction_threads</code> statically</p><p>By adding in the <code>be.conf</code> file:</p><p><code>max_base_compaction_threads=5</code></p><p>Then restart the BE process to take effect the configuration.</p></li><li><p>Modify <code>streaming_load_max_mb</code> dynamically</p><p>After BE starts, the configuration item <code>streaming_load_max_mb</code> is dynamically set by the following command:</p><div class="codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-text codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token plain">curl -X POST http://{be_ip}:{be_http_port}/api/update_config?streaming_load_max_mb=1024</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg viewBox="0 0 24 24" class="copyButtonIcon_y97N"><path fill="currentColor" d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg viewBox="0 0 24 24" class="copyButtonSuccessIcon_LjdS"><path fill="currentColor" d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div><p>The return value is as follows, indicating that the setting is successful.</p><div class="codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-text codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token plain">{</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> "status": "OK",</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> "msg": ""</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">}</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg viewBox="0 0 24 24" class="copyButtonIcon_y97N"><path fill="currentColor" d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg viewBox="0 0 24 24" class="copyButtonSuccessIcon_LjdS"><path fill="currentColor" d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div><p>The configuration will become invalid after the BE restarts. If you want to persist the modified results, use the following command:</p><div class="codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-text codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token plain">curl -X POST http://{be_ip}:{be_http_port}/api/update_config?streaming_load_max_mb=1024\&persist=true</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg viewBox="0 0 24 24" class="copyButtonIcon_y97N"><path fill="currentColor" d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg viewBox="0 0 24 24" class="copyButtonSuccessIcon_LjdS"><path fill="currentColor" d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div></li></ol><h2 class="anchor anchorWithStickyNavbar_LWe7" id="configurations">Configurations<a href="#configurations" class="hash-link" aria-label="Direct link to Configurations" title="Direct link to Configurations"></a></h2><h3 class="anchor anchorWithStickyNavbar_LWe7" id="services">Services<a href="#services" class="hash-link" aria-label="Direct link to Services" title="Direct link to Services"></a></h3><h4 class="anchor anchorWithStickyNavbar_LWe7" id="be_port"><code>be_port</code><a href="#be_port" class="hash-link" aria-label="Direct link to be_port" title="Direct link to be_port"></a></h4><ul><li>Type: int32</li><li>Description: The port of the thrift server on BE which used to receive requests from FE</li><li>Default value: 9060</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="heartbeat_service_port"><code>heartbeat_service_port</code><a href="#heartbeat_service_port" class="hash-link" aria-label="Direct link to heartbeat_service_port" title="Direct link to heartbeat_service_port"></a></h4><ul><li>Type: int32</li><li>Description: Heartbeat service port (thrift) on BE, used to receive heartbeat from FE</li><li>Default value: 9050</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="webserver_port"><code>webserver_port</code><a href="#webserver_port" class="hash-link" aria-label="Direct link to webserver_port" title="Direct link to webserver_port"></a></h4><ul><li>Type: int32</li><li>Description: Service port of http server on BE</li><li>Default value: 8040</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="brpc_port"><code>brpc_port</code><a href="#brpc_port" class="hash-link" aria-label="Direct link to brpc_port" title="Direct link to brpc_port"></a></h4><ul><li>Type: int32</li><li>Description: The port of BRPC on BE, used for communication between BEs</li><li>Default value: 8060</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="arrow_flight_sql_port"><code>arrow_flight_sql_port</code><a href="#arrow_flight_sql_port" class="hash-link" aria-label="Direct link to arrow_flight_sql_port" title="Direct link to arrow_flight_sql_port"></a></h4><ul><li>Type: int32</li><li>Description: The port of Arrow Flight SQL server on BE, used for communication between Arrow Flight Client and BE</li><li>Default value: -1</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="enable_https"><code>enable_https</code><a href="#enable_https" class="hash-link" aria-label="Direct link to enable_https" title="Direct link to enable_https"></a></h4><ul><li>Type: bool</li><li>Description: Whether https is supported. If so, configure <code>ssl_certificate_path</code> and <code>ssl_private_key_path</code> in be.conf.</li><li>Default value: false</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="priority_networks"><code>priority_networks</code><a href="#priority_networks" class="hash-link" aria-label="Direct link to priority_networks" title="Direct link to priority_networks"></a></h4><ul><li>Description: Declare a selection strategy for those servers with many IPs. Note that at most one ip should match this list. This is a semicolon-separated list in CIDR notation, such as 10.10.10.0/24. If there is no IP matching this rule, one will be randomly selected</li><li>Default value: blank</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="storage_root_path"><code>storage_root_path</code><a href="#storage_root_path" class="hash-link" aria-label="Direct link to storage_root_path" title="Direct link to storage_root_path"></a></h4><ul><li><p>Type: string</p></li><li><p>Description: data root path, separate by ';'.you can specify the storage medium of each root path, HDD or SSD. you can add capacity limit at the end of each root path, separate by ','.If the user does not use a mix of SSD and HDD disks, they do not need to configure the configuration methods in Example 1 and Example 2 below, but only need to specify the storage directory; they also do not need to modify the default storage media configuration of FE.</p><p>eg.1: <code>storage_root_path=/home/disk1/doris.HDD;/home/disk2/doris.SSD;/home/disk2/doris</code></p><ul><li>1./home/disk1/doris.HDD, indicates that the storage medium is HDD;</li><li>2./home/disk2/doris.SSD, indicates that the storage medium is SSD;</li><li>3./home/disk2/doris, indicates that the storage medium is HDD by default</li></ul><p>eg.2: <code>storage_root_path=/home/disk1/doris,medium:hdd;/home/disk2/doris,medium:ssd</code></p><ul><li>1./home/disk1/doris,medium:hdd, indicates that the storage medium is HDD;</li><li>2./home/disk2/doris,medium:ssd, indicates that the storage medium is SSD;</li></ul></li><li><p>Default value: ${DORIS_HOME}/storage</p></li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="heartbeat_service_thread_count"><code>heartbeat_service_thread_count</code><a href="#heartbeat_service_thread_count" class="hash-link" aria-label="Direct link to heartbeat_service_thread_count" title="Direct link to heartbeat_service_thread_count"></a></h4><ul><li>Type: int32</li><li>Description: The number of threads that execute the heartbeat service on BE. the default is 1, it is not recommended to modify</li><li>Default value: 1</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="ignore_broken_disk"><code>ignore_broken_disk</code><a href="#ignore_broken_disk" class="hash-link" aria-label="Direct link to ignore_broken_disk" title="Direct link to ignore_broken_disk"></a></h4><ul><li><p>Type: bool</p></li><li><p>Description: When BE starts, check <code>storage_root_path</code> All paths under configuration.</p><ul><li><code>ignore_broken_disk=true</code></li></ul><p>If the path does not exist or the file (bad disk) cannot be read or written under the path, the path will be ignored. If there are other available paths, the startup will not be interrupted.</p><ul><li><code>ignore_broken_disk=false</code></li></ul><p>If the path does not exist or the file (bad disk) cannot be read or written under the path, the system will abort the startup failure and exit.</p></li><li><p>Default value: false</p></li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="mem_limit"><code>mem_limit</code><a href="#mem_limit" class="hash-link" aria-label="Direct link to mem_limit" title="Direct link to mem_limit"></a></h4><ul><li>Type: string</li><li>Description: Limit the percentage of the server's maximum memory used by the BE process. It is used to prevent BE memory from occupying too the machine's memory. This parameter must be greater than 0. When the percentage is greater than 100%, the value will default to 100%.</li><li>Default value: 90%</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="cluster_id"><code>cluster_id</code><a href="#cluster_id" class="hash-link" aria-label="Direct link to cluster_id" title="Direct link to cluster_id"></a></h4><ul><li>Type: int32</li><li>Description: Configure the cluster id to which the BE belongs.<ul><li>This value is usually delivered by the FE to the BE by the heartbeat, no need to configure. When it is confirmed that a BE belongs to a certain Doris cluster, it can be configured. The cluster_id file under the data directory needs to be modified to make sure same as this parament.</li></ul></li><li>Default value: -1</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="custom_config_dir"><code>custom_config_dir</code><a href="#custom_config_dir" class="hash-link" aria-label="Direct link to custom_config_dir" title="Direct link to custom_config_dir"></a></h4><ul><li>Description: Configure the location of the <code>be_custom.conf</code> file. The default is in the <code>conf/</code> directory.<ul><li>In some deployment environments, the <code>conf/</code> directory may be overwritten due to system upgrades. This will cause the user modified configuration items to be overwritten. At this time, we can store <code>be_custom.conf</code> in another specified directory to prevent the configuration file from being overwritten.</li></ul></li><li>Default value: blank</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="trash_file_expire_time_sec"><code>trash_file_expire_time_sec</code><a href="#trash_file_expire_time_sec" class="hash-link" aria-label="Direct link to trash_file_expire_time_sec" title="Direct link to trash_file_expire_time_sec"></a></h4><ul><li>Description: The interval for cleaning the recycle bin is 72 hours. When the disk space is insufficient, the file retention period under trash may not comply with this parameter</li><li>Default value: 259200</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="es_http_timeout_ms"><code>es_http_timeout_ms</code><a href="#es_http_timeout_ms" class="hash-link" aria-label="Direct link to es_http_timeout_ms" title="Direct link to es_http_timeout_ms"></a></h4><ul><li>Description: The timeout period for connecting to ES via http.</li><li>Default value: 5000 (ms)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="es_scroll_keepalive"><code>es_scroll_keepalive</code><a href="#es_scroll_keepalive" class="hash-link" aria-label="Direct link to es_scroll_keepalive" title="Direct link to es_scroll_keepalive"></a></h4><ul><li>Description: es scroll keep-alive hold time</li><li>Default value: 5 (m)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="external_table_connect_timeout_sec"><code>external_table_connect_timeout_sec</code><a href="#external_table_connect_timeout_sec" class="hash-link" aria-label="Direct link to external_table_connect_timeout_sec" title="Direct link to external_table_connect_timeout_sec"></a></h4><ul><li>Type: int32</li><li>Description: The timeout when establishing connection with external table such as ODBC table.</li><li>Default value: 5 seconds</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="status_report_interval"><code>status_report_interval</code><a href="#status_report_interval" class="hash-link" aria-label="Direct link to status_report_interval" title="Direct link to status_report_interval"></a></h4><ul><li>Description: Interval between profile reports</li><li>Default value: 5 seconds</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="brpc_max_body_size"><code>brpc_max_body_size</code><a href="#brpc_max_body_size" class="hash-link" aria-label="Direct link to brpc_max_body_size" title="Direct link to brpc_max_body_size"></a></h4><ul><li><p>Description: This configuration is mainly used to modify the parameter <code>max_body_size</code> of brpc.</p><ul><li>Sometimes the query fails and an error message of <code>body_size is too large</code> will appear in the BE log. This may happen when the SQL mode is "multi distinct + no group by + more than 1T of data".This error indicates that the packet size of brpc exceeds the configured value. At this time, you can avoid this error by increasing the configuration.</li></ul></li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="brpc_socket_max_unwritten_bytes"><code>brpc_socket_max_unwritten_bytes</code><a href="#brpc_socket_max_unwritten_bytes" class="hash-link" aria-label="Direct link to brpc_socket_max_unwritten_bytes" title="Direct link to brpc_socket_max_unwritten_bytes"></a></h4><ul><li>Description: This configuration is mainly used to modify the parameter <code>socket_max_unwritten_bytes</code> of brpc.<ul><li>Sometimes the query fails and an error message of <code>The server is overcrowded</code> will appear in the BE log. This means there are too many messages to buffer at the sender side, which may happen when the SQL needs to send large bitmap value. You can avoid this error by increasing the configuration.</li></ul></li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="transfer_large_data_by_brpc"><code>transfer_large_data_by_brpc</code><a href="#transfer_large_data_by_brpc" class="hash-link" aria-label="Direct link to transfer_large_data_by_brpc" title="Direct link to transfer_large_data_by_brpc"></a></h4><ul><li>Type: bool</li><li>Description: This configuration is used to control whether to serialize the protoBuf request and embed the Tuple/Block data into the controller attachment and send it through http brpc when the length of the Tuple/Block data is greater than 1.8G. To avoid errors when the length of the protoBuf request exceeds 2G: Bad request, error_text=<!-- -->[E1003]<!-- -->Fail to compress request. In the past version, after putting Tuple/Block data in the attachment, it was sent through the default baidu_std brpc, but when the attachment exceeds 2G, it will be truncated. There is no 2G limit for sending through http brpc.</li><li>Default value: true</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="brpc_num_threads"><code>brpc_num_threads</code><a href="#brpc_num_threads" class="hash-link" aria-label="Direct link to brpc_num_threads" title="Direct link to brpc_num_threads"></a></h4><ul><li>Description: This configuration is mainly used to modify the number of bthreads for brpc. The default value is set to -1, which means the number of bthreads is #cpu-cores.<ul><li>User can set this configuration to a larger value to get better QPS performance. For more information, please refer to <code>https://github.com/apache/incubator-brpc/blob/master/docs/cn/benchmark.md</code></li></ul></li><li>Default value: -1</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="thrift_rpc_timeout_ms"><code>thrift_rpc_timeout_ms</code><a href="#thrift_rpc_timeout_ms" class="hash-link" aria-label="Direct link to thrift_rpc_timeout_ms" title="Direct link to thrift_rpc_timeout_ms"></a></h4><ul><li>Description: thrift default timeout time</li><li>Default value: 60000</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="thrift_client_retry_interval_ms"><code>thrift_client_retry_interval_ms</code><a href="#thrift_client_retry_interval_ms" class="hash-link" aria-label="Direct link to thrift_client_retry_interval_ms" title="Direct link to thrift_client_retry_interval_ms"></a></h4><ul><li>Type: int64</li><li>Description: Used to set retry interval for thrift client in be to avoid avalanche disaster in fe thrift server, the unit is ms.</li><li>Default value: 1000</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="thrift_connect_timeout_seconds"><code>thrift_connect_timeout_seconds</code><a href="#thrift_connect_timeout_seconds" class="hash-link" aria-label="Direct link to thrift_connect_timeout_seconds" title="Direct link to thrift_connect_timeout_seconds"></a></h4><ul><li>Description: The default thrift client connection timeout time</li><li>Default value: 3 (s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="thrift_server_type_of_fe"><code>thrift_server_type_of_fe</code><a href="#thrift_server_type_of_fe" class="hash-link" aria-label="Direct link to thrift_server_type_of_fe" title="Direct link to thrift_server_type_of_fe"></a></h4><ul><li><p>Type: string</p></li><li><p>Description:This configuration indicates the service model used by FE's Thrift service. The type is string and is case-insensitive. This parameter needs to be consistent with the setting of fe's thrift_server_type parameter. Currently there are two values for this parameter, <code>THREADED</code> and <code>THREAD_POOL</code>.</p><ul><li><p>If the parameter is <code>THREADED</code>, the model is a non-blocking I/O model.</p></li><li><p>If the parameter is <code>THREAD_POOL</code>, the model is a blocking I/O model.</p></li></ul></li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="txn_commit_rpc_timeout_ms"><code>txn_commit_rpc_timeout_ms</code><a href="#txn_commit_rpc_timeout_ms" class="hash-link" aria-label="Direct link to txn_commit_rpc_timeout_ms" title="Direct link to txn_commit_rpc_timeout_ms"></a></h4><ul><li>Description:txn submit rpc timeout</li><li>Default value: 60,000 (ms)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="txn_map_shard_size"><code>txn_map_shard_size</code><a href="#txn_map_shard_size" class="hash-link" aria-label="Direct link to txn_map_shard_size" title="Direct link to txn_map_shard_size"></a></h4><ul><li>Description: txn_map_lock fragment size, the value is 2^n, n=0,1,2,3,4. This is an enhancement to improve the performance of managing txn</li><li>Default value: 128</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="txn_shard_size"><code>txn_shard_size</code><a href="#txn_shard_size" class="hash-link" aria-label="Direct link to txn_shard_size" title="Direct link to txn_shard_size"></a></h4><ul><li>Description: txn_lock shard size, the value is 2^n, n=0,1,2,3,4, this is an enhancement function that can improve the performance of submitting and publishing txn</li><li>Default value: 1024</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="unused_rowset_monitor_interval"><code>unused_rowset_monitor_interval</code><a href="#unused_rowset_monitor_interval" class="hash-link" aria-label="Direct link to unused_rowset_monitor_interval" title="Direct link to unused_rowset_monitor_interval"></a></h4><ul><li>Description: Time interval for clearing expired Rowset</li><li>Default value: 30 (s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_client_cache_size_per_host"><code>max_client_cache_size_per_host</code><a href="#max_client_cache_size_per_host" class="hash-link" aria-label="Direct link to max_client_cache_size_per_host" title="Direct link to max_client_cache_size_per_host"></a></h4><ul><li>Description: The maximum number of client caches per host. There are multiple client caches in BE, but currently we use the same cache size configuration. If necessary, use different configurations to set up different client-side caches</li><li>Default value: 10</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="string_type_length_soft_limit_bytes"><code>string_type_length_soft_limit_bytes</code><a href="#string_type_length_soft_limit_bytes" class="hash-link" aria-label="Direct link to string_type_length_soft_limit_bytes" title="Direct link to string_type_length_soft_limit_bytes"></a></h4><ul><li>Type: int32</li><li>Description: The soft limit of the maximum length of String type.</li><li>Default value: 1,048,576</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="big_column_size_buffer"><code>big_column_size_buffer</code><a href="#big_column_size_buffer" class="hash-link" aria-label="Direct link to big_column_size_buffer" title="Direct link to big_column_size_buffer"></a></h4><ul><li>Type: int64</li><li>Description: When using the odbc external table, if a column type of the odbc source table is HLL, CHAR or VARCHAR, and the length of the column value exceeds this value, the query will report an error 'column value length longer than buffer length'. You can increase this value</li><li>Default value: 65535</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="small_column_size_buffer"><code>small_column_size_buffer</code><a href="#small_column_size_buffer" class="hash-link" aria-label="Direct link to small_column_size_buffer" title="Direct link to small_column_size_buffer"></a></h4><ul><li>Type: int64</li><li>Description: When using the odbc external table, if a column type of the odbc source table is not HLL, CHAR or VARCHAR, and the length of the column value exceeds this value, the query will report an error 'column value length longer than buffer length'. You can increase this value</li><li>Default value: 100</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="jsonb_type_length_soft_limit_bytes"><code>jsonb_type_length_soft_limit_bytes</code><a href="#jsonb_type_length_soft_limit_bytes" class="hash-link" aria-label="Direct link to jsonb_type_length_soft_limit_bytes" title="Direct link to jsonb_type_length_soft_limit_bytes"></a></h4><ul><li>Type: int32</li><li>Description: The soft limit of the maximum length of JSONB type.</li><li>Default value: 1,048,576</li></ul><h3 class="anchor anchorWithStickyNavbar_LWe7" id="query">Query<a href="#query" class="hash-link" aria-label="Direct link to Query" title="Direct link to Query"></a></h3><h4 class="anchor anchorWithStickyNavbar_LWe7" id="fragment_pool_queue_size"><code>fragment_pool_queue_size</code><a href="#fragment_pool_queue_size" class="hash-link" aria-label="Direct link to fragment_pool_queue_size" title="Direct link to fragment_pool_queue_size"></a></h4><ul><li>Description: The upper limit of query requests that can be processed on a single node</li><li>Default value: 4096</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="fragment_pool_thread_num_min"><code>fragment_pool_thread_num_min</code><a href="#fragment_pool_thread_num_min" class="hash-link" aria-label="Direct link to fragment_pool_thread_num_min" title="Direct link to fragment_pool_thread_num_min"></a></h4><ul><li>Description: Query the number of threads. By default, the minimum number of threads is 64.</li><li>Default value: 64</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="fragment_pool_thread_num_max"><code>fragment_pool_thread_num_max</code><a href="#fragment_pool_thread_num_max" class="hash-link" aria-label="Direct link to fragment_pool_thread_num_max" title="Direct link to fragment_pool_thread_num_max"></a></h4><ul><li>Description: Follow up query requests create threads dynamically, with a maximum of 512 threads created.</li><li>Default value: 2048</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="doris_max_scan_key_num"><code>doris_max_scan_key_num</code><a href="#doris_max_scan_key_num" class="hash-link" aria-label="Direct link to doris_max_scan_key_num" title="Direct link to doris_max_scan_key_num"></a></h4><ul><li>Type: int</li><li>Description: Used to limit the maximum number of scan keys that a scan node can split in a query request. When a conditional query request reaches the scan node, the scan node will try to split the conditions related to the key column in the query condition into multiple scan key ranges. After that, these scan key ranges will be assigned to multiple scanner threads for data scanning. A larger value usually means that more scanner threads can be used to increase the parallelism of the scanning operation. However, in high concurrency scenarios, too many threads may bring greater scheduling overhead and system load, and will slow down the query response speed. An empirical value is 50. This configuration can be configured separately at the session level. For details, please refer to the description of <code>max_scan_key_num</code> in <a href="/docs/query/query-variables/variables.md">Variables</a>.<ul><li>When the concurrency cannot be improved in high concurrency scenarios, try to reduce this value and observe the impact.</li></ul></li><li>Default value: 48</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="doris_scan_range_row_count"><code>doris_scan_range_row_count</code><a href="#doris_scan_range_row_count" class="hash-link" aria-label="Direct link to doris_scan_range_row_count" title="Direct link to doris_scan_range_row_count"></a></h4><ul><li>Type: int32</li><li>Description: When BE performs data scanning, it will split the same scanning range into multiple ScanRanges. This parameter represents the scan data range of each ScanRange. This parameter can limit the time that a single OlapScanner occupies the io thread.</li><li>Default value: 524288</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="doris_scanner_queue_size"><code>doris_scanner_queue_size</code><a href="#doris_scanner_queue_size" class="hash-link" aria-label="Direct link to doris_scanner_queue_size" title="Direct link to doris_scanner_queue_size"></a></h4><ul><li>Type: int32</li><li>Description: The length of the RowBatch buffer queue between TransferThread and OlapScanner. When Doris performs data scanning, it is performed asynchronously. The Rowbatch scanned by OlapScanner will be placed in the scanner buffer queue, waiting for the upper TransferThread to take it away.</li><li>Default value: 1024</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="doris_scanner_row_num"><code>doris_scanner_row_num</code><a href="#doris_scanner_row_num" class="hash-link" aria-label="Direct link to doris_scanner_row_num" title="Direct link to doris_scanner_row_num"></a></h4><ul><li>Description: The maximum number of data rows returned by each scanning thread in a single execution</li><li>Default value: 16384</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="doris_scanner_row_bytes"><code>doris_scanner_row_bytes</code><a href="#doris_scanner_row_bytes" class="hash-link" aria-label="Direct link to doris_scanner_row_bytes" title="Direct link to doris_scanner_row_bytes"></a></h4><ul><li>Description: single read execute fragment row bytes<ul><li>Note: If there are too many columns in the table, you can adjust this config if you encounter a <code>select *</code> stuck</li></ul></li><li>Default value: 10485760</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="doris_scanner_thread_pool_queue_size"><code>doris_scanner_thread_pool_queue_size</code><a href="#doris_scanner_thread_pool_queue_size" class="hash-link" aria-label="Direct link to doris_scanner_thread_pool_queue_size" title="Direct link to doris_scanner_thread_pool_queue_size"></a></h4><ul><li>Type: int32</li><li>Description: The queue length of the Scanner thread pool. In Doris' scanning tasks, each Scanner will be submitted as a thread task to the thread pool waiting to be scheduled, and after the number of submitted tasks exceeds the length of the thread pool queue, subsequent submitted tasks will be blocked until there is a empty slot in the queue.</li><li>Default value: 102400</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="doris_scanner_thread_pool_thread_num"><code>doris_scanner_thread_pool_thread_num</code><a href="#doris_scanner_thread_pool_thread_num" class="hash-link" aria-label="Direct link to doris_scanner_thread_pool_thread_num" title="Direct link to doris_scanner_thread_pool_thread_num"></a></h4><ul><li>Type: int32</li><li>Description: The number of threads in the Scanner thread pool. In Doris' scanning tasks, each Scanner will be submitted as a thread task to the thread pool to be scheduled. This parameter determines the size of the Scanner thread pool.</li><li>Default value: 48</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="doris_max_remote_scanner_thread_pool_thread_num"><code>doris_max_remote_scanner_thread_pool_thread_num</code><a href="#doris_max_remote_scanner_thread_pool_thread_num" class="hash-link" aria-label="Direct link to doris_max_remote_scanner_thread_pool_thread_num" title="Direct link to doris_max_remote_scanner_thread_pool_thread_num"></a></h4><ul><li>Type: int32</li><li>Description: Max thread number of Remote scanner thread pool. Remote scanner thread pool is used for scan task of all external data sources.</li><li>Default: 512</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="exchg_node_buffer_size_bytes"><code>exchg_node_buffer_size_bytes</code><a href="#exchg_node_buffer_size_bytes" class="hash-link" aria-label="Direct link to exchg_node_buffer_size_bytes" title="Direct link to exchg_node_buffer_size_bytes"></a></h4><ul><li>Type: int32</li><li>Description: The size of the Buffer queue of the ExchangeNode node, in bytes. After the amount of data sent from the Sender side is larger than the Buffer size of ExchangeNode, subsequent data sent will block until the Buffer frees up space for writing.</li><li>Default value: 10485760</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_pushdown_conditions_per_column"><code>max_pushdown_conditions_per_column</code><a href="#max_pushdown_conditions_per_column" class="hash-link" aria-label="Direct link to max_pushdown_conditions_per_column" title="Direct link to max_pushdown_conditions_per_column"></a></h4><ul><li><p>Type: int</p></li><li><p>Description: Used to limit the maximum number of conditions that can be pushed down to the storage engine for a single column in a query request. During the execution of the query plan, the filter conditions on some columns can be pushed down to the storage engine, so that the index information in the storage engine can be used for data filtering, reducing the amount of data that needs to be scanned by the query. Such as equivalent conditions, conditions in IN predicates, etc. In most cases, this parameter only affects queries containing IN predicates. Such as <code>WHERE colA IN (1,2,3,4, ...)</code>. A larger number means that more conditions in the IN predicate can be pushed to the storage engine, but too many conditions may cause an increase in random reads, and in some cases may reduce query efficiency. This configuration can be individually configured for session level. For details, please refer to the description of <code>max_pushdown_conditions_per_column</code> in <a href="/docs/query/query-variables/variables.md">Variables</a>.</p></li><li><p>Default value: 1024</p></li><li><p>Example</p><ul><li>The table structure is' id INT, col2 INT, col3 varchar (32),... '.</li><li>The query request is'WHERE id IN (v1, v2, v3, ...)</li></ul></li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_send_batch_parallelism_per_job"><code>max_send_batch_parallelism_per_job</code><a href="#max_send_batch_parallelism_per_job" class="hash-link" aria-label="Direct link to max_send_batch_parallelism_per_job" title="Direct link to max_send_batch_parallelism_per_job"></a></h4><ul><li>Type: int</li><li>Description: Max send batch parallelism for OlapTableSink. The value set by the user for <code>send_batch_parallelism</code> is not allowed to exceed <code>max_send_batch_parallelism_per_job</code>, if exceed, the value of <code>send_batch_parallelism</code> would be <code>max_send_batch_parallelism_per_job</code>.</li><li>Default value: 5</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="doris_scan_range_max_mb"><code>doris_scan_range_max_mb</code><a href="#doris_scan_range_max_mb" class="hash-link" aria-label="Direct link to doris_scan_range_max_mb" title="Direct link to doris_scan_range_max_mb"></a></h4><ul><li>Type: int32</li><li>Description: The maximum amount of data read by each OlapScanner.</li><li>Default value: 1024</li></ul><h3 class="anchor anchorWithStickyNavbar_LWe7" id="compaction">compaction<a href="#compaction" class="hash-link" aria-label="Direct link to compaction" title="Direct link to compaction"></a></h3><h4 class="anchor anchorWithStickyNavbar_LWe7" id="disable_auto_compaction"><code>disable_auto_compaction</code><a href="#disable_auto_compaction" class="hash-link" aria-label="Direct link to disable_auto_compaction" title="Direct link to disable_auto_compaction"></a></h4><ul><li>Type: bool</li><li>Description: Whether disable automatic compaction task<ul><li>Generally it needs to be turned off. When you want to manually operate the compaction task in the debugging or test environment, you can turn on the configuration.</li></ul></li><li>Default value: false</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="enable_vertical_compaction"><code>enable_vertical_compaction</code><a href="#enable_vertical_compaction" class="hash-link" aria-label="Direct link to enable_vertical_compaction" title="Direct link to enable_vertical_compaction"></a></h4><ul><li>Type: bool</li><li>Description: Whether to enable vertical compaction</li><li>Default value: true</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="vertical_compaction_num_columns_per_group"><code>vertical_compaction_num_columns_per_group</code><a href="#vertical_compaction_num_columns_per_group" class="hash-link" aria-label="Direct link to vertical_compaction_num_columns_per_group" title="Direct link to vertical_compaction_num_columns_per_group"></a></h4><ul><li>Type: int32</li><li>Description: In vertical compaction, column number for every group</li><li>Default value: 5</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="vertical_compaction_max_row_source_memory_mb"><code>vertical_compaction_max_row_source_memory_mb</code><a href="#vertical_compaction_max_row_source_memory_mb" class="hash-link" aria-label="Direct link to vertical_compaction_max_row_source_memory_mb" title="Direct link to vertical_compaction_max_row_source_memory_mb"></a></h4><ul><li>Type: int32</li><li>Description: In vertical compaction, max memory usage for row_source_buffer,The unit is MB.</li><li>Default value: 200</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="vertical_compaction_max_segment_size"><code>vertical_compaction_max_segment_size</code><a href="#vertical_compaction_max_segment_size" class="hash-link" aria-label="Direct link to vertical_compaction_max_segment_size" title="Direct link to vertical_compaction_max_segment_size"></a></h4><ul><li>Type: int32</li><li>Description: In vertical compaction, max dest segment file size, The unit is m bytes.</li><li>Default value: 268435456</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="enable_ordered_data_compaction"><code>enable_ordered_data_compaction</code><a href="#enable_ordered_data_compaction" class="hash-link" aria-label="Direct link to enable_ordered_data_compaction" title="Direct link to enable_ordered_data_compaction"></a></h4><ul><li>Type: bool</li><li>Description: Whether to enable ordered data compaction</li><li>Default value: true</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="ordered_data_compaction_min_segment_size"><code>ordered_data_compaction_min_segment_size</code><a href="#ordered_data_compaction_min_segment_size" class="hash-link" aria-label="Direct link to ordered_data_compaction_min_segment_size" title="Direct link to ordered_data_compaction_min_segment_size"></a></h4><ul><li>Type: int32</li><li>Description: In ordered data compaction, min segment size for input rowset, The unit is m bytes.</li><li>Default value: 10485760</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_base_compaction_threads"><code>max_base_compaction_threads</code><a href="#max_base_compaction_threads" class="hash-link" aria-label="Direct link to max_base_compaction_threads" title="Direct link to max_base_compaction_threads"></a></h4><p>git </p><ul><li>Type: int32</li><li>Description: The maximum of thread number in base compaction thread pool, -1 means one thread per disk.</li><li>Default value: 4</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="generate_compaction_tasks_interval_ms"><code>generate_compaction_tasks_interval_ms</code><a href="#generate_compaction_tasks_interval_ms" class="hash-link" aria-label="Direct link to generate_compaction_tasks_interval_ms" title="Direct link to generate_compaction_tasks_interval_ms"></a></h4><ul><li>Description: Minimal interval (ms) to generate compaction tasks</li><li>Default value: 10 (ms)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="base_compaction_min_rowset_num"><code>base_compaction_min_rowset_num</code><a href="#base_compaction_min_rowset_num" class="hash-link" aria-label="Direct link to base_compaction_min_rowset_num" title="Direct link to base_compaction_min_rowset_num"></a></h4><ul><li>Description: One of the triggering conditions of BaseCompaction: The limit of the number of Cumulative files to be reached. After reaching this limit, BaseCompaction will be triggered</li><li>Default value: 5</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="base_compaction_min_data_ratio"><code>base_compaction_min_data_ratio</code><a href="#base_compaction_min_data_ratio" class="hash-link" aria-label="Direct link to base_compaction_min_data_ratio" title="Direct link to base_compaction_min_data_ratio"></a></h4><ul><li>Description: One of the trigger conditions of BaseCompaction: Cumulative file size reaches the proportion of Base file</li><li>Default value: 0.3 (30%)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="total_permits_for_compaction_score"><code>total_permits_for_compaction_score</code><a href="#total_permits_for_compaction_score" class="hash-link" aria-label="Direct link to total_permits_for_compaction_score" title="Direct link to total_permits_for_compaction_score"></a></h4><ul><li>Type: int64</li><li>Description: The upper limit of "permits" held by all compaction tasks. This config can be set to limit memory consumption for compaction.</li><li>Default value: 10000</li><li>Dynamically modifiable: Yes</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="compaction_promotion_size_mbytes"><code>compaction_promotion_size_mbytes</code><a href="#compaction_promotion_size_mbytes" class="hash-link" aria-label="Direct link to compaction_promotion_size_mbytes" title="Direct link to compaction_promotion_size_mbytes"></a></h4><ul><li>Type: int64</li><li>Description: The total disk size of the output rowset of cumulative compaction exceeds this configuration size, and the rowset will be used for base compaction. The unit is m bytes.<ul><li>Generally, if the configuration is less than 2G, in order to prevent the cumulative compression time from being too long, resulting in the version backlog.</li></ul></li><li>Default value: 1024</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="compaction_promotion_ratio"><code>compaction_promotion_ratio</code><a href="#compaction_promotion_ratio" class="hash-link" aria-label="Direct link to compaction_promotion_ratio" title="Direct link to compaction_promotion_ratio"></a></h4><ul><li>Type: double</li><li>Description: When the total disk size of the cumulative compaction output rowset exceeds the configuration ratio of the base version rowset, the rowset will be used for base compaction.<ul><li>Generally, it is recommended that the configuration should not be higher than 0.1 and lower than 0.02.</li></ul></li><li>Default value: 0.05</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="compaction_promotion_min_size_mbytes"><code>compaction_promotion_min_size_mbytes</code><a href="#compaction_promotion_min_size_mbytes" class="hash-link" aria-label="Direct link to compaction_promotion_min_size_mbytes" title="Direct link to compaction_promotion_min_size_mbytes"></a></h4><ul><li>Type: int64</li><li>Description: If the total disk size of the output rowset of the cumulative compaction is lower than this configuration size, the rowset will not undergo base compaction and is still in the cumulative compaction process. The unit is m bytes.<ul><li>Generally, the configuration is within 512m. If the configuration is too large, the size of the early base version is too small, and base compaction has not been performed.</li></ul></li><li>Default value: 128</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="compaction_min_size_mbytes"><code>compaction_min_size_mbytes</code><a href="#compaction_min_size_mbytes" class="hash-link" aria-label="Direct link to compaction_min_size_mbytes" title="Direct link to compaction_min_size_mbytes"></a></h4><ul><li>Type: int64</li><li>Description: When the cumulative compaction is merged, the selected rowsets to be merged have a larger disk size than this configuration, then they are divided and merged according to the level policy. When it is smaller than this configuration, merge directly. The unit is m bytes.<ul><li>Generally, the configuration is within 128m. Over configuration will cause more cumulative compaction write amplification.</li></ul></li><li>Default value: 64</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="default_rowset_type"><code>default_rowset_type</code><a href="#default_rowset_type" class="hash-link" aria-label="Direct link to default_rowset_type" title="Direct link to default_rowset_type"></a></h4><ul><li>Type: string</li><li>Description: Identifies the storage format selected by BE by default. The configurable parameters are: "<strong>ALPHA</strong>", "<strong>BETA</strong>". Mainly play the following two roles<ul><li>When the storage_format of the table is set to Default, select the storage format of BE through this configuration.</li><li>Select the storage format of when BE performing Compaction</li></ul></li><li>Default value: BETA</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="cumulative_compaction_min_deltas"><code>cumulative_compaction_min_deltas</code><a href="#cumulative_compaction_min_deltas" class="hash-link" aria-label="Direct link to cumulative_compaction_min_deltas" title="Direct link to cumulative_compaction_min_deltas"></a></h4><ul><li>Description: Cumulative compaction strategy: the minimum number of incremental files</li><li>Default value: 5</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="cumulative_compaction_max_deltas"><code>cumulative_compaction_max_deltas</code><a href="#cumulative_compaction_max_deltas" class="hash-link" aria-label="Direct link to cumulative_compaction_max_deltas" title="Direct link to cumulative_compaction_max_deltas"></a></h4><ul><li>Description: Cumulative compaction strategy: the maximum number of incremental files</li><li>Default value: 1000</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="base_compaction_trace_threshold"><code>base_compaction_trace_threshold</code><a href="#base_compaction_trace_threshold" class="hash-link" aria-label="Direct link to base_compaction_trace_threshold" title="Direct link to base_compaction_trace_threshold"></a></h4><ul><li>Type: int32</li><li>Description: Threshold to logging base compaction's trace information, in seconds</li><li>Default value: 10</li></ul><p>Base compaction is a long time cost background task, this configuration is the threshold to logging trace information. Trace information in log file looks like:</p><div class="codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-text codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token plain">W0610 11:26:33.804431 56452 storage_engine.cpp:552] execute base compaction cost 0.00319222</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">BaseCompaction:546859:</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> - filtered_rows: 0</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> - input_row_num: 10</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> - input_rowsets_count: 10</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> - input_rowsets_data_size: 2.17 KB</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> - input_segments_num: 10</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> - merge_rowsets_latency: 100000.510ms</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> - merged_rows: 0</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> - output_row_num: 10</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> - output_rowset_data_size: 224.00 B</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> - output_segments_num: 1</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">0610 11:23:03.727535 (+ 0us) storage_engine.cpp:554] start to perform base compaction</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">0610 11:23:03.728961 (+ 1426us) storage_engine.cpp:560] found best tablet 546859</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">0610 11:23:03.728963 (+ 2us) base_compaction.cpp:40] got base compaction lock</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">0610 11:23:03.729029 (+ 66us) base_compaction.cpp:44] rowsets picked</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">0610 11:24:51.784439 (+108055410us) compaction.cpp:46] got concurrency lock and start to do compaction</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">0610 11:24:51.784818 (+ 379us) compaction.cpp:74] prepare finished</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">0610 11:26:33.359265 (+101574447us) compaction.cpp:87] merge rowsets finished</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">0610 11:26:33.484481 (+125216us) compaction.cpp:102] output rowset built</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">0610 11:26:33.484482 (+ 1us) compaction.cpp:106] check correctness finished</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">0610 11:26:33.513197 (+ 28715us) compaction.cpp:110] modify rowsets finished</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">0610 11:26:33.513300 (+ 103us) base_compaction.cpp:49] compaction finished</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">0610 11:26:33.513441 (+ 141us) base_compaction.cpp:56] unused rowsets have been moved to GC queue</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg viewBox="0 0 24 24" class="copyButtonIcon_y97N"><path fill="currentColor" d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg viewBox="0 0 24 24" class="copyButtonSuccessIcon_LjdS"><path fill="currentColor" d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div><h4 class="anchor anchorWithStickyNavbar_LWe7" id="cumulative_compaction_trace_threshold"><code>cumulative_compaction_trace_threshold</code><a href="#cumulative_compaction_trace_threshold" class="hash-link" aria-label="Direct link to cumulative_compaction_trace_threshold" title="Direct link to cumulative_compaction_trace_threshold"></a></h4><ul><li>Type: int32</li><li>Description: Threshold to logging cumulative compaction's trace information, in seconds<ul><li>Similar to <code>base_compaction_trace_threshold</code>.</li></ul></li><li>Default value: 2</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="compaction_task_num_per_disk"><code>compaction_task_num_per_disk</code><a href="#compaction_task_num_per_disk" class="hash-link" aria-label="Direct link to compaction_task_num_per_disk" title="Direct link to compaction_task_num_per_disk"></a></h4><ul><li>Type: int32</li><li>Description: The number of compaction tasks which execute in parallel for a disk(HDD).</li><li>Default value: 4</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="compaction_task_num_per_fast_disk"><code>compaction_task_num_per_fast_disk</code><a href="#compaction_task_num_per_fast_disk" class="hash-link" aria-label="Direct link to compaction_task_num_per_fast_disk" title="Direct link to compaction_task_num_per_fast_disk"></a></h4><ul><li>Type: int32</li><li>Description: The number of compaction tasks which execute in parallel for a fast disk(SSD).</li><li>Default value: 8</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="cumulative_compaction_rounds_for_each_base_compaction_round"><code>cumulative_compaction_rounds_for_each_base_compaction_round</code><a href="#cumulative_compaction_rounds_for_each_base_compaction_round" class="hash-link" aria-label="Direct link to cumulative_compaction_rounds_for_each_base_compaction_round" title="Direct link to cumulative_compaction_rounds_for_each_base_compaction_round"></a></h4><ul><li>Type: int32</li><li>Description: How many rounds of cumulative compaction for each round of base compaction when compaction tasks generation.</li><li>Default value: 9</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="cumulative_compaction_policy"><code>cumulative_compaction_policy</code><a href="#cumulative_compaction_policy" class="hash-link" aria-label="Direct link to cumulative_compaction_policy" title="Direct link to cumulative_compaction_policy"></a></h4><ul><li>Type: string</li><li>Description: Configure the merge strategy in the cumulative compression phase. Currently, two merge strategies are implemented, num_based and size_based<ul><li>For details, "ordinary" is the initial version of the cumulative compression consolidation policy. After a cumulative compression, the base compression process is directly performed. size_The general policy is the optimized version of the ordinary policy. Version merging can only be performed when the disk volume of the rowset is the same order of magnitude. After merging, qualified rowsets are promoted to the base compaction stage. In the case of a large number of small batch imports, it can reduce the write magnification of base compact, balance the read magnification and space magnification, and reduce the data of file versions.</li></ul></li><li>Default value: size_based</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_cumu_compaction_threads"><code>max_cumu_compaction_threads</code><a href="#max_cumu_compaction_threads" class="hash-link" aria-label="Direct link to max_cumu_compaction_threads" title="Direct link to max_cumu_compaction_threads"></a></h4><ul><li>Type: int32</li><li>Description: The maximum of thread number in cumulative compaction thread pool, -1 means one thread per disk.</li><li>Default value: -1</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="enable_segcompaction"><code>enable_segcompaction</code><a href="#enable_segcompaction" class="hash-link" aria-label="Direct link to enable_segcompaction" title="Direct link to enable_segcompaction"></a></h4><ul><li>Type: bool</li><li>Description: Enable to use segment compaction during loading to avoid -238 error</li><li>Default value: true</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="segcompaction_batch_size"><code>segcompaction_batch_size</code><a href="#segcompaction_batch_size" class="hash-link" aria-label="Direct link to segcompaction_batch_size" title="Direct link to segcompaction_batch_size"></a></h4><ul><li>Type: int32</li><li>Description: Max number of segments allowed in a single segment compaction task.</li><li>Default value: 10</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="segcompaction_candidate_max_rows"><code>segcompaction_candidate_max_rows</code><a href="#segcompaction_candidate_max_rows" class="hash-link" aria-label="Direct link to segcompaction_candidate_max_rows" title="Direct link to segcompaction_candidate_max_rows"></a></h4><ul><li>Type: int32</li><li>Description: Max row count allowed in a single source segment, bigger segments will be skipped.</li><li>Default value: 1048576</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="segcompaction_candidate_max_bytes"><code>segcompaction_candidate_max_bytes</code><a href="#segcompaction_candidate_max_bytes" class="hash-link" aria-label="Direct link to segcompaction_candidate_max_bytes" title="Direct link to segcompaction_candidate_max_bytes"></a></h4><ul><li>Type: int64</li><li>Description: Max file size allowed in a single source segment, bigger segments will be skipped.</li><li>Default value: 104857600</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="segcompaction_task_max_rows"><code>segcompaction_task_max_rows</code><a href="#segcompaction_task_max_rows" class="hash-link" aria-label="Direct link to segcompaction_task_max_rows" title="Direct link to segcompaction_task_max_rows"></a></h4><ul><li>Type: int32</li><li>Description: Max total row count allowed in a single segcompaction task.</li><li>Default value: 1572864</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="segcompaction_task_max_bytes"><code>segcompaction_task_max_bytes</code><a href="#segcompaction_task_max_bytes" class="hash-link" aria-label="Direct link to segcompaction_task_max_bytes" title="Direct link to segcompaction_task_max_bytes"></a></h4><ul><li>Type: int64</li><li>Description: Max total file size allowed in a single segcompaction task.</li><li>Default value: 157286400</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="segcompaction_num_threads"><code>segcompaction_num_threads</code><a href="#segcompaction_num_threads" class="hash-link" aria-label="Direct link to segcompaction_num_threads" title="Direct link to segcompaction_num_threads"></a></h4><ul><li>Type: int32</li><li>Description: Global segcompaction thread pool size.</li><li>Default value: 5</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="disable_compaction_trace_log"><code>disable_compaction_trace_log</code><a href="#disable_compaction_trace_log" class="hash-link" aria-label="Direct link to disable_compaction_trace_log" title="Direct link to disable_compaction_trace_log"></a></h4><ul><li>Type: bool</li><li>Description: disable the trace log of compaction<ul><li>If set to true, the <code>cumulative_compaction_trace_threshold</code> and <code>base_compaction_trace_threshold</code> won't work and log is disabled.</li></ul></li><li>Default value: true</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="pick_rowset_to_compact_interval_sec"><code>pick_rowset_to_compact_interval_sec</code><a href="#pick_rowset_to_compact_interval_sec" class="hash-link" aria-label="Direct link to pick_rowset_to_compact_interval_sec" title="Direct link to pick_rowset_to_compact_interval_sec"></a></h4><ul><li>Type: int64</li><li>Description: select the time interval in seconds for rowset to be compacted.</li><li>Default value: 86400</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_single_replica_compaction_threads"><code>max_single_replica_compaction_threads</code><a href="#max_single_replica_compaction_threads" class="hash-link" aria-label="Direct link to max_single_replica_compaction_threads" title="Direct link to max_single_replica_compaction_threads"></a></h4><ul><li>Type: int32</li><li>Description: The maximum of thread number in single replica compaction thread pool. -1 means one thread per disk.</li><li>Default value: -1</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="update_replica_infos_interval_seconds"><code>update_replica_infos_interval_seconds</code><a href="#update_replica_infos_interval_seconds" class="hash-link" aria-label="Direct link to update_replica_infos_interval_seconds" title="Direct link to update_replica_infos_interval_seconds"></a></h4><ul><li>Description: Minimal interval (s) to update peer replica infos</li><li>Default value: 60 (s)</li></ul><h3 class="anchor anchorWithStickyNavbar_LWe7" id="load">Load<a href="#load" class="hash-link" aria-label="Direct link to Load" title="Direct link to Load"></a></h3><h4 class="anchor anchorWithStickyNavbar_LWe7" id="enable_stream_load_record"><code>enable_stream_load_record</code><a href="#enable_stream_load_record" class="hash-link" aria-label="Direct link to enable_stream_load_record" title="Direct link to enable_stream_load_record"></a></h4><ul><li>Type: bool</li><li>Description:Whether to enable stream load record function, the default is false.</li><li>Default value: false</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="load_data_reserve_hours"><code>load_data_reserve_hours</code><a href="#load_data_reserve_hours" class="hash-link" aria-label="Direct link to load_data_reserve_hours" title="Direct link to load_data_reserve_hours"></a></h4><ul><li>Description: Used for mini load. The mini load data file will be deleted after this time</li><li>Default value: 4 (h)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="push_worker_count_high_priority"><code>push_worker_count_high_priority</code><a href="#push_worker_count_high_priority" class="hash-link" aria-label="Direct link to push_worker_count_high_priority" title="Direct link to push_worker_count_high_priority"></a></h4><ul><li>Description: Import the number of threads for processing HIGH priority tasks</li><li>Default value: 3</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="push_worker_count_normal_priority"><code>push_worker_count_normal_priority</code><a href="#push_worker_count_normal_priority" class="hash-link" aria-label="Direct link to push_worker_count_normal_priority" title="Direct link to push_worker_count_normal_priority"></a></h4><ul><li>Description: Import the number of threads for processing NORMAL priority tasks</li><li>Default value: 3</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="enable_single_replica_load"><code>enable_single_replica_load</code><a href="#enable_single_replica_load" class="hash-link" aria-label="Direct link to enable_single_replica_load" title="Direct link to enable_single_replica_load"></a></h4><ul><li>Description: Whether to enable the single-copy data import function</li><li>Default value: true</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="load_error_log_reserve_hours"><code>load_error_log_reserve_hours</code><a href="#load_error_log_reserve_hours" class="hash-link" aria-label="Direct link to load_error_log_reserve_hours" title="Direct link to load_error_log_reserve_hours"></a></h4><ul><li>Description: The load error log will be deleted after this time</li><li>Default value: 48 (h)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="load_error_log_limit_bytes"><code>load_error_log_limit_bytes</code><a href="#load_error_log_limit_bytes" class="hash-link" aria-label="Direct link to load_error_log_limit_bytes" title="Direct link to load_error_log_limit_bytes"></a></h4><ul><li>Description: The loading error logs larger than this value will be truncated</li><li>Default value: 209715200 (byte)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="load_process_max_memory_limit_percent"><code>load_process_max_memory_limit_percent</code><a href="#load_process_max_memory_limit_percent" class="hash-link" aria-label="Direct link to load_process_max_memory_limit_percent" title="Direct link to load_process_max_memory_limit_percent"></a></h4><ul><li>Description: The percentage of the upper memory limit occupied by all imported threads on a single node, the default is 50%<ul><li>Set these default values very large, because we don't want to affect load performance when users upgrade Doris. If necessary, the user should set these configurations correctly</li></ul></li><li>Default value: 50 (%)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="load_process_soft_mem_limit_percent"><code>load_process_soft_mem_limit_percent</code><a href="#load_process_soft_mem_limit_percent" class="hash-link" aria-label="Direct link to load_process_soft_mem_limit_percent" title="Direct link to load_process_soft_mem_limit_percent"></a></h4><ul><li>Description: The soft limit refers to the proportion of the load memory limit of a single node. For example, the load memory limit for all load tasks is 20GB, and the soft limit defaults to 50% of this value, that is, 10GB. When the load memory usage exceeds the soft limit, the job with the largest memory consumption will be selected to be flushed to release the memory space, the default is 50%</li><li>Default value: 50 (%)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="routine_load_thread_pool_size"><code>routine_load_thread_pool_size</code><a href="#routine_load_thread_pool_size" class="hash-link" aria-label="Direct link to routine_load_thread_pool_size" title="Direct link to routine_load_thread_pool_size"></a></h4><ul><li>Description: The thread pool size of the routine load task. This should be greater than the FE configuration'max_concurrent_task_num_per_be'</li><li>Default value: 10</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="slave_replica_writer_rpc_timeout_sec"><code>slave_replica_writer_rpc_timeout_sec</code><a href="#slave_replica_writer_rpc_timeout_sec" class="hash-link" aria-label="Direct link to slave_replica_writer_rpc_timeout_sec" title="Direct link to slave_replica_writer_rpc_timeout_sec"></a></h4><ul><li>Type: int32</li><li>Description: This configuration is mainly used to modify timeout of brpc between master replica and slave replica, used for single replica load.</li><li>Default value: 60</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_segment_num_per_rowset"><code>max_segment_num_per_rowset</code><a href="#max_segment_num_per_rowset" class="hash-link" aria-label="Direct link to max_segment_num_per_rowset" title="Direct link to max_segment_num_per_rowset"></a></h4><ul><li>Type: int32</li><li>Description: Used to limit the number of segments in the newly generated rowset when importing. If the threshold is exceeded, the import will fail with error -238. Too many segments will cause compaction to take up a lot of memory and cause OOM errors.</li><li>Default value: 200</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="high_priority_flush_thread_num_per_store"><code>high_priority_flush_thread_num_per_store</code><a href="#high_priority_flush_thread_num_per_store" class="hash-link" aria-label="Direct link to high_priority_flush_thread_num_per_store" title="Direct link to high_priority_flush_thread_num_per_store"></a></h4><ul><li>Type: int32</li><li>Description: The number of flush threads per store path allocated for the high priority import task.</li><li>Default value: 1</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="routine_load_consumer_pool_size"><code>routine_load_consumer_pool_size</code><a href="#routine_load_consumer_pool_size" class="hash-link" aria-label="Direct link to routine_load_consumer_pool_size" title="Direct link to routine_load_consumer_pool_size"></a></h4><ul><li>Type: int32</li><li>Description: The number of caches for the data consumer used by the routine load.</li><li>Default value: 10</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="multi_table_batch_plan_threshold"><code>multi_table_batch_plan_threshold</code><a href="#multi_table_batch_plan_threshold" class="hash-link" aria-label="Direct link to multi_table_batch_plan_threshold" title="Direct link to multi_table_batch_plan_threshold"></a></h4><ul><li>Type: int32</li><li>Description: For single-stream-multi-table load. When receive a batch of messages from kafka, if the size of batch is more than this threshold, we will request plans for all related tables.</li><li>Default value: 200</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="multi_table_max_wait_tables"><code>multi_table_max_wait_tables</code><a href="#multi_table_max_wait_tables" class="hash-link" aria-label="Direct link to multi_table_max_wait_tables" title="Direct link to multi_table_max_wait_tables"></a></h4><ul><li>Type: int32</li><li>Description: Used in single-stream-multi-table load. When receiving a batch of messages from Kafka, if the size of the table wait for plan is more than this threshold, we will request plans for all related tables.The param is aimed to avoid requesting and executing too many plans at once. Performing small batch processing on multiple tables during the loaded process can reduce the pressure of a single RPC and improve the real-time processing of data.</li><li>Default value: 5</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="single_replica_load_download_num_workers"><code>single_replica_load_download_num_workers</code><a href="#single_replica_load_download_num_workers" class="hash-link" aria-label="Direct link to single_replica_load_download_num_workers" title="Direct link to single_replica_load_download_num_workers"></a></h4><ul><li>Type: int32</li><li>Description:This configuration is mainly used to modify the number of http worker threads for segment download, used for single replica load. When the load concurrency increases, you can adjust this parameter to ensure that the Slave replica synchronizes data files from the Master replica timely. If needed, <code>webserver_num_workers</code> should also be increased for better IO performance.</li><li>Default value: 64</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="load_task_high_priority_threshold_second"><code>load_task_high_priority_threshold_second</code><a href="#load_task_high_priority_threshold_second" class="hash-link" aria-label="Direct link to load_task_high_priority_threshold_second" title="Direct link to load_task_high_priority_threshold_second"></a></h4><ul><li>Type: int32</li><li>Description: When the timeout of an import task is less than this threshold, Doris will consider it to be a high priority task. High priority tasks use a separate pool of flush threads.</li><li>Default: 120</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="min_load_rpc_timeout_ms"><code>min_load_rpc_timeout_ms</code><a href="#min_load_rpc_timeout_ms" class="hash-link" aria-label="Direct link to min_load_rpc_timeout_ms" title="Direct link to min_load_rpc_timeout_ms"></a></h4><ul><li>Type: int32</li><li>Description: The minimum timeout for each rpc in the load job.</li><li>Default: 20</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="kafka_api_version_request"><code>kafka_api_version_request</code><a href="#kafka_api_version_request" class="hash-link" aria-label="Direct link to kafka_api_version_request" title="Direct link to kafka_api_version_request"></a></h4><ul><li>Type: bool</li><li>Description: If the dependent Kafka version is lower than 0.10.0.0, this value should be set to false.</li><li>Default: true</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="kafka_broker_version_fallback"><code>kafka_broker_version_fallback</code><a href="#kafka_broker_version_fallback" class="hash-link" aria-label="Direct link to kafka_broker_version_fallback" title="Direct link to kafka_broker_version_fallback"></a></h4><ul><li>Description: If the dependent Kafka version is lower than 0.10.0.0, the value set by the fallback version kafka_broker_version_fallback will be used if the value of kafka_api_version_request is set to false, and the valid values are: 0.9.0.x, 0.8.x.y.</li><li>Default: 0.10.0</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_consumer_num_per_group"><code>max_consumer_num_per_group</code><a href="#max_consumer_num_per_group" class="hash-link" aria-label="Direct link to max_consumer_num_per_group" title="Direct link to max_consumer_num_per_group"></a></h4><ul><li>Description: The maximum number of consumers in a data consumer group, used for routine load</li><li>Default: 3</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="streaming_load_max_mb"><code>streaming_load_max_mb</code><a href="#streaming_load_max_mb" class="hash-link" aria-label="Direct link to streaming_load_max_mb" title="Direct link to streaming_load_max_mb"></a></h4><ul><li>Type: int64</li><li>Description: Used to limit the maximum amount of csv data allowed in one Stream load.<ul><li>Stream Load is generally suitable for loading data less than a few GB, not suitable for loading too large data.</li></ul></li><li>Default value: 10240 (MB)</li><li>Dynamically modifiable: Yes</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="streaming_load_json_max_mb"><code>streaming_load_json_max_mb</code><a href="#streaming_load_json_max_mb" class="hash-link" aria-label="Direct link to streaming_load_json_max_mb" title="Direct link to streaming_load_json_max_mb"></a></h4><ul><li>Type: int64</li><li>Description: it is used to limit the maximum amount of json data allowed in one Stream load. The unit is MB.<ul><li>Some data formats, such as JSON, cannot be split. Doris must read all the data into the memory before parsing can begin. Therefore, this value is used to limit the maximum amount of data that can be loaded in a single Stream load.</li></ul></li><li>Default value: 100</li><li>Dynamically modifiable: Yes</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="olap_table_sink_send_interval_microseconds"><code>olap_table_sink_send_interval_microseconds</code><a href="#olap_table_sink_send_interval_microseconds" class="hash-link" aria-label="Direct link to olap_table_sink_send_interval_microseconds" title="Direct link to olap_table_sink_send_interval_microseconds"></a></h4><ul><li>Description: While loading data, there's a polling thread keep sending data to corresponding BE from Coordinator's sink node. This thread will check whether there's data to send every <code>olap_table_sink_send_interval_microseconds</code> microseconds.</li><li>Default value: 1000</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="olap_table_sink_send_interval_auto_partition_factor"><code>olap_table_sink_send_interval_auto_partition_factor</code><a href="#olap_table_sink_send_interval_auto_partition_factor" class="hash-link" aria-label="Direct link to olap_table_sink_send_interval_auto_partition_factor" title="Direct link to olap_table_sink_send_interval_auto_partition_factor"></a></h4><ul><li>Description: If we load data to a table which enabled auto partition. the interval of <code>olap_table_sink_send_interval_microseconds</code> is too slow. In that case the real interval will multiply this factor.</li><li>Default value: 0.001</li></ul><h3 class="anchor anchorWithStickyNavbar_LWe7" id="thread">Thread<a href="#thread" class="hash-link" aria-label="Direct link to Thread" title="Direct link to Thread"></a></h3><h4 class="anchor anchorWithStickyNavbar_LWe7" id="delete_worker_count"><code>delete_worker_count</code><a href="#delete_worker_count" class="hash-link" aria-label="Direct link to delete_worker_count" title="Direct link to delete_worker_count"></a></h4><ul><li>Description: Number of threads performing data deletion tasks</li><li>Default value: 3</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="clear_transaction_task_worker_count"><code>clear_transaction_task_worker_count</code><a href="#clear_transaction_task_worker_count" class="hash-link" aria-label="Direct link to clear_transaction_task_worker_count" title="Direct link to clear_transaction_task_worker_count"></a></h4><ul><li>Description: Number of threads used to clean up transactions</li><li>Default value: 1</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="clone_worker_count"><code>clone_worker_count</code><a href="#clone_worker_count" class="hash-link" aria-label="Direct link to clone_worker_count" title="Direct link to clone_worker_count"></a></h4><ul><li>Description: Number of threads used to perform cloning tasks</li><li>Default value: 3</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="be_service_threads"><code>be_service_threads</code><a href="#be_service_threads" class="hash-link" aria-label="Direct link to be_service_threads" title="Direct link to be_service_threads"></a></h4><ul><li>Type: int32</li><li>Description: The number of execution threads of the thrift server service on BE which represents the number of threads that can be used to execute FE requests.</li><li>Default value: 64</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="download_worker_count"><code>download_worker_count</code><a href="#download_worker_count" class="hash-link" aria-label="Direct link to download_worker_count" title="Direct link to download_worker_count"></a></h4><ul><li>Description: The number of download threads.</li><li>Default value: 1</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="drop_tablet_worker_count"><code>drop_tablet_worker_count</code><a href="#drop_tablet_worker_count" class="hash-link" aria-label="Direct link to drop_tablet_worker_count" title="Direct link to drop_tablet_worker_count"></a></h4><ul><li>Description: Number of threads to delete tablet</li><li>Default value: 3</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="flush_thread_num_per_store"><code>flush_thread_num_per_store</code><a href="#flush_thread_num_per_store" class="hash-link" aria-label="Direct link to flush_thread_num_per_store" title="Direct link to flush_thread_num_per_store"></a></h4><ul><li>Description: The number of threads used to refresh the memory table per store</li><li>Default value: 2</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="num_threads_per_core"><code>num_threads_per_core</code><a href="#num_threads_per_core" class="hash-link" aria-label="Direct link to num_threads_per_core" title="Direct link to num_threads_per_core"></a></h4><ul><li>Description: Control the number of threads that each core runs. Usually choose 2 times or 3 times the number of cores. This keeps the core busy without causing excessive jitter</li><li>Default value: 3</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="num_threads_per_disk"><code>num_threads_per_disk</code><a href="#num_threads_per_disk" class="hash-link" aria-label="Direct link to num_threads_per_disk" title="Direct link to num_threads_per_disk"></a></h4><ul><li>Description: The maximum number of threads per disk is also the maximum queue depth of each disk</li><li>Default value: 0</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="number_slave_replica_download_threads"><code>number_slave_replica_download_threads</code><a href="#number_slave_replica_download_threads" class="hash-link" aria-label="Direct link to number_slave_replica_download_threads" title="Direct link to number_slave_replica_download_threads"></a></h4><ul><li>Description: Number of threads for slave replica synchronize data, used for single replica load.</li><li>Default value: 64</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="publish_version_worker_count"><code>publish_version_worker_count</code><a href="#publish_version_worker_count" class="hash-link" aria-label="Direct link to publish_version_worker_count" title="Direct link to publish_version_worker_count"></a></h4><ul><li>Description: the count of thread to publish version</li><li>Default value: 8</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="upload_worker_count"><code>upload_worker_count</code><a href="#upload_worker_count" class="hash-link" aria-label="Direct link to upload_worker_count" title="Direct link to upload_worker_count"></a></h4><ul><li>Description: Maximum number of threads for uploading files</li><li>Default value: 1</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="webserver_num_workers"><code>webserver_num_workers</code><a href="#webserver_num_workers" class="hash-link" aria-label="Direct link to webserver_num_workers" title="Direct link to webserver_num_workers"></a></h4><ul><li>Description: Webserver default number of worker threads</li><li>Default value: 48</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="send_batch_thread_pool_thread_num"><code>send_batch_thread_pool_thread_num</code><a href="#send_batch_thread_pool_thread_num" class="hash-link" aria-label="Direct link to send_batch_thread_pool_thread_num" title="Direct link to send_batch_thread_pool_thread_num"></a></h4><ul><li>Type: int32</li><li>Description: The number of threads in the SendBatch thread pool. In NodeChannels' sending data tasks, the SendBatch operation of each NodeChannel will be submitted as a thread task to the thread pool to be scheduled. This parameter determines the size of the SendBatch thread pool.</li><li>Default value: 64</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="send_batch_thread_pool_queue_size"><code>send_batch_thread_pool_queue_size</code><a href="#send_batch_thread_pool_queue_size" class="hash-link" aria-label="Direct link to send_batch_thread_pool_queue_size" title="Direct link to send_batch_thread_pool_queue_size"></a></h4><ul><li>Type: int32</li><li>Description: The queue length of the SendBatch thread pool. In NodeChannels' sending data tasks, the SendBatch operation of each NodeChannel will be submitted as a thread task to the thread pool waiting to be scheduled, and after the number of submitted tasks exceeds the length of the thread pool queue, subsequent submitted tasks will be blocked until there is a empty slot in the queue.</li><li>Default value: 102400</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="make_snapshot_worker_count"><code>make_snapshot_worker_count</code><a href="#make_snapshot_worker_count" class="hash-link" aria-label="Direct link to make_snapshot_worker_count" title="Direct link to make_snapshot_worker_count"></a></h4><ul><li>Description: Number of threads making snapshots</li><li>Default value: 5</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="release_snapshot_worker_count"><code>release_snapshot_worker_count</code><a href="#release_snapshot_worker_count" class="hash-link" aria-label="Direct link to release_snapshot_worker_count" title="Direct link to release_snapshot_worker_count"></a></h4><ul><li>Description: Number of threads releasing snapshots</li><li>Default value: 5</li></ul><h3 class="anchor anchorWithStickyNavbar_LWe7" id="memory">Memory<a href="#memory" class="hash-link" aria-label="Direct link to Memory" title="Direct link to Memory"></a></h3><h4 class="anchor anchorWithStickyNavbar_LWe7" id="disable_mem_pools"><code>disable_mem_pools</code><a href="#disable_mem_pools" class="hash-link" aria-label="Direct link to disable_mem_pools" title="Direct link to disable_mem_pools"></a></h4><ul><li>Type: bool</li><li>Description: Whether to disable the memory cache pool.</li><li>Default value: false</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="buffer_pool_clean_pages_limit"><code>buffer_pool_clean_pages_limit</code><a href="#buffer_pool_clean_pages_limit" class="hash-link" aria-label="Direct link to buffer_pool_clean_pages_limit" title="Direct link to buffer_pool_clean_pages_limit"></a></h4><ul><li>Description: Clean up pages that may be saved by the buffer pool</li><li>Default value: 50%</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="buffer_pool_limit"><code>buffer_pool_limit</code><a href="#buffer_pool_limit" class="hash-link" aria-label="Direct link to buffer_pool_limit" title="Direct link to buffer_pool_limit"></a></h4><ul><li>Type: string</li><li>Description: The largest allocatable memory of the buffer pool<ul><li>The maximum amount of memory available in the BE buffer pool. The buffer pool is a new memory management structure of BE, which manages the memory by the buffer page and enables spill data to disk. The memory for all concurrent queries will be allocated from the buffer pool. The current buffer pool only works on <strong>AggregationNode</strong> and <strong>ExchangeNode</strong>.</li></ul></li><li>Default value: 20%</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="chunk_reserved_bytes_limit"><code>chunk_reserved_bytes_limit</code><a href="#chunk_reserved_bytes_limit" class="hash-link" aria-label="Direct link to chunk_reserved_bytes_limit" title="Direct link to chunk_reserved_bytes_limit"></a></h4><ul><li>Description: The reserved bytes limit of Chunk Allocator, usually set as a percentage of mem_limit. defaults to bytes if no unit is given, the number of bytes must be a multiple of 2. must larger than 0. and if larger than physical memory size, it will be set to physical memory size. increase this variable can improve performance, but will acquire more free memory which can not be used by other modules.</li><li>Default value: 20%</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="madvise_huge_pages"><code>madvise_huge_pages</code><a href="#madvise_huge_pages" class="hash-link" aria-label="Direct link to madvise_huge_pages" title="Direct link to madvise_huge_pages"></a></h4><ul><li>Type: bool</li><li>Description: Whether to use linux memory huge pages.</li><li>Default value: false</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_memory_sink_batch_count"><code>max_memory_sink_batch_count</code><a href="#max_memory_sink_batch_count" class="hash-link" aria-label="Direct link to max_memory_sink_batch_count" title="Direct link to max_memory_sink_batch_count"></a></h4><ul><li>Description: The maximum external scan cache batch count, which means that the cache max_memory_cache_batch_count <em> batch_size row, the default is 20, and the default value of batch_size is 1024, which means that 20 </em> 1024 rows will be cached</li><li>Default value: 20</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="memory_max_alignment"><code>memory_max_alignment</code><a href="#memory_max_alignment" class="hash-link" aria-label="Direct link to memory_max_alignment" title="Direct link to memory_max_alignment"></a></h4><ul><li>Description: Maximum alignment memory</li><li>Default value: 16</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="mmap_buffers"><code>mmap_buffers</code><a href="#mmap_buffers" class="hash-link" aria-label="Direct link to mmap_buffers" title="Direct link to mmap_buffers"></a></h4><ul><li>Description: Whether to use mmap to allocate memory</li><li>Default value: false</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="memtable_mem_tracker_refresh_interval_ms"><code>memtable_mem_tracker_refresh_interval_ms</code><a href="#memtable_mem_tracker_refresh_interval_ms" class="hash-link" aria-label="Direct link to memtable_mem_tracker_refresh_interval_ms" title="Direct link to memtable_mem_tracker_refresh_interval_ms"></a></h4><ul><li>Description: Interval in milliseconds between memtable flush mgr refresh iterations</li><li>Default value: 100</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="zone_map_row_num_threshold"><code>zone_map_row_num_threshold</code><a href="#zone_map_row_num_threshold" class="hash-link" aria-label="Direct link to zone_map_row_num_threshold" title="Direct link to zone_map_row_num_threshold"></a></h4><ul><li>Type: int32</li><li>Description: If the number of rows in a page is less than this value, no zonemap will be created to reduce data expansion</li><li>Default value: 20</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="enable_tcmalloc_hook"><code>enable_tcmalloc_hook</code><a href="#enable_tcmalloc_hook" class="hash-link" aria-label="Direct link to enable_tcmalloc_hook" title="Direct link to enable_tcmalloc_hook"></a></h4><ul><li>Type: bool</li><li>Description: Whether Hook TCmalloc new/delete, currently consume/release tls mem tracker in Hook.</li><li>Default value: true</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="memory_mode"><code>memory_mode</code><a href="#memory_mode" class="hash-link" aria-label="Direct link to memory_mode" title="Direct link to memory_mode"></a></h4><ul><li>Type: string</li><li>Description: Control gc of tcmalloc, in performance mode Doris releases memory of tcmalloc cache when usage >= 90% <em> mem_limit, otherwise, doris releases memory of tcmalloc cache when usage >= 50% </em> mem_limit;</li><li>Default value: performance</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_sys_mem_available_low_water_mark_bytes"><code>max_sys_mem_available_low_water_mark_bytes</code><a href="#max_sys_mem_available_low_water_mark_bytes" class="hash-link" aria-label="Direct link to max_sys_mem_available_low_water_mark_bytes" title="Direct link to max_sys_mem_available_low_water_mark_bytes"></a></h4><ul><li>Type: int64</li><li>Description: The maximum low water mark of the system <code>/proc/meminfo/MemAvailable</code>, Unit byte, default 1.6G, actual low water mark=min(1.6G, MemTotal * 10%), avoid wasting too much memory on machines with large memory larger than 16G. Turn up max. On machines with more than 16G memory, more memory buffers will be reserved for Full GC. Turn down max. will use as much memory as possible.</li><li>Default value: 1717986918</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="memory_limitation_per_thread_for_schema_change_bytes"><code>memory_limitation_per_thread_for_schema_change_bytes</code><a href="#memory_limitation_per_thread_for_schema_change_bytes" class="hash-link" aria-label="Direct link to memory_limitation_per_thread_for_schema_change_bytes" title="Direct link to memory_limitation_per_thread_for_schema_change_bytes"></a></h4><ul><li>Description: Maximum memory allowed for a single schema change task</li><li>Default value: 2147483648 (2GB)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="mem_tracker_consume_min_size_bytes"><code>mem_tracker_consume_min_size_bytes</code><a href="#mem_tracker_consume_min_size_bytes" class="hash-link" aria-label="Direct link to mem_tracker_consume_min_size_bytes" title="Direct link to mem_tracker_consume_min_size_bytes"></a></h4><ul><li>Type: int32</li><li>Description: The minimum length of TCMalloc Hook when consume/release MemTracker. Consume size smaller than this value will continue to accumulate to avoid frequent calls to consume/release of MemTracker. Decreasing this value will increase the frequency of consume/release. Increasing this value will cause MemTracker statistics to be inaccurate. Theoretically, the statistical value of a MemTracker differs from the true value = ( mem_tracker_consume_min_size_bytes * the number of BE threads where the MemTracker is located).</li><li>Default value: 1,048,576</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="cache_clean_interval"><code>cache_clean_interval</code><a href="#cache_clean_interval" class="hash-link" aria-label="Direct link to cache_clean_interval" title="Direct link to cache_clean_interval"></a></h4><ul><li>Description: File handle cache cleaning interval, used to clean up file handles that have not been used for a long time.Also the clean interval of Segment Cache.</li><li>Default value: 1800 (s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="min_buffer_size"><code>min_buffer_size</code><a href="#min_buffer_size" class="hash-link" aria-label="Direct link to min_buffer_size" title="Direct link to min_buffer_size"></a></h4><ul><li>Description: Minimum read buffer size</li><li>Default value: 1024 (byte)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="write_buffer_size"><code>write_buffer_size</code><a href="#write_buffer_size" class="hash-link" aria-label="Direct link to write_buffer_size" title="Direct link to write_buffer_size"></a></h4><ul><li>Description: The size of the buffer before flashing<ul><li>Imported data is first written to a memory block on the BE, and only written back to disk when this memory block reaches the threshold. The default size is 100MB. too small a threshold may result in a large number of small files on the BE. This threshold can be increased to reduce the number of files. However, too large a threshold may cause RPC timeouts</li></ul></li><li>Default value: 104,857,600</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="remote_storage_read_buffer_mb"><code>remote_storage_read_buffer_mb</code><a href="#remote_storage_read_buffer_mb" class="hash-link" aria-label="Direct link to remote_storage_read_buffer_mb" title="Direct link to remote_storage_read_buffer_mb"></a></h4><ul><li>Type: int32</li><li>Description: The cache size used when reading files on hdfs or object storage.<ul><li>Increasing this value can reduce the number of calls to read remote data, but it will increase memory overhead.</li></ul></li><li>Default value: 16 (MB)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="file_cache_type"><code>file_cache_type</code><a href="#file_cache_type" class="hash-link" aria-label="Direct link to file_cache_type" title="Direct link to file_cache_type"></a></h4><ul><li>Type: string</li><li>Description: Type of cache file.<code>whole_file_cache</code>: download the entire segment file, <code>sub_file_cache</code>: the segment file is divided into multiple files by size. if set "", no cache, please set this parameter when caching is required.</li><li>Default value: ""</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="file_cache_alive_time_sec"><code>file_cache_alive_time_sec</code><a href="#file_cache_alive_time_sec" class="hash-link" aria-label="Direct link to file_cache_alive_time_sec" title="Direct link to file_cache_alive_time_sec"></a></h4><ul><li>Type: int64</li><li>Description: Save time of cache file</li><li>Default value: 604800 (1 week)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="file_cache_max_size_per_disk"><code>file_cache_max_size_per_disk</code><a href="#file_cache_max_size_per_disk" class="hash-link" aria-label="Direct link to file_cache_max_size_per_disk" title="Direct link to file_cache_max_size_per_disk"></a></h4><ul><li>Type: int64</li><li>Description: The cache occupies the disk size. Once this setting is exceeded, the cache that has not been accessed for the longest time will be deleted. If it is 0, the size is not limited. unit is bytes.</li><li>Default value: 0</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_sub_cache_file_size"><code>max_sub_cache_file_size</code><a href="#max_sub_cache_file_size" class="hash-link" aria-label="Direct link to max_sub_cache_file_size" title="Direct link to max_sub_cache_file_size"></a></h4><ul><li>Type: int64</li><li>Description: Cache files using sub<em> file</em> The maximum size of the split file during cache</li><li>Default value: 104857600 (100MB)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="download_cache_thread_pool_thread_num"><code>download_cache_thread_pool_thread_num</code><a href="#download_cache_thread_pool_thread_num" class="hash-link" aria-label="Direct link to download_cache_thread_pool_thread_num" title="Direct link to download_cache_thread_pool_thread_num"></a></h4><ul><li>Type: int32</li><li>Description: The number of threads in the DownloadCache thread pool. In the download cache task of FileCache, the download cache operation will be submitted to the thread pool as a thread task and wait to be scheduled. This parameter determines the size of the DownloadCache thread pool.</li><li>Default value: 48</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="download_cache_thread_pool_queue_size"><code>download_cache_thread_pool_queue_size</code><a href="#download_cache_thread_pool_queue_size" class="hash-link" aria-label="Direct link to download_cache_thread_pool_queue_size" title="Direct link to download_cache_thread_pool_queue_size"></a></h4><ul><li>Type: int32</li><li>Description: The number of threads in the DownloadCache thread pool. In the download cache task of FileCache, the download cache operation will be submitted to the thread pool as a thread task and wait to be scheduled. After the number of submitted tasks exceeds the length of the thread pool queue, subsequent submitted tasks will be blocked until there is a empty slot in the queue.</li><li>Default value: 102400</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="generate_cache_cleaner_task_interval_sec"><code>generate_cache_cleaner_task_interval_sec</code><a href="#generate_cache_cleaner_task_interval_sec" class="hash-link" aria-label="Direct link to generate_cache_cleaner_task_interval_sec" title="Direct link to generate_cache_cleaner_task_interval_sec"></a></h4><ul><li>Type：int64</li><li>Description: Cleaning interval of cache files, in seconds</li><li>Default: 43200 (12 hours)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="path_gc_check"><code>path_gc_check</code><a href="#path_gc_check" class="hash-link" aria-label="Direct link to path_gc_check" title="Direct link to path_gc_check"></a></h4><ul><li>Type：bool</li><li>Description: Whether to enable the recycle scan data thread check</li><li>Default：true</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="path_gc_check_interval_second"><code>path_gc_check_interval_second</code><a href="#path_gc_check_interval_second" class="hash-link" aria-label="Direct link to path_gc_check_interval_second" title="Direct link to path_gc_check_interval_second"></a></h4><ul><li>Description: Recycle scan data thread check interval</li><li>Default：86400 (s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="path_gc_check_step"><code>path_gc_check_step</code><a href="#path_gc_check_step" class="hash-link" aria-label="Direct link to path_gc_check_step" title="Direct link to path_gc_check_step"></a></h4><ul><li>Default：1000</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="path_gc_check_step_interval_ms"><code>path_gc_check_step_interval_ms</code><a href="#path_gc_check_step_interval_ms" class="hash-link" aria-label="Direct link to path_gc_check_step_interval_ms" title="Direct link to path_gc_check_step_interval_ms"></a></h4><ul><li>Default：10 (ms)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="path_scan_interval_second"><code>path_scan_interval_second</code><a href="#path_scan_interval_second" class="hash-link" aria-label="Direct link to path_scan_interval_second" title="Direct link to path_scan_interval_second"></a></h4><ul><li>Default：86400</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="scan_context_gc_interval_min"><code>scan_context_gc_interval_min</code><a href="#scan_context_gc_interval_min" class="hash-link" aria-label="Direct link to scan_context_gc_interval_min" title="Direct link to scan_context_gc_interval_min"></a></h4><ul><li>Description: This configuration is used for the context gc thread scheduling cycle. Note: The unit is minutes, and the default is 5 minutes</li><li>Default：5</li></ul><h3 class="anchor anchorWithStickyNavbar_LWe7" id="storage">Storage<a href="#storage" class="hash-link" aria-label="Direct link to Storage" title="Direct link to Storage"></a></h3><h4 class="anchor anchorWithStickyNavbar_LWe7" id="default_num_rows_per_column_file_block"><code>default_num_rows_per_column_file_block</code><a href="#default_num_rows_per_column_file_block" class="hash-link" aria-label="Direct link to default_num_rows_per_column_file_block" title="Direct link to default_num_rows_per_column_file_block"></a></h4><ul><li>Type: int32</li><li>Description: Configure how many rows of data are contained in a single RowBlock.</li><li>Default value: 1024</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="disable_storage_page_cache"><code>disable_storage_page_cache</code><a href="#disable_storage_page_cache" class="hash-link" aria-label="Direct link to disable_storage_page_cache" title="Direct link to disable_storage_page_cache"></a></h4><ul><li>Type: bool</li><li>Description: Disable to use page cache for index caching, this configuration only takes effect in BETA storage format, usually it is recommended to false</li><li>Default value: false</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="disk_stat_monitor_interval"><code>disk_stat_monitor_interval</code><a href="#disk_stat_monitor_interval" class="hash-link" aria-label="Direct link to disk_stat_monitor_interval" title="Direct link to disk_stat_monitor_interval"></a></h4><ul><li>Description: Disk status check interval</li><li>Default value: 5 (s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_free_io_buffers"><code>max_free_io_buffers</code><a href="#max_free_io_buffers" class="hash-link" aria-label="Direct link to max_free_io_buffers" title="Direct link to max_free_io_buffers"></a></h4><ul><li>Description: For each io buffer size, the maximum number of buffers that IoMgr will reserve ranges from 1024B to 8MB buffers, up to about 2GB buffers.</li><li>Default value: 128</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_garbage_sweep_interval"><code>max_garbage_sweep_interval</code><a href="#max_garbage_sweep_interval" class="hash-link" aria-label="Direct link to max_garbage_sweep_interval" title="Direct link to max_garbage_sweep_interval"></a></h4><ul><li>Description: The maximum interval for disk garbage cleaning</li><li>Default value: 3600 (s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_percentage_of_error_disk"><code>max_percentage_of_error_disk</code><a href="#max_percentage_of_error_disk" class="hash-link" aria-label="Direct link to max_percentage_of_error_disk" title="Direct link to max_percentage_of_error_disk"></a></h4><ul><li>Type: int32</li><li>Description: The storage engine allows the percentage of damaged hard disks to exist. After the damaged hard disk exceeds the changed ratio, BE will automatically exit.</li><li>Default value: 0</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="read_size"><code>read_size</code><a href="#read_size" class="hash-link" aria-label="Direct link to read_size" title="Direct link to read_size"></a></h4><ul><li>Description: The read size is the read size sent to the os. There is a trade-off between latency and the whole process, getting to keep the disk busy but not introducing seeks. For 8 MB reads, random io and sequential io have similar performance.</li><li>Default value: 8388608</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="min_garbage_sweep_interval"><code>min_garbage_sweep_interval</code><a href="#min_garbage_sweep_interval" class="hash-link" aria-label="Direct link to min_garbage_sweep_interval" title="Direct link to min_garbage_sweep_interval"></a></h4><ul><li>Description: The minimum interval between disk garbage cleaning</li><li>Default value: 180 (s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="pprof_profile_dir"><code>pprof_profile_dir</code><a href="#pprof_profile_dir" class="hash-link" aria-label="Direct link to pprof_profile_dir" title="Direct link to pprof_profile_dir"></a></h4><ul><li>Description: pprof profile save directory</li><li>Default value: ${DORIS_HOME}/log</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="small_file_dir"><code>small_file_dir</code><a href="#small_file_dir" class="hash-link" aria-label="Direct link to small_file_dir" title="Direct link to small_file_dir"></a></h4><ul><li>Description: Save files downloaded by SmallFileMgr</li><li>Default value: ${DORIS_HOME}/lib/small_file/</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="user_function_dir"><code>user_function_dir</code><a href="#user_function_dir" class="hash-link" aria-label="Direct link to user_function_dir" title="Direct link to user_function_dir"></a></h4><ul><li>Description: udf function directory</li><li>Default value: ${DORIS_HOME}/lib/udf</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="storage_flood_stage_left_capacity_bytes"><code>storage_flood_stage_left_capacity_bytes</code><a href="#storage_flood_stage_left_capacity_bytes" class="hash-link" aria-label="Direct link to storage_flood_stage_left_capacity_bytes" title="Direct link to storage_flood_stage_left_capacity_bytes"></a></h4><ul><li>Description: The min bytes that should be left of a data dir.</li><li>Default value: 1073741824</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="storage_flood_stage_usage_percent"><code>storage_flood_stage_usage_percent</code><a href="#storage_flood_stage_usage_percent" class="hash-link" aria-label="Direct link to storage_flood_stage_usage_percent" title="Direct link to storage_flood_stage_usage_percent"></a></h4><ul><li>Description: The storage_flood_stage_usage_percent and storage_flood_stage_left_capacity_bytes configurations limit the maximum usage of the capacity of the data directory.</li><li>Default value: 90 (90%)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="storage_medium_migrate_count"><code>storage_medium_migrate_count</code><a href="#storage_medium_migrate_count" class="hash-link" aria-label="Direct link to storage_medium_migrate_count" title="Direct link to storage_medium_migrate_count"></a></h4><ul><li>Description: the count of thread to clone</li><li>Default value: 1</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="storage_page_cache_limit"><code>storage_page_cache_limit</code><a href="#storage_page_cache_limit" class="hash-link" aria-label="Direct link to storage_page_cache_limit" title="Direct link to storage_page_cache_limit"></a></h4><ul><li>Description: Cache for storage page size</li><li>Default value: 20%</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="storage_page_cache_shard_size"><code>storage_page_cache_shard_size</code><a href="#storage_page_cache_shard_size" class="hash-link" aria-label="Direct link to storage_page_cache_shard_size" title="Direct link to storage_page_cache_shard_size"></a></h4><ul><li>Description: Shard size of StoragePageCache, the value must be power of two. It's recommended to set it to a value close to the number of BE cores in order to reduce lock contentions.</li><li>Default value: 16</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="index_page_cache_percentage"><code>index_page_cache_percentage</code><a href="#index_page_cache_percentage" class="hash-link" aria-label="Direct link to index_page_cache_percentage" title="Direct link to index_page_cache_percentage"></a></h4><ul><li>Type: int32</li><li>Description: Index page cache as a percentage of total storage page cache, value range is <!-- -->[0, 100]</li><li>Default value: 10</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="segment_cache_capacity"><code>segment_cache_capacity</code><a href="#segment_cache_capacity" class="hash-link" aria-label="Direct link to segment_cache_capacity" title="Direct link to segment_cache_capacity"></a></h4><ul><li>Type: int32</li><li>Description: Max number of segment cache (the key is rowset id) entries. -1 is for backward compatibility as fd_number * 2/5.</li><li>Default value: -1</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="storage_strict_check_incompatible_old_format"><code>storage_strict_check_incompatible_old_format</code><a href="#storage_strict_check_incompatible_old_format" class="hash-link" aria-label="Direct link to storage_strict_check_incompatible_old_format" title="Direct link to storage_strict_check_incompatible_old_format"></a></h4><ul><li>Type: bool</li><li>Description: Used to check incompatible old format strictly</li><li>Default value: true</li><li>Dynamically modify: false</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="sync_tablet_meta"><code>sync_tablet_meta</code><a href="#sync_tablet_meta" class="hash-link" aria-label="Direct link to sync_tablet_meta" title="Direct link to sync_tablet_meta"></a></h4><ul><li>Description: Whether the storage engine opens sync and keeps it to the disk</li><li>Default value: true</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="pending_data_expire_time_sec"><code>pending_data_expire_time_sec</code><a href="#pending_data_expire_time_sec" class="hash-link" aria-label="Direct link to pending_data_expire_time_sec" title="Direct link to pending_data_expire_time_sec"></a></h4><ul><li>Description: The maximum duration of unvalidated data retained by the storage engine</li><li>Default value: 1800 (s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="ignore_rowset_stale_unconsistent_delete"><code>ignore_rowset_stale_unconsistent_delete</code><a href="#ignore_rowset_stale_unconsistent_delete" class="hash-link" aria-label="Direct link to ignore_rowset_stale_unconsistent_delete" title="Direct link to ignore_rowset_stale_unconsistent_delete"></a></h4><ul><li>Type: boolean</li><li>Description:It is used to decide whether to delete the outdated merged rowset if it cannot form a consistent version path.<ul><li>The merged expired rowset version path will be deleted after half an hour. In abnormal situations, deleting these versions will result in the problem that the consistent path of the query cannot be constructed. When the configuration is false, the program check is strict and the program will directly report an error and exit.When configured as true, the program will run normally and ignore this error. In general, ignoring this error will not affect the query, only when the merged version is dispatched by fe, -230 error will appear.</li></ul></li><li>Default value: false</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="create_tablet_worker_count"><code>create_tablet_worker_count</code><a href="#create_tablet_worker_count" class="hash-link" aria-label="Direct link to create_tablet_worker_count" title="Direct link to create_tablet_worker_count"></a></h4><ul><li>Description: Number of worker threads for BE to create a tablet</li><li>Default value: 3</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="check_consistency_worker_count"><code>check_consistency_worker_count</code><a href="#check_consistency_worker_count" class="hash-link" aria-label="Direct link to check_consistency_worker_count" title="Direct link to check_consistency_worker_count"></a></h4><ul><li>Description: The number of worker threads to calculate the checksum of the tablet</li><li>Default value: 1</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_tablet_version_num"><code>max_tablet_version_num</code><a href="#max_tablet_version_num" class="hash-link" aria-label="Direct link to max_tablet_version_num" title="Direct link to max_tablet_version_num"></a></h4><ul><li>Type: int</li><li>Description: Limit the number of versions of a single tablet. It is used to prevent a large number of version accumulation problems caused by too frequent import or untimely compaction. When the limit is exceeded, the import task will be rejected.</li><li>Default value: 2000</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="number_tablet_writer_threads"><code>number_tablet_writer_threads</code><a href="#number_tablet_writer_threads" class="hash-link" aria-label="Direct link to number_tablet_writer_threads" title="Direct link to number_tablet_writer_threads"></a></h4><ul><li>Description: Number of tablet write threads</li><li>Default value: 16</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="tablet_map_shard_size"><code>tablet_map_shard_size</code><a href="#tablet_map_shard_size" class="hash-link" aria-label="Direct link to tablet_map_shard_size" title="Direct link to tablet_map_shard_size"></a></h4><ul><li>Description: tablet_map_lock fragment size, the value is 2^n, n=0,1,2,3,4, this is for better tablet management</li><li>Default value: 4</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="tablet_meta_checkpoint_min_interval_secs"><code>tablet_meta_checkpoint_min_interval_secs</code><a href="#tablet_meta_checkpoint_min_interval_secs" class="hash-link" aria-label="Direct link to tablet_meta_checkpoint_min_interval_secs" title="Direct link to tablet_meta_checkpoint_min_interval_secs"></a></h4><ul><li>Description: TabletMeta Checkpoint 线程轮询的时间间隔</li><li>Default value: 600 (s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="tablet_meta_checkpoint_min_new_rowsets_num"><code>tablet_meta_checkpoint_min_new_rowsets_num</code><a href="#tablet_meta_checkpoint_min_new_rowsets_num" class="hash-link" aria-label="Direct link to tablet_meta_checkpoint_min_new_rowsets_num" title="Direct link to tablet_meta_checkpoint_min_new_rowsets_num"></a></h4><ul><li>Description: The minimum number of Rowsets for storing TabletMeta Checkpoints</li><li>Default value: 10</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="tablet_stat_cache_update_interval_second"><code>tablet_stat_cache_update_interval_second</code><a href="#tablet_stat_cache_update_interval_second" class="hash-link" aria-label="Direct link to tablet_stat_cache_update_interval_second" title="Direct link to tablet_stat_cache_update_interval_second"></a></h4><ul><li>Description: Update interval of tablet state cache</li><li>Default value:300 (s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="tablet_rowset_stale_sweep_time_sec"><code>tablet_rowset_stale_sweep_time_sec</code><a href="#tablet_rowset_stale_sweep_time_sec" class="hash-link" aria-label="Direct link to tablet_rowset_stale_sweep_time_sec" title="Direct link to tablet_rowset_stale_sweep_time_sec"></a></h4><ul><li>Type: int64</li><li>Description: It is used to control the expiration time of cleaning up the merged rowset version. When the current time now() minus the max created rowset‘s create time in a version path is greater than tablet_rowset_stale_sweep_time_sec, the current path is cleaned up and these merged rowsets are deleted, the unit is second.<ul><li>When writing is too frequent, Fe may not be able to query the merged version, resulting in a query -230 error. This problem can be avoided by increasing this parameter.</li></ul></li><li>Default value: 300</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="tablet_writer_open_rpc_timeout_sec"><code>tablet_writer_open_rpc_timeout_sec</code><a href="#tablet_writer_open_rpc_timeout_sec" class="hash-link" aria-label="Direct link to tablet_writer_open_rpc_timeout_sec" title="Direct link to tablet_writer_open_rpc_timeout_sec"></a></h4><ul><li>Description: Update interval of tablet state cache<ul><li>The RPC timeout for sending a Batch (1024 lines) during import. The default is 60 seconds. Since this RPC may involve writing multiple batches of memory, the RPC timeout may be caused by writing batches, so this timeout can be adjusted to reduce timeout errors (such as send batch fail errors). Also, if you increase the write_buffer_size configuration, you need to increase this parameter as well.</li></ul></li><li>Default value: 60</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="tablet_writer_ignore_eovercrowded"><code>tablet_writer_ignore_eovercrowded</code><a href="#tablet_writer_ignore_eovercrowded" class="hash-link" aria-label="Direct link to tablet_writer_ignore_eovercrowded" title="Direct link to tablet_writer_ignore_eovercrowded"></a></h4><ul><li>Type: bool</li><li>Description: Used to ignore brpc error '<!-- -->[E1011]<!-- -->The server is overcrowded' when writing data.</li><li>Default value: false</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="streaming_load_rpc_max_alive_time_sec"><code>streaming_load_rpc_max_alive_time_sec</code><a href="#streaming_load_rpc_max_alive_time_sec" class="hash-link" aria-label="Direct link to streaming_load_rpc_max_alive_time_sec" title="Direct link to streaming_load_rpc_max_alive_time_sec"></a></h4><ul><li>Description: The lifetime of TabletsChannel. If the channel does not receive any data at this time, the channel will be deleted.</li><li>Default value: 1200</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="alter_tablet_worker_count"><code>alter_tablet_worker_count</code><a href="#alter_tablet_worker_count" class="hash-link" aria-label="Direct link to alter_tablet_worker_count" title="Direct link to alter_tablet_worker_count"></a></h4><ul><li>Description: The number of threads making schema changes</li><li>Default value: 3</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="alter_index_worker_count"><code>alter_index_worker_count</code><a href="#alter_index_worker_count" class="hash-link" aria-label="Direct link to alter_index_worker_count" title="Direct link to alter_index_worker_count"></a></h4><ul><li>Description: The number of threads making index change</li><li>Default value: 3</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="ignore_load_tablet_failure"><code>ignore_load_tablet_failure</code><a href="#ignore_load_tablet_failure" class="hash-link" aria-label="Direct link to ignore_load_tablet_failure" title="Direct link to ignore_load_tablet_failure"></a></h4><ul><li>Type: bool</li><li>Description: It is used to decide whether to ignore errors and continue to start be in case of tablet loading failure</li><li>Default value: false</li></ul><p>When BE starts, a separate thread will be started for each data directory to load the meta information of the tablet header. In the default configuration, if a data directory fails to load a tablet, the startup process will terminate. At the same time, it will be displayed in the <code>be The following error message is seen in the INFO</code> log:</p><div class="codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-text codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token plain">load tablets from header failed, failed tablets size: xxx, path=xxx</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg viewBox="0 0 24 24" class="copyButtonIcon_y97N"><path fill="currentColor" d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg viewBox="0 0 24 24" class="copyButtonSuccessIcon_LjdS"><path fill="currentColor" d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div><p>Indicates how many tablets failed to load in the data directory. At the same time, the log will also contain specific information about the tablets that failed to load. At this time, manual intervention is required to troubleshoot the cause of the error. After troubleshooting, there are usually two ways to restore:</p><ul><li>The tablet information cannot be repaired. If the other copies are normal, you can delete the wrong tablet with the <code>meta_tool</code> tool.</li><li>Set <code>ignore_load_tablet_failure</code> to true, BE will ignore these faulty tablets and start normally</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="report_disk_state_interval_seconds"><code>report_disk_state_interval_seconds</code><a href="#report_disk_state_interval_seconds" class="hash-link" aria-label="Direct link to report_disk_state_interval_seconds" title="Direct link to report_disk_state_interval_seconds"></a></h4><ul><li>Description: The interval time for the agent to report the disk status to FE</li><li>Default value: 60 (s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="result_buffer_cancelled_interval_time"><code>result_buffer_cancelled_interval_time</code><a href="#result_buffer_cancelled_interval_time" class="hash-link" aria-label="Direct link to result_buffer_cancelled_interval_time" title="Direct link to result_buffer_cancelled_interval_time"></a></h4><ul><li>Description: Result buffer cancellation time</li><li>Default value: 300 (s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="snapshot_expire_time_sec"><code>snapshot_expire_time_sec</code><a href="#snapshot_expire_time_sec" class="hash-link" aria-label="Direct link to snapshot_expire_time_sec" title="Direct link to snapshot_expire_time_sec"></a></h4><ul><li>Description: Snapshot file cleaning interval.</li><li>Default value:172800 (48 hours)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="compress_rowbatches"><code>compress_rowbatches</code><a href="#compress_rowbatches" class="hash-link" aria-label="Direct link to compress_rowbatches" title="Direct link to compress_rowbatches"></a></h4><ul><li>Type: bool</li><li>Description: enable to use Snappy compression algorithm for data compression when serializing RowBatch</li><li>Default value: true</li></ul><h3 class="anchor anchorWithStickyNavbar_LWe7" id="log">Log<a href="#log" class="hash-link" aria-label="Direct link to Log" title="Direct link to Log"></a></h3><h4 class="anchor anchorWithStickyNavbar_LWe7" id="sys_log_dir"><code>sys_log_dir</code><a href="#sys_log_dir" class="hash-link" aria-label="Direct link to sys_log_dir" title="Direct link to sys_log_dir"></a></h4><ul><li>Type: string</li><li>Description: Storage directory of BE log data</li><li>Default value: ${DORIS_HOME}/log</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="sys_log_level"><code>sys_log_level</code><a href="#sys_log_level" class="hash-link" aria-label="Direct link to sys_log_level" title="Direct link to sys_log_level"></a></h4><ul><li>Description: Log Level: INFO < WARNING < ERROR < FATAL</li><li>Default value: INFO</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="sys_log_roll_mode"><code>sys_log_roll_mode</code><a href="#sys_log_roll_mode" class="hash-link" aria-label="Direct link to sys_log_roll_mode" title="Direct link to sys_log_roll_mode"></a></h4><ul><li>Description: The size of the log split, one log file is split every 1G</li><li>Default value: SIZE-MB-1024</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="sys_log_roll_num"><code>sys_log_roll_num</code><a href="#sys_log_roll_num" class="hash-link" aria-label="Direct link to sys_log_roll_num" title="Direct link to sys_log_roll_num"></a></h4><ul><li>Description: Number of log files kept</li><li>Default value: 10</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="sys_log_verbose_level"><code>sys_log_verbose_level</code><a href="#sys_log_verbose_level" class="hash-link" aria-label="Direct link to sys_log_verbose_level" title="Direct link to sys_log_verbose_level"></a></h4><ul><li>Description: Log display level, used to control the log output at the beginning of VLOG in the code</li><li>Default value: 10</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="sys_log_verbose_modules"><code>sys_log_verbose_modules</code><a href="#sys_log_verbose_modules" class="hash-link" aria-label="Direct link to sys_log_verbose_modules" title="Direct link to sys_log_verbose_modules"></a></h4><ul><li>Description: Log printing module, writing olap will only print the log under the olap module</li><li>Default value: empty</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="aws_log_level"><code>aws_log_level</code><a href="#aws_log_level" class="hash-link" aria-label="Direct link to aws_log_level" title="Direct link to aws_log_level"></a></h4><ul><li>Type: int32</li><li>Description: log level of AWS SDK,<div class="codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-text codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token plain"> Off = 0,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> Fatal = 1,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> Error = 2,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> Warn = 3,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> Info = 4,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> Debug = 5,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> Trace = 6</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg viewBox="0 0 24 24" class="copyButtonIcon_y97N"><path fill="currentColor" d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg viewBox="0 0 24 24" class="copyButtonSuccessIcon_LjdS"><path fill="currentColor" d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div></li><li>Default value: 3</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="log_buffer_level"><code>log_buffer_level</code><a href="#log_buffer_level" class="hash-link" aria-label="Direct link to log_buffer_level" title="Direct link to log_buffer_level"></a></h4><ul><li>Description: The log flushing strategy is kept in memory by default</li><li>Default value: empty</li></ul><h3 class="anchor anchorWithStickyNavbar_LWe7" id="else">Else<a href="#else" class="hash-link" aria-label="Direct link to Else" title="Direct link to Else"></a></h3><h4 class="anchor anchorWithStickyNavbar_LWe7" id="report_tablet_interval_seconds"><code>report_tablet_interval_seconds</code><a href="#report_tablet_interval_seconds" class="hash-link" aria-label="Direct link to report_tablet_interval_seconds" title="Direct link to report_tablet_interval_seconds"></a></h4><ul><li>Description: The interval time for the agent to report the olap table to the FE</li><li>Default value: 60 (s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="report_task_interval_seconds"><code>report_task_interval_seconds</code><a href="#report_task_interval_seconds" class="hash-link" aria-label="Direct link to report_task_interval_seconds" title="Direct link to report_task_interval_seconds"></a></h4><ul><li>Description: The interval time for the agent to report the task signature to FE</li><li>Default value: 10 (s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="periodic_counter_update_period_ms"><code>periodic_counter_update_period_ms</code><a href="#periodic_counter_update_period_ms" class="hash-link" aria-label="Direct link to periodic_counter_update_period_ms" title="Direct link to periodic_counter_update_period_ms"></a></h4><ul><li>Description: Update rate counter and sampling counter cycle</li><li>Default value: 500 (ms)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="enable_metric_calculator"><code>enable_metric_calculator</code><a href="#enable_metric_calculator" class="hash-link" aria-label="Direct link to enable_metric_calculator" title="Direct link to enable_metric_calculator"></a></h4><ul><li>Description: If set to true, the metric calculator will run to collect BE-related indicator information, if set to false, it will not run</li><li>Default value: true</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="enable_system_metrics"><code>enable_system_metrics</code><a href="#enable_system_metrics" class="hash-link" aria-label="Direct link to enable_system_metrics" title="Direct link to enable_system_metrics"></a></h4><ul><li>Description: User control to turn on and off system indicators.</li><li>Default value: true</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="enable_token_check"><code>enable_token_check</code><a href="#enable_token_check" class="hash-link" aria-label="Direct link to enable_token_check" title="Direct link to enable_token_check"></a></h4><ul><li>Description: Used for forward compatibility, will be removed later.</li><li>Default value: true</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_runnings_transactions_per_txn_map"><code>max_runnings_transactions_per_txn_map</code><a href="#max_runnings_transactions_per_txn_map" class="hash-link" aria-label="Direct link to max_runnings_transactions_per_txn_map" title="Direct link to max_runnings_transactions_per_txn_map"></a></h4><ul><li>Description: Max number of txns for every txn_partition_map in txn manager, this is a self protection to avoid too many txns saving in manager</li><li>Default value: 2000</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="max_download_speed_kbps"><code>max_download_speed_kbps</code><a href="#max_download_speed_kbps" class="hash-link" aria-label="Direct link to max_download_speed_kbps" title="Direct link to max_download_speed_kbps"></a></h4><ul><li>Description: Maximum download speed limit</li><li>Default value: 50000 (kb/s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="download_low_speed_time"><code>download_low_speed_time</code><a href="#download_low_speed_time" class="hash-link" aria-label="Direct link to download_low_speed_time" title="Direct link to download_low_speed_time"></a></h4><ul><li>Description: Download time limit</li><li>Default value: 300 (s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="download_low_speed_limit_kbps"><code>download_low_speed_limit_kbps</code><a href="#download_low_speed_limit_kbps" class="hash-link" aria-label="Direct link to download_low_speed_limit_kbps" title="Direct link to download_low_speed_limit_kbps"></a></h4><ul><li>Description: Minimum download speed</li><li>Default value: 50 (KB/s)</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="doris_cgroups"><code>doris_cgroups</code><a href="#doris_cgroups" class="hash-link" aria-label="Direct link to doris_cgroups" title="Direct link to doris_cgroups"></a></h4><ul><li>Description: Cgroups assigned to doris</li><li>Default value: empty</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="priority_queue_remaining_tasks_increased_frequency"><code>priority_queue_remaining_tasks_increased_frequency</code><a href="#priority_queue_remaining_tasks_increased_frequency" class="hash-link" aria-label="Direct link to priority_queue_remaining_tasks_increased_frequency" title="Direct link to priority_queue_remaining_tasks_increased_frequency"></a></h4><ul><li>Description: the increased frequency of priority for remaining tasks in BlockingPriorityQueue</li><li>Default value: 512</li></ul><span class="version-mark paragraph"><span class="v-mark"><span class="version-tags"><span class="version-tag"><span class="version-tag-t">Since</span><span class="version-tag-n since">Version <!-- -->1.2</span></span></span></span><h4 class="anchor anchorWithStickyNavbar_LWe7" id="jdbc_drivers_dir"><code>jdbc_drivers_dir</code><a href="#jdbc_drivers_dir" class="hash-link" aria-label="Direct link to jdbc_drivers_dir" title="Direct link to jdbc_drivers_dir"></a></h4><ul><li>Description: Default dirs to put jdbc drivers.</li><li>Default value: <code>${DORIS_HOME}/jdbc_drivers</code></li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="enable_simdjson_reader"><code>enable_simdjson_reader</code><a href="#enable_simdjson_reader" class="hash-link" aria-label="Direct link to enable_simdjson_reader" title="Direct link to enable_simdjson_reader"></a></h4><ul><li>Description: Whether enable simdjson to parse json while stream load</li><li>Default value: true</li></ul></span><h4 class="anchor anchorWithStickyNavbar_LWe7" id="enable_query_memory_overcommit"><code>enable_query_memory_overcommit</code><a href="#enable_query_memory_overcommit" class="hash-link" aria-label="Direct link to enable_query_memory_overcommit" title="Direct link to enable_query_memory_overcommit"></a></h4><ul><li>Description: If true, when the process does not exceed the soft mem limit, the query memory will not be limited; when the process memory exceeds the soft mem limit, the query with the largest ratio between the currently used memory and the exec_mem_limit will be canceled. If false, cancel query when the memory used exceeds exec_mem_limit.</li><li>Default value: true</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="user_files_secure_path"><code>user_files_secure_path</code><a href="#user_files_secure_path" class="hash-link" aria-label="Direct link to user_files_secure_path" title="Direct link to user_files_secure_path"></a></h4><ul><li>Description: The storage directory for files queried by <code>local</code> table valued functions.</li><li>Default value: <code>${DORIS_HOME}</code></li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="brpc_streaming_client_batch_bytes"><code>brpc_streaming_client_batch_bytes</code><a href="#brpc_streaming_client_batch_bytes" class="hash-link" aria-label="Direct link to brpc_streaming_client_batch_bytes" title="Direct link to brpc_streaming_client_batch_bytes"></a></h4><ul><li>Description: The batch size for sending data by brpc streaming client</li><li>Default value: 262144</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="grace_shutdown_wait_seconds"><code>grace_shutdown_wait_seconds</code><a href="#grace_shutdown_wait_seconds" class="hash-link" aria-label="Direct link to grace_shutdown_wait_seconds" title="Direct link to grace_shutdown_wait_seconds"></a></h4><ul><li>Description: In cloud native deployment scenario, BE will be add to cluster and remove from cluster very frequently. User's query will fail if there is a fragment is running on the shuting down BE. Users could use stop_be.sh --grace, then BE will wait all running queries to stop to avoiding running query failure, but if the waiting time exceed the limit, then be will exit directly. During this period, FE will not send any queries to BE and waiting for all running queries to stop.</li><li>Default value: 120</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="enable_java_support"><code>enable_java_support</code><a href="#enable_java_support" class="hash-link" aria-label="Direct link to enable_java_support" title="Direct link to enable_java_support"></a></h4><ul><li>Description: BE Whether to enable the use of java-jni. When enabled, mutual calls between c++ and java are allowed. Currently supports hudi, java-udf, jdbc, max-compute, paimon, preload, avro</li><li>Default value: true</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="group_commit_wal_path"><code>group_commit_wal_path</code><a href="#group_commit_wal_path" class="hash-link" aria-label="Direct link to group_commit_wal_path" title="Direct link to group_commit_wal_path"></a></h4><ul><li>The <code>WAL</code> directory of group commit.</li><li>Default: A directory named <code>wal</code> is created under each directory of the <code>storage_root_path</code>. Configuration examples:<div class="codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-text codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token plain">group_commit_wal_path=/data1/storage/wal;/data2/storage/wal;/data3/storage/wal</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg viewBox="0 0 24 24" class="copyButtonIcon_y97N"><path fill="currentColor" d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg viewBox="0 0 24 24" class="copyButtonSuccessIcon_LjdS"><path fill="currentColor" d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div></li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="group_commit_memory_rows_for_max_filter_ratio"><code>group_commit_memory_rows_for_max_filter_ratio</code><a href="#group_commit_memory_rows_for_max_filter_ratio" class="hash-link" aria-label="Direct link to group_commit_memory_rows_for_max_filter_ratio" title="Direct link to group_commit_memory_rows_for_max_filter_ratio"></a></h4><ul><li>Description: The <code>max_filter_ratio</code> limit can only work if the total rows of <code>group commit</code> is less than this value. See <a href="/docs/data-operate/import/group-commit-manual.md">Group Commit</a> for more details</li><li>Default: 10000</li></ul><h4 class="anchor anchorWithStickyNavbar_LWe7" id="default_tzfiles_path"><code>default_tzfiles_path</code><a href="#default_tzfiles_path" class="hash-link" aria-label="Direct link to default_tzfiles_path" title="Direct link to default_tzfiles_path"></a></h4><ul><li>Description: Doris comes with its own time zone database. If the time zone file is not found in the system directory, the data in that directory is enabled.</li><li>Default: "${DORIS_HOME}/zoneinfo"</li></ul></div></article><nav class="pagination-nav docusaurus-mt-lg" aria-label="Docs pages"><a class="pagination-nav__link pagination-nav__link--prev" href="/docs/admin-manual/config/fe-config"><div class="pagination-nav__sublabel">Previous</div><div class="pagination-nav__label">FE Configuration</div></a><a class="pagination-nav__link pagination-nav__link--next" href="/docs/admin-manual/config/user-property"><div class="pagination-nav__sublabel">Next</div><div class="pagination-nav__label">User Property</div></a></nav></div></div><div class="col col--3"><div class="tableOfContents_jeP5 thin-scrollbar theme-doc-toc-desktop"><a href="https://github.com/apache/doris/discussions" target="_blank" rel="noopener noreferrer" class="ml-4 mb-8 flex items-center hover:no-underline"><span class="pr-2">Join Discussion</span><svg viewBox="0 0 1024 1024" version="1.1" xmlns="http://www.w3.org/2000/svg" p-id="8500" id="mx_n_1711090272569" width="16" height="16"><path d="M522.24 896.512c-25.6 4.608-51.712 7.168-78.336 7.168-79.36 0-157.696-21.504-225.792-62.464l-18.432-10.752-103.936 28.16c-28.672 7.68-54.784-18.432-47.104-47.104l28.16-103.936c-10.752-17.92-17.408-30.208-20.992-36.864C20.992 607.232 3.072 536.064 3.584 463.36c0-243.2 197.12-440.32 440.32-440.32 221.696 0 405.504 164.352 435.712 377.856 90.112 55.808 144.896 154.112 144.896 260.096 0 51.2-12.8 100.352-36.352 144.384-2.048 4.096-6.144 10.752-11.776 20.48l17.408 64c7.68 28.672-18.432 54.784-47.104 47.104l-64-17.408-7.68 4.608c-47.616 28.672-101.888 43.52-157.184 43.52-71.68-0.512-140.8-25.088-195.584-71.168z m95.232-28.672c31.232 15.36 65.536 23.04 100.352 23.04 41.472 0 82.432-11.264 117.76-32.768 2.56-1.536 9.728-5.632 22.016-12.8 8.704-5.12 19.456-6.656 29.184-3.584l14.848 4.096-4.096-14.848c-2.56-10.24-1.536-20.48 4.096-29.696 6.144-10.24 12.288-20.992 18.432-31.232 17.92-33.28 27.136-70.656 27.136-108.544 0-59.904-23.552-117.76-65.536-160.256-13.312 164.352-118.272 303.616-264.192 366.592z m-462.848-155.648l-14.848 54.784 54.784-14.848c9.728-2.56 20.48-1.536 29.184 4.096 18.432 10.752 29.184 16.896 32.768 19.456 56.32 33.792 120.832 51.712 186.88 51.712 200.704 0 363.52-162.816 363.52-363.52s-162.816-363.52-363.52-363.52-363.52 162.816-363.52 363.52c0 60.928 14.848 119.296 43.008 171.52 3.584 7.168 13.312 23.04 27.648 47.616 5.632 8.704 6.656 19.456 4.096 29.184z m448.512-382.976c20.992 0 38.4 16.896 38.4 38.4 0 20.992-16.896 38.4-38.4 38.4H284.16c-20.992 0-38.4-16.896-38.4-38.4 0-20.992 16.896-38.4 38.4-38.4h318.976z m-153.088 191.488c20.992 0 38.4 16.896 38.4 38.4 0 20.992-16.896 38.4-38.4 38.4H284.16c-20.992 0-38.4-16.896-38.4-38.4 0-20.992 16.896-38.4 38.4-38.4h165.888z m0 0" p-id="8501" fill="currentColor"></path></svg></a><span class="ml-4">On This Page</span><ul class="table-of-contents table-of-contents__left-border"><li><a href="#view-configuration-items" class="table-of-contents__link toc-highlight">View configuration items</a></li><li><a href="#set-configuration-items" class="table-of-contents__link toc-highlight">Set configuration items</a></li><li><a href="#examples" class="table-of-contents__link toc-highlight">Examples</a></li><li><a href="#configurations" class="table-of-contents__link toc-highlight">Configurations</a><ul><li><a href="#services" class="table-of-contents__link toc-highlight">Services</a><ul><li><a href="#be_port" class="table-of-contents__link toc-highlight"><code>be_port</code></a></li><li><a href="#heartbeat_service_port" class="table-of-contents__link toc-highlight"><code>heartbeat_service_port</code></a></li><li><a href="#webserver_port" class="table-of-contents__link toc-highlight"><code>webserver_port</code></a></li><li><a href="#brpc_port" class="table-of-contents__link toc-highlight"><code>brpc_port</code></a></li><li><a href="#arrow_flight_sql_port" class="table-of-contents__link toc-highlight"><code>arrow_flight_sql_port</code></a></li><li><a href="#enable_https" class="table-of-contents__link toc-highlight"><code>enable_https</code></a></li><li><a href="#priority_networks" class="table-of-contents__link toc-highlight"><code>priority_networks</code></a></li><li><a href="#storage_root_path" class="table-of-contents__link toc-highlight"><code>storage_root_path</code></a></li><li><a href="#heartbeat_service_thread_count" class="table-of-contents__link toc-highlight"><code>heartbeat_service_thread_count</code></a></li><li><a href="#ignore_broken_disk" class="table-of-contents__link toc-highlight"><code>ignore_broken_disk</code></a></li><li><a href="#mem_limit" class="table-of-contents__link toc-highlight"><code>mem_limit</code></a></li><li><a href="#cluster_id" class="table-of-contents__link toc-highlight"><code>cluster_id</code></a></li><li><a href="#custom_config_dir" class="table-of-contents__link toc-highlight"><code>custom_config_dir</code></a></li><li><a href="#trash_file_expire_time_sec" class="table-of-contents__link toc-highlight"><code>trash_file_expire_time_sec</code></a></li><li><a href="#es_http_timeout_ms" class="table-of-contents__link toc-highlight"><code>es_http_timeout_ms</code></a></li><li><a href="#es_scroll_keepalive" class="table-of-contents__link toc-highlight"><code>es_scroll_keepalive</code></a></li><li><a href="#external_table_connect_timeout_sec" class="table-of-contents__link toc-highlight"><code>external_table_connect_timeout_sec</code></a></li><li><a href="#status_report_interval" class="table-of-contents__link toc-highlight"><code>status_report_interval</code></a></li><li><a href="#brpc_max_body_size" class="table-of-contents__link toc-highlight"><code>brpc_max_body_size</code></a></li><li><a href="#brpc_socket_max_unwritten_bytes" class="table-of-contents__link toc-highlight"><code>brpc_socket_max_unwritten_bytes</code></a></li><li><a href="#transfer_large_data_by_brpc" class="table-of-contents__link toc-highlight"><code>transfer_large_data_by_brpc</code></a></li><li><a href="#brpc_num_threads" class="table-of-contents__link toc-highlight"><code>brpc_num_threads</code></a></li><li><a href="#thrift_rpc_timeout_ms" class="table-of-contents__link toc-highlight"><code>thrift_rpc_timeout_ms</code></a></li><li><a href="#thrift_client_retry_interval_ms" class="table-of-contents__link toc-highlight"><code>thrift_client_retry_interval_ms</code></a></li><li><a href="#thrift_connect_timeout_seconds" class="table-of-contents__link toc-highlight"><code>thrift_connect_timeout_seconds</code></a></li><li><a href="#thrift_server_type_of_fe" class="table-of-contents__link toc-highlight"><code>thrift_server_type_of_fe</code></a></li><li><a href="#txn_commit_rpc_timeout_ms" class="table-of-contents__link toc-highlight"><code>txn_commit_rpc_timeout_ms</code></a></li><li><a href="#txn_map_shard_size" class="table-of-contents__link toc-highlight"><code>txn_map_shard_size</code></a></li><li><a href="#txn_shard_size" class="table-of-contents__link toc-highlight"><code>txn_shard_size</code></a></li><li><a href="#unused_rowset_monitor_interval" class="table-of-contents__link toc-highlight"><code>unused_rowset_monitor_interval</code></a></li><li><a href="#max_client_cache_size_per_host" class="table-of-contents__link toc-highlight"><code>max_client_cache_size_per_host</code></a></li><li><a href="#string_type_length_soft_limit_bytes" class="table-of-contents__link toc-highlight"><code>string_type_length_soft_limit_bytes</code></a></li><li><a href="#big_column_size_buffer" class="table-of-contents__link toc-highlight"><code>big_column_size_buffer</code></a></li><li><a href="#small_column_size_buffer" class="table-of-contents__link toc-highlight"><code>small_column_size_buffer</code></a></li><li><a href="#jsonb_type_length_soft_limit_bytes" class="table-of-contents__link toc-highlight"><code>jsonb_type_length_soft_limit_bytes</code></a></li></ul></li><li><a href="#query" class="table-of-contents__link toc-highlight">Query</a><ul><li><a href="#fragment_pool_queue_size" class="table-of-contents__link toc-highlight"><code>fragment_pool_queue_size</code></a></li><li><a href="#fragment_pool_thread_num_min" class="table-of-contents__link toc-highlight"><code>fragment_pool_thread_num_min</code></a></li><li><a href="#fragment_pool_thread_num_max" class="table-of-contents__link toc-highlight"><code>fragment_pool_thread_num_max</code></a></li><li><a href="#doris_max_scan_key_num" class="table-of-contents__link toc-highlight"><code>doris_max_scan_key_num</code></a></li><li><a href="#doris_scan_range_row_count" class="table-of-contents__link toc-highlight"><code>doris_scan_range_row_count</code></a></li><li><a href="#doris_scanner_queue_size" class="table-of-contents__link toc-highlight"><code>doris_scanner_queue_size</code></a></li><li><a href="#doris_scanner_row_num" class="table-of-contents__link toc-highlight"><code>doris_scanner_row_num</code></a></li><li><a href="#doris_scanner_row_bytes" class="table-of-contents__link toc-highlight"><code>doris_scanner_row_bytes</code></a></li><li><a href="#doris_scanner_thread_pool_queue_size" class="table-of-contents__link toc-highlight"><code>doris_scanner_thread_pool_queue_size</code></a></li><li><a href="#doris_scanner_thread_pool_thread_num" class="table-of-contents__link toc-highlight"><code>doris_scanner_thread_pool_thread_num</code></a></li><li><a href="#doris_max_remote_scanner_thread_pool_thread_num" class="table-of-contents__link toc-highlight"><code>doris_max_remote_scanner_thread_pool_thread_num</code></a></li><li><a href="#exchg_node_buffer_size_bytes" class="table-of-contents__link toc-highlight"><code>exchg_node_buffer_size_bytes</code></a></li><li><a href="#max_pushdown_conditions_per_column" class="table-of-contents__link toc-highlight"><code>max_pushdown_conditions_per_column</code></a></li><li><a href="#max_send_batch_parallelism_per_job" class="table-of-contents__link toc-highlight"><code>max_send_batch_parallelism_per_job</code></a></li><li><a href="#doris_scan_range_max_mb" class="table-of-contents__link toc-highlight"><code>doris_scan_range_max_mb</code></a></li></ul></li><li><a href="#compaction" class="table-of-contents__link toc-highlight">compaction</a><ul><li><a href="#disable_auto_compaction" class="table-of-contents__link toc-highlight"><code>disable_auto_compaction</code></a></li><li><a href="#enable_vertical_compaction" class="table-of-contents__link toc-highlight"><code>enable_vertical_compaction</code></a></li><li><a href="#vertical_compaction_num_columns_per_group" class="table-of-contents__link toc-highlight"><code>vertical_compaction_num_columns_per_group</code></a></li><li><a href="#vertical_compaction_max_row_source_memory_mb" class="table-of-contents__link toc-highlight"><code>vertical_compaction_max_row_source_memory_mb</code></a></li><li><a href="#vertical_compaction_max_segment_size" class="table-of-contents__link toc-highlight"><code>vertical_compaction_max_segment_size</code></a></li><li><a href="#enable_ordered_data_compaction" class="table-of-contents__link toc-highlight"><code>enable_ordered_data_compaction</code></a></li><li><a href="#ordered_data_compaction_min_segment_size" class="table-of-contents__link toc-highlight"><code>ordered_data_compaction_min_segment_size</code></a></li><li><a href="#max_base_compaction_threads" class="table-of-contents__link toc-highlight"><code>max_base_compaction_threads</code></a></li><li><a href="#generate_compaction_tasks_interval_ms" class="table-of-contents__link toc-highlight"><code>generate_compaction_tasks_interval_ms</code></a></li><li><a href="#base_compaction_min_rowset_num" class="table-of-contents__link toc-highlight"><code>base_compaction_min_rowset_num</code></a></li><li><a href="#base_compaction_min_data_ratio" class="table-of-contents__link toc-highlight"><code>base_compaction_min_data_ratio</code></a></li><li><a href="#total_permits_for_compaction_score" class="table-of-contents__link toc-highlight"><code>total_permits_for_compaction_score</code></a></li><li><a href="#compaction_promotion_size_mbytes" class="table-of-contents__link toc-highlight"><code>compaction_promotion_size_mbytes</code></a></li><li><a href="#compaction_promotion_ratio" class="table-of-contents__link toc-highlight"><code>compaction_promotion_ratio</code></a></li><li><a href="#compaction_promotion_min_size_mbytes" class="table-of-contents__link toc-highlight"><code>compaction_promotion_min_size_mbytes</code></a></li><li><a href="#compaction_min_size_mbytes" class="table-of-contents__link toc-highlight"><code>compaction_min_size_mbytes</code></a></li><li><a href="#default_rowset_type" class="table-of-contents__link toc-highlight"><code>default_rowset_type</code></a></li><li><a href="#cumulative_compaction_min_deltas" class="table-of-contents__link toc-highlight"><code>cumulative_compaction_min_deltas</code></a></li><li><a href="#cumulative_compaction_max_deltas" class="table-of-contents__link toc-highlight"><code>cumulative_compaction_max_deltas</code></a></li><li><a href="#base_compaction_trace_threshold" class="table-of-contents__link toc-highlight"><code>base_compaction_trace_threshold</code></a></li><li><a href="#cumulative_compaction_trace_threshold" class="table-of-contents__link toc-highlight"><code>cumulative_compaction_trace_threshold</code></a></li><li><a href="#compaction_task_num_per_disk" class="table-of-contents__link toc-highlight"><code>compaction_task_num_per_disk</code></a></li><li><a href="#compaction_task_num_per_fast_disk" class="table-of-contents__link toc-highlight"><code>compaction_task_num_per_fast_disk</code></a></li><li><a href="#cumulative_compaction_rounds_for_each_base_compaction_round" class="table-of-contents__link toc-highlight"><code>cumulative_compaction_rounds_for_each_base_compaction_round</code></a></li><li><a href="#cumulative_compaction_policy" class="table-of-contents__link toc-highlight"><code>cumulative_compaction_policy</code></a></li><li><a href="#max_cumu_compaction_threads" class="table-of-contents__link toc-highlight"><code>max_cumu_compaction_threads</code></a></li><li><a href="#enable_segcompaction" class="table-of-contents__link toc-highlight"><code>enable_segcompaction</code></a></li><li><a href="#segcompaction_batch_size" class="table-of-contents__link toc-highlight"><code>segcompaction_batch_size</code></a></li><li><a href="#segcompaction_candidate_max_rows" class="table-of-contents__link toc-highlight"><code>segcompaction_candidate_max_rows</code></a></li><li><a href="#segcompaction_candidate_max_bytes" class="table-of-contents__link toc-highlight"><code>segcompaction_candidate_max_bytes</code></a></li><li><a href="#segcompaction_task_max_rows" class="table-of-contents__link toc-highlight"><code>segcompaction_task_max_rows</code></a></li><li><a href="#segcompaction_task_max_bytes" class="table-of-contents__link toc-highlight"><code>segcompaction_task_max_bytes</code></a></li><li><a href="#segcompaction_num_threads" class="table-of-contents__link toc-highlight"><code>segcompaction_num_threads</code></a></li><li><a href="#disable_compaction_trace_log" class="table-of-contents__link toc-highlight"><code>disable_compaction_trace_log</code></a></li><li><a href="#pick_rowset_to_compact_interval_sec" class="table-of-contents__link toc-highlight"><code>pick_rowset_to_compact_interval_sec</code></a></li><li><a href="#max_single_replica_compaction_threads" class="table-of-contents__link toc-highlight"><code>max_single_replica_compaction_threads</code></a></li><li><a href="#update_replica_infos_interval_seconds" class="table-of-contents__link toc-highlight"><code>update_replica_infos_interval_seconds</code></a></li></ul></li><li><a href="#load" class="table-of-contents__link toc-highlight">Load</a><ul><li><a href="#enable_stream_load_record" class="table-of-contents__link toc-highlight"><code>enable_stream_load_record</code></a></li><li><a href="#load_data_reserve_hours" class="table-of-contents__link toc-highlight"><code>load_data_reserve_hours</code></a></li><li><a href="#push_worker_count_high_priority" class="table-of-contents__link toc-highlight"><code>push_worker_count_high_priority</code></a></li><li><a href="#push_worker_count_normal_priority" class="table-of-contents__link toc-highlight"><code>push_worker_count_normal_priority</code></a></li><li><a href="#enable_single_replica_load" class="table-of-contents__link toc-highlight"><code>enable_single_replica_load</code></a></li><li><a href="#load_error_log_reserve_hours" class="table-of-contents__link toc-highlight"><code>load_error_log_reserve_hours</code></a></li><li><a href="#load_error_log_limit_bytes" class="table-of-contents__link toc-highlight"><code>load_error_log_limit_bytes</code></a></li><li><a href="#load_process_max_memory_limit_percent" class="table-of-contents__link toc-highlight"><code>load_process_max_memory_limit_percent</code></a></li><li><a href="#load_process_soft_mem_limit_percent" class="table-of-contents__link toc-highlight"><code>load_process_soft_mem_limit_percent</code></a></li><li><a href="#routine_load_thread_pool_size" class="table-of-contents__link toc-highlight"><code>routine_load_thread_pool_size</code></a></li><li><a href="#slave_replica_writer_rpc_timeout_sec" class="table-of-contents__link toc-highlight"><code>slave_replica_writer_rpc_timeout_sec</code></a></li><li><a href="#max_segment_num_per_rowset" class="table-of-contents__link toc-highlight"><code>max_segment_num_per_rowset</code></a></li><li><a href="#high_priority_flush_thread_num_per_store" class="table-of-contents__link toc-highlight"><code>high_priority_flush_thread_num_per_store</code></a></li><li><a href="#routine_load_consumer_pool_size" class="table-of-contents__link toc-highlight"><code>routine_load_consumer_pool_size</code></a></li><li><a href="#multi_table_batch_plan_threshold" class="table-of-contents__link toc-highlight"><code>multi_table_batch_plan_threshold</code></a></li><li><a href="#multi_table_max_wait_tables" class="table-of-contents__link toc-highlight"><code>multi_table_max_wait_tables</code></a></li><li><a href="#single_replica_load_download_num_workers" class="table-of-contents__link toc-highlight"><code>single_replica_load_download_num_workers</code></a></li><li><a href="#load_task_high_priority_threshold_second" class="table-of-contents__link toc-highlight"><code>load_task_high_priority_threshold_second</code></a></li><li><a href="#min_load_rpc_timeout_ms" class="table-of-contents__link toc-highlight"><code>min_load_rpc_timeout_ms</code></a></li><li><a href="#kafka_api_version_request" class="table-of-contents__link toc-highlight"><code>kafka_api_version_request</code></a></li><li><a href="#kafka_broker_version_fallback" class="table-of-contents__link toc-highlight"><code>kafka_broker_version_fallback</code></a></li><li><a href="#max_consumer_num_per_group" class="table-of-contents__link toc-highlight"><code>max_consumer_num_per_group</code></a></li><li><a href="#streaming_load_max_mb" class="table-of-contents__link toc-highlight"><code>streaming_load_max_mb</code></a></li><li><a href="#streaming_load_json_max_mb" class="table-of-contents__link toc-highlight"><code>streaming_load_json_max_mb</code></a></li><li><a href="#olap_table_sink_send_interval_microseconds" class="table-of-contents__link toc-highlight"><code>olap_table_sink_send_interval_microseconds</code></a></li><li><a href="#olap_table_sink_send_interval_auto_partition_factor" class="table-of-contents__link toc-highlight"><code>olap_table_sink_send_interval_auto_partition_factor</code></a></li></ul></li><li><a href="#thread" class="table-of-contents__link toc-highlight">Thread</a><ul><li><a href="#delete_worker_count" class="table-of-contents__link toc-highlight"><code>delete_worker_count</code></a></li><li><a href="#clear_transaction_task_worker_count" class="table-of-contents__link toc-highlight"><code>clear_transaction_task_worker_count</code></a></li><li><a href="#clone_worker_count" class="table-of-contents__link toc-highlight"><code>clone_worker_count</code></a></li><li><a href="#be_service_threads" class="table-of-contents__link toc-highlight"><code>be_service_threads</code></a></li><li><a href="#download_worker_count" class="table-of-contents__link toc-highlight"><code>download_worker_count</code></a></li><li><a href="#drop_tablet_worker_count" class="table-of-contents__link toc-highlight"><code>drop_tablet_worker_count</code></a></li><li><a href="#flush_thread_num_per_store" class="table-of-contents__link toc-highlight"><code>flush_thread_num_per_store</code></a></li><li><a href="#num_threads_per_core" class="table-of-contents__link toc-highlight"><code>num_threads_per_core</code></a></li><li><a href="#num_threads_per_disk" class="table-of-contents__link toc-highlight"><code>num_threads_per_disk</code></a></li><li><a href="#number_slave_replica_download_threads" class="table-of-contents__link toc-highlight"><code>number_slave_replica_download_threads</code></a></li><li><a href="#publish_version_worker_count" class="table-of-contents__link toc-highlight"><code>publish_version_worker_count</code></a></li><li><a href="#upload_worker_count" class="table-of-contents__link toc-highlight"><code>upload_worker_count</code></a></li><li><a href="#webserver_num_workers" class="table-of-contents__link toc-highlight"><code>webserver_num_workers</code></a></li><li><a href="#send_batch_thread_pool_thread_num" class="table-of-contents__link toc-highlight"><code>send_batch_thread_pool_thread_num</code></a></li><li><a href="#send_batch_thread_pool_queue_size" class="table-of-contents__link toc-highlight"><code>send_batch_thread_pool_queue_size</code></a></li><li><a href="#make_snapshot_worker_count" class="table-of-contents__link toc-highlight"><code>make_snapshot_worker_count</code></a></li><li><a href="#release_snapshot_worker_count" class="table-of-contents__link toc-highlight"><code>release_snapshot_worker_count</code></a></li></ul></li><li><a href="#memory" class="table-of-contents__link toc-highlight">Memory</a><ul><li><a href="#disable_mem_pools" class="table-of-contents__link toc-highlight"><code>disable_mem_pools</code></a></li><li><a href="#buffer_pool_clean_pages_limit" class="table-of-contents__link toc-highlight"><code>buffer_pool_clean_pages_limit</code></a></li><li><a href="#buffer_pool_limit" class="table-of-contents__link toc-highlight"><code>buffer_pool_limit</code></a></li><li><a href="#chunk_reserved_bytes_limit" class="table-of-contents__link toc-highlight"><code>chunk_reserved_bytes_limit</code></a></li><li><a href="#madvise_huge_pages" class="table-of-contents__link toc-highlight"><code>madvise_huge_pages</code></a></li><li><a href="#max_memory_sink_batch_count" class="table-of-contents__link toc-highlight"><code>max_memory_sink_batch_count</code></a></li><li><a href="#memory_max_alignment" class="table-of-contents__link toc-highlight"><code>memory_max_alignment</code></a></li><li><a href="#mmap_buffers" class="table-of-contents__link toc-highlight"><code>mmap_buffers</code></a></li><li><a href="#memtable_mem_tracker_refresh_interval_ms" class="table-of-contents__link toc-highlight"><code>memtable_mem_tracker_refresh_interval_ms</code></a></li><li><a href="#zone_map_row_num_threshold" class="table-of-contents__link toc-highlight"><code>zone_map_row_num_threshold</code></a></li><li><a href="#enable_tcmalloc_hook" class="table-of-contents__link toc-highlight"><code>enable_tcmalloc_hook</code></a></li><li><a href="#memory_mode" class="table-of-contents__link toc-highlight"><code>memory_mode</code></a></li><li><a href="#max_sys_mem_available_low_water_mark_bytes" class="table-of-contents__link toc-highlight"><code>max_sys_mem_available_low_water_mark_bytes</code></a></li><li><a href="#memory_limitation_per_thread_for_schema_change_bytes" class="table-of-contents__link toc-highlight"><code>memory_limitation_per_thread_for_schema_change_bytes</code></a></li><li><a href="#mem_tracker_consume_min_size_bytes" class="table-of-contents__link toc-highlight"><code>mem_tracker_consume_min_size_bytes</code></a></li><li><a href="#cache_clean_interval" class="table-of-contents__link toc-highlight"><code>cache_clean_interval</code></a></li><li><a href="#min_buffer_size" class="table-of-contents__link toc-highlight"><code>min_buffer_size</code></a></li><li><a href="#write_buffer_size" class="table-of-contents__link toc-highlight"><code>write_buffer_size</code></a></li><li><a href="#remote_storage_read_buffer_mb" class="table-of-contents__link toc-highlight"><code>remote_storage_read_buffer_mb</code></a></li><li><a href="#file_cache_type" class="table-of-contents__link toc-highlight"><code>file_cache_type</code></a></li><li><a href="#file_cache_alive_time_sec" class="table-of-contents__link toc-highlight"><code>file_cache_alive_time_sec</code></a></li><li><a href="#file_cache_max_size_per_disk" class="table-of-contents__link toc-highlight"><code>file_cache_max_size_per_disk</code></a></li><li><a href="#max_sub_cache_file_size" class="table-of-contents__link toc-highlight"><code>max_sub_cache_file_size</code></a></li><li><a href="#download_cache_thread_pool_thread_num" class="table-of-contents__link toc-highlight"><code>download_cache_thread_pool_thread_num</code></a></li><li><a href="#download_cache_thread_pool_queue_size" class="table-of-contents__link toc-highlight"><code>download_cache_thread_pool_queue_size</code></a></li><li><a href="#generate_cache_cleaner_task_interval_sec" class="table-of-contents__link toc-highlight"><code>generate_cache_cleaner_task_interval_sec</code></a></li><li><a href="#path_gc_check" class="table-of-contents__link toc-highlight"><code>path_gc_check</code></a></li><li><a href="#path_gc_check_interval_second" class="table-of-contents__link toc-highlight"><code>path_gc_check_interval_second</code></a></li><li><a href="#path_gc_check_step" class="table-of-contents__link toc-highlight"><code>path_gc_check_step</code></a></li><li><a href="#path_gc_check_step_interval_ms" class="table-of-contents__link toc-highlight"><code>path_gc_check_step_interval_ms</code></a></li><li><a href="#path_scan_interval_second" class="table-of-contents__link toc-highlight"><code>path_scan_interval_second</code></a></li><li><a href="#scan_context_gc_interval_min" class="table-of-contents__link toc-highlight"><code>scan_context_gc_interval_min</code></a></li></ul></li><li><a href="#storage" class="table-of-contents__link toc-highlight">Storage</a><ul><li><a href="#default_num_rows_per_column_file_block" class="table-of-contents__link toc-highlight"><code>default_num_rows_per_column_file_block</code></a></li><li><a href="#disable_storage_page_cache" class="table-of-contents__link toc-highlight"><code>disable_storage_page_cache</code></a></li><li><a href="#disk_stat_monitor_interval" class="table-of-contents__link toc-highlight"><code>disk_stat_monitor_interval</code></a></li><li><a href="#max_free_io_buffers" class="table-of-contents__link toc-highlight"><code>max_free_io_buffers</code></a></li><li><a href="#max_garbage_sweep_interval" class="table-of-contents__link toc-highlight"><code>max_garbage_sweep_interval</code></a></li><li><a href="#max_percentage_of_error_disk" class="table-of-contents__link toc-highlight"><code>max_percentage_of_error_disk</code></a></li><li><a href="#read_size" class="table-of-contents__link toc-highlight"><code>read_size</code></a></li><li><a href="#min_garbage_sweep_interval" class="table-of-contents__link toc-highlight"><code>min_garbage_sweep_interval</code></a></li><li><a href="#pprof_profile_dir" class="table-of-contents__link toc-highlight"><code>pprof_profile_dir</code></a></li><li><a href="#small_file_dir" class="table-of-contents__link toc-highlight"><code>small_file_dir</code></a></li><li><a href="#user_function_dir" class="table-of-contents__link toc-highlight"><code>user_function_dir</code></a></li><li><a href="#storage_flood_stage_left_capacity_bytes" class="table-of-contents__link toc-highlight"><code>storage_flood_stage_left_capacity_bytes</code></a></li><li><a href="#storage_flood_stage_usage_percent" class="table-of-contents__link toc-highlight"><code>storage_flood_stage_usage_percent</code></a></li><li><a href="#storage_medium_migrate_count" class="table-of-contents__link toc-highlight"><code>storage_medium_migrate_count</code></a></li><li><a href="#storage_page_cache_limit" class="table-of-contents__link toc-highlight"><code>storage_page_cache_limit</code></a></li><li><a href="#storage_page_cache_shard_size" class="table-of-contents__link toc-highlight"><code>storage_page_cache_shard_size</code></a></li><li><a href="#index_page_cache_percentage" class="table-of-contents__link toc-highlight"><code>index_page_cache_percentage</code></a></li><li><a href="#segment_cache_capacity" class="table-of-contents__link toc-highlight"><code>segment_cache_capacity</code></a></li><li><a href="#storage_strict_check_incompatible_old_format" class="table-of-contents__link toc-highlight"><code>storage_strict_check_incompatible_old_format</code></a></li><li><a href="#sync_tablet_meta" class="table-of-contents__link toc-highlight"><code>sync_tablet_meta</code></a></li><li><a href="#pending_data_expire_time_sec" class="table-of-contents__link toc-highlight"><code>pending_data_expire_time_sec</code></a></li><li><a href="#ignore_rowset_stale_unconsistent_delete" class="table-of-contents__link toc-highlight"><code>ignore_rowset_stale_unconsistent_delete</code></a></li><li><a href="#create_tablet_worker_count" class="table-of-contents__link toc-highlight"><code>create_tablet_worker_count</code></a></li><li><a href="#check_consistency_worker_count" class="table-of-contents__link toc-highlight"><code>check_consistency_worker_count</code></a></li><li><a href="#max_tablet_version_num" class="table-of-contents__link toc-highlight"><code>max_tablet_version_num</code></a></li><li><a href="#number_tablet_writer_threads" class="table-of-contents__link toc-highlight"><code>number_tablet_writer_threads</code></a></li><li><a href="#tablet_map_shard_size" class="table-of-contents__link toc-highlight"><code>tablet_map_shard_size</code></a></li><li><a href="#tablet_meta_checkpoint_min_interval_secs" class="table-of-contents__link toc-highlight"><code>tablet_meta_checkpoint_min_interval_secs</code></a></li><li><a href="#tablet_meta_checkpoint_min_new_rowsets_num" class="table-of-contents__link toc-highlight"><code>tablet_meta_checkpoint_min_new_rowsets_num</code></a></li><li><a href="#tablet_stat_cache_update_interval_second" class="table-of-contents__link toc-highlight"><code>tablet_stat_cache_update_interval_second</code></a></li><li><a href="#tablet_rowset_stale_sweep_time_sec" class="table-of-contents__link toc-highlight"><code>tablet_rowset_stale_sweep_time_sec</code></a></li><li><a href="#tablet_writer_open_rpc_timeout_sec" class="table-of-contents__link toc-highlight"><code>tablet_writer_open_rpc_timeout_sec</code></a></li><li><a href="#tablet_writer_ignore_eovercrowded" class="table-of-contents__link toc-highlight"><code>tablet_writer_ignore_eovercrowded</code></a></li><li><a href="#streaming_load_rpc_max_alive_time_sec" class="table-of-contents__link toc-highlight"><code>streaming_load_rpc_max_alive_time_sec</code></a></li><li><a href="#alter_tablet_worker_count" class="table-of-contents__link toc-highlight"><code>alter_tablet_worker_count</code></a></li><li><a href="#alter_index_worker_count" class="table-of-contents__link toc-highlight"><code>alter_index_worker_count</code></a></li><li><a href="#ignore_load_tablet_failure" class="table-of-contents__link toc-highlight"><code>ignore_load_tablet_failure</code></a></li><li><a href="#report_disk_state_interval_seconds" class="table-of-contents__link toc-highlight"><code>report_disk_state_interval_seconds</code></a></li><li><a href="#result_buffer_cancelled_interval_time" class="table-of-contents__link toc-highlight"><code>result_buffer_cancelled_interval_time</code></a></li><li><a href="#snapshot_expire_time_sec" class="table-of-contents__link toc-highlight"><code>snapshot_expire_time_sec</code></a></li><li><a href="#compress_rowbatches" class="table-of-contents__link toc-highlight"><code>compress_rowbatches</code></a></li></ul></li><li><a href="#log" class="table-of-contents__link toc-highlight">Log</a><ul><li><a href="#sys_log_dir" class="table-of-contents__link toc-highlight"><code>sys_log_dir</code></a></li><li><a href="#sys_log_level" class="table-of-contents__link toc-highlight"><code>sys_log_level</code></a></li><li><a href="#sys_log_roll_mode" class="table-of-contents__link toc-highlight"><code>sys_log_roll_mode</code></a></li><li><a href="#sys_log_roll_num" class="table-of-contents__link toc-highlight"><code>sys_log_roll_num</code></a></li><li><a href="#sys_log_verbose_level" class="table-of-contents__link toc-highlight"><code>sys_log_verbose_level</code></a></li><li><a href="#sys_log_verbose_modules" class="table-of-contents__link toc-highlight"><code>sys_log_verbose_modules</code></a></li><li><a href="#aws_log_level" class="table-of-contents__link toc-highlight"><code>aws_log_level</code></a></li><li><a href="#log_buffer_level" class="table-of-contents__link toc-highlight"><code>log_buffer_level</code></a></li></ul></li><li><a href="#else" class="table-of-contents__link toc-highlight">Else</a><ul><li><a href="#report_tablet_interval_seconds" class="table-of-contents__link toc-highlight"><code>report_tablet_interval_seconds</code></a></li><li><a href="#report_task_interval_seconds" class="table-of-contents__link toc-highlight"><code>report_task_interval_seconds</code></a></li><li><a href="#periodic_counter_update_period_ms" class="table-of-contents__link toc-highlight"><code>periodic_counter_update_period_ms</code></a></li><li><a href="#enable_metric_calculator" class="table-of-contents__link toc-highlight"><code>enable_metric_calculator</code></a></li><li><a href="#enable_system_metrics" class="table-of-contents__link toc-highlight"><code>enable_system_metrics</code></a></li><li><a href="#enable_token_check" class="table-of-contents__link toc-highlight"><code>enable_token_check</code></a></li><li><a href="#max_runnings_transactions_per_txn_map" class="table-of-contents__link toc-highlight"><code>max_runnings_transactions_per_txn_map</code></a></li><li><a href="#max_download_speed_kbps" class="table-of-contents__link toc-highlight"><code>max_download_speed_kbps</code></a></li><li><a href="#download_low_speed_time" class="table-of-contents__link toc-highlight"><code>download_low_speed_time</code></a></li><li><a href="#download_low_speed_limit_kbps" class="table-of-contents__link toc-highlight"><code>download_low_speed_limit_kbps</code></a></li><li><a href="#doris_cgroups" class="table-of-contents__link toc-highlight"><code>doris_cgroups</code></a></li><li><a href="#priority_queue_remaining_tasks_increased_frequency" class="table-of-contents__link toc-highlight"><code>priority_queue_remaining_tasks_increased_frequency</code></a></li><li><a href="#jdbc_drivers_dir" class="table-of-contents__link toc-highlight"><code>jdbc_drivers_dir</code></a></li><li><a href="#enable_simdjson_reader" class="table-of-contents__link toc-highlight"><code>enable_simdjson_reader</code></a></li><li><a href="#enable_query_memory_overcommit" class="table-of-contents__link toc-highlight"><code>enable_query_memory_overcommit</code></a></li><li><a href="#user_files_secure_path" class="table-of-contents__link toc-highlight"><code>user_files_secure_path</code></a></li><li><a href="#brpc_streaming_client_batch_bytes" class="table-of-contents__link toc-highlight"><code>brpc_streaming_client_batch_bytes</code></a></li><li><a href="#grace_shutdown_wait_seconds" class="table-of-contents__link toc-highlight"><code>grace_shutdown_wait_seconds</code></a></li><li><a href="#enable_java_support" class="table-of-contents__link toc-highlight"><code>enable_java_support</code></a></li><li><a href="#group_commit_wal_path" class="table-of-contents__link toc-highlight"><code>group_commit_wal_path</code></a></li><li><a href="#group_commit_memory_rows_for_max_filter_ratio" class="table-of-contents__link toc-highlight"><code>group_commit_memory_rows_for_max_filter_ratio</code></a></li><li><a href="#default_tzfiles_path" class="table-of-contents__link toc-highlight"><code>default_tzfiles_path</code></a></li></ul></li></ul></li></ul></div></div></div></div></main></div></div></div><div class="footer pt-16 pb-10"><div class="container"><div class="footer-box"><div class="left"><img src="/images/asf_logo_apache.svg" alt="" class="themedImage_ToTc themedImage--light_HNdA footer__logo"><img src="/images/asf_logo_apache.svg" alt="" class="themedImage_ToTc themedImage--dark_i4oU footer__logo"><div class="row footer__links"><div class="col footer__col"><div class="footer__title">ASF</div><ul class="footer__items clean-list"><li class="footer__item"><a href="https://www.apache.org/" target="_blank" rel="noopener noreferrer" class="footer__link-item">Foundation<svg width="13.5" height="13.5" aria-hidden="true" viewBox="0 0 24 24" class="iconExternalLink_nPIU"><path fill="currentColor" d="M21 13v10h-21v-19h12v2h-10v15h17v-8h2zm3-12h-10.988l4.035 4-6.977 7.07 2.828 2.828 6.977-7.07 4.125 4.172v-11z"></path></svg></a></li><li class="footer__item"><a href="https://www.apache.org/licenses/" target="_blank" rel="noopener noreferrer" class="footer__link-item">License<svg width="13.5" height="13.5" aria-hidden="true" viewBox="0 0 24 24" class="iconExternalLink_nPIU"><path fill="currentColor" d="M21 13v10h-21v-19h12v2h-10v15h17v-8h2zm3-12h-10.988l4.035 4-6.977 7.07 2.828 2.828 6.977-7.07 4.125 4.172v-11z"></path></svg></a></li><li class="footer__item"><a href="https://www.apache.org/events/current-event" target="_blank" rel="noopener noreferrer" class="footer__link-item">Events<svg width="13.5" height="13.5" aria-hidden="true" viewBox="0 0 24 24" class="iconExternalLink_nPIU"><path fill="currentColor" d="M21 13v10h-21v-19h12v2h-10v15h17v-8h2zm3-12h-10.988l4.035 4-6.977 7.07 2.828 2.828 6.977-7.07 4.125 4.172v-11z"></path></svg></a></li><li class="footer__item"><a href="https://www.apache.org/foundation/sponsorship.html" target="_blank" rel="noopener noreferrer" class="footer__link-item">Sponsorship<svg width="13.5" height="13.5" aria-hidden="true" viewBox="0 0 24 24" class="iconExternalLink_nPIU"><path fill="currentColor" d="M21 13v10h-21v-19h12v2h-10v15h17v-8h2zm3-12h-10.988l4.035 4-6.977 7.07 2.828 2.828 6.977-7.07 4.125 4.172v-11z"></path></svg></a></li><li class="footer__item"><a href="https://privacy.apache.org/policies/privacy-policy-public.html" target="_blank" rel="noopener noreferrer" class="footer__link-item">Privacy<svg width="13.5" height="13.5" aria-hidden="true" viewBox="0 0 24 24" class="iconExternalLink_nPIU"><path fill="currentColor" d="M21 13v10h-21v-19h12v2h-10v15h17v-8h2zm3-12h-10.988l4.035 4-6.977 7.07 2.828 2.828 6.977-7.07 4.125 4.172v-11z"></path></svg></a></li><li class="footer__item"><a href="https://www.apache.org/security/" target="_blank" rel="noopener noreferrer" class="footer__link-item">Security<svg width="13.5" height="13.5" aria-hidden="true" viewBox="0 0 24 24" class="iconExternalLink_nPIU"><path fill="currentColor" d="M21 13v10h-21v-19h12v2h-10v15h17v-8h2zm3-12h-10.988l4.035 4-6.977 7.07 2.828 2.828 6.977-7.07 4.125 4.172v-11z"></path></svg></a></li><li class="footer__item"><a href="https://www.apache.org/foundation/thanks.html" target="_blank" rel="noopener noreferrer" class="footer__link-item">Thanks<svg width="13.5" height="13.5" aria-hidden="true" viewBox="0 0 24 24" class="iconExternalLink_nPIU"><path fill="currentColor" d="M21 13v10h-21v-19h12v2h-10v15h17v-8h2zm3-12h-10.988l4.035 4-6.977 7.07 2.828 2.828 6.977-7.07 4.125 4.172v-11z"></path></svg></a></li></ul></div><div class="col footer__col"><div class="footer__title">Resources</div><ul class="footer__items clean-list"><li class="footer__item"><a class="footer__link-item" href="/download">Download</a></li><li class="footer__item"><a class="footer__link-item" href="/docs/get-starting/quick-start">Docs</a></li><li class="footer__item"><a class="footer__link-item" href="/blog">Blog</a></li><li class="footer__item"><a class="footer__link-item" href="/ecosystem/cluster-management">Ecosystem</a></li><li class="footer__item"><a class="footer__link-item" href="/users">Users</a></li><li class="footer__item"><a href="https://github.com/apache/doris/discussions" target="_blank" rel="noopener noreferrer" class="footer__link-item">Discussions<svg width="13.5" height="13.5" aria-hidden="true" viewBox="0 0 24 24" class="iconExternalLink_nPIU"><path fill="currentColor" d="M21 13v10h-21v-19h12v2h-10v15h17v-8h2zm3-12h-10.988l4.035 4-6.977 7.07 2.828 2.828 6.977-7.07 4.125 4.172v-11z"></path></svg></a></li></ul></div><div class="col footer__col"><div class="footer__title">Community</div><ul class="footer__items clean-list"><li class="footer__item"><a class="footer__link-item" href="/community/how-to-contribute/">How to contribute</a></li><li class="footer__item"><a href="https://github.com/apache/doris/" target="_blank" rel="noopener noreferrer" class="footer__link-item">Source code<svg width="13.5" height="13.5" aria-hidden="true" viewBox="0 0 24 24" class="iconExternalLink_nPIU"><path fill="currentColor" d="M21 13v10h-21v-19h12v2h-10v15h17v-8h2zm3-12h-10.988l4.035 4-6.977 7.07 2.828 2.828 6.977-7.07 4.125 4.172v-11z"></path></svg></a></li><li class="footer__item"><a href="https://cwiki.apache.org/confluence/display/DORIS/Doris+Improvement+Proposals" target="_blank" rel="noopener noreferrer" class="footer__link-item">Improvement proposal<svg width="13.5" height="13.5" aria-hidden="true" viewBox="0 0 24 24" class="iconExternalLink_nPIU"><path fill="currentColor" d="M21 13v10h-21v-19h12v2h-10v15h17v-8h2zm3-12h-10.988l4.035 4-6.977 7.07 2.828 2.828 6.977-7.07 4.125 4.172v-11z"></path></svg></a></li><li class="footer__item"><a class="footer__link-item" href="/community/team">Doris team</a></li><li class="footer__item"><a href="https://github.com/apache/doris/issues/30669" target="_blank" rel="noopener noreferrer" class="footer__link-item">Roadmap<svg width="13.5" height="13.5" aria-hidden="true" viewBox="0 0 24 24" class="iconExternalLink_nPIU"><path fill="currentColor" d="M21 13v10h-21v-19h12v2h-10v15h17v-8h2zm3-12h-10.988l4.035 4-6.977 7.07 2.828 2.828 6.977-7.07 4.125 4.172v-11z"></path></svg></a></li></ul></div></div></div><div class="right"><div class="footer__title">Join the community</div><div class="social-list"><div class="social"><a href="mailto:dev@doris.apache.org" target="_blank" title="mail" class="item"><svg xmlns="http://www.w3.org/2000/svg" width="2em" height="2em" viewBox="0 0 32 32" fill="none"><path d="M5.6003 6H26.3997C27.8186 6 28.982 7.10964 29 8.46946L16.0045 15.454L3.01202 8.47829C3.02405 7.11258 4.1784 6 5.6003 6ZM3.01202 11.1508L3 23.5011C3 24.8756 4.16938 26 5.6003 26H26.3997C27.8306 26 29 24.8756 29 23.5011V11.145L16.3111 17.8028C16.1157 17.9058 15.8813 17.9058 15.6889 17.8028L3.01202 11.1508Z" fill="currentColor"></path></svg></a><a href="https://github.com/apache/doris" target="_blank" title="github" class="item"><svg width="2em" height="2em" viewBox="0 0 32 32" fill="none" xmlns="http://www.w3.org/2000/svg"><path d="M16.0001 2.66675C8.63342 2.66675 2.66675 8.63341 2.66675 16.0001C2.66524 18.7991 3.54517 21.5276 5.1817 23.7983C6.81824 26.0691 9.12828 27.7668 11.7841 28.6508C12.4508 28.7668 12.7001 28.3668 12.7001 28.0161C12.7001 27.7001 12.6828 26.6508 12.6828 25.5334C9.33342 26.1508 8.46675 24.7174 8.20008 23.9668C8.04942 23.5828 7.40008 22.4001 6.83342 22.0828C6.36675 21.8334 5.70008 21.2161 6.81608 21.2001C7.86675 21.1828 8.61608 22.1668 8.86675 22.5668C10.0668 24.5828 11.9841 24.0161 12.7494 23.6668C12.8668 22.8001 13.2161 22.2174 13.6001 21.8841C10.6334 21.5508 7.53342 20.4001 7.53342 15.3001C7.53342 13.8494 8.04942 12.6507 8.90008 11.7161C8.76675 11.3827 8.30008 10.0161 9.03342 8.18275C9.03342 8.18275 10.1494 7.83342 12.7001 9.55075C13.7855 9.2495 14.907 9.09787 16.0334 9.10008C17.1668 9.10008 18.3001 9.24942 19.3668 9.54942C21.9161 7.81608 23.0334 8.18408 23.0334 8.18408C23.7668 10.0174 23.3001 11.3841 23.1668 11.7174C24.0161 12.6507 24.5334 13.8334 24.5334 15.3001C24.5334 20.4174 21.4174 21.5508 18.4508 21.8841C18.9334 22.3001 19.3508 23.1001 19.3508 24.3508C19.3508 26.1334 19.3334 27.5668 19.3334 28.0174C19.3334 28.3668 19.5841 28.7828 20.2508 28.6494C22.8975 27.7558 25.1973 26.0547 26.8266 23.7856C28.4559 21.5165 29.3327 18.7936 29.3334 16.0001C29.3334 8.63341 23.3668 2.66675 16.0001 2.66675V2.66675Z" fill="currentColor"></path></svg></a><a href="https://twitter.com/doris_apache" target="_blank" title="twitter" class="item"><svg xmlns="http://www.w3.org/2000/svg" width="2em" height="2em" viewBox="0 0 32 32" fill="none"><path d="M4.625 4.625H11.2809L27.375 27.375H20.7191L4.625 4.625ZM7.52549 6.10639L21.5236 25.8936H24.4746L10.4764 6.10639H7.52549Z" fill="currentColor"></path><path d="M14.4268 18.4803L6.53447 27.375H4.625L13.5581 17.2525L14.4268 18.4803ZM18.1299 14.3066L26.7203 4.625H24.7017L17.2525 13.0662L18.1299 14.3066Z" fill="currentColor"></path></svg></a><a href="https://join.slack.com/t/apachedoriscommunity/shared_invite/zt-2kl08hzc0-SPJe4VWmL_qzrFd2u2XYQA" title="slack" target="_blank" class="item"><svg width="2em" height="2em" viewBox="0 0 32 32" fill="none" xmlns="http://www.w3.org/2000/svg"><g clip-path="url(#clip0_125_278)"><path d="M12.5875 16.6906C11.0844 16.6906 9.86562 17.9094 9.86562 19.4125V26.2375C9.86562 26.9594 10.1524 27.6517 10.6628 28.1622C11.1733 28.6726 11.8656 28.9594 12.5875 28.9594C13.3094 28.9594 14.0017 28.6726 14.5122 28.1622C15.0226 27.6517 15.3094 26.9594 15.3094 26.2375V19.4531C15.3094 17.9094 14.0906 16.6906 12.5875 16.6906ZM3 19.4531C3 20.175 3.28677 20.8673 3.79722 21.3778C4.30767 21.8882 4.99999 22.175 5.72187 22.175C6.44376 22.175 7.13608 21.8882 7.64653 21.3778C8.15698 20.8673 8.44375 20.175 8.44375 19.4531V16.7312H5.7625C4.25938 16.6906 3 17.9094 3 19.4531ZM12.5875 3C11.8656 3 11.1733 3.28677 10.6628 3.79722C10.1524 4.30767 9.86562 4.99999 9.86562 5.72187C9.86562 6.44376 10.1524 7.13608 10.6628 7.64653C11.1733 8.15698 11.8656 8.44375 12.5875 8.44375H15.3094V5.72187C15.3094 4.21875 14.0906 3 12.5875 3ZM5.72187 15.3094H12.5469C13.2688 15.3094 13.9611 15.0226 14.4715 14.5122C14.982 14.0017 15.2688 13.3094 15.2688 12.5875C15.2688 11.8656 14.982 11.1733 14.4715 10.6628C13.9611 10.1524 13.2688 9.86562 12.5469 9.86562H5.72187C4.99999 9.86562 4.30767 10.1524 3.79722 10.6628C3.28677 11.1733 3 11.8656 3 12.5875C3 13.3094 3.28677 14.0017 3.79722 14.5122C4.30767 15.0226 4.99999 15.3094 5.72187 15.3094ZM26.2375 9.86562C24.7344 9.86562 23.5156 11.0844 23.5156 12.5875V15.3094H26.2375C26.9594 15.3094 27.6517 15.0226 28.1622 14.5122C28.6726 14.0017 28.9594 13.3094 28.9594 12.5875C28.9594 11.8656 28.6726 11.1733 28.1622 10.6628C27.6517 10.1524 26.9594 9.86562 26.2375 9.86562ZM16.6906 5.72187V12.5875C16.6906 13.3094 16.9774 14.0017 17.4878 14.5122C17.9983 15.0226 18.6906 15.3094 19.4125 15.3094C20.1344 15.3094 20.8267 15.0226 21.3372 14.5122C21.8476 14.0017 22.1344 13.3094 22.1344 12.5875V5.72187C22.1344 4.99999 21.8476 4.30767 21.3372 3.79722C20.8267 3.28677 20.1344 3 19.4125 3C18.6906 3 17.9983 3.28677 17.4878 3.79722C16.9774 4.30767 16.6906 4.99999 16.6906 5.72187ZM22.1344 26.2781C22.1344 24.775 20.9156 23.5562 19.4125 23.5562H16.6906V26.2781C16.6906 27 16.9774 27.6923 17.4878 28.2028C17.9983 28.7132 18.6906 29 19.4125 29C20.1344 29 20.8267 28.7132 21.3372 28.2028C21.8476 27.6923 22.1344 27 22.1344 26.2781ZM26.2781 16.6906H19.4125C18.6906 16.6906 17.9983 16.9774 17.4878 17.4878C16.9774 17.9983 16.6906 18.6906 16.6906 19.4125C16.6906 20.1344 16.9774 20.8267 17.4878 21.3372C17.9983 21.8476 18.6906 22.1344 19.4125 22.1344H26.2375C27.7406 22.1344 28.9594 20.9156 28.9594 19.4125C29 17.9094 27.7812 16.6906 26.2781 16.6906Z" fill="currentColor"></path></g><defs><clipPath id="clip0_125_278"><rect width="26" height="26" fill="currentColor" transform="translate(3 3)"></rect></clipPath></defs></svg></a></div><div class="social"><a href="https://www.youtube.com/@apachedoris/channels" title="youtube" target="_blank" class="item"><svg xmlns="http://www.w3.org/2000/svg" width="2em" height="2em" viewBox="0 0 32 32" fill="none"><path d="M28.5167 7.83429C28.9436 8.25423 29.2532 8.77539 29.4154 9.34742C29.8205 11.5462 30.0159 13.7775 29.999 16.0121C30.0144 18.2382 29.819 20.4609 29.4154 22.6515C29.2532 23.2235 28.9436 23.7446 28.5167 24.1645C28.0898 24.5845 27.5601 24.889 26.9785 25.0486C24.7728 25.625 16.0124 25.625 16.0124 25.625C16.0124 25.625 7.22652 25.625 5.04638 25.0486C4.46489 24.889 3.9351 24.5845 3.5082 24.1645C3.08132 23.7446 2.77176 23.2235 2.60948 22.6515C2.19736 20.4617 1.9934 18.239 2.00025 16.0121C1.9918 13.7767 2.19577 11.5455 2.60948 9.34742C2.77176 8.77539 3.08132 8.25423 3.5082 7.83429C3.9351 7.41436 4.46489 7.10985 5.04638 6.95021C7.25103 6.36354 16.0124 6.37502 16.0124 6.37502C16.0124 6.37502 24.796 6.37502 26.9785 6.95021C27.5601 7.10985 28.0898 7.41436 28.5167 7.83429ZM12.5 21.25L21.25 16.008L12.5 10.75V21.25Z" fill="currentColor"></path></svg></a><a href="https://www.linkedin.com/company/doris-apache/" title="linkedin" target="_blank" class="item"><svg width="2rem" height="2rem" viewBox="0 0 32 32" fill="none" xmlns="http://www.w3.org/2000/svg"><path d="M4.29925 26.9996H9.66738V11.6781H4.29925V26.9996ZM22.1628 11.1949C19.9409 11.1949 18.7157 11.9388 17.3054 13.7407V11.6777H11.9459V26.9996H17.305V18.6738C17.305 16.9168 18.145 15.1982 20.1535 15.1982C22.162 15.1982 22.6559 16.9164 22.6559 18.632V27H28V18.2902C28 12.2386 24.3854 11.1949 22.1628 11.1949ZM6.99325 4C5.3395 4 4 5.21047 4 6.7046C4 8.19759 5.3395 9.40617 6.99325 9.40617C8.6455 9.40617 9.985 8.19722 9.985 6.7046C9.985 5.21047 8.6455 4 6.99325 4Z" fill="white"></path></svg></a><a href="https://medium.com/@ApacheDoris" title="medium" target="_blank" class="item"><svg width="2em" height="2em" viewBox="0 0 32 32" fill="none" xmlns="http://www.w3.org/2000/svg"><g id="Frame"><path id="Vector" d="M17.7967 16.5385C17.8029 18.53 16.9746 20.4425 15.4937 21.8559C14.0128 23.2693 12.0004 24.0681 9.89836 24.0769C7.79633 24.0681 5.78391 23.2693 4.30302 21.8559C2.82212 20.4425 1.99383 18.53 2.00003 16.5385C1.99383 14.5469 2.82212 12.6344 4.30302 11.221C5.78391 9.80759 7.79633 9.00878 9.89836 9C12.0004 9.00878 14.0128 9.80759 15.4937 11.221C16.9746 12.6344 17.8029 14.5469 17.7967 16.5385ZM26.4533 16.5385C26.4533 20.4514 24.6917 23.6348 22.51 23.6348C20.3283 23.6348 18.555 20.4514 18.555 16.5385C18.555 12.6255 20.3283 9.44214 22.51 9.44214C24.6917 9.44214 26.4533 12.6255 26.4533 16.5385ZM30 16.5385C30 20.0424 29.3817 22.8942 28.6117 22.8942C27.8417 22.8942 27.2233 20.0424 27.2233 16.5385C27.2233 13.0345 27.8417 10.1827 28.6117 10.1827C29.3817 10.1827 30 13.0345 30 16.5385Z" fill="currentColor"></path></g></svg></a><a class="item wechat"><svg width="2em" height="2em" viewBox="0 0 32 32" fill="none" xmlns="http://www.w3.org/2000/svg"><path d="M20.7578 11.5169C21.0708 11.5169 21.3795 11.5398 21.6851 11.573C20.8524 7.73517 16.7052 4.88306 11.9718 4.88306C6.67951 4.88306 2.34412 8.45283 2.34412 12.9854C2.34412 15.6013 3.78679 17.7498 6.19667 19.4161L5.2339 22.2827L8.59917 20.6122C9.80411 20.8478 10.7698 21.0906 11.9718 21.0906C12.2738 21.0906 12.5728 21.0759 12.8703 21.0523C12.682 20.4159 12.5728 19.7485 12.5728 19.0566C12.5728 14.8947 16.1847 11.5169 20.7578 11.5169ZM15.5822 8.9335C16.3072 8.9335 16.7871 9.40601 16.7871 10.1229C16.7871 10.8369 16.3072 11.3153 15.5822 11.3153C14.8601 11.3153 14.1365 10.8369 14.1365 10.1229C14.1365 9.40601 14.8601 8.9335 15.5822 8.9335ZM8.84429 11.3153C8.12218 11.3153 7.3942 10.8368 7.3942 10.1229C7.3942 9.40597 8.12218 8.93346 8.84429 8.93346C9.56559 8.93346 10.0463 9.40597 10.0463 10.1229C10.0463 10.8369 9.56559 11.3153 8.84429 11.3153ZM29.5453 18.9422C29.5453 15.1332 25.6935 12.0285 21.3677 12.0285C16.7871 12.0285 13.1797 15.1332 13.1797 18.9422C13.1797 22.7567 16.7871 25.8547 21.3677 25.8547C22.326 25.8547 23.2932 25.6169 24.2559 25.3777L26.897 26.8086L26.1726 24.4282C28.1056 22.993 29.5453 21.0906 29.5453 18.9422ZM18.7126 17.7498C18.2335 17.7498 17.7499 17.278 17.7499 16.7966C17.7499 16.3219 18.2335 15.8442 18.7126 15.8442C19.4406 15.8442 19.9176 16.3219 19.9176 16.7966C19.9176 17.278 19.4406 17.7498 18.7126 17.7498ZM24.0079 17.7498C23.5324 17.7498 23.0518 17.278 23.0518 16.7966C23.0518 16.3219 23.5324 15.8442 24.0079 15.8442C24.73 15.8442 25.2128 16.3219 25.2128 16.7966C25.2128 17.278 24.73 17.7498 24.0079 17.7498Z" fill="currentColor"></path></svg><div class="wechat-dropdown"><p class="text-[#4c576c] text-xs">Connect on WeChat</p><img src="https://cdnd.selectdb.com/assets/images/doris-wechat-b949e908a3bc2776d824f79a9100bd4b.png" alt=""></div></a></div></div></div></div><div class="footer__copyright">Copyright © 2024 The Apache Software Foundation,Licensed under the <a href="https://www.apache.org/licenses/LICENSE-2.0" target="_blank">Apache License, Version 2.0</a>. Apache, Doris, Apache Doris, the Apache feather logo and the Apache Doris logo are trademarks of The Apache Software Foundation.</div></div></div></div> |
