output/blog/2017/07/31/drill-1.11-released/index.html - drill-site - Git at Google

 <!DOCTYPE html>
 <html>

 <head>

 <meta charset="UTF-8">
 <meta name=viewport content="width=device-width, initial-scale=1">


 <title>Drill 1.11 Released - Apache Drill</title>

 <link href="https://maxcdn.bootstrapcdn.com/font-awesome/4.3.0/css/font-awesome.min.css" rel="stylesheet" type="text/css"/>
 <link href="/css/site.css" rel="stylesheet" type="text/css"/>

 <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon"/>
 <link rel="icon" href="/favicon.ico" type="image/x-icon"/>

 <script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/1.11.1/jquery.min.js" language="javascript" type="text/javascript"></script>
 <script src="https://cdnjs.cloudflare.com/ajax/libs/jquery-easing/1.3/jquery.easing.min.js" language="javascript" type="text/javascript"></script>
 <script language="javascript" type="text/javascript" src="/js/modernizr.custom.js"></script>
 <script language="javascript" type="text/javascript" src="/js/script.js"></script>
 <script language="javascript" type="text/javascript" src="/js/drill.js"></script>

 </head>


 <body onResize="resized();">
   <div class="page-wrap">
     <div class="bui"></div>

 <div id="menu" class="mw">
 <ul>
   <li class='toc-categories'>
   <a class="expand-toc-icon" href="javascript:void(0);"><i class="fa fa-bars"></i></a>
   </li>
   <li class="logo"><a href="/"></a></li>
   <li class='expand-menu'>
   <a href="javascript:void(0);"><span class='menu-text'>Menu</span><span class='expand-icon'><i class="fa fa-bars"></i></span></a>
   </li>
   <li class="clear-float"></li>
   <li class="nav">
 	<a>Language</a>
 	<ul>

 		<li>
 			<a style="font-weight: bold;" href="/blog/2017/07/31/drill-1.11-released/" >en</a>
 		</li>

 		<li>
 			<a  href="/zh/blog/2017/07/31/drill-1.11-released/" >zh</a>
 		</li>

 	</ul>
   </li>
   <li class="apache-link">
     <a href="/apacheASF/">Apache</a>
   </li>
   <li class="poweredby">
     <a href="/poweredBy">Powered By</a>
   </li>
   <li class="documentation-menu">
     <a href="/docs/">Documentation</a>
     <ul>


         <li><a href="/docs/getting-started/">Getting Started</a></li>

         <li><a href="/docs/architecture/">Architecture</a></li>

         <li><a href="/docs/tutorials/">Tutorials</a></li>

         <li><a href="/docs/drill-on-yarn/">Drill-on-YARN</a></li>

         <li><a href="/docs/install-drill/">Install Drill</a></li>

         <li><a href="/docs/configure-drill/">Configure Drill</a></li>

         <li><a href="/docs/connect-a-data-source/">Connect a Data Source</a></li>

         <li><a href="/docs/odbc-jdbc-interfaces/">ODBC/JDBC Interfaces</a></li>

         <li><a href="/docs/query-data/">Query Data</a></li>

         <li><a href="/docs/performance-tuning/">Performance Tuning</a></li>

         <li><a href="/docs/log-and-debug/">Log and Debug</a></li>

         <li><a href="/docs/sql-reference/">SQL Reference</a></li>

         <li><a href="/docs/data-sources-and-file-formats/">Data Sources and File Formats</a></li>

         <li><a href="/docs/develop-custom-functions/">Develop Custom Functions</a></li>

         <li><a href="/docs/troubleshooting/">Troubleshooting</a></li>

         <li><a href="/docs/developer-information/">Developer Information</a></li>

         <li><a href="/docs/release-notes/">Release Notes</a></li>

         <li><a href="/docs/sample-datasets/">Sample Datasets</a></li>

         <li><a href="/docs/project-bylaws/">Project Bylaws</a></li>

         <li><a href="/docs/ecosystem/">Ecosystem</a></li>

     </ul>
   </li>
   <li class='nav'>
     <a href="/community-resources/">Community</a>
     <ul>
       <li><a href="/team/">Team</a></li>
       <li><a href="/mailinglists/">Mailing Lists</a></li>
       <li><a href="/community-resources/">Community Resources</a></li>
     </ul>
   </li>
   <li class='nav'><a href="/faq/">FAQ</a></li>
   <li class='nav'><a href="/blog/">Blog</a></li>
   <li class="social-menu-item"><a href="https://twitter.com/apachedrill" title="apachedrill on twitter" target="_blank"><img src="/images/twitter_32_26_white.png" alt="twitter logo" align="center"></a> </li>
   <li class="social-menu-item"><a href="https://join.slack.com/t/apache-drill/shared_invite/enQtNTQ4MjM1MDA3MzQ2LTJlYmUxMTRkMmUwYmQ2NTllYmFmMjU4MDk0NjYwZjBmYjg0MDZmOTE2ZDg0ZjBlYmI3Yjc4Y2I2NTQyNGVlZTc" title="Apache Drill Slack channels"
       target="_blank"><img src="/images/slack-logo.svg" alt="Slack logo" align="center"></a> </li>
   <li class='search-bar'>
     <form id="drill-search-form">
       <input type="text" placeholder="Search Apache Drill" id="drill-search-term" />
       <button type="submit">
         <i class="fa fa-search"></i>
       </button>
     </form>
   </li>
   <li class="d">
     <a href="/download/">
       <i class="fa fa-cloud-download"></i> Download
     </a>
   </li>
 </ul>
 </div>

     <link href="/css/content.css" rel="stylesheet" type="text/css">

 <div class="post int_text">
   <header class="post-header">
     <div class="int_title">
       <h1 class="post-title">Drill 1.11 Released</h1>
     </div>
     <p class="post-meta">


       <strong>Author:</strong> Bridget Bevens (Committer, MapR Technologies)<br />

 <strong>Date:</strong> Jul 31, 2017
 </p>
   </header>
   <div class="addthis_sharing_toolbox"></div>

   <article class="post-content">
     <p>Today, we’re happy to announce the availability of Drill 1.11.0. You can download it <a href="https://drill.apache.org/download/">here</a>.</p>

 <p>The release provides the following bug fixes and improvements:</p>

 <h2 id="cryptography-related-functions-drill-5634">Cryptography-Related Functions (DRILL-5634)</h2>
 <p>Drill provides the following cryptographic-related functions:</p>

 <ul>
   <li>aes_encrypt()</li>
   <li>aes_decrypt()</li>
   <li>md5()</li>
   <li>sha()</li>
   <li>sha1()</li>
   <li>sha2()</li>
 </ul>

 <h2 id="spill-to-disk-for-hash-aggregate-operator-drill-5457">Spill to Disk for Hash Aggregate Operator (DRILL-5457)</h2>
 <p>The Hash aggregate operator can spill data to disk in cases where the operation exceeds the set memory limit. Note that you may need to increase the default value of the <code class="language-plaintext highlighter-rouge">planner.memory.max_query_memory_per_node</code> option due to insufficient memory.</p>

 <h2 id="format-plugin-support-for-pcap-files-drill-5432">Format Plugin Support for PCAP Files (DRILL-5432)</h2>
 <p>A “pcap” format plugin enables Drill to read PCAP files. You must add the “pcap” format to the dfs storage plugin configuration, as shown:</p>

 <div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>   "pcap": {
           "type": "pcap"
         }
 </code></pre></div></div>

 <h2 id="change-the-hdfs-block-size-for-parquet-files-drill-5379">Change the HDFS Block Size for Parquet Files (DRILL-5379)</h2>
 <p>The <code class="language-plaintext highlighter-rouge">store.parquet.writer.use_single_fs_block</code> option enables Drill to write a Parquet file as a single file system block without changing the file system default block size.</p>

 <h2 id="store-query-profiles-in-memory-drill-5481">Store Query Profiles in Memory (DRILL-5481)</h2>
 <p>The <code class="language-plaintext highlighter-rouge">drill.exec.profiles.store.inmemory</code> option enables Drill to store query profiles in memory instead of writing the query profiles to disk. The <code class="language-plaintext highlighter-rouge">drill.exec.profiles.store.capacity</code> option sets the maximum number of most recent profiles to retain in memory.</p>

 <h2 id="configurable-ctas-directory-and-file-permissions-option-drill-5391">Configurable CTAS Directory and File Permissions Option (DRILL-5391)</h2>
 <p>You can use the <code class="language-plaintext highlighter-rouge">exec.persistent_table.umask</code> configuration option, at the system or session level, to modify permissions on directories and files that result from running the CTAS command. By default, the option is set to 002, which sets the default directory permissions to 775 and default file permissions to 664.</p>

 <h2 id="support-for-network-encryption-drill-4335">Support for Network Encryption (DRILL-4335)</h2>
 <p>Drill can use SASL to support network encryption between the Drill client and drillbits, and also between drillbits.</p>

 <h2 id="metadata-file-stores-relative-paths-drill-3867">Metadata file Stores Relative Paths (DRILL-3867)</h2>
 <p>Drill now stores the relative path in the metadata file (versus the absolute path), which enables you to move partitioned Parquet directories from one location in DFS to another without having to rebuild the Parquet metadata files; the metadata remains valid in the new location.</p>

 <h2 id="support-for-additional-quoting-identifiers-drill-3510">Support for Additional Quoting Identifiers (DRILL-3510)</h2>
 <p>In addition to back ticks, the SQL parser in Drill can use double quotes and square brackets as identifier quotes. Use the <code class="language-plaintext highlighter-rouge">planner.parser.quoting_identifiers</code> configuration option, at the system or session level, to set the type of identifier quotes that the SQL parser in Drill uses, as shown:</p>

 <div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>   ALTER SESSION SET planner.parser.quoting_identifiers = '"';
    ALTER SESSION SET planner.parser.quoting_identifiers = '[';
    ALTER SESSION SET planner.parser.quoting_identifiers = '`';
 </code></pre></div></div>

 <p>The default setting is back ticks. The quoting identifier used in queries must match the setting. If you use another type of quoting identifier, Drill returns an error.</p>

 <p>You can find a complete list of JIRAs resolved in the 1.11.0 release <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&amp;version=12339943">here</a>.</p>


   </article>
  <div id="disqus_thread"></div>
     <script type="text/javascript">
         /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
         var disqus_shortname = 'drill'; // required: replace example with your forum shortname

         /* * * DON'T EDIT BELOW THIS LINE * * */
         (function() {
             var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
             dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
             (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
         })();
     </script>
     <noscript>Please enable JavaScript to view the <a href="http://disqus.com/?ref_noscript">comments powered by Disqus.</a></noscript>

 </div>
 <script type="text/javascript" src="https://s7.addthis.com/js/300/addthis_widget.js#pubid=ra-548b2caa33765e8d" async="async"></script>

   </div>
   <p class="push"></p>
 <div id="footer" class="mw">
 <div class="wrapper">
 Copyright © 2012-2025 The Apache Software Foundation, licensed under the Apache License, Version 2.0.<br>
 Apache and the Apache feather logo are trademarks of The Apache Software Foundation. Other names appearing on the site may be trademarks of their respective owners.<br/><br/>
 </div>
 </div>

   <script type="text/javascript" src="https://s7.addthis.com/js/300/addthis_widget.js#pubid=ra-548b2caa33765e8d" async="async"></script>

 </body>
 </html>
	<!DOCTYPE html>
	<html>

	<head>

	<meta charset="UTF-8">
	<meta name=viewport content="width=device-width, initial-scale=1">


	<title>Drill 1.11 Released - Apache Drill</title>

	<link href="https://maxcdn.bootstrapcdn.com/font-awesome/4.3.0/css/font-awesome.min.css" rel="stylesheet" type="text/css"/>
	<link href="/css/site.css" rel="stylesheet" type="text/css"/>

	<link rel="shortcut icon" href="/favicon.ico" type="image/x-icon"/>
	<link rel="icon" href="/favicon.ico" type="image/x-icon"/>

	<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/1.11.1/jquery.min.js" language="javascript" type="text/javascript"></script>
	<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery-easing/1.3/jquery.easing.min.js" language="javascript" type="text/javascript"></script>
	<script language="javascript" type="text/javascript" src="/js/modernizr.custom.js"></script>
	<script language="javascript" type="text/javascript" src="/js/script.js"></script>
	<script language="javascript" type="text/javascript" src="/js/drill.js"></script>

	</head>


	<body onResize="resized();">
	<div class="page-wrap">
	<div class="bui"></div>

	<div id="menu" class="mw">
	<ul>
	<li class='toc-categories'>
	<a class="expand-toc-icon" href="javascript:void(0);"><i class="fa fa-bars"></i></a>
	</li>
	<li class="logo"><a href="/"></a></li>
	<li class='expand-menu'>
	<a href="javascript:void(0);"><span class='menu-text'>Menu</span><span class='expand-icon'><i class="fa fa-bars"></i></span></a>
	</li>
	<li class="clear-float"></li>
	<li class="nav">
	<a>Language</a>
	<ul>

	<li>
	<a style="font-weight: bold;" href="/blog/2017/07/31/drill-1.11-released/" >en</a>
	</li>

	<li>
	<a href="/zh/blog/2017/07/31/drill-1.11-released/" >zh</a>
	</li>

	</ul>
	</li>
	<li class="apache-link">
	<a href="/apacheASF/">Apache</a>
	</li>
	<li class="poweredby">
	<a href="/poweredBy">Powered By</a>
	</li>
	<li class="documentation-menu">
	<a href="/docs/">Documentation</a>
	<ul>


	<li><a href="/docs/getting-started/">Getting Started</a></li>

	<li><a href="/docs/architecture/">Architecture</a></li>

	<li><a href="/docs/tutorials/">Tutorials</a></li>

	<li><a href="/docs/drill-on-yarn/">Drill-on-YARN</a></li>

	<li><a href="/docs/install-drill/">Install Drill</a></li>

	<li><a href="/docs/configure-drill/">Configure Drill</a></li>

	<li><a href="/docs/connect-a-data-source/">Connect a Data Source</a></li>

	<li><a href="/docs/odbc-jdbc-interfaces/">ODBC/JDBC Interfaces</a></li>

	<li><a href="/docs/query-data/">Query Data</a></li>

	<li><a href="/docs/performance-tuning/">Performance Tuning</a></li>

	<li><a href="/docs/log-and-debug/">Log and Debug</a></li>

	<li><a href="/docs/sql-reference/">SQL Reference</a></li>

	<li><a href="/docs/data-sources-and-file-formats/">Data Sources and File Formats</a></li>

	<li><a href="/docs/develop-custom-functions/">Develop Custom Functions</a></li>

	<li><a href="/docs/troubleshooting/">Troubleshooting</a></li>

	<li><a href="/docs/developer-information/">Developer Information</a></li>

	<li><a href="/docs/release-notes/">Release Notes</a></li>

	<li><a href="/docs/sample-datasets/">Sample Datasets</a></li>

	<li><a href="/docs/project-bylaws/">Project Bylaws</a></li>

	<li><a href="/docs/ecosystem/">Ecosystem</a></li>

	</ul>
	</li>
	<li class='nav'>
	<a href="/community-resources/">Community</a>
	<ul>
	<li><a href="/team/">Team</a></li>
	<li><a href="/mailinglists/">Mailing Lists</a></li>
	<li><a href="/community-resources/">Community Resources</a></li>
	</ul>
	</li>
	<li class='nav'><a href="/faq/">FAQ</a></li>
	<li class='nav'><a href="/blog/">Blog</a></li>
	<li class="social-menu-item"><a href="https://twitter.com/apachedrill" title="apachedrill on twitter" target="_blank"><img src="/images/twitter_32_26_white.png" alt="twitter logo" align="center"></a> </li>
	<li class="social-menu-item"><a href="https://join.slack.com/t/apache-drill/shared_invite/enQtNTQ4MjM1MDA3MzQ2LTJlYmUxMTRkMmUwYmQ2NTllYmFmMjU4MDk0NjYwZjBmYjg0MDZmOTE2ZDg0ZjBlYmI3Yjc4Y2I2NTQyNGVlZTc" title="Apache Drill Slack channels"
	target="_blank"><img src="/images/slack-logo.svg" alt="Slack logo" align="center"></a> </li>
	<li class='search-bar'>
	<form id="drill-search-form">
	<input type="text" placeholder="Search Apache Drill" id="drill-search-term" />
	<button type="submit">
	<i class="fa fa-search"></i>
	</button>
	</form>
	</li>
	<li class="d">
	<a href="/download/">
	<i class="fa fa-cloud-download"></i> Download
	</a>
	</li>
	</ul>
	</div>

	<link href="/css/content.css" rel="stylesheet" type="text/css">

	<div class="post int_text">
	<header class="post-header">
	<div class="int_title">
	<h1 class="post-title">Drill 1.11 Released</h1>
	</div>
	<p class="post-meta">



	<strong>Author:</strong> Bridget Bevens (Committer, MapR Technologies)<br />

	<strong>Date:</strong> Jul 31, 2017
	</p>
	</header>
	<div class="addthis_sharing_toolbox"></div>

	<article class="post-content">
	<p>Today, we’re happy to announce the availability of Drill 1.11.0. You can download it <a href="https://drill.apache.org/download/">here</a>.</p>

	<p>The release provides the following bug fixes and improvements:</p>

	<h2 id="cryptography-related-functions-drill-5634">Cryptography-Related Functions (DRILL-5634)</h2>
	<p>Drill provides the following cryptographic-related functions:</p>

	<ul>
	<li>aes_encrypt()</li>
	<li>aes_decrypt()</li>
	<li>md5()</li>
	<li>sha()</li>
	<li>sha1()</li>
	<li>sha2()</li>
	</ul>

	<h2 id="spill-to-disk-for-hash-aggregate-operator-drill-5457">Spill to Disk for Hash Aggregate Operator (DRILL-5457)</h2>
	<p>The Hash aggregate operator can spill data to disk in cases where the operation exceeds the set memory limit. Note that you may need to increase the default value of the <code class="language-plaintext highlighter-rouge">planner.memory.max_query_memory_per_node</code> option due to insufficient memory.</p>

	<h2 id="format-plugin-support-for-pcap-files-drill-5432">Format Plugin Support for PCAP Files (DRILL-5432)</h2>
	<p>A “pcap” format plugin enables Drill to read PCAP files. You must add the “pcap” format to the dfs storage plugin configuration, as shown:</p>

	<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code> "pcap": {
	"type": "pcap"
	}
	</code></pre></div></div>

	<h2 id="change-the-hdfs-block-size-for-parquet-files-drill-5379">Change the HDFS Block Size for Parquet Files (DRILL-5379)</h2>
	<p>The <code class="language-plaintext highlighter-rouge">store.parquet.writer.use_single_fs_block</code> option enables Drill to write a Parquet file as a single file system block without changing the file system default block size.</p>

	<h2 id="store-query-profiles-in-memory-drill-5481">Store Query Profiles in Memory (DRILL-5481)</h2>
	<p>The <code class="language-plaintext highlighter-rouge">drill.exec.profiles.store.inmemory</code> option enables Drill to store query profiles in memory instead of writing the query profiles to disk. The <code class="language-plaintext highlighter-rouge">drill.exec.profiles.store.capacity</code> option sets the maximum number of most recent profiles to retain in memory.</p>

	<h2 id="configurable-ctas-directory-and-file-permissions-option-drill-5391">Configurable CTAS Directory and File Permissions Option (DRILL-5391)</h2>
	<p>You can use the <code class="language-plaintext highlighter-rouge">exec.persistent_table.umask</code> configuration option, at the system or session level, to modify permissions on directories and files that result from running the CTAS command. By default, the option is set to 002, which sets the default directory permissions to 775 and default file permissions to 664.</p>

	<h2 id="support-for-network-encryption-drill-4335">Support for Network Encryption (DRILL-4335)</h2>
	<p>Drill can use SASL to support network encryption between the Drill client and drillbits, and also between drillbits.</p>

	<h2 id="metadata-file-stores-relative-paths-drill-3867">Metadata file Stores Relative Paths (DRILL-3867)</h2>
	<p>Drill now stores the relative path in the metadata file (versus the absolute path), which enables you to move partitioned Parquet directories from one location in DFS to another without having to rebuild the Parquet metadata files; the metadata remains valid in the new location.</p>

	<h2 id="support-for-additional-quoting-identifiers-drill-3510">Support for Additional Quoting Identifiers (DRILL-3510)</h2>
	<p>In addition to back ticks, the SQL parser in Drill can use double quotes and square brackets as identifier quotes. Use the <code class="language-plaintext highlighter-rouge">planner.parser.quoting_identifiers</code> configuration option, at the system or session level, to set the type of identifier quotes that the SQL parser in Drill uses, as shown:</p>

	<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code> ALTER SESSION SET planner.parser.quoting_identifiers = '"';
	ALTER SESSION SET planner.parser.quoting_identifiers = '[';
	ALTER SESSION SET planner.parser.quoting_identifiers = '`';
	</code></pre></div></div>

	<p>The default setting is back ticks. The quoting identifier used in queries must match the setting. If you use another type of quoting identifier, Drill returns an error.</p>

	<p>You can find a complete list of JIRAs resolved in the 1.11.0 release <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12339943">here</a>.</p>


	</article>
	<div id="disqus_thread"></div>
	<script type="text/javascript">
	/* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
	var disqus_shortname = 'drill'; // required: replace example with your forum shortname

	/* * * DON'T EDIT BELOW THIS LINE * * */
	(function() {
	var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
	dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
	(document.getElementsByTagName('head')[0] \|\| document.getElementsByTagName('body')[0]).appendChild(dsq);
	})();
	</script>
	<noscript>Please enable JavaScript to view the <a href="http://disqus.com/?ref_noscript">comments powered by Disqus.</a></noscript>

	</div>
	<script type="text/javascript" src="https://s7.addthis.com/js/300/addthis_widget.js#pubid=ra-548b2caa33765e8d" async="async"></script>

	</div>
	<p class="push"></p>
	<div id="footer" class="mw">
	<div class="wrapper">
	Copyright © 2012-2025 The Apache Software Foundation, licensed under the Apache License, Version 2.0.<br>
	Apache and the Apache feather logo are trademarks of The Apache Software Foundation. Other names appearing on the site may be trademarks of their respective owners.<br/><br/>
	</div>
	</div>

	<script type="text/javascript" src="https://s7.addthis.com/js/300/addthis_widget.js#pubid=ra-548b2caa33765e8d" async="async"></script>

	</body>
	</html>