blob: e0a6ee0468200d783e2477814d492878c56309cd [file] [log] [blame]
<!DOCTYPE html>
<html>
<head>
<meta charset="UTF-8">
<meta name=viewport content="width=device-width, initial-scale=1">
<title>Blog - Apache Drill</title>
<link href="https://maxcdn.bootstrapcdn.com/font-awesome/4.3.0/css/font-awesome.min.css" rel="stylesheet" type="text/css"/>
<link href='https://fonts.googleapis.com/css?family=PT+Sans' rel='stylesheet' type='text/css'/>
<link href="/css/site.css" rel="stylesheet" type="text/css"/>
<link rel="shortcut icon" href="/favicon.ico" type="image/x-icon"/>
<link rel="icon" href="/favicon.ico" type="image/x-icon"/>
<script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.1/jquery.min.js" language="javascript" type="text/javascript"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery-easing/1.3/jquery.easing.min.js" language="javascript" type="text/javascript"></script>
<script language="javascript" type="text/javascript" src="/js/modernizr.custom.js"></script>
<script language="javascript" type="text/javascript" src="/js/script.js"></script>
<script language="javascript" type="text/javascript" src="/js/drill.js"></script>
</head>
<body onResize="resized();">
<div class="page-wrap">
<div class="bui"></div>
<div id="menu" class="mw">
<ul>
<li class='toc-categories'>
<a class="expand-toc-icon" href="javascript:void(0);"><i class="fa fa-bars"></i></a>
</li>
<li class="logo"><a href="/"></a></li>
<li class='expand-menu'>
<a href="javascript:void(0);"><span class='menu-text'>Menu</span><span class='expand-icon'><i class="fa fa-bars"></i></span></a>
</li>
<li class="clear-float"></li>
<li class="nav">
<a>Language</a>
<ul>
<li>
<a style="font-weight: bold;" href="/blog/" >en</a>
</li>
<li>
<a href="/zh/blog/" >zh</a>
</li>
</ul>
</li>
<li class="apache-link">
<a href="/apacheASF/">Apache</a>
</li>
<li class="poweredby">
<a href="/poweredBy">Powered By</a>
</li>
<li class="documentation-menu">
<a href="/docs/">Documentation</a>
<ul>
<li><a href="/docs/getting-started/">Getting Started</a></li>
<li><a href="/docs/architecture/">Architecture</a></li>
<li><a href="/docs/tutorials/">Tutorials</a></li>
<li><a href="/docs/drill-on-yarn/">Drill-on-YARN</a></li>
<li><a href="/docs/install-drill/">Install Drill</a></li>
<li><a href="/docs/configure-drill/">Configure Drill</a></li>
<li><a href="/docs/connect-a-data-source/">Connect a Data Source</a></li>
<li><a href="/docs/odbc-jdbc-interfaces/">ODBC/JDBC Interfaces</a></li>
<li><a href="/docs/query-data/">Query Data</a></li>
<li><a href="/docs/performance-tuning/">Performance Tuning</a></li>
<li><a href="/docs/log-and-debug/">Log and Debug</a></li>
<li><a href="/docs/sql-reference/">SQL Reference</a></li>
<li><a href="/docs/data-sources-and-file-formats/">Data Sources and File Formats</a></li>
<li><a href="/docs/develop-custom-functions/">Develop Custom Functions</a></li>
<li><a href="/docs/troubleshooting/">Troubleshooting</a></li>
<li><a href="/docs/developer-information/">Developer Information</a></li>
<li><a href="/docs/release-notes/">Release Notes</a></li>
<li><a href="/docs/sample-datasets/">Sample Datasets</a></li>
<li><a href="/docs/project-bylaws/">Project Bylaws</a></li>
<li><a href="/docs/ecosystem/">Ecosystem</a></li>
</ul>
</li>
<li class='nav'>
<a href="/community-resources/">Community</a>
<ul>
<li><a href="/team/">Team</a></li>
<li><a href="/mailinglists/">Mailing Lists</a></li>
<li><a href="/community-resources/">Community Resources</a></li>
</ul>
</li>
<li class='nav'><a href="/faq/">FAQ</a></li>
<li class='nav'><a href="/blog/">Blog</a></li>
<li class="social-menu-item"><a href="https://twitter.com/apachedrill" title="apachedrill on twitter" target="_blank"><img src="/images/twitter_32_26_white.png" alt="twitter logo" align="center"></a> </li>
<li class="social-menu-item"><a href="https://join.slack.com/t/apache-drill/shared_invite/enQtNTQ4MjM1MDA3MzQ2LTJlYmUxMTRkMmUwYmQ2NTllYmFmMjU4MDk0NjYwZjBmYjg0MDZmOTE2ZDg0ZjBlYmI3Yjc4Y2I2NTQyNGVlZTc" title="Apache Drill Slack channels"
target="_blank"><img src="/images/slack-logo.svg" alt="Slack logo" align="center"></a> </li>
<li class='search-bar'>
<form id="drill-search-form">
<input type="text" placeholder="Search Apache Drill" id="drill-search-term" />
<button type="submit">
<i class="fa fa-search"></i>
</button>
</form>
</li>
<li class="d">
<a href="/download/">
<i class="fa fa-cloud-download"></i> Download
</a>
</li>
</ul>
</div>
<div class="int_title">
<h1>Blog</h1>
</div>
<div class="int_text" align="left"><!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2021/08/05/drill-provider-for-airflow/">Drill provider for Airflow</a><br/>
<span class="post-date">Posted on Aug 5, 2021
by James Turton</span>
<br/>In its provider package release this month, the Apache Airflow project added a provider for interacting with Apache Drill. This allows data engineers and data scientists to incorporate Drill queries in their Airflow DAGs, enabling the automation of big data and data science workflows.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2021/07/09/streaming-data-from-the-rest-api/">Streaming data from the Drill REST API</a><br/>
<span class="post-date">Posted on Jul 9, 2021
by James Turton</span>
<br/>The release of Apache Drill 1.19 saw a major change under the hood of Drill's REST API with the introduction of a streaming data path for query results moving from Drill and over the network to the initiating client. The result is better memory utilisation, less blocking and a more reliable API.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2021/06/10/drill-1.19-released/">Drill 1.19 Released</a><br/>
<span class="post-date">Posted on Jun 10, 2021
by Laurent Goujon</span>
<br/>Apache Drill 1.19 has been released providing new storage plugins for Cassandra, Elasticsearch and Splunk, updating several storage plugins to EVF, adding Linux ARM64 support and JSON reader improvements, and more.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2020/09/05/drill-1.18-released/">Drill 1.18 Released</a><br/>
<span class="post-date">Posted on Sep 5, 2020
by Abhishek Girish</span>
<br/>Apache Drill 1.18 has been released providing Drill Metadata management "Drill Metastore", Format Plugins for HDF5 and SPSS, Storage Plugins for Generic HTTP REST APIs and Apache Druid, Support for DICT type in RowSet Framework, Dynamic credit based flow control, Support for injecting BufferManager into UDF, Drill RDBMS Metastore"</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2019/12/26/drill-1.17-released/">Drill 1.17 Released</a><br/>
<span class="post-date">Posted on Dec 26, 2019
by Bridget Bevens</span>
<br/>Apache Drill 1.17's highlights are&#58; Hadoop, Kafka, Sqlline, and Calcite upgrades, .zip compression, file/table function for schema provisioning, new UDFs, and more.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2019/05/02/drill-user-meetup/">Drill User Meetup 2019</a><br/>
<span class="post-date">Posted on May 2, 2019
by Bridget Bevens</span>
<br/>Drill User Meetup coming soon.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2019/05/02/drill-1.16-released/">Drill 1.16 Released</a><br/>
<span class="post-date">Posted on May 2, 2019
by Bridget Bevens</span>
<br/>Apache Drill 1.16's highlights are&#58; table statistics, schema provisioning for text files, parquet metadata caching improvements, several Web UI improvements, and more.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2018/12/31/drill-1.15-released/">Drill 1.15 Released</a><br/>
<span class="post-date">Posted on Dec 31, 2018
by Bridget Bevens</span>
<br/>Apache Drill 1.15's highlights are&#58; SQLLine upgrade, index support, ability to secure znodes with custom ACLs, INFORMATION_SCHEMA files table, systemfunctions table, and more.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2018/12/01/learning-apache-drill-book/">Learning Apache Drill book from O'Reilly Media</a><br/>
<span class="post-date">Posted on Dec 1, 2018
by James Turton</span>
<br/>A new book for learning to work with Apache Drill from two Drill comitters has been published through O'Reilly Media. The book contains helpful explanations and recipes for different types of user from big data admins to data scientists. It also presents information relevant to developers interested in customising Drill, contributing to the open source project or just taking a peek under the hood.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2018/10/16/drill-user-meetup/">Drill User Meetup 2018</a><br/>
<span class="post-date">Posted on Oct 16, 2018
by Bridget Bevens</span>
<br/>Drill User Meetup coming soon.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2018/10/16/drill-developer-day/">Drill Developer Day 2018</a><br/>
<span class="post-date">Posted on Oct 16, 2018
by Bridget Bevens</span>
<br/>Drill Developer Day coming soon.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2018/08/05/drill-1.14-released/">Drill 1.14 Released</a><br/>
<span class="post-date">Posted on Aug 5, 2018
by Bridget Bevens</span>
<br/>Apache Drill 1.14's highlights are&#58; Ability to run Drill in a Docker container, ability to export and save storage plugin configurations, a storage plugin configuration file to manage storage plugin configurations, an image metadata format plugin, option to set Hive properties at the session level, and more.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2018/03/18/drill-1.13-released/">Drill 1.13 Released</a><br/>
<span class="post-date">Posted on Mar 18, 2018
by Bridget Bevens</span>
<br/>Apache Drill 1.13's highlights are&#58; YARN support, support for HTTP Kerberos authentication using SPNEGO, SQL syntax highlighting of queries, and user and distribution specific configuration checks during startup.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2018/02/09/running-sql-queries-on-amazon-s3/">Running SQL Queries on Amazon S3</a><br/>
<span class="post-date">Posted on Feb 9, 2018
by Nick Amato</span>
<br/>Drill enables you to run SQL queries directly on data in S3. There's no need to ingest the data into a managed cluster or transform the data. This is a step-by-step tutorial on how to use Drill with S3.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2017/12/15/drill-1.12-released/">Drill 1.12 Released</a><br/>
<span class="post-date">Posted on Dec 15, 2017
by Bridget Bevens</span>
<br/>Apache Drill 1.12's highlights are&#58; Kafka and OpenTSDB storage plugins, SSL and network encryption support, queue-based memory assignment for buffering operators, networking functions, and the ability to prevent users from accessing paths outside the root of a workspace.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2017/07/31/drill-1.11-released/">Drill 1.11 Released</a><br/>
<span class="post-date">Posted on Jul 31, 2017
by Bridget Bevens</span>
<br/>Apache Drill 1.11's highlights are&#58; Cryptography-related functions, spill to disk for the hash aggregate operator, Format plugin support for PCAP files, ability to change the HDFS block Size for Parquet files, ability to store query profiles in memory, configurable CTAS directory and file permissions option, support for network encryption, relative paths stored in the metadata file, and support for ANSI_QUOTES.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2017/03/15/drill-1.10-released/">Drill 1.10 Released</a><br/>
<span class="post-date">Posted on Mar 15, 2017
by Bridget Bevens</span>
<br/>Apache Drill 1.10's highlights are&#58; CTTAS, improved fault tolerance, Drill version and statistics in Web Console, implicit interpretation of INT96, and Kerberos authentication.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2016/11/29/drill-1.9-released/">Drill 1.9 Released</a><br/>
<span class="post-date">Posted on Nov 29, 2016
by Bridget Bevens</span>
<br/>Apache Drill 1.9's highlights are&#58; asynchronous Parquet reader, Parquet filter pushdown, dynamic UDF support, and HTTPD format plugin.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2016/08/30/drill-1.8-released/">Drill 1.8 Released</a><br/>
<span class="post-date">Posted on Aug 30, 2016
by Bridget Bevens</span>
<br/>Apache Drill 1.8's highlights are&#58; metadata cache pruning, IF EXISTS support, DESCRIBE SCHEMA command, multi-byte delimiter support, and new parameters for filter selectivity estimates.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2016/06/28/drill-1.7-released/">Drill 1.7 Released</a><br/>
<span class="post-date">Posted on Jun 28, 2016
by Bridget Bevens</span>
<br/>Apache Drill 1.7's highlights are&#58; Monitoring via JMX, Hive CHAR data type support, and HBase 1.x support.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2016/03/16/drill-1.6-released/">Drill 1.6 Released</a><br/>
<span class="post-date">Posted on Mar 16, 2016
by Bridget Bevens</span>
<br/>Apache Drill 1.6's highlights are&#58; Inbound impersonation and additional custom window frames.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2016/02/16/drill-1.5-released/">Drill 1.5 Released</a><br/>
<span class="post-date">Posted on Feb 16, 2016
by Jason Altekruse, Bridget Bevens</span>
<br/>Apache Drill 1.5's highlights are&#58; Authentication and security for the Web interface and REST API, experimental query support for Apache Kudu (incubating), an improved memory allocator, and configurable caching for Hive metadata.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2015/12/14/drill-1.4-released/">Drill 1.4 Released</a><br/>
<span class="post-date">Posted on Dec 14, 2015
by Jacques Nadeau</span>
<br/>Apache Drill 1.4's highlights are&#58; "select with options" queries that can change storage plugin settings, improved behavior when parsing CSV file header names, a variable to set non-pretty (e.g. compact) printing of JSON, and better drillbit.log files that include query text.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2015/11/23/drill-1.3-released/">Drill 1.3 Released</a><br/>
<span class="post-date">Posted on Nov 23, 2015
by Jacques Nadeau</span>
<br/>Drill 1.3 has been released. Users can now query Hadoop sequence files and text delimited files with headers. In addition, this release provides significant performance and usability improvements for working with Amazon S3. Drill 1.3 also adds support for heterogeneous types, enabling queries on datasets with columns that have more than one data type (commonly seen in JSON files, MongoDB collections, etc.).</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2015/10/16/drill-1.2-released/">Drill 1.2 Released</a><br/>
<span class="post-date">Posted on Oct 16, 2015
by Jacques Nadeau</span>
<br/>Drill 1.2 has been released. This release includes a new JDBC storage plugin for querying relational databases, as well as new window functions such as `NTILE`, `FIRST_VALUE`, `LAST_VALUE`, `LEAD` and `LAG`. This release addresses 210 JIRAs, including performance, stability and documentation enhancements.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2015/07/23/drill-tutorial-at-nosql-now-2015/">Drill Tutorial at NoSQL Now! 2015</a><br/>
<span class="post-date">Posted on Jul 23, 2015
by Tomer Shiran</span>
<br/>Attend the 3-hour Drill tutorial at the NoSQL Now! 2015 conference to learn more about Apache Drill.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2015/07/05/drill-1.1-released/">Drill 1.1 Released</a><br/>
<span class="post-date">Posted on Jul 5, 2015
by Jacques Nadeau</span>
<br/>Drill 1.1 has been released, providing window functions, automatic partitioning, improved MongoDB support and more. This release addresses 162 JIRAs.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2015/05/19/the-apache-software-foundation-announces-apache-drill-1.0/">The Apache Software Foundation Announces Apache Drill 1.0</a><br/>
<span class="post-date">Posted on May 19, 2015
by Tomer Shiran</span>
<br/>The Apache Software Foundation announced today the availability of Apache Drill 1.0, the schema-free SQL query engine for Apache Hadoop, NoSQL and cloud storage.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2015/05/19/drill-1.0-released/">Drill 1.0 Released</a><br/>
<span class="post-date">Posted on May 19, 2015
by Tomer Shiran, Jacques Nadeau</span>
<br/>Drill 1.0 has been released, representing a major milestone for the Drill community. Drill in now production-ready, making it easier than ever to explore and analyze data in non-relational datastores.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2015/05/04/drill-0.9-released/">Drill 0.9 Released</a><br/>
<span class="post-date">Posted on May 4, 2015
by Tomer Shiran, Jacques Nadeau</span>
<br/>The community has just released Drill 0.9, which includes 199 resolved JIRAs and numerous enhancements.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2015/04/30/apache-parquet-graudates-to-a-top-level-project/">Apache Parquet Graduates to a Top-Level Project</a><br/>
<span class="post-date">Posted on Apr 30, 2015
by Tomer Shiran</span>
<br/>The Apache Parquet project has graduated to a top-level project (TLP) at the Apache Software Foundation.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2015/03/31/drill-0.8-released/">Drill 0.8 Released</a><br/>
<span class="post-date">Posted on Mar 31, 2015
by Tomer Shiran, Jacques Nadeau</span>
<br/>The community has just released Drill 0.8, which includes 243 resolved JIRAs and numerous enhancements.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2015/03/23/microstrategy-announces-drill-support/">MicroStrategy Announces Drill Support</a><br/>
<span class="post-date">Posted on Mar 23, 2015
by Tomer Shiran</span>
<br/>MicroStrategy announced that it is now certified with Apache Drill, providing a first-class BI experience for Hadoop and NoSQL databases.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2015/01/27/schema-free-json-data-infrastructure/">Schema-free JSON Data Infrastructure</a><br/>
<span class="post-date">Posted on Jan 27, 2015
by Tomer Shiran</span>
<br/>JSON has emerged as the de-facto standard data exchange format. Data infrastructure technologies such as Apache Drill, MongoDB and Elasticsearch are embracing JSON as their native data models, bringing game-changing ease-of-use and agility to developers and analysts.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2014/12/23/drill-0.7-released/">Drill 0.7 Released</a><br/>
<span class="post-date">Posted on Dec 23, 2014
by Jacques Nadeau</span>
<br/>The community has just released Drill 0.7, which includes 228 resolved JIRAs and numerous enhancements.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2014/12/16/whats-coming-in-2015/">What's Coming in 2015?</a><br/>
<span class="post-date">Posted on Dec 16, 2014
by Tomer Shiran</span>
<br/>Drill is now a top-level project, and the community is expanding rapidly. Find out more about some of the new features planned for 2015.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2014/12/11/apache-drill-qa-panelist-spotlight/">Apache Drill Q&A Panelist Spotlight</a><br/>
<span class="post-date">Posted on Dec 11, 2014
by Tomer Shiran</span>
<br/>Join us on Twitter for a live Q&A on Wednesday, December 17.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2014/12/02/drill-top-level-project/">Apache Drill Graduates to a Top-Level Project</a><br/>
<span class="post-date">Posted on Dec 2, 2014
by Tomer Shiran</span>
<br/>Drill has graduated to a Top-Level Project at Apache. This marks a significant accomplishment for the Drill community, which now includes dozens of developers working at a variety of companies.</p>
<!-- previously: site.posts -->
<p><a class="post-link" href="/blog/2014/11/19/sql-on-mongodb/">SQL on MongoDB</a><br/>
<span class="post-date">Posted on Nov 19, 2014
by Anil Kumar Batchu, Kamesh Bhallamudi</span>
<br/>The MongoDB storage plugin for Drill enables analytical queries on MongoDB databases. Drill's schema-free JSON data model is a natural fit for MongoDB's data model.</p>
<p class="info">Want to contribute a blog post? Check out the source for some of the <a href="https://github.com/apache/drill/tree/gh-pages/blog/_posts">existing posts</a> to see how it's done. When you're ready, email your Markdown file to <a href="mailto:dev@drill.apache.org">dev@drill.apache.org</a>.</p>
<h1>Third-Party Articles</h1>
<!-- previously: site.posts -->
<p><a class="post-link" href="https://www.mapr.com/blog/how-turn-raw-data-yelp-insights-minutes-apache-drill">How to Turn Raw Data from Yelp into Insights in Minutes with Apache Drill</a> (Nov 13, 2014)<br/></p>
<!-- previously: site.posts -->
<p><a class="post-link" href="https://www.mapr.com/blog/how-use-sql-hadoop-drill-rest-json-nosql-and-hbase-simple-rest-client">How to Use SQL, Hadoop, Drill, REST, JSON, NoSQL, and HBase in a Simple REST Client</a> (Jan 6, 2015)<br/></p>
</div>
</div>
<p class="push"></p>
<div id="footer" class="mw">
<div class="wrapper">
Copyright © 2012-2020 The Apache Software Foundation, licensed under the Apache License, Version 2.0.<br>
Apache and the Apache feather logo are trademarks of The Apache Software Foundation. Other names appearing on the site may be trademarks of their respective owners.<br/><br/>
</div>
</div>
<script>
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
ga('create', 'UA-53379651-1', 'auto');
ga('send', 'pageview');
</script>
<script type="text/javascript" src="https://s7.addthis.com/js/300/addthis_widget.js#pubid=ra-548b2caa33765e8d" async="async"></script>
</body>
</html>