Menu
Language
- en
- zh
Apache
Powered By
Documentation
Community
FAQ
Blog
Download

Getting Started

Drill Introduction
Why Drill

Architecture

Architecture Introduction
Drill Query Execution
Core Modules
Performance

Tutorials

Tutorials Introduction
Drill in 10 Minutes
Analyzing the Yelp Academic Dataset
Learn Drill with the MapR Sandbox

About the MapR Sandbox
Installing the Apache Drill Sandbox
Getting to Know the Drill Sandbox
Lesson 1: Learn about the Data Set
Lesson 2: Run Queries with ANSI SQL
Lesson 3: Run Queries on Complex Data Types
Summary

Analyzing Highly Dynamic Datasets
Analyzing Social Media
Analyzing Data Using Window Functions
Orchestrating queries with Airflow

Drill-on-YARN

Drill-on-YARN Introduction
Creating a Basic Drill Cluster
Launch Drill Under YARN
Configuration Reference
Drill-on-YARN Command-Line Tool
Using the Drill-on-YARN Web UI
Multiple Drill Clusters
Enabling Web UI Security
Appendix A: Release Note Issues
Appendix B: drill-env.sh Settings
Appendix C: Troubleshooting
Appendix D: Recreate the Drill Archive

Install Drill

Install Drill Introduction
Migrating Parquet Data
Installing Drill in Embedded Mode

Embedded Mode Prerequisites
Running Drill on Docker
Installing Drill on Linux and Mac OS X
Starting Drill on Linux and Mac OS X
Installing Drill on Windows
Starting Drill on Windows

Installing Drill in Distributed Mode

Distributed Mode Prerequisites
Installing Drill on the Cluster
Starting Drill in Distributed Mode

Starting the Web UI
Stopping Drill
Identifying Multiple Drill Versions in a Cluster
Extended

Installing Drill in Distributed Mode with GCP Dataproc

Configure Drill

Configure Drill Introduction
Configuring Drill Memory
Securing Drill

Securing Drill Introduction
Secure Communication Paths
Roles and Privileges
Configuring User Impersonation
Configuring Inbound Impersonation
Configuring User Impersonation with Hive Authorization
Configuring User Security
Configuring Plain Security
Configuring SSL/TLS for Encryption
Using libpam4j as the PAM Authenticator
Using jpam as the PAM Authenticator
Configuring htpasswd file authentication
Configuring HashiCorp Vault authentication
Configuring Kerberos Security
Configuring Drill to use SPNEGO for HTTP Authentication
Configuring Web UI and REST API Security
Configuring Custom ACLs to Secure znodes

Configuring a Multitenant Cluster

Configuring a Multitenant Cluster Introduction
Configuring Multitenant Resources
Configuring Resources for a Shared Drillbit

Configuration Options

Configuration Options Introduction
Start-Up Options
Planning and Execution Options
Persistent Configuration Storage
Global Query List

Ports and Bind Addresses Used by Drill
Configuring the Drill Shell
Configuring cgroups to Control CPU Usage

Connect a Data Source

Connect a Data Source Introduction
Storage Plugin Registration
Storage Plugin Configuration

Plugin Configuration Basics
Configuring Storage Plugins
Storage plugin authentication modes
Workspaces
Drill Default Input Format

File System Storage Plugin
HBase Storage Plugin
Hive Storage Plugin
RDBMS Storage Plugin
MongoDB Storage Plugin
MapR-DB Format
S3 Storage Plugin
OCI OS Storage Plugin
OpenTSDB Storage Plugin
Kafka Storage Plugin
Azure Blob Storage Plugin
Druid Storage Plugin
HTTP Storage Plugin
ElasticSearch Storage Plugin
Splunk Storage Plugin
Cassandra Storage Plugin
Dropbox Storage Plugin
Google Sheets Storage Plugin

ODBC/JDBC Interfaces

Interfaces Introduction
Using the JDBC Driver
Using JDBC with SQuirreL on Windows
Installing the ODBC Driver

Installing the Driver on Linux
Installing the Driver on Mac OS X
Installing the Driver on Windows

Configuring ODBC

ODBC Configuration Reference
Logging and Tracing
Configuring ODBC on Linux
Configuring ODBC on Mac OS X
Configuring ODBC on Windows
Testing the ODBC Connection

Using Drill Explorer

Drill Explorer Introduction
Connecting Drill Explorer to Data
Browsing Data and Defining Views

Using Drill with BI Tools

Using Drill with BI Tools Introduction
Tableau Examples
Using MicroStrategy Analytics with Apache Drill
Using Tibco Spotfire Desktop with Drill
Configuring Tibco Spotfire Server with Drill
Using Qlik Sense with Drill
Using Apache Drill with Tableau 10.2
Using Apache Drill with Tableau 9 Desktop
Using Apache Drill with Tableau 9 Server
Using Information Builders’ WebFOCUS with Apache Drill
Configuring JReport with Drill

Query Data

Query Data Introduction
Querying a File System

Querying a File System Introduction
Querying Avro Files
Querying JSON Files
Querying Parquet Files
Querying Plain Text Files
Querying Directories
Querying Sequence Files

Querying HBase
Querying Complex Data

Querying Complex Data Introduction
Sample Data: Donuts
Selecting Flat Data
Using SQL Functions, Clauses, and Joins
Selecting Nested Data for a Column
Selecting Multiple Columns Within Nested Data

Querying Hive
Querying the INFORMATION SCHEMA
Querying Indexes

Querying Indexes Introduction
Queries that Qualify for Index-Based Query Plans
Types of Indexes
Index Selection
Designing Indexes for Your Queries
Configuring Index Planning
Verifying Index Use

Querying System Tables
Monitoring and Canceling Queries in the Drill Web UI

Performance Tuning

Drill Metastore

Using Drill Metastore
Drill Iceberg Metastore
RDBMS Metastore
Mongo Metastore

Performance Tuning Introduction
Partition Pruning

Partition Pruning Introduction
How to Partition Data

Asynchronous Parquet Reader
Optimizing Parquet Metadata Reading
Parquet Filter Pushdown
Hive Metadata Caching
Choosing a Storage Format
Query Plans and Tuning

Query Plans and Tuning Introduction
Join Planning Guidelines
Guidelines for Optimizing Aggregation
Modifying Query Planning Options
Sort-Based and Hash-Based Memory-Constrained Operators
Enabling Query Queuing
Throttling
Controlling Parallelization to Balance Performance with Multi-Tenancy

Identifying Performance Issues

Query Plans
Query Profiles

Performance Tuning Reference

Query Profile Column Descriptions
Physical Operators

Monitoring Metrics

Log and Debug

Log and Debug Introduction
Error Messages
Modify logback.xml
Review the Java Stack Trace
Query Audit Logging

SQL Reference

SQL Reference Introduction
Data Types

Supported Data Types
Date, Time, and Timestamp
Handling Different Data Types

Lexical Structure
Operators
SQL Functions

About SQL Function Examples
Math and Trig
Statistical
Data Type Conversion
Data Type Functions
Date/Time Functions and Arithmetic
String Manipulation
Aggregate and Aggregate Statistical
Functions for Handling Nulls
Phonetic Functions
String Distance Functions
Cryptography Functions
SQL dialect compatibility functions
GIS functions
Time Series Analysis Functions
IP Networking functions

SQL Window Functions

SQL Window Functions Introduction
Aggregate Window Functions
Ranking Window Functions
Value Window Functions
SQL Window Functions Examples

Nested Data Functions

Nested Data Limitations
FLATTEN
KVGEN
REPEATED_COUNT
REPEATED_CONTAINS
COLLECT_LIST

Query Directory Functions
SQL Commands

SQL Conditional Expressions

CASE

Reserved Keywords
SQL Extensions

Data Sources and File Formats

Data Sources and File Formats Introduction
Hive-to-Drill Data Type Mapping
Deploying and Using a Hive UDF
Parquet Format
Logfile Plugin
JSON Data Model
Text Files: CSV, TSV, PSV
Sequence Files
HTTPD Format Plugin
Image Metadata Format Plugin
Syslog Format Plugin
LTSV Format Plugin
SPSS Format Plugin
ESRI Shapefile Format Plugin
Excel Format Plugin
HDF5 Format Plugin
Microsoft Access Format Plugin
XML Format Plugin
Iceberg Format Plugin
Delta Lake Format Plugin
SAS Format Plugin

Develop Custom Functions

Develop Custom Functions Introduction
Developing a Simple Function
Tutorial: Develop a Simple Function
Developing an Aggregate Function
Adding Custom Functions to Drill

Adding Custom Functions to Drill Introduction
Manually Adding Custom Functions to Drill
Creating Custom Authenticators
Dynamic UDFs

Using Custom Functions in Queries
Custom Function Interfaces

Troubleshooting
Developer Information

REST API

REST API Introduction
Submitting Queries from the REST API when Impersonation is Enabled and Authentication is Disabled
Use Postman to Run SQL Queries on Drill Data Sources

Develop Drill

Compiling Drill from Source
Useful Information for Drill Developers

Contribute to Drill

Apache Drill Contribution Guidelines
Apache Drill Contribution Ideas

Design Docs

Drill Plan Syntax
RPC Overview
Query Stages
Useful Research
Value Vectors

Release Notes

Apache Drill 1.21.2 Release Notes
Apache Drill 1.21.1 Release Notes
Apache Drill 1.21.0 Release Notes
Apache Drill 1.20.3 Release Notes
Apache Drill 1.20.2 Release Notes
Apache Drill 1.20.1 Release Notes
Apache Drill 1.20.0 Release Notes
Apache Drill 1.19.0 Release Notes
Apache Drill 1.18.0 Release Notes
Apache Drill 1.17.0 Release Notes
Apache Drill 1.16.0 Release Notes
Apache Drill 1.15.0 Release Notes
Apache Drill 1.14.0 Release Notes
Apache Drill 1.13.0 Release Notes
Apache Drill 1.12.0 Release Notes
Apache Drill 1.11.0 Release Notes
Apache Drill 1.10.0 Release Notes
Apache Drill 1.9.0 Release Notes
Apache Drill 1.8.0 Release Notes
Apache Drill 1.7.0 Release Notes
Apache Drill 1.6.0 Release Notes
Apache Drill 1.5.0 Release Notes
Apache Drill 1.4.0 Release Notes
Apache Drill 1.3.0 Release Notes
Apache Drill 1.2.0 Release Notes
Apache Drill 1.1.0 Release Notes
Apache Drill 1.0.0 Release Notes
Apache Drill 0.9.0 Release Notes
Apache Drill 0.8.0 Release Notes
Apache Drill 0.7.0 Release Notes
Apache Drill 0.6.0 Release Notes
Apache Drill 0.5.0 Release Notes
Apache Drill 0.4.0 Release Notes
Apache Drill M1 Release Notes (Apache Drill Alpha)

Sample Datasets

Enron Emails
Wikipedia Edit History

Project Bylaws
Ecosystem

Using Saiku Analytics with Apache Drill

Develop Custom Functions

Adding Custom Functions to Drill

Adding Custom Functions to Drill

Adding Custom Functions to Drill Introduction
Manually Adding Custom Functions to Drill
Creating Custom Authenticators
Dynamic UDFs

← Developing an Aggregate FunctionUsing Custom Functions in Queries →

Copyright © 2012-2022 The Apache Software Foundation, licensed under the Apache License, Version 2.0.
Apache and the Apache feather logo are trademarks of The Apache Software Foundation. Other names appearing on the site may be trademarks of their respective owners.