Drill : 1.21.2-SNAPSHOT API

Packages
Package
Description
Generate-fmpp has a dependency on beanshell EvalError.
 
 
 
 
 
 
 
Logical (execution-engine-independent) element definitions.
 
 
Internal configuration state definitions.
Various exceptions used in logical, physical and execution contexts.
Logical expression tree representation.
Logical function definitions.
 
Logical type definitions.
Visitors for validating or optimizing logical expressions.
Connected-graph representation shared by logical and physical query graphs.
Storage plugin interfaces and logical plan representation.
Logical operators in a query graph.
Visitors for Drill logical plan graphs.
 
 
 
 
 
Logical data types.
Utilities useful across packages.
 
Drill execution engine, including: physical operators, runtime code generation, planning, RPC layer, Value Vector data structures.
 
Distributed cache for syncing state and data between Drillbits.
Java client API for submitting queries and accepting result sets from a Drill server.
Runtime code-generation, compilation and bytecode-manipulation utilities.
Bytecode manipulation utilities for stitching together runtime-generated code with prebuilt templates.
TODO - write docs for this package
Cluster coordination system based on Apache Zookeeper and Curator.
A single-node "cluster coordinator" used when running Drill locally.
 
Zookeeper/Curator integration code.
Interface for Drill's interaction with the local disk to persist data temporarily during an operation.
Meta-data persistence format, used for views and other cluster-wide persistent state.
Execution-time exceptions.
Drill expression materialization and evaluation facilities.
 
 
 
 
 
 
 
 
 
 
 
 
Memory Allocation, Account and Management See the README.md file in this directory for detailed information about Drill's memory allocation subsystem.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Defines a revised implementation of the Drill RecordBatch protocol.
 
Defines the scan operation implementation.
Handles the special "columns" column used by the text reader, and available to similar readers.
Standard type conversion tools for the case in which the input types are the standard Java types already supported by the ValuesWriter interface.
Handles optional file metadata columns: implicit columns and partition columns.
Defines the projection, vector continuity and other operations for a set of one or more readers.
Provides run-time semantic analysis of the projection list for the scan operator.
Provides the "version 3" scan framework (which can also be thought of as EVF version 2).
 
Implements the details of the scan lifecycle for a set of readers, primarily the process of resolving the scan output schema from a variety of input schemas, then running each reader, each of which will produce some number of batches.
Provides run-time semantic analysis of the projection list for the scan operator.
 
 
Collection of classes shared by operators that implement spill-to-disk.
 
 
 
 
 
 
 
 
 
 
 
 
Provides a second-generation row set (AKA "record batch") writer used by client code to Define the schema of a result set. Write data into the vectors backing a row set.
Handles the details of the result set loader implementation.
The "row set model" provides a "dual" of the vector structure used to create, allocate and work with a collection of vectors.
Implementation of a row set model for hyper-batches.
This set of classes models the structure of a batch consisting of single vectors (as contrasted with a hyper batch.) Provides tools or metdata-based construction, allocation, reading and writing of the vectors.
 
 
Provides a set of tools to work with row sets.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Provides a fluent schema builder.
 
 
 
 
This package will contain all the components of resource manager in Drill.
This package contains the configuration components of ResourceManagement feature in Drill.
 
Defines all the selection policy implementation which can be configured with Resource Management.
Defines all the Selectors which can be assigned to a ResourcePool in the ResourceManagement configuration.
 
 
 
 
Communication security.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Drill storage plugin.
 
 
 
 
 
 
 
 
 
Provides parsing for Mongo extended types which are generally of the form { "$type": value }.
 
 
 
 
 
 
Version 3 of the text reader.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Package containing writers used to write data from Hive table columns into Drill's value vectors.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Kafka storage plugin.
 
 
 
 
 
Defines a mock data source which generates dummy test data for use in testing.
MongoDB storage plugin.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
For comments on realization of this format plugin look at :
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Provides a light-weight, simplified set of column readers and writers that can be plugged into a variety of row-level readers and writers.
Provides implementations of the API defined in the parent package.
Provides the reader hierarchy as explained in the API package.
 
Implementation of the vector writers.
This package provides a "dummy" set of writers.
 
 
 
 
 
 
 
 
 
Provides resource management and queuing support for the Drill foreman.
 
 
 
 
 
JDBC driver for Drill.
 
Tracing proxy JDBC driver.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Implements the Drill Application Master for YARN.
 
Implements a "YARN client" for Drill-on-YARN.
Holds functionality common to the Drill-on-YARN client and Application Master (AM).
Interface between the Application Master and ZooKeeper.