Uses of Interface
org.apache.drill.exec.record.metadata.TupleMetadata
Package
Description
Drill expression materialization and evaluation facilities.
Handles the special "columns" column used by the text reader,
and available to similar readers.
Standard type conversion tools for the case in which the input
types are the standard Java types already supported by the
ValuesWriter
interface.Handles optional file metadata columns: implicit columns and
partition columns.
Defines the projection, vector continuity and other operations for
a set of one or more readers.
Provides run-time semantic analysis of the projection list for the
scan operator.
Provides the "version 3" scan framework (which can also be thought of
as EVF version 2).
Implements the details of the scan lifecycle for a set of readers,
primarily the process of resolving the scan output schema from a variety
of input schemas, then running each reader, each of which will produce
some number of batches.
Provides run-time semantic analysis of the projection list for the
scan operator.
Provides a second-generation row set (AKA "record batch") writer used
by client code to
Define the schema of a result set.
Write data into the vectors backing a row set.
Handles the details of the result set loader implementation.
The "row set model" provides a "dual" of the vector structure used to create,
allocate and work with a collection of vectors.
Implementation of a row set model for hyper-batches.
This set of classes models the structure of a batch consisting
of single vectors (as contrasted with a hyper batch.) Provides tools
or metdata-based construction, allocation, reading and writing of
the vectors.
Provides a set of tools to work with row sets.
Provides a fluent schema builder.
Version 3 of the text reader.
Provides a light-weight, simplified set of column readers and writers that
can be plugged into a variety of row-level readers and writers.
Provides the reader hierarchy as explained in the API package.
Implementation of the vector writers.
-
Uses of TupleMetadata in org.apache.drill.exec.expr
Modifier and TypeMethodDescriptionstatic LogicalExpression
ExpressionTreeMaterializer.materializeFilterExpr
(LogicalExpression expr, TupleMetadata fieldTypes, ErrorCollector errorCollector, FunctionLookupContext functionLookupContext) -
Uses of TupleMetadata in org.apache.drill.exec.expr.fn.impl
Modifier and TypeMethodDescriptionstatic TupleMetadata
SchemaFunctions.getTupleMetadata
(String serialized) Wraps static method from TupleMetadata to avoidIncompatibleClassChangeError
for JDK 9+. -
Uses of TupleMetadata in org.apache.drill.exec.metastore.store
Modifier and TypeFieldDescriptionprotected TupleMetadata
MetastoreFileTableMetadataProvider.Builder.schema
protected final TupleMetadata
MetastoreFileTableMetadataProvider.schema
Modifier and TypeMethodDescriptionstatic TableMetadataProvider
FileSystemMetadataProviderManager.getMetadataProviderForSchema
(TupleMetadata schema) ReturnsTableMetadataProvider
which provides specified schema.MetastoreFileTableMetadataProvider.Builder.withSchema
(TupleMetadata schema) SimpleFileTableMetadataProvider.Builder.withSchema
(TupleMetadata schema) -
Uses of TupleMetadata in org.apache.drill.exec.metastore.store.parquet
Modifier and TypeMethodDescriptionMetastoreParquetTableMetadataProvider.Builder.withSchema
(TupleMetadata schema) ParquetMetadataProviderBuilder.withSchema
(TupleMetadata schema) -
Uses of TupleMetadata in org.apache.drill.exec.physical.base
Modifier and TypeFieldDescriptionprotected TupleMetadata
AbstractGroupScanWithMetadata.GroupScanWithMetadataFilterer.tableSchema
Modifier and TypeMethodDescriptionstatic FilterPredicate<?>
AbstractGroupScanWithMetadata.getFilterPredicate
(LogicalExpression filterExpr, UdfUtilities udfUtilities, FunctionLookupContext functionImplementationRegistry, OptionManager optionManager, boolean omitUnsupportedExprs, boolean supportsFileImplicitColumns, TupleMetadata schema) Returns parquet filter predicate built from specifiedfilterExpr
.AbstractGroupScanWithMetadata.GroupScanWithMetadataFilterer.schema
(TupleMetadata tableSchema) -
Uses of TupleMetadata in org.apache.drill.exec.physical.config
-
Uses of TupleMetadata in org.apache.drill.exec.physical.impl.scan.columns
Modifier and TypeMethodDescriptionboolean
ColumnsArrayManager.resolveColumn
(ColumnProjection col, ResolvedTuple outputTuple, TupleMetadata tableSchema) -
Uses of TupleMetadata in org.apache.drill.exec.physical.impl.scan.convert
Modifier and TypeMethodDescriptionStandardConversions.Builder.withSchema
(TupleMetadata providedSchema) -
Uses of TupleMetadata in org.apache.drill.exec.physical.impl.scan.file
Modifier and TypeMethodDescriptionboolean
ImplicitColumnManager.resolveColumn
(ColumnProjection col, ResolvedTuple tuple, TupleMetadata tableSchema) Resolves metadata columns to concrete, materialized columns with the proper value for the present file. -
Uses of TupleMetadata in org.apache.drill.exec.physical.impl.scan.framework
Modifier and TypeFieldDescriptionprotected TupleMetadata
SchemaNegotiatorImpl.providedSchema
protected TupleMetadata
SchemaNegotiatorImpl.tableSchema
Modifier and TypeMethodDescriptionManagedScanFramework.outputSchema()
SchemaNegotiator.providedSchema()
Returns the provided schema, if defined.SchemaNegotiatorImpl.providedSchema()
Modifier and TypeMethodDescriptionvoid
SchemaNegotiator.tableSchema
(TupleMetadata schema, boolean isComplete) Specify the table schema if this is an early-schema reader.void
SchemaNegotiatorImpl.tableSchema
(TupleMetadata schema, boolean isComplete) -
Uses of TupleMetadata in org.apache.drill.exec.physical.impl.scan.project
Modifier and TypeFieldDescriptionprotected TupleMetadata
NullColumnBuilder.NullBuilderBuilder.outputSchema
protected TupleMetadata
NullColumnBuilder.outputSchema
final TupleMetadata
ScanSchemaOrchestrator.ScanSchemaOptions.providedSchema
protected final TupleMetadata
ScanLevelProjection.readerSchema
Modifier and TypeMethodDescriptionScanLevelProjection.Builder.providedSchema()
ScanSchemaOrchestrator.providedSchema()
Returns the provided reader schema.ScanSchemaOrchestrator.ScanOrchestratorBuilder.providedSchema()
protected TupleMetadata
ScanSchemaOrchestrator.ScanSchemaOptions.providedSchema()
ScanLevelProjection.readerSchema()
Modifier and TypeMethodDescriptionstatic ScanLevelProjection
ScanLevelProjection.build
(List<SchemaPath> projectionList, List<ScanLevelProjection.ScanProjectionParser> parsers, TupleMetadata outputSchema) Builder shortcut, primarily for tests.ReaderSchemaOrchestrator.makeTableLoader
(CustomErrorContext errorContext, TupleMetadata readerSchema, long localLimit) ReaderSchemaOrchestrator.makeTableLoader
(TupleMetadata readerSchema) ScanLevelProjection.Builder.providedSchema
(TupleMetadata providedSchema) void
ScanSchemaOrchestrator.ScanOrchestratorBuilder.providedSchema
(TupleMetadata providedSchema) SchemaSmoother.resolve
(TupleMetadata tableSchema, ResolvedTuple outputTuple) boolean
ReaderLevelProjection.ReaderProjectionResolver.resolveColumn
(ColumnProjection col, ResolvedTuple tuple, TupleMetadata tableSchema) protected void
ReaderLevelProjection.resolveSpecial
(ResolvedTuple rootOutputTuple, ColumnProjection col, TupleMetadata tableSchema) NullColumnBuilder.NullBuilderBuilder.setOutputSchema
(TupleMetadata outputSchema) ModifierConstructorDescriptionExplicitSchemaProjection
(ScanLevelProjection scanProj, TupleMetadata readerSchema, ResolvedTuple rootTuple, List<ReaderLevelProjection.ReaderProjectionResolver> resolvers) SmoothingProjection
(ScanLevelProjection scanProj, TupleMetadata tableSchema, ResolvedTuple priorSchema, ResolvedTuple outputTuple, List<ReaderLevelProjection.ReaderProjectionResolver> resolvers) WildcardProjection
(ScanLevelProjection scanProj, TupleMetadata tableSchema, ResolvedTuple rootTuple, List<ReaderLevelProjection.ReaderProjectionResolver> resolvers) WildcardSchemaProjection
(ScanLevelProjection scanProj, TupleMetadata readerSchema, ResolvedTuple rootTuple, List<ReaderLevelProjection.ReaderProjectionResolver> resolvers) -
Uses of TupleMetadata in org.apache.drill.exec.physical.impl.scan.v3
Modifier and TypeFieldDescriptionprotected TupleMetadata
ScanLifecycleBuilder.definedSchema
protected TupleMetadata
ScanLifecycleBuilder.providedSchema
Modifier and TypeMethodDescriptionScanLifecycleBuilder.definedSchema()
SchemaNegotiator.inputSchema()
Returns the reader input schema: the schema which describes the set of columns this reader should produce.static TupleMetadata
FixedReceiver.Builder.mergeSchemas
(TupleMetadata providedSchema, TupleMetadata readerSchema) Given a desired provided schema and an actual reader schema, create a merged schema that contains the provided column where available, but the reader column otherwise.ScanLifecycleBuilder.providedSchema()
SchemaNegotiator.providedSchema()
Returns the provided schema, if defined.Modifier and TypeMethodDescriptionFixedReceiver.Builder.build
(TupleMetadata readerSchema) Create a fixed receiver for the provided schema (if any) in the scan plan, and the given reader schema.void
ScanLifecycleBuilder.definedSchema
(TupleMetadata definedSchema) static TupleMetadata
FixedReceiver.Builder.mergeSchemas
(TupleMetadata providedSchema, TupleMetadata readerSchema) Given a desired provided schema and an actual reader schema, create a merged schema that contains the provided column where available, but the reader column otherwise.void
ScanLifecycleBuilder.providedSchema
(TupleMetadata providedSchema) void
SchemaNegotiator.tableSchema
(TupleMetadata schema) void
SchemaNegotiator.tableSchema
(TupleMetadata schema, boolean isComplete) Specify the table schema if this is an early-schema reader. -
Uses of TupleMetadata in org.apache.drill.exec.physical.impl.scan.v3.file
ModifierConstructorDescriptionprotected
ParseResult
(List<ImplicitColumnMarker> columns, TupleMetadata schema, boolean isMetadataScan) -
Uses of TupleMetadata in org.apache.drill.exec.physical.impl.scan.v3.lifecycle
Modifier and TypeFieldDescriptionprotected TupleMetadata
MissingColumnHandlerBuilder.inputSchema
protected final TupleMetadata
OutputBatchBuilder.MapSource.mapSchema
protected TupleMetadata
MissingColumnHandlerBuilder.outputSchema
protected final TupleMetadata
ReaderLifecycle.readerInputSchema
protected TupleMetadata
SchemaNegotiatorImpl.readerSchema
protected final TupleMetadata
StaticBatchBuilder.schema
Modifier and TypeMethodDescriptionMissingColumnHandlerBuilder.buildSchema()
SchemaNegotiatorImpl.inputSchema()
ScanLifecycle.outputSchema()
SchemaNegotiatorImpl.providedSchema()
ReaderLifecycle.readerInputSchema()
ReaderLifecycle.readerOutputSchema()
StaticBatchBuilder.schema()
Modifier and TypeMethodDescriptionprotected void
OutputBatchBuilder.defineSourceBatchMapping
(TupleMetadata schema, int source) Define the mapping for one of the sources.MissingColumnHandlerBuilder.inputSchema
(TupleMetadata inputSchema) ReaderLifecycle.missingColumnsBuilder
(TupleMetadata readerSchema) void
SchemaNegotiatorImpl.tableSchema
(TupleMetadata schema) void
SchemaNegotiatorImpl.tableSchema
(TupleMetadata schema, boolean isComplete) ModifierConstructorDescriptionBatchSource
(TupleMetadata schema, VectorContainer container) MapSource
(TupleMetadata mapSchema, AbstractMapVector mapVector) NullBatchBuilder
(ResultVectorCache vectorCache, TupleMetadata schema) OutputBatchBuilder
(TupleMetadata outputSchema, List<OutputBatchBuilder.BatchSource> sources, BufferAllocator allocator) RepeatedBatchBuilder
(ResultVectorCache vectorCache, TupleMetadata schema, Object[] values) StaticBatchBuilder
(ResultVectorCache vectorCache, TupleMetadata schema) -
Uses of TupleMetadata in org.apache.drill.exec.physical.impl.scan.v3.schema
Modifier and TypeFieldDescriptionfinal TupleMetadata
ScanProjectionParser.ProjectionParseResult.dynamicSchema
Modifier and TypeMethodDescriptionAbstractSchemaTracker.applyImplicitCols()
ScanSchemaTracker.applyImplicitCols()
Indicate that implicit column parsing is complete.ProjectedColumn.explicitMembers()
AbstractSchemaTracker.missingColumns
(TupleMetadata readerOutputSchema) ScanSchemaTracker.missingColumns
(TupleMetadata readerOutputSchema) Identifies the missing columns given a reader output schema.AbstractSchemaTracker.outputSchema()
ScanSchemaTracker.outputSchema()
Returns the scan output schema which is a somewhat complicated computation that depends on the projection type.AbstractSchemaTracker.readerInputSchema()
ScanSchemaTracker.readerInputSchema()
The schema which the reader should produce.MutableTupleSchema.toSchema()
ProjectedColumn.tupleSchema()
Modifier and TypeMethodDescriptionvoid
ProjectionSchemaTracker.applyEarlyReaderSchema
(TupleMetadata readerSchema) void
ScanSchemaTracker.applyEarlyReaderSchema
(TupleMetadata readerSchema) If a reader can define a schema before reading data, apply that schema to the scan schema.void
SchemaBasedTracker.applyEarlyReaderSchema
(TupleMetadata readerSchema) void
ProjectionSchemaTracker.applyProvidedSchema
(TupleMetadata providedSchema) void
ProjectionSchemaTracker.applyReaderSchema
(TupleMetadata readerOutputSchema, CustomErrorContext errorContext) void
ScanSchemaTracker.applyReaderSchema
(TupleMetadata readerOutputSchema, CustomErrorContext errorContext) Once a reader has read a batch, the reader will have provided a type for each projected column which the reader knows about.void
SchemaBasedTracker.applyReaderSchema
(TupleMetadata readerOutputSchema, CustomErrorContext errorContext) void
ScanSchemaResolver.applySchema
(TupleMetadata sourceSchema) void
MutableTupleSchema.copyFrom
(TupleMetadata from) ScanSchemaConfigBuilder.definedSchema
(TupleMetadata definedSchema) static boolean
SchemaUtils.isProjectAll
(TupleMetadata tuple) static boolean
SchemaUtils.isProjectNone
(TupleMetadata tuple) static boolean
SchemaUtils.isStrict
(TupleMetadata schema) static void
SchemaUtils.markStrict
(TupleMetadata schema) AbstractSchemaTracker.missingColumns
(TupleMetadata readerOutputSchema) ScanSchemaTracker.missingColumns
(TupleMetadata readerOutputSchema) Identifies the missing columns given a reader output schema.protected ProjectedColumn
ScanProjectionParser.project
(TupleMetadata tuple, String colName) ScanSchemaConfigBuilder.providedSchema
(TupleMetadata providedSchema) void
AbstractSchemaTracker.resolveMissingCols
(TupleMetadata missingCols) void
ScanSchemaTracker.resolveMissingCols
(TupleMetadata missingCols) The missing column handler obtains the list of missing columns from#missingColumns()
.protected static void
AbstractSchemaTracker.validateProjection
(TupleMetadata projection, TupleMetadata schema) Validate a projection list against a defined-schema tuple.void
SchemaBasedTracker.validateProjection
(TupleMetadata projection) Validate a projection list (provided as an argument) against a defined schema already held by this tracker.ModifierConstructorDescriptionDynamicTupleFilter
(TupleMetadata mapSchema, boolean isOpen, CustomErrorContext errorContext, String source) DynamicTupleFilter
(TupleMetadata projectionSet, CustomErrorContext errorContext) ProjectionParseResult
(int wildcardPosn, TupleMetadata dynamicSchema) ProjectionSchemaTracker
(TupleMetadata definedSchema, ScanProjectionParser.ProjectionParseResult parseResult, CustomErrorContext errorContext) SchemaBasedTracker
(TupleMetadata definedSchema, CustomErrorContext errorContext) -
Uses of TupleMetadata in org.apache.drill.exec.physical.resultSet
Modifier and TypeMethodDescriptionResultSetLoader.activeSchema()
Returns the active output schema; the schema used by the writers, minus any unprojected columns.ResultSetLoader.outputSchema()
The schema of the harvested batch.PullResultSetReader.schema()
Return the schema for this result set. -
Uses of TupleMetadata in org.apache.drill.exec.physical.resultSet.impl
Modifier and TypeFieldDescriptionprotected TupleMetadata
TupleState.outputSchema
Metadata description of the output container (for the row) or map (for map or repeated map.)protected TupleMetadata
ResultSetOptionBuilder.readerSchema
protected final TupleMetadata
ProjectionFilter.BaseSchemaProjectionFilter.schema
protected final TupleMetadata
ResultSetLoaderImpl.ResultSetOptions.schema
protected final TupleMetadata
TupleState.schema
Internal writer schema that matches the column list.Modifier and TypeMethodDescriptionResultSetLoaderImpl.activeSchema()
ResultSetLoaderImpl.outputSchema()
TupleState.outputSchema()
PullResultSetReaderImpl.schema()
TupleState.schema()
Modifier and TypeMethodDescriptionprotected void
TupleState.bindOutputSchema
(TupleMetadata outputSchema) void
BuildFromSchema.buildTuple
(TupleWriter writer, TupleMetadata schema) When creating a schema up front, provide the schema of the desired tuple, then build vectors and writers to match.static ProjectionFilter
ProjectionFilter.definedSchemaFilter
(TupleMetadata definedSchema, CustomErrorContext errorContext) static ProjectionFilter
ProjectionFilter.providedSchemaFilter
(RequestedTuple tupleProj, TupleMetadata providedSchema, CustomErrorContext errorContext) ResultSetOptionBuilder.readerSchema
(TupleMetadata readerSchema) Clients can use the row set builder in several ways: Provide the schema up front, when known, by using this method to provide the schema. Discover the schema on the fly, adding columns during the write operation.ModifierConstructorDescriptionprotected
RowSetLoaderImpl
(ResultSetLoaderImpl rsLoader, TupleMetadata schema) SchemaProjectionFilter
(TupleMetadata definedSchema, CustomErrorContext errorContext) TypeProjectionFilter
(TupleMetadata providedSchema, CustomErrorContext errorContext) -
Uses of TupleMetadata in org.apache.drill.exec.physical.resultSet.model
Modifier and TypeFieldDescriptionprotected final TupleMetadata
BaseTupleModel.schema
Descriptive schema associated with the columns above.Modifier and TypeMethodDescriptionBaseTupleModel.schema()
TupleModel.schema()
MetadataProvider.ArraySchemaCreator.tuple()
MetadataProvider.ArraySchemaRetrieval.tuple()
MetadataProvider.MetadataCreator.tuple()
MetadataProvider.MetadataRetrieval.tuple()
MetadataProvider.tuple()
MetadataProvider.VariantSchemaCreator.tuple()
MetadataProvider.VariantSchemaRetrieval.tuple()
ModifierConstructorDescriptionBaseTupleModel
(TupleMetadata schema, List<TupleModel.ColumnModel> columns) MetadataRetrieval
(TupleMetadata schema) -
Uses of TupleMetadata in org.apache.drill.exec.physical.resultSet.model.hyper
Modifier and TypeMethodDescriptionstatic RowSetReaderImpl
HyperReaderBuilder.build
(VectorContainer container, TupleMetadata schema, SelectionVector4 sv4) protected List<AbstractObjectReader>
HyperReaderBuilder.buildContainerChildren
(VectorContainer container, TupleMetadata schema) protected List<AbstractObjectReader>
HyperReaderBuilder.buildMapMembers
(VectorAccessor va, TupleMetadata mapSchema) -
Uses of TupleMetadata in org.apache.drill.exec.physical.resultSet.model.single
Modifier and TypeMethodDescriptionvoid
VectorAllocator.allocate
(int rowCount, TupleMetadata schema) BuildVectorsFromMetadata.build
(TupleMetadata schema) static RowSetReaderImpl
SimpleReaderBuilder.build
(VectorContainer container, TupleMetadata schema, ReaderIndex rowIndex) -
Uses of TupleMetadata in org.apache.drill.exec.physical.rowSet
Modifier and TypeMethodDescriptionAbstractRowSet.schema()
RowSet.schema()
RowSetReaderImpl.tupleSchema()
Modifier and TypeMethodDescriptionstatic RowSet
RowSetBuilder.emptyBatch
(BufferAllocator allocator, TupleMetadata schema) static DirectRowSet
DirectRowSet.fromSchema
(BufferAllocator allocator, TupleMetadata schema) ModifierConstructorDescriptionAbstractRowSet
(VectorContainer container, TupleMetadata schema) protected
AbstractSingleRowSet
(VectorContainer container, TupleMetadata schema) HyperRowSetImpl
(TupleMetadata schema, VectorContainer container, SelectionVector4 sv4) RowSetBuilder
(BufferAllocator allocator, TupleMetadata schema) RowSetBuilder
(BufferAllocator allocator, TupleMetadata schema, int capacity) RowSetReaderImpl
(TupleMetadata schema, ReaderIndex index, List<AbstractObjectReader> readers) RowSetReaderImpl
(TupleMetadata schema, ReaderIndex index, AbstractObjectReader[] readers) protected
RowSetWriterImpl
(RowSet.ExtendableRowSet rowSet, TupleMetadata schema, org.apache.drill.exec.physical.rowSet.RowSetWriterImpl.WriterIndexImpl index, List<AbstractObjectWriter> writers) -
Uses of TupleMetadata in org.apache.drill.exec.record
Modifier and TypeMethodDescriptionstatic TupleMetadata
SchemaUtil.fromBatchSchema
(BatchSchema batchSchema) Modifier and TypeMethodDescriptionColumnConverterFactory.getConverter
(TupleMetadata providedSchema, ColumnMetadata readerSchema, ObjectWriter writer) Based on column type, creates corresponding column converter which holds conversion logic and appropriate writer to set converted data into.protected ColumnConverter
ColumnConverterFactory.getMapConverter
(TupleMetadata providedSchema, TupleMetadata readerSchema, TupleWriter tupleWriter) ColumnConverterFactory.getRootConverter
(TupleMetadata providedSchema, TupleMetadata readerSchema, TupleWriter tupleWriter) static List<SchemaPath>
SchemaUtil.getSchemaPaths
(TupleMetadata schema) Returns list ofSchemaPath
for fields taken from specified schema.ModifierConstructorDescriptionColumnConverterFactory
(TupleMetadata providedSchema) MapColumnConverter
(ColumnConverterFactory factory, TupleMetadata providedSchema, TupleWriter tupleWriter, Map<String, ColumnConverter> converters) -
Uses of TupleMetadata in org.apache.drill.exec.record.metadata
Modifier and TypeClassDescriptionclass
Defines the schema of a tuple: either the top-level row or a nested "map" (really structure).Modifier and TypeMethodDescriptionSchemaBuilder.build()
SchemaBuilder.buildSchema()
TupleMetadata.copy()
static TupleMetadata
MetadataUtils.diffTuple
(TupleMetadata base, TupleMetadata subtend) static TupleMetadata
Converts given JSON string intoTupleMetadata
instance.AbstractMapColumnMetadata.parentTuple()
AbstractColumnMetadata.tupleSchema()
AbstractMapColumnMetadata.tupleSchema()
ColumnMetadata.tupleSchema()
Schema forTUPLE
columns.Modifier and TypeMethodDescriptionSchemaBuilder.addAll
(TupleMetadata from) void
AbstractColumnMetadata.bind
(TupleMetadata parentTuple) void
AbstractMapColumnMetadata.bind
(TupleMetadata parentTuple) void
ColumnMetadata.bind
(TupleMetadata parentTuple) static ColumnMetadata
MetadataUtils.cloneMapWithSchema
(ColumnMetadata source, TupleMetadata members) static TupleMetadata
MetadataUtils.diffTuple
(TupleMetadata base, TupleMetadata subtend) static boolean
MetadataUtils.hasDynamicColumns
(TupleMetadata schema) boolean
TupleMetadata.isEquivalent
(TupleMetadata other) boolean
TupleSchema.isEquivalent
(TupleMetadata other) static MapColumnMetadata
MetadataUtils.newMap
(String name, TypeProtos.DataMode dataMode, TupleMetadata schema) static MapColumnMetadata
MetadataUtils.newMap
(String name, TupleMetadata schema) static ColumnMetadata
MetadataUtils.newMapArray
(String name, TupleMetadata schema) -
Uses of TupleMetadata in org.apache.drill.exec.record.metadata.schema
ModifierConstructorDescriptionSchemaContainer
(String table, TupleMetadata schema, Integer version) -
Uses of TupleMetadata in org.apache.drill.exec.record.metadata.schema.parser
Modifier and TypeMethodDescriptionstatic TupleMetadata
SchemaExprParser.parseSchema
(String schema) Parses string definition of the schema and converts it intoTupleMetadata
instance.SchemaVisitor.visitColumns
(SchemaParser.ColumnsContext ctx) SchemaVisitor.visitSchema
(SchemaParser.SchemaContext ctx) -
Uses of TupleMetadata in org.apache.drill.exec.store.avro
Modifier and TypeMethodDescriptionstatic TupleMetadata
AvroSchemaUtil.convert
(org.apache.avro.Schema schema) Converts Avro schema into Drill metadata description of the schema.Modifier and TypeMethodDescriptionvoid
AvroColumnConverterFactory.buildMapMembers
(org.apache.avro.generic.GenericRecord genericRecord, TupleMetadata providedSchema, TupleWriter tupleWriter, List<ColumnConverter> converters) protected ColumnConverter
AvroColumnConverterFactory.getMapConverter
(TupleMetadata providedSchema, TupleMetadata readerSchema, TupleWriter tupleWriter) Based on provided schema, given converted Avro schema and current row writer generates list of column converters based on column type forAvroColumnConverterFactory.MapColumnConverter
and returns it.AvroColumnConverterFactory.initConverters
(TupleMetadata providedSchema, TupleMetadata readerSchema, RowSetLoader rowWriter) Based on given converted Avro schema and current row writer generates list of column converters based on column type.ModifierConstructorDescriptionAvroColumnConverterFactory
(TupleMetadata providedSchema) MapColumnConverter
(AvroColumnConverterFactory factory, TupleMetadata providedSchema, TupleWriter tupleWriter, List<ColumnConverter> converters) -
Uses of TupleMetadata in org.apache.drill.exec.store.cassandra
Modifier and TypeMethodDescriptionCassandraColumnConverterFactoryProvider.getFactory
(TupleMetadata schema) protected ColumnConverter
CassandraColumnConverterFactory.getMapConverter
(TupleMetadata providedSchema, TupleMetadata readerSchema, TupleWriter tupleWriter) -
Uses of TupleMetadata in org.apache.drill.exec.store.delta
Modifier and TypeMethodDescriptionDeltaGroupScan.DeltaGroupScanBuilder.schema
(TupleMetadata schema) ModifierConstructorDescriptionDeltaGroupScan
(String userName, List<ReadEntryWithPath> entries, StoragePluginConfig storageConfig, FormatPluginConfig formatConfig, List<SchemaPath> columns, TupleMetadata schema, String path, ParquetReaderConfig readerConfig, LogicalExpression condition, Integer limit, Map<org.apache.hadoop.fs.Path, Map<String, String>> partitionHolder, StoragePluginRegistry pluginRegistry) DeltaRowGroupScan
(String userName, DeltaFormatPlugin formatPlugin, List<RowGroupReadEntry> rowGroupReadEntries, List<SchemaPath> columns, Map<org.apache.hadoop.fs.Path, Map<String, String>> partitions, ParquetReaderConfig readerConfig, LogicalExpression filter, TupleMetadata schema) DeltaRowGroupScan
(StoragePluginRegistry registry, String userName, StoragePluginConfig storageConfig, FormatPluginConfig formatPluginConfig, List<RowGroupReadEntry> rowGroupReadEntries, List<SchemaPath> columns, Map<org.apache.hadoop.fs.Path, Map<String, String>> partitions, ParquetReaderConfig readerConfig, LogicalExpression filter, TupleMetadata schema) -
Uses of TupleMetadata in org.apache.drill.exec.store.dfs.easy
ModifierConstructorDescriptionEasyGroupScan
(String userName, List<org.apache.hadoop.fs.Path> files, StoragePluginConfig storageConfig, FormatPluginConfig formatConfig, StoragePluginRegistry engineRegistry, List<SchemaPath> columns, org.apache.hadoop.fs.Path selectionRoot, TupleMetadata schema, int limit) EasySubScan
(String userName, List<CompleteFileWork.FileWorkImpl> files, StoragePluginConfig storageConfig, FormatPluginConfig formatConfig, StoragePluginRegistry engineRegistry, List<SchemaPath> columns, org.apache.hadoop.fs.Path selectionRoot, int partitionDepth, TupleMetadata schema, int limit) EasySubScan
(String userName, List<CompleteFileWork.FileWorkImpl> files, EasyFormatPlugin<?> plugin, List<SchemaPath> columns, org.apache.hadoop.fs.Path selectionRoot, int partitionDepth, TupleMetadata schema, int limit) -
Uses of TupleMetadata in org.apache.drill.exec.store.easy.json.loader
Modifier and TypeMethodDescriptionBaseFieldFactory.multiDimObjectArrayFor
(ObjectWriter writer, int dims, TupleMetadata providedSchema) Create a repeated list listener for a Map.protected ElementParser
BaseFieldFactory.objectArrayParserFor
(FieldDefn fieldDefn, ColumnMetadata colSchema, TupleMetadata providedSchema) Create a map array column and its associated parsers and listeners for the given column schema and optional provided schema.protected ElementParser
BaseFieldFactory.objectArrayParserFor
(ArrayWriter arrayWriter, TupleMetadata providedSchema) protected ElementParser
BaseFieldFactory.objectParserFor
(FieldDefn fieldDefn, ColumnMetadata colSchema, TupleMetadata providedSchema) Create a map column and its associated object value listener for the given key and optional provided schema.protected ElementParser
BaseFieldFactory.objectParserFor
(TupleWriter writer, TupleMetadata providedSchema) JsonLoaderImpl.JsonLoaderBuilder.providedSchema
(TupleMetadata providedSchema) ModifierConstructorDescriptionTupleParser
(JsonLoaderImpl loader, TupleWriter tupleWriter, TupleMetadata providedSchema) TupleParser
(JsonStructureParser structParser, JsonLoaderImpl loader, TupleWriter tupleWriter, TupleMetadata providedSchema) -
Uses of TupleMetadata in org.apache.drill.exec.store.easy.text.reader
ModifierConstructorDescriptionTextParsingSettings
(TextFormatConfig config, TupleMetadata providedSchema) Configure the properties for this one scan based on: -
Uses of TupleMetadata in org.apache.drill.exec.store.elasticsearch
Modifier and TypeMethodDescriptionElasticsearchColumnConverterFactoryProvider.getFactory
(TupleMetadata schema) protected ColumnConverter
ElasticsearchColumnConverterFactory.getMapConverter
(TupleMetadata providedSchema, TupleMetadata readerSchema, TupleWriter tupleWriter) -
Uses of TupleMetadata in org.apache.drill.exec.store.enumerable
Modifier and TypeMethodDescriptionColumnConverterFactoryProvider.getFactory
(TupleMetadata schema) DefaultColumnConverterFactoryProvider.getFactory
(TupleMetadata schema) ModifierConstructorDescriptionEnumerableGroupScan
(String code, List<SchemaPath> columns, Map<String, Integer> fieldsMap, double rows, TupleMetadata schema, String schemaPath, ColumnConverterFactoryProvider converterFactoryProvider) EnumerableSubScan
(String code, List<SchemaPath> columns, Map<String, Integer> fieldsMap, TupleMetadata schema, String schemaPath, ColumnConverterFactoryProvider converterFactoryProvider) -
Uses of TupleMetadata in org.apache.drill.exec.store.googlesheets
Modifier and TypeMethodDescriptionGoogleSheetsGroupScan.getSchema()
GoogleSheetsSubScan.getSchema()
ModifierConstructorDescriptionGoogleSheetsSubScan
(String username, GoogleSheetsStoragePluginConfig config, GoogleSheetsScanSpec scanSpec, List<SchemaPath> columns, Map<String, ExprNode.ColRelOpConstNode> filters, int maxRecords, TupleMetadata schema) -
Uses of TupleMetadata in org.apache.drill.exec.store.googlesheets.utils
Modifier and TypeMethodDescriptionstatic TupleMetadata
GoogleSheetsUtils.buildSchema
(Map<String, GoogleSheetsColumn> columnMap) Builds a Drill Schema from a Map of GoogleSheetsColumns. -
Uses of TupleMetadata in org.apache.drill.exec.store.hdf5.writers
ModifierConstructorDescriptionWriterSpec
(TupleWriter tupleWriter, TupleMetadata providedSchema, CustomErrorContext errorContext) -
Uses of TupleMetadata in org.apache.drill.exec.store.hive
ModifierConstructorDescriptionHiveDrillNativeParquetRowGroupScan
(String userName, HiveStoragePlugin hiveStoragePlugin, List<RowGroupReadEntry> rowGroupReadEntries, List<SchemaPath> columns, HivePartitionHolder hivePartitionHolder, Map<String, String> confProperties, ParquetReaderConfig readerConfig, LogicalExpression filter, TupleMetadata schema) HiveDrillNativeParquetRowGroupScan
(StoragePluginRegistry registry, String userName, HiveStoragePluginConfig hiveStoragePluginConfig, List<RowGroupReadEntry> rowGroupReadEntries, List<SchemaPath> columns, HivePartitionHolder hivePartitionHolder, Map<String, String> confProperties, ParquetReaderConfig readerConfig, LogicalExpression filter, TupleMetadata schema) HiveDrillNativeParquetScan
(StoragePluginRegistry engineRegistry, String userName, HiveStoragePluginConfig hiveStoragePluginConfig, List<SchemaPath> columns, List<ReadEntryWithPath> entries, HivePartitionHolder hivePartitionHolder, Map<String, String> confProperties, ParquetReaderConfig readerConfig, LogicalExpression filter, TupleMetadata schema) -
Uses of TupleMetadata in org.apache.drill.exec.store.http
Modifier and TypeMethodDescriptionHttpGroupScan.getSchema()
HttpJsonOptions.schema()
HttpSubScan.schema()
HttpXmlOptions.schema()
Modifier and TypeMethodDescriptionHttpJsonOptions.HttpJsonOptionsBuilder.schema
(TupleMetadata schema) HttpXmlOptions.HttpXmlOptionsBuilder.schema
(TupleMetadata schema) ModifierConstructorDescriptionHttpSubScan
(HttpScanSpec tableSpec, List<SchemaPath> columns, Map<String, String> filters, int maxRecords, TupleMetadata schema) HttpXmlOptions
(Integer dataLevel, TupleMetadata schema) -
Uses of TupleMetadata in org.apache.drill.exec.store.httpd
-
Uses of TupleMetadata in org.apache.drill.exec.store.iceberg
Modifier and TypeMethodDescriptionIcebergGroupScan.IcebergGroupScanBuilder.schema
(TupleMetadata schema) IcebergSubScan.IcebergSubScanBuilder.schema
(TupleMetadata schema) ModifierConstructorDescriptionIcebergGroupScan
(String userName, StoragePluginConfig storageConfig, FormatPluginConfig formatConfig, List<SchemaPath> columns, TupleMetadata schema, String path, LogicalExpression condition, Integer maxRecords, StoragePluginRegistry pluginRegistry) IcebergSubScan
(String userName, StoragePluginConfig storageConfig, FormatPluginConfig formatConfig, List<SchemaPath> columns, String path, List<IcebergWork> workList, TupleMetadata schema, LogicalExpression condition, Integer maxRecords, StoragePluginRegistry pluginRegistry) -
Uses of TupleMetadata in org.apache.drill.exec.store.iceberg.read
Modifier and TypeMethodDescriptionvoid
MapColumnConverter.buildMapMembers
(org.apache.iceberg.data.Record record, TupleMetadata providedSchema, TupleWriter tupleWriter, Map<String, ColumnConverter> converters) protected ColumnConverter
IcebergColumnConverterFactory.getMapConverter
(TupleMetadata providedSchema, TupleMetadata readerSchema, TupleWriter tupleWriter) ModifierConstructorDescriptionIcebergColumnConverterFactory
(TupleMetadata providedSchema) MapColumnConverter
(ColumnConverterFactory factory, TupleMetadata providedSchema, TupleWriter tupleWriter, Map<String, ColumnConverter> converters) -
Uses of TupleMetadata in org.apache.drill.exec.store.log
Modifier and TypeFieldDescriptionprotected final TupleMetadata
LogBatchReader.LogReaderConfig.providedSchema
protected final TupleMetadata
LogBatchReader.LogReaderConfig.readerSchema
protected final TupleMetadata
LogBatchReader.LogReaderConfig.tableSchema
ModifierConstructorDescriptionLogReaderConfig
(LogFormatPlugin plugin, Pattern pattern, TupleMetadata providedSchema, TupleMetadata tableSchema, TupleMetadata readerSchema, boolean asArray, int groupCount, int maxErrors) -
Uses of TupleMetadata in org.apache.drill.exec.store.parquet
Modifier and TypeFieldDescriptionprotected final TupleMetadata
AbstractParquetRowGroupScan.schema
protected TupleMetadata
BaseParquetMetadataProvider.schema
Modifier and TypeMethodDescriptionstatic Map<SchemaPath,
ColumnStatistics<?>> ParquetTableMetadataUtils.getColumnStatistics
(TupleMetadata schema, DrillStatsTable statistics) Returns map with schema path andColumnStatistics
obtained from specifiedDrillStatsTable
for all columns from specifiedBaseTableMetadata
.static RowsMatch
FilterEvaluatorUtils.matches
(LogicalExpression expr, Map<SchemaPath, ColumnStatistics<?>> columnsStatistics, TupleMetadata schema, long rowCount, UdfUtilities udfUtilities, FunctionLookupContext functionImplementationRegistry, Set<SchemaPath> schemaPathsInExpr) static <T extends Comparable<T>>
RowsMatchFilterEvaluatorUtils.matches
(FilterPredicate<T> parquetPredicate, Map<SchemaPath, ColumnStatistics<?>> columnsStatistics, long rowCount, TupleMetadata fileMetadata, Set<SchemaPath> schemaPathsInExpr, UdfUtilities udfUtilities) BaseParquetMetadataProvider.Builder.withSchema
(TupleMetadata schema) ModifierConstructorDescriptionprotected
AbstractParquetRowGroupScan
(String userName, List<RowGroupReadEntry> rowGroupReadEntries, List<SchemaPath> columns, ParquetReaderConfig readerConfig, LogicalExpression filter, org.apache.hadoop.fs.Path selectionRoot, TupleMetadata schema) ParquetGroupScan
(StoragePluginRegistry engineRegistry, String userName, List<ReadEntryWithPath> entries, StoragePluginConfig storageConfig, FormatPluginConfig formatConfig, List<SchemaPath> columns, org.apache.hadoop.fs.Path selectionRoot, org.apache.hadoop.fs.Path cacheFileRoot, ParquetReaderConfig readerConfig, LogicalExpression filter, TupleMetadata schema) ParquetRowGroupScan
(String userName, ParquetFormatPlugin formatPlugin, List<RowGroupReadEntry> rowGroupReadEntries, List<SchemaPath> columns, ParquetReaderConfig readerConfig, org.apache.hadoop.fs.Path selectionRoot, LogicalExpression filter, TupleMetadata schema) ParquetRowGroupScan
(StoragePluginRegistry registry, String userName, StoragePluginConfig storageConfig, FormatPluginConfig formatConfig, LinkedList<RowGroupReadEntry> rowGroupReadEntries, List<SchemaPath> columns, ParquetReaderConfig readerConfig, org.apache.hadoop.fs.Path selectionRoot, LogicalExpression filter, TupleMetadata schema) -
Uses of TupleMetadata in org.apache.drill.exec.store.pcap.schema
-
Uses of TupleMetadata in org.apache.drill.exec.store.splunk
-
Uses of TupleMetadata in org.apache.drill.exec.store.syslog
-
Uses of TupleMetadata in org.apache.drill.exec.vector.accessor
-
Uses of TupleMetadata in org.apache.drill.exec.vector.accessor.reader
-
Uses of TupleMetadata in org.apache.drill.exec.vector.accessor.writer
ModifierConstructorDescriptionprotected
AbstractTupleWriter
(TupleMetadata schema) protected
AbstractTupleWriter
(TupleMetadata schema, List<AbstractObjectWriter> writers) -
Uses of TupleMetadata in org.apache.drill.exec.vector.complex.fn
Modifier and TypeMethodDescriptionstatic void
JsonReaderUtils.writeColumnsUsingSchema
(BaseWriter.ComplexWriter writer, Collection<SchemaPath> columns, TupleMetadata schema, boolean allTextMode) Creates writers which correspond to the specified schema for specified root writer. -
Uses of TupleMetadata in org.apache.drill.metastore.metadata
Modifier and TypeFieldDescriptionprotected TupleMetadata
BaseMetadata.BaseMetadataBuilder.schema
protected final TupleMetadata
BaseMetadata.schema
Modifier and TypeMethodDescriptionBaseMetadata.getSchema()
Metadata.getSchema()
Returns schema stored in current metadata represented asTupleMetadata
.NonInterestingColumnsMetadata.getSchema()
Modifier and TypeMethodDescriptionBaseMetadata.BaseMetadataBuilder.schema
(TupleMetadata schema) TableMetadataProviderBuilder.withSchema
(TupleMetadata schema) -
Uses of TupleMetadata in org.apache.drill.metastore.util
Modifier and TypeMethodDescriptionstatic void
SchemaPathUtils.addColumnMetadata
(TupleMetadata schema, SchemaPath schemaPath, TypeProtos.MajorType type, Map<SchemaPath, TypeProtos.MajorType> types) Adds column with specified schema path and type into specifiedTupleMetadata schema
.static ColumnMetadata
SchemaPathUtils.getColumnMetadata
(SchemaPath schemaPath, TupleMetadata schema) ReturnsColumnMetadata
instance obtained from specifiedTupleMetadata schema
which corresponds to the specified column schema path.static boolean
SchemaPathUtils.isFieldNestedInDictOrRepeatedMap
(SchemaPath schemaPath, TupleMetadata schema) Checks if field identified by the schema path is child in eitherDICT
orREPEATED MAP
.