org.apache.drill.exec.metastore.store

Class MetastoreFileTableMetadataProvider

java.lang.Object

org.apache.drill.exec.metastore.store.MetastoreFileTableMetadataProvider

All Implemented Interfaces:

TableMetadataProvider

Direct Known Subclasses:

MetastoreParquetTableMetadataProvider

public class MetastoreFileTableMetadataProvider
extends Object
implements TableMetadataProvider

Implementation of TableMetadataProvider which uses Drill Metastore for providing table metadata for file-based tables.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	MetastoreFileTableMetadataProvider.Builder<T extends MetastoreFileTableMetadataProvider.Builder<T>>

Field Summary

Fields

Modifier and Type	Field and Description
protected BasicTablesRequests	basicTablesRequests
protected TableMetadataProviderBuilder	fallbackBuilder
protected boolean	fallbackToFileMetadata
protected Map<org.apache.hadoop.fs.Path,FileMetadata>	files
protected MetastoreTableInfo	metastoreTableInfo
protected List<PartitionMetadata>	partitions
protected List<String>	paths
protected TupleMetadata	schema
protected Map<org.apache.hadoop.fs.Path,SegmentMetadata>	segmentsMetadata
protected DrillStatsTable	statsProvider
protected TableInfo	tableInfo
protected BaseTableMetadata	tableMetadata
protected boolean	useSchema
protected boolean	useStatistics

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	MetastoreFileTableMetadataProvider(MetastoreFileTableMetadataProvider.Builder<?> builder)

Method Summary

Modifier and Type	Method and Description
boolean	checkMetadataVersion() Whether metadata actuality should be checked.
FileMetadata	getFileMetadata(org.apache.hadoop.fs.Path location) Returns FileMetadata instance which corresponds to metadata of file for specified location.
List<FileMetadata>	getFilesForPartition(PartitionMetadata partition) Returns list of FileMetadata instances which belongs to specified partitions.
Map<org.apache.hadoop.fs.Path,FileMetadata>	getFilesMetadataMap() Returns map of FileMetadata instances which provides metadata for specific file and its columns.
NonInterestingColumnsMetadata	getNonInterestingColumnsMetadata() Returns NonInterestingColumnsMetadata instance which provides metadata for non-interesting columns.
List<SchemaPath>	getPartitionColumns() Returns list of partition columns for table from this TableMetadataProvider.
List<PartitionMetadata>	getPartitionMetadata(SchemaPath columnName) Returns list of PartitionMetadata instances which corresponds to partitions for specified column and provides metadata for specific partitions and its columns.
List<PartitionMetadata>	getPartitionsMetadata() Returns list of PartitionMetadata instances which provides metadata for specific partitions and its columns.
Map<org.apache.hadoop.fs.Path,SegmentMetadata>	getSegmentsMetadataMap() Returns map of SegmentMetadata instances which provides metadata for segment and its columns.
TableMetadata	getTableMetadata() Returns TableMetadata instance which provides metadata for table and columns metadata.
protected void	throwIfChanged()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

basicTablesRequests

protected final BasicTablesRequests basicTablesRequests

tableInfo

protected final TableInfo tableInfo

metastoreTableInfo

protected final MetastoreTableInfo metastoreTableInfo

schema

protected final TupleMetadata schema

paths

protected final List<String> paths

statsProvider

protected final DrillStatsTable statsProvider

fallbackBuilder

protected final TableMetadataProviderBuilder fallbackBuilder

useSchema

protected final boolean useSchema

useStatistics

protected final boolean useStatistics

fallbackToFileMetadata

protected final boolean fallbackToFileMetadata

tableMetadata

protected BaseTableMetadata tableMetadata

segmentsMetadata

protected Map<org.apache.hadoop.fs.Path,SegmentMetadata> segmentsMetadata

partitions

protected List<PartitionMetadata> partitions

files

protected Map<org.apache.hadoop.fs.Path,FileMetadata> files

Constructor Detail

MetastoreFileTableMetadataProvider

protected MetastoreFileTableMetadataProvider(MetastoreFileTableMetadataProvider.Builder<?> builder)

Method Detail

throwIfChanged

protected void throwIfChanged()

getTableMetadata

public TableMetadata getTableMetadata()

Description copied from interface: TableMetadataProvider

Returns TableMetadata instance which provides metadata for table and columns metadata.

Specified by:

getTableMetadata in interface TableMetadataProvider

Returns:

TableMetadata instance

getPartitionColumns

public List<SchemaPath> getPartitionColumns()

Description copied from interface: TableMetadataProvider

Returns list of partition columns for table from this TableMetadataProvider.

Specified by:

getPartitionColumns in interface TableMetadataProvider

Returns:

list of partition columns

getPartitionsMetadata

public List<PartitionMetadata> getPartitionsMetadata()

Description copied from interface: TableMetadataProvider

Returns list of PartitionMetadata instances which provides metadata for specific partitions and its columns.

Specified by:

getPartitionsMetadata in interface TableMetadataProvider

Returns:

list of PartitionMetadata instances

getPartitionMetadata

public List<PartitionMetadata> getPartitionMetadata(SchemaPath columnName)

Description copied from interface: TableMetadataProvider

Returns list of PartitionMetadata instances which corresponds to partitions for specified column and provides metadata for specific partitions and its columns.

Specified by:

getPartitionMetadata in interface TableMetadataProvider

Returns:

list of PartitionMetadata instances which corresponds to partitions for specified column

getFilesMetadataMap

public Map<org.apache.hadoop.fs.Path,FileMetadata> getFilesMetadataMap()

Description copied from interface: TableMetadataProvider

Returns map of FileMetadata instances which provides metadata for specific file and its columns.

Specified by:

getFilesMetadataMap in interface TableMetadataProvider

Returns:

map of FileMetadata instances

getSegmentsMetadataMap

public Map<org.apache.hadoop.fs.Path,SegmentMetadata> getSegmentsMetadataMap()

Description copied from interface: TableMetadataProvider

Returns map of SegmentMetadata instances which provides metadata for segment and its columns.

Specified by:

getSegmentsMetadataMap in interface TableMetadataProvider

Returns:

map of SegmentMetadata instances

getFileMetadata

public FileMetadata getFileMetadata(org.apache.hadoop.fs.Path location)

Description copied from interface: TableMetadataProvider

Returns FileMetadata instance which corresponds to metadata of file for specified location.

Specified by:

getFileMetadata in interface TableMetadataProvider

Parameters:

location - location of the file

Returns:

FileMetadata instance which corresponds to metadata of file for specified location

getFilesForPartition

public List<FileMetadata> getFilesForPartition(PartitionMetadata partition)

Description copied from interface: TableMetadataProvider

Returns list of FileMetadata instances which belongs to specified partitions.

Specified by:

getFilesForPartition in interface TableMetadataProvider

Parameters:

partition - partition which

Returns:

list of FileMetadata instances which belongs to specified partitions

getNonInterestingColumnsMetadata

public NonInterestingColumnsMetadata getNonInterestingColumnsMetadata()

Description copied from interface: TableMetadataProvider

Returns NonInterestingColumnsMetadata instance which provides metadata for non-interesting columns.

Specified by:

getNonInterestingColumnsMetadata in interface TableMetadataProvider

Returns:

NonInterestingColumnsMetadata instance

checkMetadataVersion

public boolean checkMetadataVersion()

Description copied from interface: TableMetadataProvider

Whether metadata actuality should be checked.

Specified by:

checkMetadataVersion in interface TableMetadataProvider

Returns:

true if metadata actuality should be checked