| Package | Description |
|---|---|
| org.apache.drill.exec.physical.base | |
| org.apache.drill.exec.store.parquet | |
| org.apache.drill.metastore.metadata | |
| org.apache.drill.metastore.util |
| Modifier and Type | Method and Description |
|---|---|
protected <T extends BaseMetadata> |
AbstractGroupScanWithMetadata.limitMetadata(Collection<T> metadataList,
int maxRecords)
Prunes specified metadata list and leaves minimum metadata instances count with general rows number
which is not less than specified
maxRecords. |
protected static <T extends BaseMetadata & LocationProvider> |
AbstractGroupScanWithMetadata.pruneForPartitions(Map<org.apache.hadoop.fs.Path,T> metadataToPrune,
List<PartitionMetadata> filteredPartitionMetadata)
Removes metadata which does not belong to any of partitions in metadata list.
|
protected static <T extends BaseMetadata & LocationProvider> |
AbstractGroupScanWithMetadata.GroupScanWithMetadataFilterer.pruneForSegments(Map<org.apache.hadoop.fs.Path,T> metadataToPrune,
Map<org.apache.hadoop.fs.Path,SegmentMetadata> filteredSegmentMetadata)
Removes metadata which does not belong to any of partitions in metadata list.
|
| Modifier and Type | Class and Description |
|---|---|
class |
ParquetGroupScanStatistics<T extends BaseMetadata & LocationProvider>
Holds common statistics about data in parquet group scan,
including information about total row count, columns counts, partition columns.
|
| Modifier and Type | Method and Description |
|---|---|
protected static <T extends BaseMetadata & LocationProvider> |
AbstractParquetGroupScan.pruneForPartitions(org.apache.drill.shaded.guava.com.google.common.collect.Multimap<org.apache.hadoop.fs.Path,T> metadataToPrune,
List<PartitionMetadata> filteredPartitionMetadata)
Removes metadata which does not belong to any of partitions in metadata list.
|
protected static <T extends BaseMetadata & LocationProvider> |
AbstractParquetGroupScan.RowGroupScanFilterer.pruneForSegments(org.apache.drill.shaded.guava.com.google.common.collect.Multimap<org.apache.hadoop.fs.Path,T> metadataToPrune,
Map<org.apache.hadoop.fs.Path,SegmentMetadata> filteredSegmentMetadata)
Removes metadata which does not belong to any of segments in metadata list.
|
| Modifier and Type | Class and Description |
|---|---|
class |
BaseTableMetadata
Base implementation of
TableMetadata interface. |
class |
FileMetadata
Metadata which corresponds to the file level of table.
|
class |
PartitionMetadata
Represents a metadata for the table part, which corresponds to the specific partition key.
|
class |
RowGroupMetadata
Metadata which corresponds to the row group level of table.
|
class |
SegmentMetadata
Metadata which corresponds to the segment level of table.
|
| Modifier and Type | Method and Description |
|---|---|
abstract BaseMetadata |
BaseMetadata.BaseMetadataBuilder.build() |
| Modifier and Type | Method and Description |
|---|---|
static <T extends BaseMetadata> |
TableMetadataUtils.mergeColumnsStatistics(Collection<T> metadataList,
Set<SchemaPath> columns,
List<CollectableColumnStatisticsKind<?>> statisticsToCollect)
Merges list of specified metadata into the map of
ColumnStatistics with columns as keys. |
| Modifier and Type | Method and Description |
|---|---|
static TableMetadata |
TableMetadataUtils.updateRowCount(TableMetadata tableMetadata,
Collection<? extends BaseMetadata> statistics)
Updates row count and column nulls count for specified table metadata and returns new
TableMetadata instance with updated statistics. |
Copyright © 2021 The Apache Software Foundation. All rights reserved.