| Package | Description |
|---|---|
| org.apache.drill.exec.store.parquet | |
| org.apache.drill.exec.store.parquet.columnreaders | |
| org.apache.drill.exec.store.parquet2 |
| Modifier and Type | Method and Description |
|---|---|
static ParquetReaderUtility.DateCorruptionStatus |
ParquetReaderUtility.checkForCorruptDateValuesInStatistics(org.apache.parquet.hadoop.metadata.ParquetMetadata footer,
List<SchemaPath> columns,
boolean autoCorrectCorruptDates)
Detect corrupt date values by looking at the min/max values in the metadata.
|
static ParquetReaderUtility.DateCorruptionStatus |
ParquetReaderUtility.detectCorruptDates(org.apache.parquet.hadoop.metadata.ParquetMetadata footer,
List<SchemaPath> columns,
boolean autoCorrectCorruptDates)
Check for corrupted dates in a parquet file.
|
static ParquetReaderUtility.DateCorruptionStatus |
ParquetReaderUtility.DateCorruptionStatus.valueOf(String name)
Returns the enum constant of this type with the specified name.
|
static ParquetReaderUtility.DateCorruptionStatus[] |
ParquetReaderUtility.DateCorruptionStatus.values()
Returns an array containing the constants of this enum type, in
the order they are declared.
|
| Modifier and Type | Method and Description |
|---|---|
ParquetReaderUtility.DateCorruptionStatus |
ParquetRecordReader.getDateCorruptionStatus()
Flag indicating if the old non-standard data format appears
in this file, see DRILL-4203.
|
| Constructor and Description |
|---|
ParquetRecordReader(FragmentContext fragmentContext,
long numRecordsToRead,
org.apache.hadoop.fs.Path path,
int rowGroupIndex,
org.apache.hadoop.fs.FileSystem fs,
org.apache.parquet.hadoop.CodecFactory codecFactory,
org.apache.parquet.hadoop.metadata.ParquetMetadata footer,
List<SchemaPath> columns,
ParquetReaderUtility.DateCorruptionStatus dateCorruptionStatus) |
ParquetRecordReader(FragmentContext fragmentContext,
org.apache.hadoop.fs.Path path,
int rowGroupIndex,
org.apache.hadoop.fs.FileSystem fs,
org.apache.parquet.hadoop.CodecFactory codecFactory,
org.apache.parquet.hadoop.metadata.ParquetMetadata footer,
List<SchemaPath> columns,
ParquetReaderUtility.DateCorruptionStatus dateCorruptionStatus) |
ParquetRecordReader(FragmentContext fragmentContext,
org.apache.hadoop.fs.Path path,
int rowGroupIndex,
long numRecordsToRead,
org.apache.hadoop.fs.FileSystem fs,
org.apache.parquet.hadoop.CodecFactory codecFactory,
org.apache.parquet.hadoop.metadata.ParquetMetadata footer,
List<SchemaPath> columns,
ParquetReaderUtility.DateCorruptionStatus dateCorruptionStatus) |
| Constructor and Description |
|---|
DrillParquetGroupConverter(OutputMutator mutator,
org.apache.drill.exec.vector.complex.writer.BaseWriter baseWriter,
org.apache.parquet.schema.GroupType schema,
Collection<SchemaPath> columns,
OptionManager options,
ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates,
boolean skipRepeated,
String parentName)
The constructor is responsible for creation of converters tree and may invoke itself for
creation of child converters when nested field is group type field too.
|
DrillParquetGroupConverter(OutputMutator mutator,
org.apache.drill.exec.vector.complex.writer.BaseWriter baseWriter,
OptionManager options,
ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates)
Constructor is responsible for creation of converter without creation of child converters.
|
DrillParquetReader(FragmentContext fragmentContext,
org.apache.parquet.hadoop.metadata.ParquetMetadata footer,
RowGroupReadEntry entry,
List<SchemaPath> columns,
DrillFileSystem fileSystem,
ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates,
long recordsToRead) |
DrillParquetRecordMaterializer(OutputMutator mutator,
org.apache.parquet.schema.MessageType schema,
Collection<SchemaPath> columns,
OptionManager options,
ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates) |
Copyright © 2021 The Apache Software Foundation. All rights reserved.