Class DrillParquetReader
java.lang.Object
org.apache.drill.exec.store.AbstractRecordReader
org.apache.drill.exec.store.CommonParquetRecordReader
org.apache.drill.exec.store.parquet2.DrillParquetReader
- All Implemented Interfaces:
AutoCloseable,RecordReader
-
Nested Class Summary
Nested classes/interfaces inherited from class org.apache.drill.exec.store.CommonParquetRecordReader
CommonParquetRecordReader.Metric -
Field Summary
Fields inherited from class org.apache.drill.exec.store.CommonParquetRecordReader
footer, fragmentContext, NUM_RECORDS_TO_READ_NOT_SPECIFIED, operatorContext, parquetReaderStatsFields inherited from class org.apache.drill.exec.store.AbstractRecordReader
DEFAULT_TEXT_COLS_TO_READFields inherited from interface org.apache.drill.exec.store.RecordReader
ALLOCATOR_INITIAL_RESERVATION, ALLOCATOR_MAX_RESERVATION -
Constructor Summary
ConstructorsConstructorDescriptionDrillParquetReader(FragmentContext fragmentContext, org.apache.parquet.hadoop.metadata.ParquetMetadata footer, RowGroupReadEntry entry, List<SchemaPath> columns, DrillFileSystem fileSystem, ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates, long recordsToRead) -
Method Summary
Modifier and TypeMethodDescriptionvoidallocate(Map<String, ValueVector> vectorMap) voidclose()intnext()Increments this record reader forward, writing via the provided output mutator into the output batch.voidsetup(OperatorContext context, OutputMutator output) Configure the RecordReader with the provided schema and the record batch that should be written to.toString()Methods inherited from class org.apache.drill.exec.store.CommonParquetRecordReader
closeStats, handleAndRaise, initNumRecordsToRead, updateRowGroupsStatsMethods inherited from class org.apache.drill.exec.store.AbstractRecordReader
getColumns, getDefaultColumnsToRead, hasNext, isSkipQuery, isStarQuery, setColumns, transformColumns
-
Constructor Details
-
DrillParquetReader
public DrillParquetReader(FragmentContext fragmentContext, org.apache.parquet.hadoop.metadata.ParquetMetadata footer, RowGroupReadEntry entry, List<SchemaPath> columns, DrillFileSystem fileSystem, ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates, long recordsToRead)
-
-
Method Details
-
allocate
- Specified by:
allocatein interfaceRecordReader- Overrides:
allocatein classAbstractRecordReader- Throws:
OutOfMemoryException
-
setup
Description copied from interface:RecordReaderConfigure the RecordReader with the provided schema and the record batch that should be written to.- Parameters:
context- operator context for the readeroutput- The place where output for a particular scan should be written. The record reader is responsible for mutating the set of schema values for that particular record.- Throws:
ExecutionSetupException
-
next
public int next()Description copied from interface:RecordReaderIncrements this record reader forward, writing via the provided output mutator into the output batch.- Returns:
- The number of additional records added to the output.
-
close
public void close() -
toString
- Overrides:
toStringin classAbstractRecordReader
-