org.apache.drill.exec.store.easy.text.reader

Class ConstrainedFieldOutput

java.lang.Object

org.apache.drill.exec.store.easy.text.reader.BaseFieldOutput

org.apache.drill.exec.store.easy.text.reader.ConstrainedFieldOutput

public class ConstrainedFieldOutput
extends BaseFieldOutput

For CSV files without headers, but with a provided schema, handles the case where extra fields appear in the file beyond the columns enumerated in the schema. These fields are ignored.

Field Summary

Fields

Modifier and Type	Field and Description
protected ValueWriter[]	colWriters

Fields inherited from class org.apache.drill.exec.store.easy.text.reader.BaseFieldOutput

currentDataPointer, currentFieldIndex, fieldBytes, fieldProjected, fieldWriteCount, maxField, writer

Method Summary

Modifier and Type	Method and Description
protected ValueWriter	columnWriter()
boolean	endField() End processing a field within a record.
protected void	writeToVector() Write a buffer of data to the underlying vector using the column writer.

Methods inherited from class org.apache.drill.exec.store.easy.text.reader.BaseFieldOutput

append, endEmptyField, finishRecord, getRecordCount, isFull, startField, startRecord

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

colWriters

protected final ValueWriter[] colWriters

Method Detail

writeToVector

protected void writeToVector()

Description copied from class: BaseFieldOutput

Write a buffer of data to the underlying vector using the column writer. The buffer holds a complete or partial chunk of data for the field. If this is the first data for the field, write the bytes. If this is a second buffer for the same field, append the bytes. The append will work if the underlying vector is VarChar, it will fail if a type conversion shim is in between. (This is generally OK because the previous setBytes should have failed because a large int or date is not supported.)

Overrides:

writeToVector in class BaseFieldOutput

endField

public boolean endField()

End processing a field within a record.

Overrides:

endField in class BaseFieldOutput

Returns:

true if engine should continue processing record. false if rest of record can be skipped.

columnWriter

protected ValueWriter columnWriter()

Specified by:

columnWriter in class BaseFieldOutput