org.apache.drill.exec.physical.impl.statistics

Class StatisticsMergeBatch

java.lang.Object

org.apache.drill.exec.record.AbstractRecordBatch<T>

org.apache.drill.exec.record.AbstractUnaryRecordBatch<T>

org.apache.drill.exec.record.AbstractSingleRecordBatch<StatisticsMerge>

org.apache.drill.exec.physical.impl.statistics.StatisticsMergeBatch

All Implemented Interfaces:

AutoCloseable, Iterable<VectorWrapper<?>>, CloseableRecordBatch, RecordBatch, VectorAccessible

public class StatisticsMergeBatch
extends AbstractSingleRecordBatch<StatisticsMerge>

Example input and output: Schema of incoming batch:

    "columns"       : MAP - Column names
       "region_id"  : VARCHAR
       "sales_city" : VARCHAR
       "cnt"        : VARCHAR
    "statscount" : MAP - Number of entries (rows)
       "region_id"  : BIGINT - statscount(region_id)
                      in incoming batch
       "sales_city" : BIGINT - statscount(sales_city)
       "cnt"        : BIGINT - statscount(cnt)
    "nonnullstatcount" : MAP - Number of non-null entries (rows)
       "region_id"  : BIGINT - nonnullstatcount(region_id)
       "sales_city" : BIGINT - nonnullstatcount(sales_city)
       "cnt"        : BIGINT - nonnullstatcount(cnt)
   .... another map for next stats function ....
 

Schema of outgoing batch:

    "schema" : BIGINT - Schema number. For each schema change this number is incremented.
    "computed" : DATE - What time is it computed?
    "columns"       : MAP - Column names
       "region_id"  : VARCHAR
       "sales_city" : VARCHAR
       "cnt"        : VARCHAR
    "statscount" : MAP - Number of entries (rows)
       "region_id"  : BIGINT - statscount(region_id) - aggregation over all values of region_id
                      in incoming batch
       "sales_city" : BIGINT - statscount(sales_city)
       "cnt"        : BIGINT - statscount(cnt)
    "nonnullstatcount" : MAP - Number of non-null entries (rows)
       "region_id"  : BIGINT - nonnullstatcount(region_id)
       "sales_city" : BIGINT - nonnullstatcount(sales_city)
       "cnt"        : BIGINT - nonnullstatcount(cnt)
   .... another map for next stats function ....
 

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.drill.exec.record.AbstractRecordBatch

AbstractRecordBatch.BatchState

Nested classes/interfaces inherited from interface org.apache.drill.exec.record.RecordBatch

RecordBatch.IterOutcome

Field Summary

Fields inherited from class org.apache.drill.exec.record.AbstractSingleRecordBatch

incoming

Fields inherited from class org.apache.drill.exec.record.AbstractUnaryRecordBatch

callBack

Fields inherited from class org.apache.drill.exec.record.AbstractRecordBatch

batchStatsContext, container, context, oContext, popConfig, state, stats, unionTypeEnabled

Fields inherited from interface org.apache.drill.exec.record.RecordBatch

MAX_BATCH_ROW_COUNT

Constructor Summary

Constructors

Constructor and Description
StatisticsMergeBatch(StatisticsMerge popConfig, RecordBatch incoming, FragmentContext context)

Method Summary

Modifier and Type	Method and Description
protected RecordBatch.IterOutcome	doWork()
void	dump() Perform dump of this batch's state to logs.
VectorContainer	getOutgoingContainer()
int	getRecordCount() Get the number of records.
RecordBatch.IterOutcome	innerNext()
protected boolean	setupNewSchema()

Methods inherited from class org.apache.drill.exec.record.AbstractSingleRecordBatch

getFinalOutcome, getIncoming

Methods inherited from class org.apache.drill.exec.record.AbstractUnaryRecordBatch

cancelIncoming, getLastKnownOutcome, handleNullInput, setLastKnownOutcome

Methods inherited from class org.apache.drill.exec.record.AbstractRecordBatch

buildSchema, cancel, checkContinue, close, getContainer, getContext, getPopConfig, getRecordBatchStatsContext, getSchema, getSelectionVector2, getSelectionVector4, getValueAccessorById, getValueVectorId, getWritableBatch, isRecordBatchStatsLoggingEnabled, iterator, next, next, next, schemaChangeException, schemaChangeException

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Constructor Detail

StatisticsMergeBatch

public StatisticsMergeBatch(StatisticsMerge popConfig,
                            RecordBatch incoming,
                            FragmentContext context)
                     throws OutOfMemoryException

Throws:

OutOfMemoryException

Method Detail

setupNewSchema

protected boolean setupNewSchema()

Specified by:

setupNewSchema in class AbstractUnaryRecordBatch<StatisticsMerge>

doWork

protected RecordBatch.IterOutcome doWork()

Specified by:

doWork in class AbstractUnaryRecordBatch<StatisticsMerge>

getOutgoingContainer

public VectorContainer getOutgoingContainer()

Specified by:

getOutgoingContainer in interface RecordBatch

Overrides:

getOutgoingContainer in class AbstractRecordBatch<StatisticsMerge>

dump

public void dump()

Description copied from interface: RecordBatch

Perform dump of this batch's state to logs.

innerNext

public RecordBatch.IterOutcome innerNext()

Overrides:

innerNext in class AbstractUnaryRecordBatch<StatisticsMerge>

getRecordCount

public int getRecordCount()

Description copied from interface: VectorAccessible

Get the number of records.

Returns:

number of records