Package org.apache.drill.exec.physical.impl.partitionsender

Class PartitionerTemplate

java.lang.Object

org.apache.drill.exec.physical.impl.partitionsender.PartitionerTemplate

All Implemented Interfaces:

Partitioner

public abstract class PartitionerTemplate
extends Object
implements Partitioner

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
class	PartitionerTemplate.OutgoingRecordBatch

Field Summary

Fields

Modifier and Type	Field	Description
protected ClassGenerator<?>	cg
protected FragmentContext	context

Fields inherited from interface org.apache.drill.exec.physical.impl.partitionsender.Partitioner

TEMPLATE_DEFINITION

Constructor Summary

Constructors

Constructor	Description
PartitionerTemplate()

Method Summary

Modifier and Type	Method	Description
void	clear()
abstract int	doEval(int inIndex)
abstract void	doSetup(FragmentContext context, RecordBatch incoming, PartitionerTemplate.OutgoingRecordBatch[] outgoing)
void	flushOutgoingBatches(boolean isLastBatch, boolean schemaChanged)	Flush each outgoing record batch, and optionally reset the state of each outgoing record batch (on schema change).
PartitionOutgoingBatch	getOutgoingBatch(int index)	Get PartitionOutgoingBatch based on the fact that there can be > 1 Partitioner
List<? extends PartitionOutgoingBatch>	getOutgoingBatches()
OperatorStats	getStats()
void	initialize()
protected PartitionerTemplate.OutgoingRecordBatch	injectMembers(PartitionerTemplate.OutgoingRecordBatch outgoingRecordBatch)
protected PartitionerTemplate.OutgoingRecordBatch	newOutgoingRecordBatch(OperatorStats stats, HashPartitionSender operator, AccountingDataTunnel tunnel, FragmentContext context, BufferAllocator allocator, int oppositeMinorFragmentId)	Shim method to be overridden in plain-old Java mode by the subclass to instantiate the generated inner class.
void	partitionBatch(RecordBatch incoming)
final void	setup(ExchangeFragmentContext context, RecordBatch incoming, HashPartitionSender popConfig, OperatorStats stats, OperatorContext oContext, ClassGenerator<?> cg, int start, int end)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

cg

protected ClassGenerator<?> cg

context

protected FragmentContext context

Constructor Details

PartitionerTemplate

public PartitionerTemplate()

Method Details

getOutgoingBatches

public List<? extends PartitionOutgoingBatch> getOutgoingBatches()

Specified by:

getOutgoingBatches in interface Partitioner

getOutgoingBatch

public PartitionOutgoingBatch getOutgoingBatch(int index)

Description copied from interface: Partitioner

Get PartitionOutgoingBatch based on the fact that there can be > 1 Partitioner

Specified by:

getOutgoingBatch in interface Partitioner

Parameters:

index -

Returns:

PartitionOutgoingBatch that matches index within Partitioner. This method can return null if index does not fall within boundary of this Partitioner

setup

public final void setup(ExchangeFragmentContext context,
 RecordBatch incoming,
 HashPartitionSender popConfig,
 OperatorStats stats,
 OperatorContext oContext,
 ClassGenerator<?> cg,
 int start,
 int end)
                 throws SchemaChangeException

Specified by:

setup in interface Partitioner

Throws:

SchemaChangeException

newOutgoingRecordBatch

protected PartitionerTemplate.OutgoingRecordBatch newOutgoingRecordBatch(OperatorStats stats,
 HashPartitionSender operator,
 AccountingDataTunnel tunnel,
 FragmentContext context,
 BufferAllocator allocator,
 int oppositeMinorFragmentId)

Shim method to be overridden in plain-old Java mode by the subclass to instantiate the generated inner class. Byte-code manipulation appears to fix up the byte codes directly. The name is special, it must be "new" + inner class name.

injectMembers

protected PartitionerTemplate.OutgoingRecordBatch injectMembers(PartitionerTemplate.OutgoingRecordBatch outgoingRecordBatch)

getStats

public OperatorStats getStats()

Specified by:

getStats in interface Partitioner

flushOutgoingBatches

public void flushOutgoingBatches(boolean isLastBatch,
 boolean schemaChanged)
                          throws IOException

Flush each outgoing record batch, and optionally reset the state of each outgoing record batch (on schema change). Note that the schema is updated based on incoming at the time this function is invoked.

Specified by:

flushOutgoingBatches in interface Partitioner

Parameters:

isLastBatch - true if this is the last incoming batch

schemaChanged - true if the schema has changed

Throws:

IOException

partitionBatch

public void partitionBatch(RecordBatch incoming)
                    throws IOException

Specified by:

partitionBatch in interface Partitioner

Throws:

IOException

initialize

public void initialize()

Specified by:

initialize in interface Partitioner

clear

public void clear()

Specified by:

clear in interface Partitioner

doSetup

public abstract void doSetup(@Named("context")
 FragmentContext context,
 @Named("incoming")
 RecordBatch incoming,
 @Named("outgoing")
 PartitionerTemplate.OutgoingRecordBatch[] outgoing)
                      throws SchemaChangeException

Throws:

SchemaChangeException

doEval

public abstract int doEval(@Named("inIndex")
 int inIndex)
                    throws SchemaChangeException

Throws:

SchemaChangeException