org.apache.drill.exec.work.batch

Class AbstractDataCollector

java.lang.Object

org.apache.drill.exec.work.batch.AbstractDataCollector

All Implemented Interfaces:

AutoCloseable, DataCollector

Direct Known Subclasses:

MergingCollector, PartitionedCollector

public abstract class AbstractDataCollector
extends Object
implements DataCollector

Field Summary

Fields

Modifier and Type	Field and Description
protected RawBatchBuffer[]	buffers
protected ArrayWrappedIntIntMap	fragmentMap
protected BufferAllocator	ownerAllocator Allocator which owns incoming batches

Fields inherited from interface org.apache.drill.exec.work.batch.DataCollector

logger

Constructor Summary

Constructors

Constructor and Description
AbstractDataCollector(AtomicInteger parentAccounter, int numBuffers, BitControl.Collector collector, int bufferCapacity, FragmentContext context)

Method Summary

Modifier and Type	Method and Description
boolean	batchArrived(int minorFragmentId, RawFragmentBatch batch)
void	close()
BufferAllocator	getAllocator()
protected abstract RawBatchBuffer	getBuffer(int minorFragmentId)
RawBatchBuffer[]	getBuffers()
int	getOppositeMajorFragmentId()
int	getTotalIncomingFragments()
void	setAllocator(BufferAllocator allocator) Enables caller (e.g., receiver) to attach its buffer allocator to this Data Collector in order to claim ownership of incoming batches; by default, the fragment allocator owns these batches.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

buffers

protected final RawBatchBuffer[] buffers

fragmentMap

protected final ArrayWrappedIntIntMap fragmentMap

ownerAllocator

protected BufferAllocator ownerAllocator

Allocator which owns incoming batches

Constructor Detail

AbstractDataCollector

public AbstractDataCollector(AtomicInteger parentAccounter,
                             int numBuffers,
                             BitControl.Collector collector,
                             int bufferCapacity,
                             FragmentContext context)

Parameters:

parentAccounter -

numBuffers - Number of RawBatchBuffer inputs required to store the incoming data

bufferCapacity - Capacity of each RawBatchBuffer.

context -

Method Detail

getOppositeMajorFragmentId

public int getOppositeMajorFragmentId()

Specified by:

getOppositeMajorFragmentId in interface DataCollector

getBuffers

public RawBatchBuffer[] getBuffers()

Specified by:

getBuffers in interface DataCollector

batchArrived

public boolean batchArrived(int minorFragmentId,
                            RawFragmentBatch batch)
                     throws IOException

Specified by:

batchArrived in interface DataCollector

Throws:

IOException

getTotalIncomingFragments

public int getTotalIncomingFragments()

Specified by:

getTotalIncomingFragments in interface DataCollector

getBuffer

protected abstract RawBatchBuffer getBuffer(int minorFragmentId)

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Specified by:

close in interface DataCollector

Throws:

Exception

getAllocator

public BufferAllocator getAllocator()

Specified by:

getAllocator in interface DataCollector

Returns:

allocator

setAllocator

public void setAllocator(BufferAllocator allocator)

Enables caller (e.g., receiver) to attach its buffer allocator to this Data Collector in order to claim ownership of incoming batches; by default, the fragment allocator owns these batches.

Specified by:

setAllocator in interface DataCollector

Parameters:

allocator - operator buffer allocator