org.apache.drill.exec.physical.base

Class AbstractExchange

java.lang.Object

org.apache.drill.exec.physical.base.AbstractBase

org.apache.drill.exec.physical.base.AbstractSingle

org.apache.drill.exec.physical.base.AbstractExchange

All Implemented Interfaces:

Iterable<PhysicalOperator>, GraphValue<PhysicalOperator>, Exchange, PhysicalOperator

Direct Known Subclasses:

AbstractDeMuxExchange, AbstractMuxExchange, BroadcastExchange, HashToMergeExchange, HashToRandomExchange, OrderedPartitionExchange, RangePartitionExchange, SingleMergeExchange, UnionExchange

public abstract class AbstractExchange
extends AbstractSingle
implements Exchange

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.drill.exec.physical.base.Exchange

Exchange.ParallelizationDependency

Field Summary

Fields

Modifier and Type	Field and Description
protected List<CoordinationProtos.DrillbitEndpoint>	receiverLocations
protected int	receiverMajorFragmentId
protected List<CoordinationProtos.DrillbitEndpoint>	senderLocations
protected int	senderMajorFragmentId

Fields inherited from class org.apache.drill.exec.physical.base.AbstractSingle

child

Fields inherited from class org.apache.drill.exec.physical.base.AbstractBase

INIT_ALLOCATION, initialAllocation, MAX_ALLOCATION, maxAllocation

Constructor Summary

Constructors

Constructor and Description
AbstractExchange(PhysicalOperator child)

Method Summary

Modifier and Type	Method and Description
<T,X,E extends Throwable> T	accept(PhysicalVisitor<T,X,E> physicalVisitor, X value) Provides capability to build a set of output based on traversing a query graph tree.
protected static List<EndpointAffinity>	getDefaultAffinityMap(List<CoordinationProtos.DrillbitEndpoint> fragmentEndpoints) Get a default endpoint affinity map where affinity of a Drillbit is proportional to the number of its occurrences in given endpoint list.
String	getOperatorType()
Exchange.ParallelizationDependency	getParallelizationDependency() Get the parallelization dependency of the Exchange.
long	getReceiverMemory(int receivers, int senders) Returns the memory requirement for the receiver side of the exchange operator.
ParallelizationInfo	getReceiverParallelizationInfo(List<CoordinationProtos.DrillbitEndpoint> senderFragmentEndpoints) Default receiver parallelization width range is [1, Integer.MAX_VALUE] and affinity to nodes where sender fragments are running.
long	getSenderMemory(int receivers, int senders) Returns the memory requirement for the sender side of the exchange operator.
ParallelizationInfo	getSenderParallelizationInfo(List<CoordinationProtos.DrillbitEndpoint> receiverFragmentEndpoints) Default sender parallelization width range is [1, Integer.MAX_VALUE] and no endpoint affinity
boolean	isExecutable() Exchanges are not executable.
void	setupReceivers(int majorFragmentId, List<CoordinationProtos.DrillbitEndpoint> receiverLocations) Inform this Exchange node about its receiver locations.
protected void	setupReceivers(List<CoordinationProtos.DrillbitEndpoint> receiverLocations)
void	setupSenders(int majorFragmentId, List<CoordinationProtos.DrillbitEndpoint> senderLocations) Inform this Exchange node about its sender locations.
protected void	setupSenders(List<CoordinationProtos.DrillbitEndpoint> senderLocations)

Methods inherited from class org.apache.drill.exec.physical.base.AbstractSingle

getChild, getNewWithChild, getNewWithChildren, iterator

Methods inherited from class org.apache.drill.exec.physical.base.AbstractBase

accept, getCost, getInitialAllocation, getMaxAllocation, getOperatorId, getSVMode, getUserName, isBufferedOperator, setCost, setMaxAllocation, setOperatorId

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.drill.exec.physical.base.Exchange

getChild, getReceiver, getSender

Methods inherited from interface org.apache.drill.exec.physical.base.PhysicalOperator

getCost, getInitialAllocation, getMaxAllocation, getNewWithChildren, getOperatorId, getSVMode, getUserName, isBufferedOperator, setCost, setMaxAllocation, setOperatorId

Methods inherited from interface org.apache.drill.common.graph.GraphValue

accept

Methods inherited from interface java.lang.Iterable

forEach, iterator, spliterator

Field Detail

senderMajorFragmentId

protected int senderMajorFragmentId

receiverMajorFragmentId

protected int receiverMajorFragmentId

senderLocations

protected List<CoordinationProtos.DrillbitEndpoint> senderLocations

receiverLocations

protected List<CoordinationProtos.DrillbitEndpoint> receiverLocations

Constructor Detail

AbstractExchange

public AbstractExchange(PhysicalOperator child)

Method Detail

isExecutable

public boolean isExecutable()

Exchanges are not executable. The Execution layer first has to set their parallelization and convert them into something executable

Specified by:

isExecutable in interface PhysicalOperator

Overrides:

isExecutable in class AbstractBase

getSenderParallelizationInfo

public ParallelizationInfo getSenderParallelizationInfo(List<CoordinationProtos.DrillbitEndpoint> receiverFragmentEndpoints)

Default sender parallelization width range is [1, Integer.MAX_VALUE] and no endpoint affinity

Specified by:

getSenderParallelizationInfo in interface Exchange

Parameters:

receiverFragmentEndpoints - Endpoints assigned to receiver fragment if available, otherwise an empty list.

Returns:

Sender ParallelizationInfo.

getReceiverParallelizationInfo

public ParallelizationInfo getReceiverParallelizationInfo(List<CoordinationProtos.DrillbitEndpoint> senderFragmentEndpoints)

Default receiver parallelization width range is [1, Integer.MAX_VALUE] and affinity to nodes where sender fragments are running.

Specified by:

getReceiverParallelizationInfo in interface Exchange

Parameters:

senderFragmentEndpoints - Endpoints assigned to receiver fragment if available, otherwise an empty list.

Returns:

Receiver ParallelizationInfo.

getDefaultAffinityMap

protected static List<EndpointAffinity> getDefaultAffinityMap(List<CoordinationProtos.DrillbitEndpoint> fragmentEndpoints)

Get a default endpoint affinity map where affinity of a Drillbit is proportional to the number of its occurrences in given endpoint list.

Parameters:

fragmentEndpoints - Drillbit endpoint assignments of fragments.

Returns:

List of EndpointAffinity objects for each Drillbit endpoint given fragmentEndpoints.

setupSenders

protected void setupSenders(List<CoordinationProtos.DrillbitEndpoint> senderLocations)

setupReceivers

protected void setupReceivers(List<CoordinationProtos.DrillbitEndpoint> receiverLocations)
                       throws PhysicalOperatorSetupException

Throws:

PhysicalOperatorSetupException

setupSenders

public final void setupSenders(int majorFragmentId,
                               List<CoordinationProtos.DrillbitEndpoint> senderLocations)
                        throws PhysicalOperatorSetupException

Description copied from interface: Exchange

Inform this Exchange node about its sender locations. This list should be index-ordered the same as the expected minorFragmentIds for each sender.

Specified by:

setupSenders in interface Exchange

Throws:

PhysicalOperatorSetupException

setupReceivers

public final void setupReceivers(int majorFragmentId,
                                 List<CoordinationProtos.DrillbitEndpoint> receiverLocations)
                          throws PhysicalOperatorSetupException

Description copied from interface: Exchange

Inform this Exchange node about its receiver locations. This list should be index-ordered the same as the expected minorFragmentIds for each receiver.

Specified by:

setupReceivers in interface Exchange

Throws:

PhysicalOperatorSetupException

accept

public final <T,X,E extends Throwable> T accept(PhysicalVisitor<T,X,E> physicalVisitor,
                                                X value)
                                         throws E extends Throwable

Description copied from interface: PhysicalOperator

Provides capability to build a set of output based on traversing a query graph tree.

Specified by:

accept in interface PhysicalOperator

Throws:

E extends Throwable

getOperatorType

public String getOperatorType()

Specified by:

getOperatorType in interface PhysicalOperator

getParallelizationDependency

public Exchange.ParallelizationDependency getParallelizationDependency()

Description copied from interface: Exchange

Get the parallelization dependency of the Exchange.

Specified by:

getParallelizationDependency in interface Exchange

getSenderMemory

public long getSenderMemory(int receivers,
                            int senders)

Description copied from interface: Exchange

Returns the memory requirement for the sender side of the exchange operator.

Specified by:

getSenderMemory in interface Exchange

Parameters:

receivers - number of receivers at the receiving end of this exchange operator.

senders - number of senders sending the rows for this exchange operator.

Returns:

Total memory required by this operator.

getReceiverMemory

public long getReceiverMemory(int receivers,
                              int senders)

Description copied from interface: Exchange

Returns the memory requirement for the receiver side of the exchange operator.

Specified by:

getReceiverMemory in interface Exchange

Parameters:

receivers - number of receivers receiving the rows sent by the sender side of this exchange operator.

senders - number of senders sending the rows.

Returns:

Total memory required by this operator.