public static class HashJoinMechanicalMemoryCalculator.MechanicalBuildSidePartitioning extends Object implements HashJoinMemoryCalculator.BuildSidePartitioning
| Constructor and Description |
|---|
MechanicalBuildSidePartitioning(int maxNumInMemBatches) |
| Modifier and Type | Method and Description |
|---|---|
long |
getBuildReservedMemory() |
long |
getMaxReservedMemory() |
int |
getNumPartitions() |
HashJoinState |
getState()
The current
HashJoinState corresponding to this calculator. |
void |
initialize(boolean autoTune,
boolean reserveHash,
RecordBatch buildSideBatch,
RecordBatch probeSideBatch,
Set<String> joinColumns,
boolean probeEmpty,
long memoryAvailable,
int initialPartitions,
int recordsPerPartitionBatchBuild,
int recordsPerPartitionBatchProbe,
int maxBatchNumRecordsBuild,
int maxBatchNumRecordsProbe,
int outputBatchSize,
double loadFactor) |
String |
makeDebugString() |
HashJoinMemoryCalculator.PostBuildCalculations |
next()
Signifies that the current state is complete and returns the next
HashJoinStateCalculator. |
void |
setPartitionStatSet(HashJoinMemoryCalculator.PartitionStatSet partitionStatSet) |
boolean |
shouldSpill() |
public MechanicalBuildSidePartitioning(int maxNumInMemBatches)
public void initialize(boolean autoTune,
boolean reserveHash,
RecordBatch buildSideBatch,
RecordBatch probeSideBatch,
Set<String> joinColumns,
boolean probeEmpty,
long memoryAvailable,
int initialPartitions,
int recordsPerPartitionBatchBuild,
int recordsPerPartitionBatchProbe,
int maxBatchNumRecordsBuild,
int maxBatchNumRecordsProbe,
int outputBatchSize,
double loadFactor)
initialize in interface HashJoinMemoryCalculator.BuildSidePartitioningpublic void setPartitionStatSet(HashJoinMemoryCalculator.PartitionStatSet partitionStatSet)
setPartitionStatSet in interface HashJoinMemoryCalculator.BuildSidePartitioningpublic int getNumPartitions()
getNumPartitions in interface HashJoinMemoryCalculator.BuildSidePartitioningpublic long getBuildReservedMemory()
getBuildReservedMemory in interface HashJoinMemoryCalculator.BuildSidePartitioningpublic long getMaxReservedMemory()
getMaxReservedMemory in interface HashJoinMemoryCalculator.BuildSidePartitioningpublic boolean shouldSpill()
shouldSpill in interface HashJoinMemoryCalculator.BuildSidePartitioningpublic String makeDebugString()
makeDebugString in interface HashJoinMemoryCalculator.BuildSidePartitioning@Nullable public HashJoinMemoryCalculator.PostBuildCalculations next()
HashJoinStateCalculatorHashJoinStateCalculator.
Returns null in the case where there is no next state.next in interface HashJoinStateCalculator<HashJoinMemoryCalculator.PostBuildCalculations>HashJoinStateCalculator or null if this was the last state.public HashJoinState getState()
HashJoinStateCalculatorHashJoinState corresponding to this calculator.getState in interface HashJoinStateCalculator<HashJoinMemoryCalculator.PostBuildCalculations>Copyright © 2021 The Apache Software Foundation. All rights reserved.