org.apache.drill.exec.physical.impl.xsort

Class TestSortEmitOutcome

java.lang.Object

org.apache.drill.test.BaseTest

org.apache.drill.test.DrillTest

org.apache.drill.exec.ExecTest

org.apache.drill.test.PhysicalOpUnitTestBase

org.apache.drill.exec.physical.impl.BaseTestOpBatchEmitOutcome

org.apache.drill.exec.physical.impl.xsort.TestSortEmitOutcome

public class TestSortEmitOutcome
extends BaseTestOpBatchEmitOutcome

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.drill.test.PhysicalOpUnitTestBase

PhysicalOpUnitTestBase.BatchIterator, PhysicalOpUnitTestBase.MockExecutorFragmentContext, PhysicalOpUnitTestBase.MockPhysicalOperator

Nested classes/interfaces inherited from class org.apache.drill.test.DrillTest

DrillTest.MemWatcher

Field Summary

Fields inherited from class org.apache.drill.exec.physical.impl.BaseTestOpBatchEmitOutcome

emptyInputRowSet, inputContainer, inputContainerSv2, inputOutcomes, inputSchema, nonEmptyInputRowSet, outputRecordCount

Fields inherited from class org.apache.drill.test.PhysicalOpUnitTestBase

classpathScan, dirTestWatcher, drillbitContext, drillConf, fragContext, opContext, opCreatorReg, operatorFixture, scanDecodeExecutor, scanExecutor

Fields inherited from class org.apache.drill.exec.ExecTest

c, optionManager

Fields inherited from class org.apache.drill.test.DrillTest

logOutcome, objectMapper, REPEAT_RULE, thrownException, TIMEOUT

Constructor Summary

Constructors

Constructor and Description
TestSortEmitOutcome()

Method Summary

Modifier and Type	Method and Description
void	closeOperator()
static void	defineOrdering()
void	testRegularTopNWithEmptyDataSet()
void	testSort_NonEmptyFirst_EmptyOKEmitOutcome() Verifies ExternalSortBatch behavior when it receives incoming batches with different IterOutcomes like OK_NEW_SCHEMA / OK / EMIT / NONE
void	testSortEmptyBatchEmitOutcome() Verifies that if SortBatch receives empty batches with OK_NEW_SCHEMA and EMIT outcome then it correctly produces empty batches as output.
void	testSortEmptyBatchFollowedByNonEmptyBatchEmitOutcome() Verifies ExternalSortBatch behavior when it receives first incoming batch post buildSchema phase as empty batch with EMIT outcome followed by non-empty batch with EMIT outcome.
void	testSortMultipleEMITOutcome()
void	testSortMultipleEmptyBatchWithANonEmptyBatchEmitOutcome() Verifies ExternalSortBatch behavior with runs of empty batch with EMIT outcome followed by an non-empty batch with EMIT outcome.
void	testSortMultipleInputToSingleOutputBatch() Verifies ExternalSortBatch behavior when it receives multiple non-empty batch across same EMIT boundary such that all the output records can fit within single output batch.
void	testSortNonEmptyBatchEmitOutcome() Verifies ExternalSortBatch handling of first non-empty batch with EMIT outcome post buildSchema phase.
void	testSpillNotSupportedWithEmitOutcome() Verifies ExternalSortBatch behavior when it sees batches with EMIT outcome but has to spill to disk because of memory pressure.
void	testSpillWithNoEmitOutcome() Verifies successful spilling in absence of EMIT outcome
void	testTopN_WithEmptyNonEmptyBatchesAndOKOutcome() Test for validating ExternalSortBatch behavior without EMIT outcome
void	testTopNMultipleOutputBatch()
void	testTopNResetsAfterFirstEmitOutcome() Verifies ExternalSortBatch behavior when it receives non-empty batch in BuildSchema phase followed by empty EMIT batch.

Methods inherited from class org.apache.drill.exec.physical.impl.BaseTestOpBatchEmitOutcome

afterTest, beforeTest, setUpBeforeClass

Methods inherited from class org.apache.drill.test.PhysicalOpUnitTestBase

getJsonReadersFromBatchString, getJsonReadersFromInputFiles, getOpCreatorReg, getReaderListForJsonBatches, joinCond, legacyOpTestBuilder, mockFragmentContext, mockOpContext, opTestBuilder, ordering, parseExprs, setup, teardown

Methods inherited from class org.apache.drill.exec.ExecTest

clear, getLocalFileSystem, mockDrillbitContext, mockUsDateFormatSymbols, mockUtcDateTimeZone, parseExpr, setupOptionManager

Methods inherited from class org.apache.drill.test.DrillTest

escapeJsonString, finishDrillTest, initDrillTest

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TestSortEmitOutcome

public TestSortEmitOutcome()

Method Detail

defineOrdering

public static void defineOrdering()

closeOperator

public void closeOperator()

testSortEmptyBatchEmitOutcome

public void testSortEmptyBatchEmitOutcome()

Verifies that if SortBatch receives empty batches with OK_NEW_SCHEMA and EMIT outcome then it correctly produces empty batches as output. First empty batch will be with OK_NEW_SCHEMA and second will be with EMIT outcome.

testSortNonEmptyBatchEmitOutcome

public void testSortNonEmptyBatchEmitOutcome()

Verifies ExternalSortBatch handling of first non-empty batch with EMIT outcome post buildSchema phase. Expectation is that it will return 2 output batch for first EMIT incoming, first output batch with OK_NEW_SCHEMA followed by second output batch with EMIT outcome.

testSortEmptyBatchFollowedByNonEmptyBatchEmitOutcome

public void testSortEmptyBatchFollowedByNonEmptyBatchEmitOutcome()

Verifies ExternalSortBatch behavior when it receives first incoming batch post buildSchema phase as empty batch with EMIT outcome followed by non-empty batch with EMIT outcome. Expectation is sort will handle the EMIT boundary correctly and produce 2 empty output batch for first EMIT outcome and 1 non-empty output batch for second EMIT outcome.

testSortMultipleEmptyBatchWithANonEmptyBatchEmitOutcome

public void testSortMultipleEmptyBatchWithANonEmptyBatchEmitOutcome()

Verifies ExternalSortBatch behavior with runs of empty batch with EMIT outcome followed by an non-empty batch with EMIT outcome.

testTopNResetsAfterFirstEmitOutcome

public void testTopNResetsAfterFirstEmitOutcome()

Verifies ExternalSortBatch behavior when it receives non-empty batch in BuildSchema phase followed by empty EMIT batch. Second record boundary has non-empty batch with OK outcome followed by empty EMIT outcome batch. In this case for first non-empty batch in buildSchema phase, sort should consider that data as part of first record boundary and produce it in output for that record boundary with EMIT outcome. Same is true for second pair of batches with OK and EMIT outcome

testSort_NonEmptyFirst_EmptyOKEmitOutcome

public void testSort_NonEmptyFirst_EmptyOKEmitOutcome()

Verifies ExternalSortBatch behavior when it receives incoming batches with different IterOutcomes like OK_NEW_SCHEMA / OK / EMIT / NONE

testTopNMultipleOutputBatch

public void testTopNMultipleOutputBatch()

testSortMultipleEMITOutcome

public void testSortMultipleEMITOutcome()

testSortMultipleInputToSingleOutputBatch

public void testSortMultipleInputToSingleOutputBatch()

Verifies ExternalSortBatch behavior when it receives multiple non-empty batch across same EMIT boundary such that all the output records can fit within single output batch. Then Sort correctly waits for the EMIT outcome before producing the output batches for all the buffered incoming batches with data.

testSpillNotSupportedWithEmitOutcome

public void testSpillNotSupportedWithEmitOutcome()
                                          throws Exception

Verifies ExternalSortBatch behavior when it sees batches with EMIT outcome but has to spill to disk because of memory pressure. Expectation is currenlty spilling is not supported with EMIT outcome so while preparing the output batch that will be detected and Sort will throw UnsupportedOperationException

Throws:

Exception

testTopN_WithEmptyNonEmptyBatchesAndOKOutcome

public void testTopN_WithEmptyNonEmptyBatchesAndOKOutcome()

Test for validating ExternalSortBatch behavior without EMIT outcome

testRegularTopNWithEmptyDataSet

public void testRegularTopNWithEmptyDataSet()

testSpillWithNoEmitOutcome

public void testSpillWithNoEmitOutcome()
                                throws Exception

Verifies successful spilling in absence of EMIT outcome

Throws:

Exception