org.apache.drill.exec.store.easy.text.compliant

Class TestCsvWithoutHeaders

java.lang.Object

org.apache.drill.test.BaseTest

org.apache.drill.test.DrillTest

org.apache.drill.test.ClusterTest

org.apache.drill.exec.store.easy.text.compliant.BaseCsvTest

org.apache.drill.exec.store.easy.text.compliant.TestCsvWithoutHeaders

public class TestCsvWithoutHeaders
extends BaseCsvTest

Test behavior of the text (CSV) reader for files without headers and without an external schema. Data is represented with the `columns` array column.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.drill.test.DrillTest

DrillTest.MemWatcher

Field Summary

Fields inherited from class org.apache.drill.exec.store.easy.text.compliant.BaseCsvTest

BIG_COL_SIZE, EMPTY_FILE, FILE_N_NAME, NESTED_DIR, NESTED_FILE, PART_DIR, ROOT_FILE, SCHEMA_BATCH_ENABLED, secondFile, testDir, validHeaders

Fields inherited from class org.apache.drill.test.ClusterTest

client, cluster, dirTestWatcher

Fields inherited from class org.apache.drill.test.DrillTest

logOutcome, objectMapper, REPEAT_RULE, thrownException, TIMEOUT

Constructor Summary

Constructors

Constructor and Description
TestCsvWithoutHeaders()

Method Summary

Modifier and Type	Method and Description
protected static void	buildNestedTableWithoutHeaders()
void	doTestWildcardAndMetadata()
static void	setup()
void	testColumns()
void	testColumnsAndMetadata()
void	testColumnsAsMap() When the `columns` array is allowed, the projection list cannot implicitly suggest that `columns` is a map.
void	testColumnsIndexOverflow() When the `columns` array is allowed, and an index is projected, it must be below the maximum.
void	testEmptyFile() An empty no-headers file has a valid schema: it will always be `columns`.
void	testHugeColumn()
void	testPartitionExpansion() Test partition expansion.
void	testRaggedRows()
void	testSpecificColumns()
void	testWildcard() Verify that the wildcard expands to the `columns` array

Methods inherited from class org.apache.drill.exec.store.easy.text.compliant.BaseCsvTest

buildBigColFile, buildFile, buildFile, buildNestedTable, buildTable, enableMultiScan, enableSchema, enableSchemaSupport, resetMultiScan, resetSchema, resetSchemaSupport, setup, setup

Methods inherited from class org.apache.drill.test.ClusterTest

getFile, queryBuilder, run, runAndLog, runAndPrint, runAndPrint, shutdown, startCluster, testBuilder

Methods inherited from class org.apache.drill.test.DrillTest

escapeJsonString, finishDrillTest, initDrillTest

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TestCsvWithoutHeaders

public TestCsvWithoutHeaders()

Method Detail

setup

public static void setup()
                  throws Exception

Throws:

Exception

buildNestedTableWithoutHeaders

protected static void buildNestedTableWithoutHeaders()
                                              throws IOException

Throws:

IOException

testWildcard

public void testWildcard()
                  throws IOException

Verify that the wildcard expands to the `columns` array

Throws:

IOException

testEmptyFile

public void testEmptyFile()
                   throws IOException

An empty no-headers file has a valid schema: it will always be `columns`. The scan operator can return a single, empty batch with that schema to represent the empty file.

Throws:

IOException

See Also:

TestEmptyInputSql#testQueryEmptyCsv}

testColumns

public void testColumns()
                 throws IOException

Throws:

IOException

doTestWildcardAndMetadata

public void doTestWildcardAndMetadata()
                               throws IOException

Throws:

IOException

testColumnsAndMetadata

public void testColumnsAndMetadata()
                            throws IOException

Throws:

IOException

testSpecificColumns

public void testSpecificColumns()
                         throws IOException

Throws:

IOException

testRaggedRows

public void testRaggedRows()
                    throws IOException

Throws:

IOException

testPartitionExpansion

public void testPartitionExpansion()
                            throws IOException

Test partition expansion.

V3, as in V2 before Drill 1.12, puts partition columns after data columns (so that data columns don't shift positions if files are nested to another level.)

Throws:

IOException

testColumnsAsMap

public void testColumnsAsMap()
                      throws Exception

When the `columns` array is allowed, the projection list cannot implicitly suggest that `columns` is a map.

V2 message: DATA_READ ERROR: Selected column 'columns' must be an array index

Throws:

Exception

testColumnsIndexOverflow

public void testColumnsIndexOverflow()
                              throws Exception

When the `columns` array is allowed, and an index is projected, it must be below the maximum.

V2 message: INTERNAL_ERROR ERROR: 70000

Throws:

Exception

testHugeColumn

public void testHugeColumn()
                    throws IOException

Throws:

IOException