org.apache.drill.exec.store.log

Class TestLogReader

java.lang.Object

org.apache.drill.test.BaseTest

org.apache.drill.test.DrillTest

org.apache.drill.test.ClusterTest

org.apache.drill.exec.store.log.TestLogReader

public class TestLogReader
extends ClusterTest

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.drill.test.DrillTest

DrillTest.MemWatcher

Field Summary

Fields

Modifier and Type	Field and Description
static String	DATE_ONLY_PATTERN
static BaseDirTestWatcher	dirTestWatcher
protected static File	schemaAndConfigDir
protected static File	schemaOnlyDir

Fields inherited from class org.apache.drill.test.ClusterTest

client, cluster

Fields inherited from class org.apache.drill.test.DrillTest

logOutcome, objectMapper, REPEAT_RULE, thrownException, TIMEOUT

Constructor Summary

Constructors

Constructor and Description
TestLogReader()

Method Summary

Modifier and Type	Method and Description
static void	setup()
void	testCount()
void	testDate()
void	testEmptyPattern() Verify that an error is thrown if no pattern is provided in the plugin config, table function or provided schema.
void	testExplicitProject()
void	testFirewallSchema()
void	testFull()
void	testMissingColumns()
void	testPluginSerialization() The config classes for this plugin have been trick to get right.
void	testProvidedSchema()
void	testRaw()
void	testRawNoSchema()
void	testRawUMNoSchema()
void	testSchemaOnlyNoCols() Test the case in which the plugin config contains no information other than the file extensions.
void	testSchemaOnlyWithCols() Test the case in which the plugin config contains no information other than the file extensions.
void	testSchemaOnlyWithMissingCols() Corner case: provided schema has the regex and two of the three columns, the third takes a default name and type.
void	testSomeFieldsQueryNoSchema()
void	testStarQueryNoSchema() Test log queries without a defined schema using select *
void	testTableFunction() Test the ability to use table functions to specify the regex.
void	testTableFunctionNoGroups() Test the use of a table function to provide the regex.
void	testTableFunctionWithConfigAndSchema() Test that a schema can be provided in a table function that also includes plugin config.
void	testTableFunctionWithSchema() Test the use of the schema table function to provide a schema including types.
void	testUMNoSchema()
void	testWildcard()
void	testWildcardLargeFile() Tests for no crashes; does not validate results, unfortunately.

Methods inherited from class org.apache.drill.test.ClusterTest

getFile, queryBuilder, run, runAndLog, runAndPrint, runAndPrint, shutdown, startCluster, testBuilder

Methods inherited from class org.apache.drill.test.DrillTest

escapeJsonString, finishDrillTest, initDrillTest

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DATE_ONLY_PATTERN

public static final String DATE_ONLY_PATTERN

See Also:

Constant Field Values

dirTestWatcher

public static final BaseDirTestWatcher dirTestWatcher

schemaAndConfigDir

protected static File schemaAndConfigDir

schemaOnlyDir

protected static File schemaOnlyDir

Constructor Detail

TestLogReader

public TestLogReader()

Method Detail

setup

public static void setup()
                  throws Exception

Throws:

Exception

testWildcard

public void testWildcard()
                  throws RpcException

Throws:

RpcException

testWildcardLargeFile

public void testWildcardLargeFile()
                           throws RpcException

Tests for no crashes; does not validate results, unfortunately.

Throws:

RpcException

testExplicitProject

public void testExplicitProject()
                         throws RpcException

Throws:

RpcException

testMissingColumns

public void testMissingColumns()
                        throws RpcException

Throws:

RpcException

testRaw

public void testRaw()
             throws RpcException

Throws:

RpcException

testDate

public void testDate()
              throws RpcException

Throws:

RpcException

testCount

public void testCount()
               throws RpcException

Throws:

RpcException

testFull

public void testFull()
              throws RpcException

Throws:

RpcException

testStarQueryNoSchema

public void testStarQueryNoSchema()
                           throws RpcException

Test log queries without a defined schema using select *

Throws:

RpcException

testSomeFieldsQueryNoSchema

public void testSomeFieldsQueryNoSchema()
                                 throws RpcException

Throws:

RpcException

testRawNoSchema

public void testRawNoSchema()
                     throws RpcException

Throws:

RpcException

testUMNoSchema

public void testUMNoSchema()
                    throws RpcException

Throws:

RpcException

testRawUMNoSchema

public void testRawUMNoSchema()
                       throws RpcException

Throws:

RpcException

testProvidedSchema

public void testProvidedSchema()
                        throws Exception

Throws:

Exception

testSchemaOnlyNoCols

public void testSchemaOnlyNoCols()
                          throws Exception

Test the case in which the plugin config contains no information other than the file extensions. The regex is provided by the provided schema, but no columns are defined, so we use the columns[] array.

Throws:

Exception

testSchemaOnlyWithCols

public void testSchemaOnlyWithCols()
                            throws Exception

Test the case in which the plugin config contains no information other than the file extensions. The provided schema includes both the regex and the set of columns and types.

Throws:

Exception

testSchemaOnlyWithMissingCols

public void testSchemaOnlyWithMissingCols()
                                   throws Exception

Corner case: provided schema has the regex and two of the three columns, the third takes a default name and type.

Throws:

Exception

testEmptyPattern

public void testEmptyPattern()
                      throws Exception

Verify that an error is thrown if no pattern is provided in the plugin config, table function or provided schema.

Throws:

Exception

testTableFunction

public void testTableFunction()
                       throws Exception

Test the ability to use table functions to specify the regex.

Throws:

Exception

testTableFunctionNoGroups

public void testTableFunctionNoGroups()
                               throws Exception

Test the use of a table function to provide the regex. Verify that the plugin throws an error if no groups are defined.

Throws:

Exception

testTableFunctionWithSchema

public void testTableFunctionWithSchema()
                                 throws Exception

Test the use of the schema table function to provide a schema including types. In this form, the regex must be provided by the plugin config or (as in this test), as table properties.

Throws:

Exception

testTableFunctionWithConfigAndSchema

public void testTableFunctionWithConfigAndSchema()
                                          throws Exception

Test that a schema can be provided in a table function that also includes plugin config. This case fails for the log format plugin because, unfortunately, the log format plugin has a config field called "schema" which is not a string and is found by the code before trying to treat "schema" as a schema. So, this test is disabled.

Throws:

Exception

testPluginSerialization

public void testPluginSerialization()
                             throws IOException

The config classes for this plugin have been trick to get right. The following ensures that the plugin config works correctly to serialize/deserialize values.

Throws:

IOException

testFirewallSchema

public void testFirewallSchema()
                        throws RpcException

Throws:

RpcException