| Modifier and Type | Method and Description |
|---|---|
static DotDrillFile |
DotDrillFile.create(DrillFileSystem fs,
org.apache.hadoop.fs.FileStatus status) |
static List<DotDrillFile> |
DotDrillUtil.getDotDrills(DrillFileSystem fs,
org.apache.hadoop.fs.Path root,
DotDrillType... types)
Return list of DotDrillFile objects whose file name ends with .drill and matches the provided Drill Dot files types
in a given parent Path.
|
static List<DotDrillFile> |
DotDrillUtil.getDotDrills(DrillFileSystem fs,
org.apache.hadoop.fs.Path root,
String name,
DotDrillType... types)
Return list of DotDrillFile objects whose file name matches the provided name pattern and Drill Dot files types
in a given parent Path.
|
| Modifier and Type | Method and Description |
|---|---|
static List<org.apache.hadoop.fs.FileStatus> |
FileMetadataInfoCollector.getFileStatuses(FileSelection fileSelection,
DrillFileSystem fs)
Returns list of
FileStatus file statuses obtained from specified FileSelection file selection. |
| Modifier and Type | Method and Description |
|---|---|
DrillFileSystem |
MetastoreFileTableMetadataProvider.Builder.fs() |
| Modifier and Type | Method and Description |
|---|---|
SimpleFileTableMetadataProvider.Builder |
SimpleFileTableMetadataProvider.Builder.withFileSystem(DrillFileSystem fs) |
T |
FileTableMetadataProviderBuilder.withFileSystem(DrillFileSystem fs) |
T |
MetastoreFileTableMetadataProvider.Builder.withFileSystem(DrillFileSystem fs) |
| Modifier and Type | Method and Description |
|---|---|
boolean |
ParquetTableMetadataProviderImpl.fileExists(DrillFileSystem fs,
List<org.apache.hadoop.fs.Path> paths) |
List<org.apache.hadoop.fs.Path> |
ParquetTableMetadataProviderImpl.populateMetaPaths(org.apache.hadoop.fs.Path p,
DrillFileSystem fs)
Returns list of metadata cache files
|
ParquetTableMetadataProviderImpl.Builder |
ParquetTableMetadataProviderImpl.Builder.withFileSystem(DrillFileSystem fs) |
MetastoreParquetTableMetadataProvider.Builder |
MetastoreParquetTableMetadataProvider.Builder.withFileSystem(DrillFileSystem fs) |
| Modifier and Type | Method and Description |
|---|---|
DrillFileSystem |
OperatorContext.newFileSystem(org.apache.hadoop.conf.Configuration conf) |
DrillFileSystem |
BaseOperatorContext.newFileSystem(org.apache.hadoop.conf.Configuration conf)
Creates DrillFileSystem that automatically tracks operator stats.
|
DrillFileSystem |
OperatorContext.newNonTrackingFileSystem(org.apache.hadoop.conf.Configuration conf) |
DrillFileSystem |
BaseOperatorContext.newNonTrackingFileSystem(org.apache.hadoop.conf.Configuration conf)
Creates a DrillFileSystem that does not automatically track operator stats.
|
| Modifier and Type | Method and Description |
|---|---|
DrillFileSystem |
FileScanFramework.fileSystem() |
DrillFileSystem |
FileScanFramework.FileSchemaNegotiator.fileSystem()
Gives the Drill file system for this operator.
|
DrillFileSystem |
FileScanFramework.FileSchemaNegotiatorImpl.fileSystem() |
| Modifier and Type | Field and Description |
|---|---|
protected DrillFileSystem |
ImplicitColumnResolver.ImplicitColumnOptions.dfs |
| Modifier and Type | Method and Description |
|---|---|
DrillFileSystem |
FileScanLifecycle.fileSystem() |
DrillFileSystem |
FileDescrip.fileSystem()
Gives the Drill file system for this operator.
|
| Modifier and Type | Method and Description |
|---|---|
ImplicitColumnResolver.ImplicitColumnOptions |
ImplicitColumnResolver.ImplicitColumnOptions.dfs(DrillFileSystem dfs) |
| Constructor and Description |
|---|
FileDescrip(DrillFileSystem dfs,
FileWork fileWork,
org.apache.hadoop.fs.Path selectionRoot) |
ImplicitFileColumnsHandler(DrillFileSystem dfs,
OptionSet options,
FileScanLifecycleBuilder scanOptions,
ResultVectorCache vectorCache,
ScanSchemaTracker schemaTracker) |
| Modifier and Type | Field and Description |
|---|---|
protected static DrillFileSystem |
TestMiniPlan.fs |
protected static DrillFileSystem |
TestNullInputMiniPlan.fs |
| Modifier and Type | Method and Description |
|---|---|
T |
MiniPlanUnitTestBase.ScanPopBuider.fileSystem(DrillFileSystem fs) |
| Modifier and Type | Method and Description |
|---|---|
DrillFileSystem |
WorkspaceSchemaFactory.WorkspaceSchema.getFS() |
| Modifier and Type | Method and Description |
|---|---|
boolean |
WorkspaceSchemaFactory.accessible(DrillFileSystem fs)
Checks whether a FileSystem object has the permission to list/read workspace directory
|
boolean |
FileSelection.containsDirectories(DrillFileSystem fs) |
static FileSelection |
FileSelection.create(DrillFileSystem fs,
String parent,
String path,
boolean allowAccessOutsideWorkspace) |
WorkspaceSchemaFactory.WorkspaceSchema |
WorkspaceSchemaFactory.createSchema(List<String> parentSchemaPath,
SchemaConfig schemaConfig,
DrillFileSystem fs) |
org.apache.hadoop.fs.FileStatus |
FileSelection.getFirstPath(DrillFileSystem fs) |
List<org.apache.hadoop.fs.FileStatus> |
FileSelection.getStatuses(DrillFileSystem fs) |
boolean |
BasicFormatMatcher.isFileReadable(DrillFileSystem fs,
org.apache.hadoop.fs.FileStatus status)
Function returns true if the file extension matches the pattern.
|
abstract boolean |
FormatMatcher.isFileReadable(DrillFileSystem fs,
org.apache.hadoop.fs.FileStatus status) |
DrillTable |
BasicFormatMatcher.isReadable(DrillFileSystem fs,
FileSelection selection,
FileSystemPlugin fsPlugin,
String storageEngineName,
SchemaConfig schemaConfig) |
abstract DrillTable |
FormatMatcher.isReadable(DrillFileSystem fs,
FileSelection selection,
FileSystemPlugin fsPlugin,
String storageEngineName,
SchemaConfig schemaConfig) |
FileSelection |
FileSelection.minusDirectories(DrillFileSystem fs) |
| Constructor and Description |
|---|
WorkspaceSchema(List<String> parentSchemaPath,
String wsName,
SchemaConfig schemaConfig,
DrillFileSystem fs) |
| Modifier and Type | Method and Description |
|---|---|
RecordReader |
EasyFormatPlugin.getRecordReader(FragmentContext context,
DrillFileSystem dfs,
FileWork fileWork,
List<SchemaPath> columns,
String userName)
Return a record reader for the specific file format, when using the original
ScanBatch scanner. |
| Modifier and Type | Method and Description |
|---|---|
RecordReader |
JSONFormatPlugin.getRecordReader(FragmentContext context,
DrillFileSystem dfs,
FileWork fileWork,
List<SchemaPath> columns,
String userName) |
| Constructor and Description |
|---|
JSONRecordReader(FragmentContext fragmentContext,
com.fasterxml.jackson.databind.JsonNode embeddedContent,
DrillFileSystem fileSystem,
List<SchemaPath> columns)
Create a new JSON Record Reader that uses a in memory materialized JSON stream.
|
JSONRecordReader(FragmentContext fragmentContext,
org.apache.hadoop.fs.Path inputPath,
DrillFileSystem fileSystem,
List<SchemaPath> columns)
Create a JSON Record Reader that uses a file based input stream.
|
| Modifier and Type | Method and Description |
|---|---|
RecordReader |
LTSVFormatPlugin.getRecordReader(FragmentContext context,
DrillFileSystem dfs,
FileWork fileWork,
List<SchemaPath> columns,
String userName) |
| Constructor and Description |
|---|
LTSVRecordReader(FragmentContext fragmentContext,
org.apache.hadoop.fs.Path path,
DrillFileSystem fileSystem,
List<SchemaPath> columns) |
| Modifier and Type | Method and Description |
|---|---|
boolean |
TableFormatMatcher.isFileReadable(DrillFileSystem fs,
org.apache.hadoop.fs.FileStatus status) |
DrillTable |
TableFormatMatcher.isReadable(DrillFileSystem fs,
FileSelection selection,
FileSystemPlugin fsPlugin,
String storageEngineName,
SchemaConfig schemaConfig) |
| Modifier and Type | Method and Description |
|---|---|
DrillTable |
MapRDBFormatMatcher.isReadable(DrillFileSystem fs,
FileSelection selection,
FileSystemPlugin fsPlugin,
String storageEngineName,
SchemaConfig schemaConfig) |
DrillTable |
MapRDBFormatMatcher.isReadableIndex(DrillFileSystem fs,
FileSelection selection,
FileSystemPlugin fsPlugin,
String storageEngineName,
String userName,
IndexDescriptor secondaryIndexDesc)
Get an instance of DrillTable for a particular native secondary index
|
| Modifier and Type | Method and Description |
|---|---|
protected abstract DrillFileSystem |
AbstractParquetScanBatchCreator.AbstractDrillFileSystemManager.get(org.apache.hadoop.conf.Configuration config,
org.apache.hadoop.fs.Path path) |
| Constructor and Description |
|---|
DrillParquetReader(FragmentContext fragmentContext,
org.apache.parquet.hadoop.metadata.ParquetMetadata footer,
RowGroupReadEntry entry,
List<SchemaPath> columns,
DrillFileSystem fileSystem,
ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates,
long recordsToRead) |
| Modifier and Type | Method and Description |
|---|---|
static DrillFileSystem |
LocalPersistentStore.getFileSystem(DrillConfig config,
org.apache.hadoop.fs.Path root) |
| Constructor and Description |
|---|
LocalPersistentStore(DrillFileSystem fs,
org.apache.hadoop.fs.Path base,
PersistentStoreConfig<V> config) |
| Modifier and Type | Method and Description |
|---|---|
static DrillFileSystem |
ImpersonationUtil.createFileSystem(String proxyUserName,
org.apache.hadoop.conf.Configuration fsConf)
Create DrillFileSystem for given proxyUserName and configuration.
|
| Modifier and Type | Method and Description |
|---|---|
static Iterator<RecordReader> |
PhysicalOpUnitTestBase.getJsonReadersFromInputFiles(DrillFileSystem fs,
List<org.apache.hadoop.fs.Path> inputPaths,
FragmentContext fragContext,
List<SchemaPath> columnsToRead)
Create JSONRecordReader from files on a file system.
|
Copyright © 2021 The Apache Software Foundation. All rights reserved.