Uses of Class
org.apache.drill.exec.store.dfs.DrillFileSystem
Package
Description
Meta-data persistence format, used for views and other cluster-wide
persistent state.
Handles optional file metadata columns: implicit columns and
partition columns.
-
Uses of DrillFileSystem in org.apache.drill.exec.dotdrill
Modifier and TypeMethodDescriptionstatic DotDrillFile
DotDrillFile.create
(DrillFileSystem fs, org.apache.hadoop.fs.FileStatus status) static List<DotDrillFile>
DotDrillUtil.getDotDrills
(DrillFileSystem fs, org.apache.hadoop.fs.Path root, String name, DotDrillType... types) Return list of DotDrillFile objects whose file name matches the provided name pattern and Drill Dot files types in a given parent Path.static List<DotDrillFile>
DotDrillUtil.getDotDrills
(DrillFileSystem fs, org.apache.hadoop.fs.Path root, DotDrillType... types) Return list of DotDrillFile objects whose file name ends with .drill and matches the provided Drill Dot files types in a given parent Path. -
Uses of DrillFileSystem in org.apache.drill.exec.metastore.analyze
Modifier and TypeMethodDescriptionstatic List<org.apache.hadoop.fs.FileStatus>
FileMetadataInfoCollector.getFileStatuses
(FileSelection fileSelection, DrillFileSystem fs) Returns list ofFileStatus
file statuses obtained from specifiedFileSelection
file selection. -
Uses of DrillFileSystem in org.apache.drill.exec.metastore.store
Modifier and TypeMethodDescriptionFileTableMetadataProviderBuilder.withFileSystem
(DrillFileSystem fs) MetastoreFileTableMetadataProvider.Builder.withFileSystem
(DrillFileSystem fs) SimpleFileTableMetadataProvider.Builder.withFileSystem
(DrillFileSystem fs) -
Uses of DrillFileSystem in org.apache.drill.exec.metastore.store.parquet
Modifier and TypeMethodDescriptionboolean
ParquetTableMetadataProviderImpl.fileExists
(DrillFileSystem fs, List<org.apache.hadoop.fs.Path> paths) List<org.apache.hadoop.fs.Path>
ParquetTableMetadataProviderImpl.populateMetaPaths
(org.apache.hadoop.fs.Path p, DrillFileSystem fs) Returns list of metadata cache filesMetastoreParquetTableMetadataProvider.Builder.withFileSystem
(DrillFileSystem fs) ParquetTableMetadataProviderImpl.Builder.withFileSystem
(DrillFileSystem fs) -
Uses of DrillFileSystem in org.apache.drill.exec.ops
Modifier and TypeMethodDescriptionBaseOperatorContext.newFileSystem
(org.apache.hadoop.conf.Configuration conf) Creates DrillFileSystem that automatically tracks operator stats.OperatorContext.newFileSystem
(org.apache.hadoop.conf.Configuration conf) BaseOperatorContext.newNonTrackingFileSystem
(org.apache.hadoop.conf.Configuration conf) Creates a DrillFileSystem that does not automatically track operator stats.OperatorContext.newNonTrackingFileSystem
(org.apache.hadoop.conf.Configuration conf) -
Uses of DrillFileSystem in org.apache.drill.exec.physical.impl.scan.file
Modifier and TypeMethodDescriptionFileScanFramework.FileSchemaNegotiator.fileSystem()
Gives the Drill file system for this operator.FileScanFramework.FileSchemaNegotiatorImpl.fileSystem()
FileScanFramework.fileSystem()
-
Uses of DrillFileSystem in org.apache.drill.exec.physical.impl.scan.v3.file
Modifier and TypeFieldDescriptionprotected DrillFileSystem
ImplicitColumnResolver.ImplicitColumnOptions.dfs
Modifier and TypeMethodDescriptionFileDescrip.fileSystem()
Gives the Drill file system for this operator.FileScanLifecycle.fileSystem()
Modifier and TypeMethodDescriptionImplicitColumnResolver.ImplicitColumnOptions.dfs
(DrillFileSystem dfs) ModifierConstructorDescriptionFileDescrip
(DrillFileSystem dfs, FileWork fileWork, org.apache.hadoop.fs.Path selectionRoot) ImplicitFileColumnsHandler
(DrillFileSystem dfs, OptionSet options, FileScanLifecycleBuilder scanOptions, ResultVectorCache vectorCache, ScanSchemaTracker schemaTracker) -
Uses of DrillFileSystem in org.apache.drill.exec.store.delta.format
Modifier and TypeMethodDescriptionboolean
DeltaFormatMatcher.isFileReadable
(DrillFileSystem fs, org.apache.hadoop.fs.FileStatus status) DeltaFormatMatcher.isReadable
(DrillFileSystem fs, FileSelection selection, FileSystemPlugin fsPlugin, String storageEngineName, SchemaConfig schemaConfig) -
Uses of DrillFileSystem in org.apache.drill.exec.store.delta.read
Modifier and TypeMethodDescriptionDeltaScanBatchCreator.getImplicitValues
(AbstractParquetRowGroupScan rowGroupScan, ColumnExplorer columnExplorer, RowGroupReadEntry rowGroup, DrillFileSystem fs) -
Uses of DrillFileSystem in org.apache.drill.exec.store.dfs
Modifier and TypeMethodDescriptionboolean
WorkspaceSchemaFactory.accessible
(DrillFileSystem fs) Checks whether a FileSystem object has the permission to list/read workspace directoryboolean
FileSelection.containsDirectories
(DrillFileSystem fs) static FileSelection
FileSelection.create
(DrillFileSystem fs, String parent, String path, boolean allowAccessOutsideWorkspace) WorkspaceSchemaFactory.createSchema
(List<String> parentSchemaPath, SchemaConfig schemaConfig, DrillFileSystem fs) org.apache.hadoop.fs.FileStatus
FileSelection.getFirstPath
(DrillFileSystem fs) List<org.apache.hadoop.fs.FileStatus>
FileSelection.getStatuses
(DrillFileSystem fs) boolean
BasicFormatMatcher.isFileReadable
(DrillFileSystem fs, org.apache.hadoop.fs.FileStatus status) Function returns true if the file extension matches the pattern.abstract boolean
FormatMatcher.isFileReadable
(DrillFileSystem fs, org.apache.hadoop.fs.FileStatus status) BasicFormatMatcher.isReadable
(DrillFileSystem fs, FileSelection selection, FileSystemPlugin fsPlugin, String storageEngineName, SchemaConfig schemaConfig) abstract DrillTable
FormatMatcher.isReadable
(DrillFileSystem fs, FileSelection selection, FileSystemPlugin fsPlugin, String storageEngineName, SchemaConfig schemaConfig) FileSelection.minusDirectories
(DrillFileSystem fs) FileSelection.selectAnyFile
(DrillFileSystem fs) ModifierConstructorDescriptionWorkspaceSchema
(List<String> parentSchemaPath, String wsName, SchemaConfig schemaConfig, DrillFileSystem fs, WorkspaceConfig config) -
Uses of DrillFileSystem in org.apache.drill.exec.store.dfs.easy
Modifier and TypeMethodDescriptionEasyFormatPlugin.getRecordReader
(FragmentContext context, DrillFileSystem dfs, FileWork fileWork, List<SchemaPath> columns, String userName) Return a record reader for the specific file format, when using the originalScanBatch
scanner. -
Uses of DrillFileSystem in org.apache.drill.exec.store.easy.json
Modifier and TypeMethodDescriptionJSONFormatPlugin.getRecordReader
(FragmentContext context, DrillFileSystem dfs, FileWork fileWork, List<SchemaPath> columns, String userName) ModifierConstructorDescriptionJSONRecordReader
(FragmentContext fragmentContext, com.fasterxml.jackson.databind.JsonNode embeddedContent, DrillFileSystem fileSystem, List<SchemaPath> columns) Deprecated.Create a new JSON Record Reader that uses an in memory materialized JSON stream.JSONRecordReader
(FragmentContext fragmentContext, org.apache.hadoop.fs.Path inputPath, DrillFileSystem fileSystem, List<SchemaPath> columns, JSONFormatConfig config) Deprecated.Create a JSON Record Reader that uses a file based input stream. -
Uses of DrillFileSystem in org.apache.drill.exec.store.iceberg.format
Modifier and TypeMethodDescriptionboolean
IcebergFormatMatcher.isFileReadable
(DrillFileSystem fs, org.apache.hadoop.fs.FileStatus status) IcebergFormatMatcher.isReadable
(DrillFileSystem fs, FileSelection selection, FileSystemPlugin fsPlugin, String storageEngineName, SchemaConfig schemaConfig) -
Uses of DrillFileSystem in org.apache.drill.exec.store.parquet
Modifier and TypeMethodDescriptionprotected abstract DrillFileSystem
AbstractParquetScanBatchCreator.AbstractDrillFileSystemManager.get
(org.apache.hadoop.conf.Configuration config, org.apache.hadoop.fs.Path path) protected DrillFileSystem
ParquetScanBatchCreator.ParquetDrillFileSystemManager.get
(org.apache.hadoop.conf.Configuration config, org.apache.hadoop.fs.Path path) Modifier and TypeMethodDescriptionAbstractParquetScanBatchCreator.getImplicitValues
(AbstractParquetRowGroupScan rowGroupScan, ColumnExplorer columnExplorer, RowGroupReadEntry rowGroup, DrillFileSystem fs) -
Uses of DrillFileSystem in org.apache.drill.exec.store.parquet2
ModifierConstructorDescriptionDrillParquetReader
(FragmentContext fragmentContext, org.apache.parquet.hadoop.metadata.ParquetMetadata footer, RowGroupReadEntry entry, List<SchemaPath> columns, DrillFileSystem fileSystem, ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates, long recordsToRead) -
Uses of DrillFileSystem in org.apache.drill.exec.store.sys.store
Modifier and TypeMethodDescriptionstatic DrillFileSystem
LocalPersistentStore.getFileSystem
(DrillConfig config, org.apache.hadoop.fs.Path root) ModifierConstructorDescriptionLocalPersistentStore
(DrillFileSystem fs, org.apache.hadoop.fs.Path base, PersistentStoreConfig<V> config) -
Uses of DrillFileSystem in org.apache.drill.exec.util
Modifier and TypeMethodDescriptionstatic DrillFileSystem
ImpersonationUtil.createFileSystem
(String proxyUserName, org.apache.hadoop.conf.Configuration fsConf) Create DrillFileSystem for given proxyUserName and configuration.