Uses of Class
org.apache.drill.exec.store.dfs.DrillFileSystem
Packages that use DrillFileSystem
Package
Description
Meta-data persistence format, used for views and other cluster-wide
persistent state.
Handles optional file metadata columns: implicit columns and
partition columns.
-
Uses of DrillFileSystem in org.apache.drill.exec.dotdrill
Methods in org.apache.drill.exec.dotdrill with parameters of type DrillFileSystemModifier and TypeMethodDescriptionstatic DotDrillFile
DotDrillFile.create
(DrillFileSystem fs, org.apache.hadoop.fs.FileStatus status) static List<DotDrillFile>
DotDrillUtil.getDotDrills
(DrillFileSystem fs, org.apache.hadoop.fs.Path root, String name, DotDrillType... types) Return list of DotDrillFile objects whose file name matches the provided name pattern and Drill Dot files types in a given parent Path.static List<DotDrillFile>
DotDrillUtil.getDotDrills
(DrillFileSystem fs, org.apache.hadoop.fs.Path root, DotDrillType... types) Return list of DotDrillFile objects whose file name ends with .drill and matches the provided Drill Dot files types in a given parent Path. -
Uses of DrillFileSystem in org.apache.drill.exec.metastore.analyze
Methods in org.apache.drill.exec.metastore.analyze with parameters of type DrillFileSystemModifier and TypeMethodDescriptionstatic List<org.apache.hadoop.fs.FileStatus>
FileMetadataInfoCollector.getFileStatuses
(FileSelection fileSelection, DrillFileSystem fs) Returns list ofFileStatus
file statuses obtained from specifiedFileSelection
file selection. -
Uses of DrillFileSystem in org.apache.drill.exec.metastore.store
Methods in org.apache.drill.exec.metastore.store that return DrillFileSystemMethods in org.apache.drill.exec.metastore.store with parameters of type DrillFileSystemModifier and TypeMethodDescriptionFileTableMetadataProviderBuilder.withFileSystem
(DrillFileSystem fs) MetastoreFileTableMetadataProvider.Builder.withFileSystem
(DrillFileSystem fs) SimpleFileTableMetadataProvider.Builder.withFileSystem
(DrillFileSystem fs) -
Uses of DrillFileSystem in org.apache.drill.exec.metastore.store.parquet
Methods in org.apache.drill.exec.metastore.store.parquet with parameters of type DrillFileSystemModifier and TypeMethodDescriptionboolean
ParquetTableMetadataProviderImpl.fileExists
(DrillFileSystem fs, List<org.apache.hadoop.fs.Path> paths) List<org.apache.hadoop.fs.Path>
ParquetTableMetadataProviderImpl.populateMetaPaths
(org.apache.hadoop.fs.Path p, DrillFileSystem fs) Returns list of metadata cache filesMetastoreParquetTableMetadataProvider.Builder.withFileSystem
(DrillFileSystem fs) ParquetTableMetadataProviderImpl.Builder.withFileSystem
(DrillFileSystem fs) -
Uses of DrillFileSystem in org.apache.drill.exec.ops
Methods in org.apache.drill.exec.ops that return DrillFileSystemModifier and TypeMethodDescriptionBaseOperatorContext.newFileSystem
(org.apache.hadoop.conf.Configuration conf) Creates DrillFileSystem that automatically tracks operator stats.OperatorContext.newFileSystem
(org.apache.hadoop.conf.Configuration conf) BaseOperatorContext.newNonTrackingFileSystem
(org.apache.hadoop.conf.Configuration conf) Creates a DrillFileSystem that does not automatically track operator stats.OperatorContext.newNonTrackingFileSystem
(org.apache.hadoop.conf.Configuration conf) -
Uses of DrillFileSystem in org.apache.drill.exec.physical.impl.scan.file
Methods in org.apache.drill.exec.physical.impl.scan.file that return DrillFileSystemModifier and TypeMethodDescriptionFileScanFramework.FileSchemaNegotiator.fileSystem()
Gives the Drill file system for this operator.FileScanFramework.FileSchemaNegotiatorImpl.fileSystem()
FileScanFramework.fileSystem()
-
Uses of DrillFileSystem in org.apache.drill.exec.physical.impl.scan.v3.file
Fields in org.apache.drill.exec.physical.impl.scan.v3.file declared as DrillFileSystemModifier and TypeFieldDescriptionprotected DrillFileSystem
ImplicitColumnResolver.ImplicitColumnOptions.dfs
Methods in org.apache.drill.exec.physical.impl.scan.v3.file that return DrillFileSystemModifier and TypeMethodDescriptionFileDescrip.fileSystem()
Gives the Drill file system for this operator.FileScanLifecycle.fileSystem()
Methods in org.apache.drill.exec.physical.impl.scan.v3.file with parameters of type DrillFileSystemModifier and TypeMethodDescriptionImplicitColumnResolver.ImplicitColumnOptions.dfs
(DrillFileSystem dfs) Constructors in org.apache.drill.exec.physical.impl.scan.v3.file with parameters of type DrillFileSystemModifierConstructorDescriptionFileDescrip
(DrillFileSystem dfs, FileWork fileWork, org.apache.hadoop.fs.Path selectionRoot) ImplicitFileColumnsHandler
(DrillFileSystem dfs, OptionSet options, FileScanLifecycleBuilder scanOptions, ResultVectorCache vectorCache, ScanSchemaTracker schemaTracker) -
Uses of DrillFileSystem in org.apache.drill.exec.store.delta.format
Methods in org.apache.drill.exec.store.delta.format with parameters of type DrillFileSystemModifier and TypeMethodDescriptionboolean
DeltaFormatMatcher.isFileReadable
(DrillFileSystem fs, org.apache.hadoop.fs.FileStatus status) DeltaFormatMatcher.isReadable
(DrillFileSystem fs, FileSelection selection, FileSystemPlugin fsPlugin, String storageEngineName, SchemaConfig schemaConfig) -
Uses of DrillFileSystem in org.apache.drill.exec.store.delta.read
Methods in org.apache.drill.exec.store.delta.read with parameters of type DrillFileSystemModifier and TypeMethodDescriptionDeltaScanBatchCreator.getImplicitValues
(AbstractParquetRowGroupScan rowGroupScan, ColumnExplorer columnExplorer, RowGroupReadEntry rowGroup, DrillFileSystem fs) -
Uses of DrillFileSystem in org.apache.drill.exec.store.dfs
Methods in org.apache.drill.exec.store.dfs that return DrillFileSystemMethods in org.apache.drill.exec.store.dfs with parameters of type DrillFileSystemModifier and TypeMethodDescriptionboolean
WorkspaceSchemaFactory.accessible
(DrillFileSystem fs) Checks whether a FileSystem object has the permission to list/read workspace directoryboolean
FileSelection.containsDirectories
(DrillFileSystem fs) static FileSelection
FileSelection.create
(DrillFileSystem fs, String parent, String path, boolean allowAccessOutsideWorkspace) WorkspaceSchemaFactory.createSchema
(List<String> parentSchemaPath, SchemaConfig schemaConfig, DrillFileSystem fs) org.apache.hadoop.fs.FileStatus
FileSelection.getFirstPath
(DrillFileSystem fs) List<org.apache.hadoop.fs.FileStatus>
FileSelection.getStatuses
(DrillFileSystem fs) boolean
BasicFormatMatcher.isFileReadable
(DrillFileSystem fs, org.apache.hadoop.fs.FileStatus status) Function returns true if the file extension matches the pattern.abstract boolean
FormatMatcher.isFileReadable
(DrillFileSystem fs, org.apache.hadoop.fs.FileStatus status) BasicFormatMatcher.isReadable
(DrillFileSystem fs, FileSelection selection, FileSystemPlugin fsPlugin, String storageEngineName, SchemaConfig schemaConfig) abstract DrillTable
FormatMatcher.isReadable
(DrillFileSystem fs, FileSelection selection, FileSystemPlugin fsPlugin, String storageEngineName, SchemaConfig schemaConfig) FileSelection.minusDirectories
(DrillFileSystem fs) FileSelection.selectAnyFile
(DrillFileSystem fs) Constructors in org.apache.drill.exec.store.dfs with parameters of type DrillFileSystemModifierConstructorDescriptionWorkspaceSchema
(List<String> parentSchemaPath, String wsName, SchemaConfig schemaConfig, DrillFileSystem fs, WorkspaceConfig config) -
Uses of DrillFileSystem in org.apache.drill.exec.store.dfs.easy
Methods in org.apache.drill.exec.store.dfs.easy with parameters of type DrillFileSystemModifier and TypeMethodDescriptionEasyFormatPlugin.getRecordReader
(FragmentContext context, DrillFileSystem dfs, FileWork fileWork, List<SchemaPath> columns, String userName) Return a record reader for the specific file format, when using the originalScanBatch
scanner. -
Uses of DrillFileSystem in org.apache.drill.exec.store.easy.json
Methods in org.apache.drill.exec.store.easy.json with parameters of type DrillFileSystemModifier and TypeMethodDescriptionJSONFormatPlugin.getRecordReader
(FragmentContext context, DrillFileSystem dfs, FileWork fileWork, List<SchemaPath> columns, String userName) Constructors in org.apache.drill.exec.store.easy.json with parameters of type DrillFileSystemModifierConstructorDescriptionJSONRecordReader
(FragmentContext fragmentContext, com.fasterxml.jackson.databind.JsonNode embeddedContent, DrillFileSystem fileSystem, List<SchemaPath> columns) Deprecated.Create a new JSON Record Reader that uses an in memory materialized JSON stream.JSONRecordReader
(FragmentContext fragmentContext, org.apache.hadoop.fs.Path inputPath, DrillFileSystem fileSystem, List<SchemaPath> columns, JSONFormatConfig config) Deprecated.Create a JSON Record Reader that uses a file based input stream. -
Uses of DrillFileSystem in org.apache.drill.exec.store.iceberg.format
Methods in org.apache.drill.exec.store.iceberg.format with parameters of type DrillFileSystemModifier and TypeMethodDescriptionboolean
IcebergFormatMatcher.isFileReadable
(DrillFileSystem fs, org.apache.hadoop.fs.FileStatus status) IcebergFormatMatcher.isReadable
(DrillFileSystem fs, FileSelection selection, FileSystemPlugin fsPlugin, String storageEngineName, SchemaConfig schemaConfig) -
Uses of DrillFileSystem in org.apache.drill.exec.store.parquet
Methods in org.apache.drill.exec.store.parquet that return DrillFileSystemModifier and TypeMethodDescriptionprotected abstract DrillFileSystem
AbstractParquetScanBatchCreator.AbstractDrillFileSystemManager.get
(org.apache.hadoop.conf.Configuration config, org.apache.hadoop.fs.Path path) protected DrillFileSystem
ParquetScanBatchCreator.ParquetDrillFileSystemManager.get
(org.apache.hadoop.conf.Configuration config, org.apache.hadoop.fs.Path path) Methods in org.apache.drill.exec.store.parquet with parameters of type DrillFileSystemModifier and TypeMethodDescriptionAbstractParquetScanBatchCreator.getImplicitValues
(AbstractParquetRowGroupScan rowGroupScan, ColumnExplorer columnExplorer, RowGroupReadEntry rowGroup, DrillFileSystem fs) -
Uses of DrillFileSystem in org.apache.drill.exec.store.parquet2
Constructors in org.apache.drill.exec.store.parquet2 with parameters of type DrillFileSystemModifierConstructorDescriptionDrillParquetReader
(FragmentContext fragmentContext, org.apache.parquet.hadoop.metadata.ParquetMetadata footer, RowGroupReadEntry entry, List<SchemaPath> columns, DrillFileSystem fileSystem, ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates, long recordsToRead) -
Uses of DrillFileSystem in org.apache.drill.exec.store.sys.store
Methods in org.apache.drill.exec.store.sys.store that return DrillFileSystemModifier and TypeMethodDescriptionstatic DrillFileSystem
LocalPersistentStore.getFileSystem
(DrillConfig config, org.apache.hadoop.fs.Path root) Constructors in org.apache.drill.exec.store.sys.store with parameters of type DrillFileSystemModifierConstructorDescriptionLocalPersistentStore
(DrillFileSystem fs, org.apache.hadoop.fs.Path base, PersistentStoreConfig<V> config) -
Uses of DrillFileSystem in org.apache.drill.exec.util
Methods in org.apache.drill.exec.util that return DrillFileSystemModifier and TypeMethodDescriptionstatic DrillFileSystem
ImpersonationUtil.createFileSystem
(String proxyUserName, org.apache.hadoop.conf.Configuration fsConf) Create DrillFileSystem for given proxyUserName and configuration.