org.apache.drill.exec.store.dfs

Class DrillFileSystem

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.fs.FileSystem

org.apache.drill.exec.store.dfs.DrillFileSystem

All Implemented Interfaces:

Closeable, AutoCloseable, OpenFileTracker, org.apache.hadoop.conf.Configurable, org.apache.hadoop.fs.PathCapabilities, org.apache.hadoop.security.token.DelegationTokenIssuer

public class DrillFileSystem
extends org.apache.hadoop.fs.FileSystem
implements OpenFileTracker

DrillFileSystem is the wrapper around the actual FileSystem implementation. The DrillFileSystem is immutable. If OperatorStats are provided it returns an instrumented FSDataInputStream to measure IO wait time and tracking file open/close operations.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DrillFileSystem.DebugStackTrace

Nested classes/interfaces inherited from class org.apache.hadoop.fs.FileSystem

org.apache.hadoop.fs.FileSystem.DirectoryEntries, org.apache.hadoop.fs.FileSystem.DirListingIterator<T extends org.apache.hadoop.fs.FileStatus>, org.apache.hadoop.fs.FileSystem.Statistics

Field Summary

Fields

Modifier and Type	Field and Description
static String	DOT_PREFIX
static String	UNDERSCORE_PREFIX

Fields inherited from class org.apache.hadoop.fs.FileSystem

DEFAULT_FS, FS_DEFAULT_NAME_KEY, LOG, SHUTDOWN_HOOK_PRIORITY, statistics, TRASH_PREFIX, USER_HOME_PREFIX

Constructor Summary

Constructors

Constructor and Description
DrillFileSystem(org.apache.hadoop.conf.Configuration fsConf)
DrillFileSystem(org.apache.hadoop.conf.Configuration fsConf, OperatorStats operatorStats)

Method Summary

Modifier and Type	Method and Description
void	access(org.apache.hadoop.fs.Path path, org.apache.hadoop.fs.permission.FsAction mode)
org.apache.hadoop.security.token.Token<?>[]	addDelegationTokens(String renewer, org.apache.hadoop.security.Credentials credentials)
org.apache.hadoop.fs.FSDataOutputStream	append(org.apache.hadoop.fs.Path f)
org.apache.hadoop.fs.FSDataOutputStream	append(org.apache.hadoop.fs.Path f, int bufferSize)
org.apache.hadoop.fs.FSDataOutputStream	append(org.apache.hadoop.fs.Path f, int bufferSize, org.apache.hadoop.util.Progressable progress)
boolean	cancelDeleteOnExit(org.apache.hadoop.fs.Path f)
void	close()
void	completeLocalOutput(org.apache.hadoop.fs.Path fsOutputFile, org.apache.hadoop.fs.Path tmpLocalFile)
void	concat(org.apache.hadoop.fs.Path trg, org.apache.hadoop.fs.Path[] psrcs)
void	copyFromLocalFile(boolean delSrc, boolean overwrite, org.apache.hadoop.fs.Path[] srcs, org.apache.hadoop.fs.Path dst)
void	copyFromLocalFile(boolean delSrc, boolean overwrite, org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst)
void	copyFromLocalFile(boolean delSrc, org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst)
void	copyFromLocalFile(org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst)
void	copyToLocalFile(boolean delSrc, org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst)
void	copyToLocalFile(boolean delSrc, org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst, boolean useRawLocalFileSystem)
void	copyToLocalFile(org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst)
org.apache.hadoop.fs.FSDataOutputStream	create(org.apache.hadoop.fs.Path f)
org.apache.hadoop.fs.FSDataOutputStream	create(org.apache.hadoop.fs.Path f, boolean overwrite)
org.apache.hadoop.fs.FSDataOutputStream	create(org.apache.hadoop.fs.Path f, boolean overwrite, int bufferSize)
org.apache.hadoop.fs.FSDataOutputStream	create(org.apache.hadoop.fs.Path f, boolean overwrite, int bufferSize, org.apache.hadoop.util.Progressable progress)
org.apache.hadoop.fs.FSDataOutputStream	create(org.apache.hadoop.fs.Path f, boolean overwrite, int bufferSize, short replication, long blockSize)
org.apache.hadoop.fs.FSDataOutputStream	create(org.apache.hadoop.fs.Path f, boolean overwrite, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress)
org.apache.hadoop.fs.FSDataOutputStream	create(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, boolean overwrite, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress)
org.apache.hadoop.fs.FSDataOutputStream	create(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, EnumSet<org.apache.hadoop.fs.CreateFlag> flags, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress)
org.apache.hadoop.fs.FSDataOutputStream	create(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, EnumSet<org.apache.hadoop.fs.CreateFlag> flags, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress, org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt)
org.apache.hadoop.fs.FSDataOutputStream	create(org.apache.hadoop.fs.Path f, org.apache.hadoop.util.Progressable progress)
org.apache.hadoop.fs.FSDataOutputStream	create(org.apache.hadoop.fs.Path f, short replication)
org.apache.hadoop.fs.FSDataOutputStream	create(org.apache.hadoop.fs.Path f, short replication, org.apache.hadoop.util.Progressable progress)
boolean	createNewFile(org.apache.hadoop.fs.Path f)
org.apache.hadoop.fs.FSDataOutputStream	createNonRecursive(org.apache.hadoop.fs.Path f, boolean overwrite, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress) Deprecated.
org.apache.hadoop.fs.FSDataOutputStream	createNonRecursive(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, boolean overwrite, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress) Deprecated.
org.apache.hadoop.fs.FSDataOutputStream	createNonRecursive(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, EnumSet<org.apache.hadoop.fs.CreateFlag> flags, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress) Deprecated.
org.apache.hadoop.fs.Path	createSnapshot(org.apache.hadoop.fs.Path path, String snapshotName)
void	createSymlink(org.apache.hadoop.fs.Path target, org.apache.hadoop.fs.Path link, boolean createParent)
boolean	delete(org.apache.hadoop.fs.Path f) Deprecated.
boolean	delete(org.apache.hadoop.fs.Path f, boolean recursive)
boolean	deleteOnExit(org.apache.hadoop.fs.Path f)
void	deleteSnapshot(org.apache.hadoop.fs.Path path, String snapshotName)
boolean	exists(org.apache.hadoop.fs.Path f)
void	fileClosed(DrillFSDataInputStream fsDataInputStream) Remove the given DrillFSDataInputStream from opened file list.
void	fileOpened(org.apache.hadoop.fs.Path path, DrillFSDataInputStream fsDataInputStream) Add new file location and DrillFSDataInputStream to list.
org.apache.hadoop.fs.permission.AclStatus	getAclStatus(org.apache.hadoop.fs.Path path)
long	getBlockSize(org.apache.hadoop.fs.Path f) Deprecated.
String	getCanonicalServiceName()
org.apache.hadoop.fs.FileSystem[]	getChildFileSystems()
org.apache.hadoop.io.compress.CompressionCodec	getCodec(org.apache.hadoop.fs.Path path) Returns the CompressionCodec for a given file.
org.apache.hadoop.conf.Configuration	getConf() Returns a copy of Configuration for this DrillFileSystem.
org.apache.hadoop.fs.ContentSummary	getContentSummary(org.apache.hadoop.fs.Path f)
long	getDefaultBlockSize() Deprecated.
long	getDefaultBlockSize(org.apache.hadoop.fs.Path f)
short	getDefaultReplication() Deprecated.
short	getDefaultReplication(org.apache.hadoop.fs.Path path)
org.apache.hadoop.security.token.Token<?>	getDelegationToken(String renewer)
org.apache.hadoop.fs.BlockLocation[]	getFileBlockLocations(org.apache.hadoop.fs.FileStatus file, long start, long len)
org.apache.hadoop.fs.BlockLocation[]	getFileBlockLocations(org.apache.hadoop.fs.Path p, long start, long len)
org.apache.hadoop.fs.FileChecksum	getFileChecksum(org.apache.hadoop.fs.Path f)
org.apache.hadoop.fs.FileChecksum	getFileChecksum(org.apache.hadoop.fs.Path f, long length)
org.apache.hadoop.fs.FileStatus	getFileLinkStatus(org.apache.hadoop.fs.Path f)
org.apache.hadoop.fs.FileStatus	getFileStatus(org.apache.hadoop.fs.Path f)
org.apache.hadoop.fs.Path	getHomeDirectory()
long	getLength(org.apache.hadoop.fs.Path f) Deprecated.
org.apache.hadoop.fs.Path	getLinkTarget(org.apache.hadoop.fs.Path f)
String	getName() Deprecated.
short	getReplication(org.apache.hadoop.fs.Path src) Deprecated.
String	getScheme()
org.apache.hadoop.fs.FsServerDefaults	getServerDefaults() Deprecated.
org.apache.hadoop.fs.FsServerDefaults	getServerDefaults(org.apache.hadoop.fs.Path p)
org.apache.hadoop.fs.FsStatus	getStatus()
org.apache.hadoop.fs.FsStatus	getStatus(org.apache.hadoop.fs.Path p)
URI	getUri()
long	getUsed()
org.apache.hadoop.fs.Path	getWorkingDirectory()
byte[]	getXAttr(org.apache.hadoop.fs.Path path, String name)
Map<String,byte[]>	getXAttrs(org.apache.hadoop.fs.Path path)
Map<String,byte[]>	getXAttrs(org.apache.hadoop.fs.Path path, List<String> names)
org.apache.hadoop.fs.FileStatus[]	globStatus(org.apache.hadoop.fs.Path pathPattern)
org.apache.hadoop.fs.FileStatus[]	globStatus(org.apache.hadoop.fs.Path pathPattern, org.apache.hadoop.fs.PathFilter filter)
void	initialize(URI name, org.apache.hadoop.conf.Configuration conf) This method should never be used on DrillFileSystem since DrillFileSystem is immutable.
boolean	isDirectory(org.apache.hadoop.fs.Path f)
boolean	isFile(org.apache.hadoop.fs.Path f)
org.apache.hadoop.fs.RemoteIterator<org.apache.hadoop.fs.Path>	listCorruptFileBlocks(org.apache.hadoop.fs.Path path)
org.apache.hadoop.fs.RemoteIterator<org.apache.hadoop.fs.LocatedFileStatus>	listFiles(org.apache.hadoop.fs.Path f, boolean recursive)
org.apache.hadoop.fs.RemoteIterator<org.apache.hadoop.fs.LocatedFileStatus>	listLocatedStatus(org.apache.hadoop.fs.Path f)
org.apache.hadoop.fs.FileStatus[]	listStatus(org.apache.hadoop.fs.Path f)
org.apache.hadoop.fs.FileStatus[]	listStatus(org.apache.hadoop.fs.Path[] files)
org.apache.hadoop.fs.FileStatus[]	listStatus(org.apache.hadoop.fs.Path[] files, org.apache.hadoop.fs.PathFilter filter)
org.apache.hadoop.fs.FileStatus[]	listStatus(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.PathFilter filter)
org.apache.hadoop.fs.RemoteIterator<org.apache.hadoop.fs.FileStatus>	listStatusIterator(org.apache.hadoop.fs.Path p)
List<String>	listXAttrs(org.apache.hadoop.fs.Path path)
org.apache.hadoop.fs.Path	makeQualified(org.apache.hadoop.fs.Path path)
boolean	mkdirs(org.apache.hadoop.fs.Path folderPath)
boolean	mkdirs(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission)
void	modifyAclEntries(org.apache.hadoop.fs.Path path, List<org.apache.hadoop.fs.permission.AclEntry> aclSpec)
void	moveFromLocalFile(org.apache.hadoop.fs.Path[] srcs, org.apache.hadoop.fs.Path dst)
void	moveFromLocalFile(org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst)
void	moveToLocalFile(org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst)
org.apache.hadoop.fs.FSDataInputStream	open(org.apache.hadoop.fs.Path f) If OperatorStats are provided return a instrumented FSDataInputStream.
org.apache.hadoop.fs.FSDataInputStream	open(org.apache.hadoop.fs.Path f, int bufferSize) If OperatorStats are provided return a instrumented FSDataInputStream.
InputStream	openPossiblyCompressedStream(org.apache.hadoop.fs.Path path) Returns an InputStream from a Hadoop path.
void	removeAcl(org.apache.hadoop.fs.Path path)
void	removeAclEntries(org.apache.hadoop.fs.Path path, List<org.apache.hadoop.fs.permission.AclEntry> aclSpec)
void	removeDefaultAcl(org.apache.hadoop.fs.Path path)
void	removeXAttr(org.apache.hadoop.fs.Path path, String name)
boolean	rename(org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst)
void	renameSnapshot(org.apache.hadoop.fs.Path path, String snapshotOldName, String snapshotNewName)
org.apache.hadoop.fs.Path	resolvePath(org.apache.hadoop.fs.Path p)
void	setAcl(org.apache.hadoop.fs.Path path, List<org.apache.hadoop.fs.permission.AclEntry> aclSpec)
void	setConf(org.apache.hadoop.conf.Configuration conf) This method should never be used on DrillFileSystem since DrillFileSystem is immutable.
void	setOwner(org.apache.hadoop.fs.Path p, String username, String groupname)
void	setPermission(org.apache.hadoop.fs.Path p, org.apache.hadoop.fs.permission.FsPermission permission)
boolean	setReplication(org.apache.hadoop.fs.Path src, short replication)
void	setTimes(org.apache.hadoop.fs.Path p, long mtime, long atime)
void	setVerifyChecksum(boolean verifyChecksum) This method should never be used on DrillFileSystem since DrillFileSystem is immutable.
void	setWorkingDirectory(org.apache.hadoop.fs.Path new_dir) This method should never be used on DrillFileSystem since DrillFileSystem is immutable.
void	setWriteChecksum(boolean writeChecksum) This method should never be used on DrillFileSystem since DrillFileSystem is immutable.
void	setXAttr(org.apache.hadoop.fs.Path path, String name, byte[] value)
void	setXAttr(org.apache.hadoop.fs.Path path, String name, byte[] value, EnumSet<org.apache.hadoop.fs.XAttrSetFlag> flag)
org.apache.hadoop.fs.Path	startLocalOutput(org.apache.hadoop.fs.Path fsOutputFile, org.apache.hadoop.fs.Path tmpLocalFile)
boolean	supportsSymlinks()
boolean	truncate(org.apache.hadoop.fs.Path f, long newLength)

Methods inherited from class org.apache.hadoop.fs.FileSystem

appendFile, areSymlinksEnabled, canonicalizeUri, checkPath, clearStatistics, closeAll, closeAllForUGI, create, createFile, createPathHandle, createSnapshot, enableSymlinks, fixRelativePart, get, get, get, getAdditionalTokenIssuers, getAllStatistics, getAllStoragePolicies, getCanonicalUri, getDefaultPort, getDefaultUri, getFileSystemClass, getFSofPath, getGlobalStorageStatistics, getInitialWorkingDirectory, getLocal, getNamed, getPathHandle, getQuotaUsage, getStatistics, getStatistics, getStoragePolicy, getStorageStatistics, getTrashRoot, getTrashRoots, getUsed, hasPathCapability, listLocatedStatus, listStatusBatch, mkdirs, msync, newInstance, newInstance, newInstance, newInstanceLocal, open, open, primitiveCreate, primitiveMkdir, primitiveMkdir, printStatistics, processDeleteOnExit, rename, resolveLink, satisfyStoragePolicy, setDefaultUri, setDefaultUri, setQuota, setQuotaByStorageType, setStoragePolicy, unsetStoragePolicy

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.security.token.DelegationTokenIssuer

collectDelegationTokens

Field Detail

UNDERSCORE_PREFIX

public static final String UNDERSCORE_PREFIX

See Also:

Constant Field Values

DOT_PREFIX

public static final String DOT_PREFIX

See Also:

Constant Field Values

Constructor Detail

DrillFileSystem

public DrillFileSystem(org.apache.hadoop.conf.Configuration fsConf)
                throws IOException

Throws:

IOException

DrillFileSystem

public DrillFileSystem(org.apache.hadoop.conf.Configuration fsConf,
                       OperatorStats operatorStats)
                throws IOException

Throws:

IOException

Method Detail

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

This method should never be used on DrillFileSystem since DrillFileSystem is immutable.

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Overrides:

setConf in class org.apache.hadoop.conf.Configured

Throws:

UnsupportedOperationException - when called.

getConf

public org.apache.hadoop.conf.Configuration getConf()

Returns a copy of Configuration for this DrillFileSystem. Note: a copy of the Configuration is returned in order to enforce immutability.

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

Overrides:

getConf in class org.apache.hadoop.conf.Configured

Returns:

A copy of Configuration for this DrillFileSystem.

open

public org.apache.hadoop.fs.FSDataInputStream open(org.apache.hadoop.fs.Path f,
                                                   int bufferSize)
                                            throws IOException

If OperatorStats are provided return a instrumented FSDataInputStream.

Specified by:

open in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

open

public org.apache.hadoop.fs.FSDataInputStream open(org.apache.hadoop.fs.Path f)
                                            throws IOException

If OperatorStats are provided return a instrumented FSDataInputStream.

Overrides:

open in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

initialize

public void initialize(URI name,
                       org.apache.hadoop.conf.Configuration conf)

This method should never be used on DrillFileSystem since DrillFileSystem is immutable.

Overrides:

initialize in class org.apache.hadoop.fs.FileSystem

Throws:

UnsupportedOperationException - when called.

getScheme

public String getScheme()

Overrides:

getScheme in class org.apache.hadoop.fs.FileSystem

create

public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f)
                                               throws IOException

Overrides:

create in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

create

public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f,
                                                      boolean overwrite)
                                               throws IOException

Overrides:

create in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

create

public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f,
                                                      org.apache.hadoop.util.Progressable progress)
                                               throws IOException

Overrides:

create in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

create

public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f,
                                                      short replication)
                                               throws IOException

Overrides:

create in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

create

public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f,
                                                      short replication,
                                                      org.apache.hadoop.util.Progressable progress)
                                               throws IOException

Overrides:

create in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

create

public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f,
                                                      boolean overwrite,
                                                      int bufferSize)
                                               throws IOException

Overrides:

create in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

create

public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f,
                                                      boolean overwrite,
                                                      int bufferSize,
                                                      org.apache.hadoop.util.Progressable progress)
                                               throws IOException

Overrides:

create in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

create

public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f,
                                                      boolean overwrite,
                                                      int bufferSize,
                                                      short replication,
                                                      long blockSize)
                                               throws IOException

Overrides:

create in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

create

public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f,
                                                      boolean overwrite,
                                                      int bufferSize,
                                                      short replication,
                                                      long blockSize,
                                                      org.apache.hadoop.util.Progressable progress)
                                               throws IOException

Overrides:

create in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getFileStatus

public org.apache.hadoop.fs.FileStatus getFileStatus(org.apache.hadoop.fs.Path f)
                                              throws IOException

Specified by:

getFileStatus in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

createSymlink

public void createSymlink(org.apache.hadoop.fs.Path target,
                          org.apache.hadoop.fs.Path link,
                          boolean createParent)
                   throws IOException

Overrides:

createSymlink in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getFileLinkStatus

public org.apache.hadoop.fs.FileStatus getFileLinkStatus(org.apache.hadoop.fs.Path f)
                                                  throws IOException

Overrides:

getFileLinkStatus in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

supportsSymlinks

public boolean supportsSymlinks()

Overrides:

supportsSymlinks in class org.apache.hadoop.fs.FileSystem

getLinkTarget

public org.apache.hadoop.fs.Path getLinkTarget(org.apache.hadoop.fs.Path f)
                                        throws IOException

Overrides:

getLinkTarget in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getFileChecksum

public org.apache.hadoop.fs.FileChecksum getFileChecksum(org.apache.hadoop.fs.Path f)
                                                  throws IOException

Overrides:

getFileChecksum in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

setVerifyChecksum

public void setVerifyChecksum(boolean verifyChecksum)

This method should never be used on DrillFileSystem since DrillFileSystem is immutable.

Overrides:

setVerifyChecksum in class org.apache.hadoop.fs.FileSystem

Throws:

UnsupportedOperationException - when called.

setWriteChecksum

public void setWriteChecksum(boolean writeChecksum)

This method should never be used on DrillFileSystem since DrillFileSystem is immutable.

Overrides:

setWriteChecksum in class org.apache.hadoop.fs.FileSystem

Throws:

UnsupportedOperationException - when called.

getStatus

public org.apache.hadoop.fs.FsStatus getStatus()
                                        throws IOException

Overrides:

getStatus in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getStatus

public org.apache.hadoop.fs.FsStatus getStatus(org.apache.hadoop.fs.Path p)
                                        throws IOException

Overrides:

getStatus in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

setPermission

public void setPermission(org.apache.hadoop.fs.Path p,
                          org.apache.hadoop.fs.permission.FsPermission permission)
                   throws IOException

Overrides:

setPermission in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

setOwner

public void setOwner(org.apache.hadoop.fs.Path p,
                     String username,
                     String groupname)
              throws IOException

Overrides:

setOwner in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

setTimes

public void setTimes(org.apache.hadoop.fs.Path p,
                     long mtime,
                     long atime)
              throws IOException

Overrides:

setTimes in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

createSnapshot

public org.apache.hadoop.fs.Path createSnapshot(org.apache.hadoop.fs.Path path,
                                                String snapshotName)
                                         throws IOException

Overrides:

createSnapshot in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

renameSnapshot

public void renameSnapshot(org.apache.hadoop.fs.Path path,
                           String snapshotOldName,
                           String snapshotNewName)
                    throws IOException

Overrides:

renameSnapshot in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

deleteSnapshot

public void deleteSnapshot(org.apache.hadoop.fs.Path path,
                           String snapshotName)
                    throws IOException

Overrides:

deleteSnapshot in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

modifyAclEntries

public void modifyAclEntries(org.apache.hadoop.fs.Path path,
                             List<org.apache.hadoop.fs.permission.AclEntry> aclSpec)
                      throws IOException

Overrides:

modifyAclEntries in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

removeAclEntries

public void removeAclEntries(org.apache.hadoop.fs.Path path,
                             List<org.apache.hadoop.fs.permission.AclEntry> aclSpec)
                      throws IOException

Overrides:

removeAclEntries in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

removeDefaultAcl

public void removeDefaultAcl(org.apache.hadoop.fs.Path path)
                      throws IOException

Overrides:

removeDefaultAcl in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

removeAcl

public void removeAcl(org.apache.hadoop.fs.Path path)
               throws IOException

Overrides:

removeAcl in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

setAcl

public void setAcl(org.apache.hadoop.fs.Path path,
                   List<org.apache.hadoop.fs.permission.AclEntry> aclSpec)
            throws IOException

Overrides:

setAcl in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getAclStatus

public org.apache.hadoop.fs.permission.AclStatus getAclStatus(org.apache.hadoop.fs.Path path)
                                                       throws IOException

Overrides:

getAclStatus in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getWorkingDirectory

public org.apache.hadoop.fs.Path getWorkingDirectory()

Specified by:

getWorkingDirectory in class org.apache.hadoop.fs.FileSystem

append

public org.apache.hadoop.fs.FSDataOutputStream append(org.apache.hadoop.fs.Path f,
                                                      int bufferSize,
                                                      org.apache.hadoop.util.Progressable progress)
                                               throws IOException

Specified by:

append in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

concat

public void concat(org.apache.hadoop.fs.Path trg,
                   org.apache.hadoop.fs.Path[] psrcs)
            throws IOException

Overrides:

concat in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getReplication

@Deprecated
public short getReplication(org.apache.hadoop.fs.Path src)
                                 throws IOException

Deprecated.

Overrides:

getReplication in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

setReplication

public boolean setReplication(org.apache.hadoop.fs.Path src,
                              short replication)
                       throws IOException

Overrides:

setReplication in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

mkdirs

public boolean mkdirs(org.apache.hadoop.fs.Path f,
                      org.apache.hadoop.fs.permission.FsPermission permission)
               throws IOException

Specified by:

mkdirs in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

copyFromLocalFile

public void copyFromLocalFile(org.apache.hadoop.fs.Path src,
                              org.apache.hadoop.fs.Path dst)
                       throws IOException

Overrides:

copyFromLocalFile in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

moveFromLocalFile

public void moveFromLocalFile(org.apache.hadoop.fs.Path[] srcs,
                              org.apache.hadoop.fs.Path dst)
                       throws IOException

Overrides:

moveFromLocalFile in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

moveFromLocalFile

public void moveFromLocalFile(org.apache.hadoop.fs.Path src,
                              org.apache.hadoop.fs.Path dst)
                       throws IOException

Overrides:

moveFromLocalFile in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

copyFromLocalFile

public void copyFromLocalFile(boolean delSrc,
                              org.apache.hadoop.fs.Path src,
                              org.apache.hadoop.fs.Path dst)
                       throws IOException

Overrides:

copyFromLocalFile in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

copyFromLocalFile

public void copyFromLocalFile(boolean delSrc,
                              boolean overwrite,
                              org.apache.hadoop.fs.Path[] srcs,
                              org.apache.hadoop.fs.Path dst)
                       throws IOException

Overrides:

copyFromLocalFile in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

copyFromLocalFile

public void copyFromLocalFile(boolean delSrc,
                              boolean overwrite,
                              org.apache.hadoop.fs.Path src,
                              org.apache.hadoop.fs.Path dst)
                       throws IOException

Overrides:

copyFromLocalFile in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

copyToLocalFile

public void copyToLocalFile(org.apache.hadoop.fs.Path src,
                            org.apache.hadoop.fs.Path dst)
                     throws IOException

Overrides:

copyToLocalFile in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

moveToLocalFile

public void moveToLocalFile(org.apache.hadoop.fs.Path src,
                            org.apache.hadoop.fs.Path dst)
                     throws IOException

Overrides:

moveToLocalFile in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

copyToLocalFile

public void copyToLocalFile(boolean delSrc,
                            org.apache.hadoop.fs.Path src,
                            org.apache.hadoop.fs.Path dst)
                     throws IOException

Overrides:

copyToLocalFile in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

copyToLocalFile

public void copyToLocalFile(boolean delSrc,
                            org.apache.hadoop.fs.Path src,
                            org.apache.hadoop.fs.Path dst,
                            boolean useRawLocalFileSystem)
                     throws IOException

Overrides:

copyToLocalFile in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

startLocalOutput

public org.apache.hadoop.fs.Path startLocalOutput(org.apache.hadoop.fs.Path fsOutputFile,
                                                  org.apache.hadoop.fs.Path tmpLocalFile)
                                           throws IOException

Overrides:

startLocalOutput in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

completeLocalOutput

public void completeLocalOutput(org.apache.hadoop.fs.Path fsOutputFile,
                                org.apache.hadoop.fs.Path tmpLocalFile)
                         throws IOException

Overrides:

completeLocalOutput in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getUsed

public long getUsed()
             throws IOException

Overrides:

getUsed in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getBlockSize

@Deprecated
public long getBlockSize(org.apache.hadoop.fs.Path f)
                              throws IOException

Deprecated.

Overrides:

getBlockSize in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getDefaultBlockSize

@Deprecated
public long getDefaultBlockSize()

Deprecated.

Overrides:

getDefaultBlockSize in class org.apache.hadoop.fs.FileSystem

getDefaultBlockSize

public long getDefaultBlockSize(org.apache.hadoop.fs.Path f)

Overrides:

getDefaultBlockSize in class org.apache.hadoop.fs.FileSystem

getDefaultReplication

@Deprecated
public short getDefaultReplication()

Deprecated.

Overrides:

getDefaultReplication in class org.apache.hadoop.fs.FileSystem

getDefaultReplication

public short getDefaultReplication(org.apache.hadoop.fs.Path path)

Overrides:

getDefaultReplication in class org.apache.hadoop.fs.FileSystem

mkdirs

public boolean mkdirs(org.apache.hadoop.fs.Path folderPath)
               throws IOException

Overrides:

mkdirs in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

create

public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f,
                                                      org.apache.hadoop.fs.permission.FsPermission permission,
                                                      EnumSet<org.apache.hadoop.fs.CreateFlag> flags,
                                                      int bufferSize,
                                                      short replication,
                                                      long blockSize,
                                                      org.apache.hadoop.util.Progressable progress,
                                                      org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt)
                                               throws IOException

Overrides:

create in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

createNonRecursive

@Deprecated
public org.apache.hadoop.fs.FSDataOutputStream createNonRecursive(org.apache.hadoop.fs.Path f,
                                                                              boolean overwrite,
                                                                              int bufferSize,
                                                                              short replication,
                                                                              long blockSize,
                                                                              org.apache.hadoop.util.Progressable progress)
                                                                       throws IOException

Deprecated.

Overrides:

createNonRecursive in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

createNonRecursive

@Deprecated
public org.apache.hadoop.fs.FSDataOutputStream createNonRecursive(org.apache.hadoop.fs.Path f,
                                                                              org.apache.hadoop.fs.permission.FsPermission permission,
                                                                              boolean overwrite,
                                                                              int bufferSize,
                                                                              short replication,
                                                                              long blockSize,
                                                                              org.apache.hadoop.util.Progressable progress)
                                                                       throws IOException

Deprecated.

Overrides:

createNonRecursive in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

createNonRecursive

@Deprecated
public org.apache.hadoop.fs.FSDataOutputStream createNonRecursive(org.apache.hadoop.fs.Path f,
                                                                              org.apache.hadoop.fs.permission.FsPermission permission,
                                                                              EnumSet<org.apache.hadoop.fs.CreateFlag> flags,
                                                                              int bufferSize,
                                                                              short replication,
                                                                              long blockSize,
                                                                              org.apache.hadoop.util.Progressable progress)
                                                                       throws IOException

Deprecated.

Overrides:

createNonRecursive in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

createNewFile

public boolean createNewFile(org.apache.hadoop.fs.Path f)
                      throws IOException

Overrides:

createNewFile in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

append

public org.apache.hadoop.fs.FSDataOutputStream append(org.apache.hadoop.fs.Path f)
                                               throws IOException

Overrides:

append in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

append

public org.apache.hadoop.fs.FSDataOutputStream append(org.apache.hadoop.fs.Path f,
                                                      int bufferSize)
                                               throws IOException

Overrides:

append in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

create

public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f,
                                                      org.apache.hadoop.fs.permission.FsPermission permission,
                                                      boolean overwrite,
                                                      int bufferSize,
                                                      short replication,
                                                      long blockSize,
                                                      org.apache.hadoop.util.Progressable progress)
                                               throws IOException

Specified by:

create in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

create

public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f,
                                                      org.apache.hadoop.fs.permission.FsPermission permission,
                                                      EnumSet<org.apache.hadoop.fs.CreateFlag> flags,
                                                      int bufferSize,
                                                      short replication,
                                                      long blockSize,
                                                      org.apache.hadoop.util.Progressable progress)
                                               throws IOException

Overrides:

create in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

listStatus

public org.apache.hadoop.fs.FileStatus[] listStatus(org.apache.hadoop.fs.Path f)
                                             throws FileNotFoundException,
                                                    IOException

Specified by:

listStatus in class org.apache.hadoop.fs.FileSystem

Throws:

FileNotFoundException

IOException

listCorruptFileBlocks

public org.apache.hadoop.fs.RemoteIterator<org.apache.hadoop.fs.Path> listCorruptFileBlocks(org.apache.hadoop.fs.Path path)
                                                                                     throws IOException

Overrides:

listCorruptFileBlocks in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

listStatus

public org.apache.hadoop.fs.FileStatus[] listStatus(org.apache.hadoop.fs.Path f,
                                                    org.apache.hadoop.fs.PathFilter filter)
                                             throws FileNotFoundException,
                                                    IOException

Overrides:

listStatus in class org.apache.hadoop.fs.FileSystem

Throws:

FileNotFoundException

IOException

listStatus

public org.apache.hadoop.fs.FileStatus[] listStatus(org.apache.hadoop.fs.Path[] files)
                                             throws FileNotFoundException,
                                                    IOException

Overrides:

listStatus in class org.apache.hadoop.fs.FileSystem

Throws:

FileNotFoundException

IOException

listStatus

public org.apache.hadoop.fs.FileStatus[] listStatus(org.apache.hadoop.fs.Path[] files,
                                                    org.apache.hadoop.fs.PathFilter filter)
                                             throws FileNotFoundException,
                                                    IOException

Overrides:

listStatus in class org.apache.hadoop.fs.FileSystem

Throws:

FileNotFoundException

IOException

globStatus

public org.apache.hadoop.fs.FileStatus[] globStatus(org.apache.hadoop.fs.Path pathPattern)
                                             throws IOException

Overrides:

globStatus in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

globStatus

public org.apache.hadoop.fs.FileStatus[] globStatus(org.apache.hadoop.fs.Path pathPattern,
                                                    org.apache.hadoop.fs.PathFilter filter)
                                             throws IOException

Overrides:

globStatus in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

listLocatedStatus

public org.apache.hadoop.fs.RemoteIterator<org.apache.hadoop.fs.LocatedFileStatus> listLocatedStatus(org.apache.hadoop.fs.Path f)
                                                                                              throws FileNotFoundException,
                                                                                                     IOException

Overrides:

listLocatedStatus in class org.apache.hadoop.fs.FileSystem

Throws:

FileNotFoundException

IOException

listFiles

public org.apache.hadoop.fs.RemoteIterator<org.apache.hadoop.fs.LocatedFileStatus> listFiles(org.apache.hadoop.fs.Path f,
                                                                                             boolean recursive)
                                                                                      throws FileNotFoundException,
                                                                                             IOException

Overrides:

listFiles in class org.apache.hadoop.fs.FileSystem

Throws:

FileNotFoundException

IOException

getHomeDirectory

public org.apache.hadoop.fs.Path getHomeDirectory()

Overrides:

getHomeDirectory in class org.apache.hadoop.fs.FileSystem

setWorkingDirectory

public void setWorkingDirectory(org.apache.hadoop.fs.Path new_dir)

This method should never be used on DrillFileSystem since DrillFileSystem is immutable.

Specified by:

setWorkingDirectory in class org.apache.hadoop.fs.FileSystem

Throws:

UnsupportedOperationException - when called.

rename

public boolean rename(org.apache.hadoop.fs.Path src,
                      org.apache.hadoop.fs.Path dst)
               throws IOException

Specified by:

rename in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

delete

@Deprecated
public boolean delete(org.apache.hadoop.fs.Path f)
                           throws IOException

Deprecated.

Overrides:

delete in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

delete

public boolean delete(org.apache.hadoop.fs.Path f,
                      boolean recursive)
               throws IOException

Specified by:

delete in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

deleteOnExit

public boolean deleteOnExit(org.apache.hadoop.fs.Path f)
                     throws IOException

Overrides:

deleteOnExit in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

cancelDeleteOnExit

public boolean cancelDeleteOnExit(org.apache.hadoop.fs.Path f)

Overrides:

cancelDeleteOnExit in class org.apache.hadoop.fs.FileSystem

exists

public boolean exists(org.apache.hadoop.fs.Path f)
               throws IOException

Overrides:

exists in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

isDirectory

public boolean isDirectory(org.apache.hadoop.fs.Path f)
                    throws IOException

Overrides:

isDirectory in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

isFile

public boolean isFile(org.apache.hadoop.fs.Path f)
               throws IOException

Overrides:

isFile in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getLength

@Deprecated
public long getLength(org.apache.hadoop.fs.Path f)
                           throws IOException

Deprecated.

Overrides:

getLength in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getContentSummary

public org.apache.hadoop.fs.ContentSummary getContentSummary(org.apache.hadoop.fs.Path f)
                                                      throws IOException

Overrides:

getContentSummary in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getUri

public URI getUri()

Specified by:

getUri in class org.apache.hadoop.fs.FileSystem

getCanonicalServiceName

@InterfaceAudience.LimitedPrivate(value={"HDFS","MapReduce"})
public String getCanonicalServiceName()

Specified by:

getCanonicalServiceName in interface org.apache.hadoop.security.token.DelegationTokenIssuer

Overrides:

getCanonicalServiceName in class org.apache.hadoop.fs.FileSystem

getName

@Deprecated
public String getName()

Deprecated.

Overrides:

getName in class org.apache.hadoop.fs.FileSystem

makeQualified

public org.apache.hadoop.fs.Path makeQualified(org.apache.hadoop.fs.Path path)

Overrides:

makeQualified in class org.apache.hadoop.fs.FileSystem

getDelegationToken

@InterfaceAudience.Private
public org.apache.hadoop.security.token.Token<?> getDelegationToken(String renewer)
                                                                                        throws IOException

Specified by:

getDelegationToken in interface org.apache.hadoop.security.token.DelegationTokenIssuer

Overrides:

getDelegationToken in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

addDelegationTokens

@InterfaceAudience.LimitedPrivate(value={"HDFS","MapReduce"})
public org.apache.hadoop.security.token.Token<?>[] addDelegationTokens(String renewer,
                                                                                                                                     org.apache.hadoop.security.Credentials credentials)
                                                                                                                              throws IOException

Specified by:

addDelegationTokens in interface org.apache.hadoop.security.token.DelegationTokenIssuer

Throws:

IOException

getChildFileSystems

@InterfaceAudience.LimitedPrivate(value="HDFS")
public org.apache.hadoop.fs.FileSystem[] getChildFileSystems()

Overrides:

getChildFileSystems in class org.apache.hadoop.fs.FileSystem

getFileBlockLocations

public org.apache.hadoop.fs.BlockLocation[] getFileBlockLocations(org.apache.hadoop.fs.FileStatus file,
                                                                  long start,
                                                                  long len)
                                                           throws IOException

Overrides:

getFileBlockLocations in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getFileBlockLocations

public org.apache.hadoop.fs.BlockLocation[] getFileBlockLocations(org.apache.hadoop.fs.Path p,
                                                                  long start,
                                                                  long len)
                                                           throws IOException

Overrides:

getFileBlockLocations in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getServerDefaults

@Deprecated
public org.apache.hadoop.fs.FsServerDefaults getServerDefaults()
                                                                    throws IOException

Deprecated.

Overrides:

getServerDefaults in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getServerDefaults

public org.apache.hadoop.fs.FsServerDefaults getServerDefaults(org.apache.hadoop.fs.Path p)
                                                        throws IOException

Overrides:

getServerDefaults in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

resolvePath

public org.apache.hadoop.fs.Path resolvePath(org.apache.hadoop.fs.Path p)
                                      throws IOException

Overrides:

resolvePath in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

truncate

public boolean truncate(org.apache.hadoop.fs.Path f,
                        long newLength)
                 throws IOException

Overrides:

truncate in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

listStatusIterator

public org.apache.hadoop.fs.RemoteIterator<org.apache.hadoop.fs.FileStatus> listStatusIterator(org.apache.hadoop.fs.Path p)
                                                                                        throws FileNotFoundException,
                                                                                               IOException

Overrides:

listStatusIterator in class org.apache.hadoop.fs.FileSystem

Throws:

FileNotFoundException

IOException

access

public void access(org.apache.hadoop.fs.Path path,
                   org.apache.hadoop.fs.permission.FsAction mode)
            throws org.apache.hadoop.security.AccessControlException,
                   FileNotFoundException,
                   IOException

Overrides:

access in class org.apache.hadoop.fs.FileSystem

Throws:

org.apache.hadoop.security.AccessControlException

FileNotFoundException

IOException

getFileChecksum

public org.apache.hadoop.fs.FileChecksum getFileChecksum(org.apache.hadoop.fs.Path f,
                                                         long length)
                                                  throws IOException

Overrides:

getFileChecksum in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

setXAttr

public void setXAttr(org.apache.hadoop.fs.Path path,
                     String name,
                     byte[] value)
              throws IOException

Overrides:

setXAttr in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

setXAttr

public void setXAttr(org.apache.hadoop.fs.Path path,
                     String name,
                     byte[] value,
                     EnumSet<org.apache.hadoop.fs.XAttrSetFlag> flag)
              throws IOException

Overrides:

setXAttr in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getXAttr

public byte[] getXAttr(org.apache.hadoop.fs.Path path,
                       String name)
                throws IOException

Overrides:

getXAttr in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getXAttrs

public Map<String,byte[]> getXAttrs(org.apache.hadoop.fs.Path path)
                             throws IOException

Overrides:

getXAttrs in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getXAttrs

public Map<String,byte[]> getXAttrs(org.apache.hadoop.fs.Path path,
                                    List<String> names)
                             throws IOException

Overrides:

getXAttrs in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

listXAttrs

public List<String> listXAttrs(org.apache.hadoop.fs.Path path)
                        throws IOException

Overrides:

listXAttrs in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

removeXAttr

public void removeXAttr(org.apache.hadoop.fs.Path path,
                        String name)
                 throws IOException

Overrides:

removeXAttr in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

openPossiblyCompressedStream

public InputStream openPossiblyCompressedStream(org.apache.hadoop.fs.Path path)
                                         throws IOException

Returns an InputStream from a Hadoop path. If the data is compressed, this method will return a compressed InputStream depending on the codec.

Parameters:

path - Input file path

Returns:

InputStream of opened file path

Throws:

IOException - If the file is unreachable, unavailable or otherwise unreadable

getCodec

public org.apache.hadoop.io.compress.CompressionCodec getCodec(org.apache.hadoop.fs.Path path)

Returns the CompressionCodec for a given file. This can be used to determine the type of compression (if any) which was used. Returns null if the file is not compressed.

Parameters:

path - The file of unknown compression

Returns:

CompressionCodec used by the file. Null if the file is not compressed.

fileOpened

public void fileOpened(org.apache.hadoop.fs.Path path,
                       DrillFSDataInputStream fsDataInputStream)

Description copied from interface: OpenFileTracker

Add new file location and DrillFSDataInputStream to list.

Specified by:

fileOpened in interface OpenFileTracker

fileClosed

public void fileClosed(DrillFSDataInputStream fsDataInputStream)

Description copied from interface: OpenFileTracker

Remove the given DrillFSDataInputStream from opened file list.

Specified by:

fileClosed in interface OpenFileTracker