File access on non *nix systems such as Windows was largely ignored and few cared. Little thought was put into creating a general file access API that could be implemented across platforms. The Apache Hadoop FileSystem was designed tightly coupled to *unix file systems. The current implementation does not support the *nix sticky bit.A future version will register with Java's service loading mechanism as .LocalFileSystem does, although this will still require manual specification in an environment such as Spark, because there would be two conflicting registered file systems for file. The current implementation does not register as a service supporting the file scheme, and instead must be specified manually.The current implementation does not handle symbolic links, but this is planned.See HADOOP-13223: winutils.exe is a bug nexus and should be killed with an axe. This is because the Winutils kludge permeates the Hadoop code and is hard-coded at a low-level, executed statically upon class loading, even for code completely unrelated to file access. Note that you may still get warnings that "HADOOP_HOME and are unset" and "Did not find winutils.exe". setClass( "fs.file.impl", BareLocalFileSystem.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |