at org.apache.spark.deploy.history.FsHistoryProvider.<init>(FsHistoryProvider.scala:156)
at org.apache.spark.deploy.history.FsHistoryProvider.<init>(FsHistoryProvider.scala:77)
... 6 more
Caused by: java.io.FileNotFoundException: File does not exist: hdfs://hadoop101:9000/directory
at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1309)
at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1301)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1317)
at org.apache.spark.deploy.history.FsHistoryProvider.org$apache$spark$deploy$history$FsHistoryProvider$$startPolling(FsHistoryProvider.scala:204)

Spark启动报错|java.io.FileNotFoundException: File does not exist: hdfs://hadoop101:9000/directory 随笔 第1张

 在网页打开192.168.142.101:4000,无法像下面一样打开

SRE实战 互联网时代守护先锋,助力企业售后服务体系运筹帷幄!一键直达领取阿里云限量特价优惠。

 Spark启动报错|java.io.FileNotFoundException: File does not exist: hdfs://hadoop101:9000/directory 随笔 第2张

 

说白了就是没在hdfs上创建手机日志的文件夹 hdfs dfs -mkdir direcory

转自:https://blog.csdn.net/zmc921/article/details/80338267

扫码关注我们
微信号:SRE实战
拒绝背锅 运筹帷幄