Hadoop(HDFS)--Shell操作上传与下载

关注WeChat公众号码:网上快捷方式

关注CSDN博客:张志伟的博客

一、启动集群

[atguigu@hadoop103 ~]$ cd /opt/module/hadoop-3.1.3/

[atguigu@hadoop102 hadoop-3.1.3]$ sbin/start-dfs.sh

[atguigu@hadoop103 ~]$ cd /opt/module/hadoop-3.1.3/
[atguigu@hadoop103 hadoop-3.1.3]$ sbin/start-yarn.sh

查看是否启动

[atguigu@hadoop102 hadoop-3.1.3]$ jpsall
=============== hadoop102 ===============
2916 NameNode
3037 DataNode
3358 NodeManager
3486 Jps
=============== hadoop103 ===============
3137 NodeManager
2882 DataNode
3026 ResourceManager
3560 Jps
=============== hadoop104 ===============
3154 Jps
2979 NodeManager
2806 DataNode
2872 SecondaryNameNode

二、上传

创建文件夹

[atguigu@hadoop102 hadoop-3.1.3]$ hadoop fs -mkdir /sanguo

地址: http://hadoop102:9870/

输入“sanguo”文件夹,里面没有数据

2.1moveFromLocal:从本地剪辑粘贴到HDFS

[atguigu@hadoop102 hadoop-3.1.3]$ vim shuguo.txt
输入：shuguo

[atguigu@hadoop102 hadoop-3.1.3]$ hadoop fs  -moveFromLocal  ./shuguo.txt  /sanguo

Shuuo.txt文件被剪掉了

你可以通过刷新“页.txt”保存在“Songuo”文件夹中查看“Songuo”

你可以看到内容是守護

2.2 copyFromLocal:从本地文件系统复制文件到HDFS路径

[atguigu@hadoop102 hadoop-3.1.3]$ vim weiguo.txt

输入：weiguo

[atguigu@hadoop102 hadoop-3.1.3]$ hadoop fs -copyFromLocal weiguo.txt /sanguo

从本地拷贝中, weiguo.txt仍然存在

浏览新页, weiguo.txt已复制到 hdfs,文件内容为 weiguo

2.3置:与 copyFromLocal相等,生产环境更适应置

[atguigu@hadoop102 hadoop-3.1.3]$ vim wuguo.txt

输入:wuguo

[atguigu@hadoop102 hadoop-3.1.3]$ hadoop fs -put ./wuguo.txt /sanguo

刷页,wuguo.txt已复制到 hdfs,文件内容为wuguo

2.4appendToFile:将文件添加到现有文件的末端

[atguigu@hadoop102 hadoop-3.1.3]$ vim liubei.txt

输入：liubei

[atguigu@hadoop102 hadoop-3.1.3]$ hadoop fs -appendToFile liubei.txt /sanguo/shuguo.txt

查看新页面在守護文中。 txt文件中附加的劉備内容

三、下载

3.1copyToLocal:从HDFS复制到本地

[atguigu@hadoop102 hadoop-3.1.3]$ hadoop fs -copyToLocal /sanguo/shuguo.txt ./

3.2获取:与 copyToLocal一样,生产环境更适应获取

[atguigu@hadoop102 hadoop-3.1.3]$ hadoop fs -get /sanguo/shuguo.txt ./shuguo2.txt