macOS安装与运行Hadoop单机(standalone)模式

    科技2024-05-21  78

    macOS安装与运行Hadoop单机模式

    1 Download Hadoop2 Install Hadoop3 Verify Install4 Run a programme5 Reference

    1 Download Hadoop

    下载地址,选择3.2.1 https://downloads.apache.org/hadoop/common/. 保险起见下载完成后在Downloads中双击解压(不知为何先移动再解压会报错)

    在home中创建文件夹

    > cd ~ > mkdir -p Install/Hadoop

    2 Install Hadoop

    将Downloads中的文件移动到目标文件夹

    > mv ~/Downloads/hadoop-3.2.1 ~/Install/Hadoop

    3 Verify Install

    > cd Install/Hadoop > cd hadoop-3.2.1 && ls -g

    若安装成功,则

    -rw-r--r--@ 1 staff 150569 Sep 10 07:35 LICENSE.txt -rw-r--r--@ 1 staff 22125 Sep 10 07:35 NOTICE.txt -rw-r--r--@ 1 staff 1361 Sep 10 07:35 README.txt drwxr-xr-x@ 13 staff 416 Sep 10 09:51 bin drwxr-xr-x@ 3 staff 96 Sep 10 08:58 etc drwxr-xr-x@ 7 staff 224 Sep 10 09:51 include drwxr-xr-x@ 3 staff 96 Sep 10 09:51 lib drwxr-xr-x@ 14 staff 448 Sep 10 09:51 libexec drwxr-xr-x@ 29 staff 928 Sep 10 08:58 sbin

    4 Run a programme

    > mkdir input > cp etc/hadoop/*.xml input > bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce- examples-3.2.1.jar grep input output 'dfs[a-z.]+' > cat output/*

    运行结果:

    5 Reference

    https://www.exception404.com/post/steps-to-install-hadoop-on-mac-os-x-in-standalone-mode.

    Processed: 0.009, SQL: 8