{"id":1930,"date":"2012-06-16T11:20:19","date_gmt":"2012-06-16T02:20:19","guid":{"rendered":"http:\/\/www.creationline.com\/?p=1930"},"modified":"2023-08-29T11:10:21","modified_gmt":"2023-08-29T02:10:21","slug":"hadoop%e3%82%92%e4%bd%bf%e3%81%a3%e3%81%a6%e3%81%bf%e3%82%88%e3%81%86-3","status":"publish","type":"post","link":"https:\/\/www.creationline.com\/tech-blog\/author\/higuchi\/1930","title":{"rendered":"Hadoop\u3092\u4f7f\u3063\u3066\u307f\u3088\u3046 [3]"},"content":{"rendered":"<h2>CDHv3\u3092Ubuntu Server\u306b\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb<\/h2>\n<p>\u524d\u56de\u306f<a href=\"http:\/\/www.cloudera.com\/\">\u7c73Cloudera\u793e<\/a>\u304c\u63d0\u4f9b\u3057\u3066\u3044\u308bKVM\u7528\u306e\u30c7\u30e2\u30a4\u30e1\u30fc\u30b8\u3092\u4f7f\u3063\u3066Hadoop\u3092\u4f53\u9a13\u3057\u307e\u3057\u305f\u3002<br \/>\n\u4eca\u56de\u306fUbuntu Server 10.04 LTS (x86_64)\u306bCDHv3\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3092\u884c\u3044\u307e\u3059\u3002<\/p>\n<h2>Java Development Kit\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb<\/h2>\n<p>Java\u306b\u306f\u30aa\u30fc\u30d7\u30f3\u306a\u5b9f\u88c5\u304c\u3044\u304f\u3064\u304b\u5b58\u5728\u3057\u307e\u3059\u304c\u3001Cloudera\u306f<a href=\"https:\/\/ccp.cloudera.com\/display\/CDHDOC\/Java+Development+Kit+Installation\">Oracle JDK\u306e\u4f7f\u7528\u3092\u63a8\u5968<\/a>\u3057\u3066\u3044\u308b\u305f\u3081\u3001\u3053\u3053\u3067\u306f\u305d\u308c\u306b\u306a\u3089\u3044\u307e\u3059\u3002Oracle JDK\u306f\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u306b\u624b\u9593\u304c\u304b\u304b\u308b\u305f\u3081\u3001\u4f59\u88d5\u3092\u6301\u3063\u3066\u6e96\u5099\u3092\u884c\u3063\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n<p>Oracle JDK\u306e\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u304c\u5b8c\u4e86\u3057\u305f\u3089\u3001Ubuntu Server 10.04 LTS (x86_64)\u306b\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3092\u884c\u3044\u307e\u3059\u3002<\/p>\n<pre>root@ubuntu:~# sh jdk-6u26-linux-x64.bin\n\t:\nDone.\nroot@ubuntu:~# \n\nroot@ubuntu:~# mv jdk1.6.0_26 \/usr\/local\/lib\nroot@ubuntu:~#<\/pre>\n<p>\u30d1\u30b9\u3092\u901a\u3057\u307e\u3059\u3002<\/p>\n<pre>root@ubuntu:~# cat &gt;&gt; \/etc\/bash.bashrc\nexport JAVA_HOME=\/usr\/local\/lib\/jdk1.6.0_26\nexport PATH=$JAVA_HOME\/bin:$PATH\nroot@ubuntu:~#<\/pre>\n<h2>CDHv3\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb<\/h2>\n<p>CDHv3\u7528\u306e\u30ec\u30dd\u30b8\u30c8\u30ea\u8a2d\u5b9a\u30d1\u30c3\u30b1\u30fc\u30b8\u3092\u53d6\u5f97\u3057\u3001\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u307e\u3059\u3002<\/p>\n<pre>root@ubuntu:~# wget http:\/\/archive.cloudera.com\/one-click-install\/lucid\/cdh3-repository_1.0_all.deb\n--2012-05-29 21:52:19--  http:\/\/archive.cloudera.com\/one-click-install\/lucid\/cdh3-repository_1.0_all.deb\narchive.cloudera.com \u3092DNS\u306b\u554f\u3044\u3042\u308f\u305b\u3066\u3044\u307e\u3059... 75.101.147.51\narchive.cloudera.com|75.101.147.51|:80 \u306b\u63a5\u7d9a\u3057\u3066\u3044\u307e\u3059... \u63a5\u7d9a\u3057\u307e\u3057\u305f\u3002\nHTTP \u306b\u3088\u308b\u63a5\u7d9a\u8981\u6c42\u3092\u9001\u4fe1\u3057\u307e\u3057\u305f\u3001\u5fdc\u7b54\u3092\u5f85\u3063\u3066\u3044\u307e\u3059... 200 OK\n\u9577\u3055: 3274 (3.2K) [application\/x-debian-package]\n`cdh3-repository_1.0_all.deb' \u306b\u4fdd\u5b58\u4e2d\n\n100%[======================================&gt;] 3,274       --.-K\/s   \u6642\u9593 0s    \n\n2012-05-29 21:52:20 (387 MB\/s) - `cdh3-repository_1.0_all.deb' \u3078\u4fdd\u5b58\u5b8c\u4e86 [3274\/3274]\n\nroot@ubuntu:~# dpkg -i cdh3-repository_1.0_all.deb\n\u672a\u9078\u629e\u30d1\u30c3\u30b1\u30fc\u30b8 cdh3-repository \u3092\u9078\u629e\u3057\u3066\u3044\u307e\u3059\u3002\n(\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u8aad\u307f\u8fbc\u3093\u3067\u3044\u307e\u3059 ... \u73fe\u5728 45728 \u500b\u306e\u30d5\u30a1\u30a4\u30eb\u3068\u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u304c\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3055\u308c\u3066\u3044\u307e\u3059\u3002)\n(cdh3-repository_1.0_all.deb \u304b\u3089) cdh3-repository \u3092\u5c55\u958b\u3057\u3066\u3044\u307e\u3059...\ncdh3-repository (1.0) \u3092\u8a2d\u5b9a\u3057\u3066\u3044\u307e\u3059 ...\ngpg: \u9375\u8f2a\u300c\/etc\/apt\/trusted.gpg.d\/cloudera-cdh3.gpg\u300d\u304c\u3067\u304d\u307e\u3057\u305f\ngpg: \u937502A818DD: \u516c\u958b\u9375\u201cCloudera Apt Repository\u201d\u3092\u8aad\u307f\u8fbc\u307f\u307e\u3057\u305f\ngpg: \u51e6\u7406\u6570\u306e\u5408\u8a08: 1\ngpg:               \u8aad\u8fbc\u307f: 1\n\nroot@ubuntu:~#<\/pre>\n<p>Hadoop\u306e\u30b3\u30a2\u30d1\u30c3\u30b1\u30fc\u30b8\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u307e\u3059\u3002<\/p>\n<pre>root@ubuntu:~# aptitude update\n\t:\nroot@ubuntu:~# aptitude search hadoop\nv   hadoop                          -\np   hadoop-0.20                     - A software platform for processing vast am\np   hadoop-0.20-conf-pseudo         - Pseudo-distributed Hadoop configuration\np   hadoop-0.20-datanode            - Data Node for Hadoop\np   hadoop-0.20-doc                 - Documentation for Hadoop\np   hadoop-0.20-fuse                - HDFS exposed over a Filesystem in Userspac\np   hadoop-0.20-jobtracker          - Job Tracker for Hadoop\np   hadoop-0.20-namenode            - Name Node for Hadoop\np   hadoop-0.20-native              - Native libraries for Hadoop (e.g., compres\np   hadoop-0.20-pipes               - Interface to author Hadoop MapReduce jobs\np   hadoop-0.20-sbin                - Server-side binaries necessary for secured\np   hadoop-0.20-secondarynamenode   - Secondary Name Node for Hadoop\np   hadoop-0.20-source              - Source code for Hadoop\np   hadoop-0.20-tasktracker         - Task Tracker for Hadoop\n\t:\nroot@ubuntu:~# aptitude install hadoop-0.20 hadoop-0.20-native\n\t:\n\u53d6\u5f97:1 http:\/\/jp.archive.ubuntu.com\/ubuntu\/ lucid\/main liblzo2-2 2.03-2 [59.2kB]\n\u53d6\u5f97:2 http:\/\/jp.archive.ubuntu.com\/ubuntu\/ lucid-updates\/main libzip1 0.9-3ubuntu0.1 [26.0kB]\n\u53d6\u5f97:3 http:\/\/archive.cloudera.com\/debian\/ lucid-cdh3\/contrib hadoop-0.20 0.20.2+923.256-1~lucid-cdh3 [32.2MB]\n\u53d6\u5f97:4 http:\/\/archive.cloudera.com\/debian\/ lucid-cdh3\/contrib hadoop-0.20-native 0.20.2+923.256-1~lucid-cdh3 [321kB]\n\t:\nliblzo2-2 (2.03-2) \u3092\u8a2d\u5b9a\u3057\u3066\u3044\u307e\u3059 ...\n\nlibzip1 (0.9-3ubuntu0.1) \u3092\u8a2d\u5b9a\u3057\u3066\u3044\u307e\u3059 ...\n\nhadoop-0.20 (0.20.2+923.256-1~lucid-cdh3) \u3092\u8a2d\u5b9a\u3057\u3066\u3044\u307e\u3059 ...\nupdate-alternatives: \/etc\/hadoop-0.20\/conf (hadoop-0.20-conf) \u3092\u63d0\u4f9b\u3059\u308b\u305f\u3081\u306b \u81ea\u52d5\u30e2\u30fc\u30c9 \u3067 \/etc\/hadoop-0.20\/conf.empty \u3092\u4f7f\u3044\u307e\u3059\u3002\nupdate-alternatives: \/usr\/bin\/hadoop (hadoop-default) \u3092\u63d0\u4f9b\u3059\u308b\u305f\u3081\u306b \u81ea\u52d5\u30e2\u30fc\u30c9 \u3067 \/usr\/bin\/hadoop-0.20 \u3092\u4f7f\u3044\u307e\u3059\u3002\n\nhadoop-0.20-native (0.20.2+923.256-1~lucid-cdh3) \u3092\u8a2d\u5b9a\u3057\u3066\u3044\u307e\u3059 ...\n\t:\nroot@ubuntu:~#<\/pre>\n<p>\u7591\u4f3c\u30af\u30e9\u30b9\u30bf\u30d1\u30c3\u30b1\u30fc\u30b8\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u307e\u3059\u3002\u3053\u308c\u306b\u3088\u308a\u3001\u30de\u30b9\u30bf\u30fc\u3001\u30b9\u30ec\u30fc\u30d6\u3059\u3079\u3066\u306e\u51e6\u7406\u30921\u53f0\u3067\u884c\u3046\u30db\u30b9\u30c8\u304c\u5b8c\u6210\u3057\u307e\u3059\u3002<\/p>\n<pre>root@ubuntu:~# aptitude install hadoop-0.20-conf-pseudo\n\t:\n\u53d6\u5f97:1 http:\/\/archive.cloudera.com\/debian\/ lucid-cdh3\/contrib hadoop-0.20-namenode 0.20.2+923.256-1~lucid-cdh3 [256kB]\n\u53d6\u5f97:2 http:\/\/archive.cloudera.com\/debian\/ lucid-cdh3\/contrib hadoop-0.20-datanode 0.20.2+923.256-1~lucid-cdh3 [256kB]\n\u53d6\u5f97:3 http:\/\/archive.cloudera.com\/debian\/ lucid-cdh3\/contrib hadoop-0.20-secondarynamenode 0.20.2+923.256-1~lucid-cdh3 [256kB]\n\u53d6\u5f97:4 http:\/\/archive.cloudera.com\/debian\/ lucid-cdh3\/contrib hadoop-0.20-jobtracker 0.20.2+923.256-1~lucid-cdh3 [256kB]\n\u53d6\u5f97:5 http:\/\/archive.cloudera.com\/debian\/ lucid-cdh3\/contrib hadoop-0.20-tasktracker 0.20.2+923.256-1~lucid-cdh3 [256kB]\n\u53d6\u5f97:6 http:\/\/archive.cloudera.com\/debian\/ lucid-cdh3\/contrib hadoop-0.20-conf-pseudo 0.20.2+923.256-1~lucid-cdh3 [263kB]\n\t:\nhadoop-0.20-namenode (0.20.2+923.256-1~lucid-cdh3) \u3092\u8a2d\u5b9a\u3057\u3066\u3044\u307e\u3059 ...\nupdate-rc.d: warning: hadoop-0.20-namenode start runlevel arguments (2 3 4 5) do not match LSB Default-Start values (3 5)\nupdate-rc.d: warning: hadoop-0.20-namenode stop runlevel arguments (0 1 6) do not match LSB Default-Stop values (0 1 2 4 6)\n\nhadoop-0.20-datanode (0.20.2+923.256-1~lucid-cdh3) \u3092\u8a2d\u5b9a\u3057\u3066\u3044\u307e\u3059 ...\nupdate-rc.d: warning: hadoop-0.20-datanode start runlevel arguments (2 3 4 5) do not match LSB Default-Start values (3 5)\nupdate-rc.d: warning: hadoop-0.20-datanode stop runlevel arguments (0 1 6) do not match LSB Default-Stop values (0 1 2 4 6)\n\nhadoop-0.20-secondarynamenode (0.20.2+923.256-1~lucid-cdh3) \u3092\u8a2d\u5b9a\u3057\u3066\u3044\u307e\u3059 ...\nupdate-rc.d: warning: hadoop-0.20-secondarynamenode start runlevel arguments (2 3 4 5) do not match LSB Default-Start values (3 5)\nupdate-rc.d: warning: hadoop-0.20-secondarynamenode stop runlevel arguments (0 1 6) do not match LSB Default-Stop values (0 1 2 4 6)\n\nhadoop-0.20-jobtracker (0.20.2+923.256-1~lucid-cdh3) \u3092\u8a2d\u5b9a\u3057\u3066\u3044\u307e\u3059 ...\nupdate-rc.d: warning: hadoop-0.20-jobtracker start runlevel arguments (2 3 4 5) do not match LSB Default-Start values (3 5)\nupdate-rc.d: warning: hadoop-0.20-jobtracker stop runlevel arguments (0 1 6) do not match LSB Default-Stop values (0 1 2 4 6)\n\nhadoop-0.20-tasktracker (0.20.2+923.256-1~lucid-cdh3) \u3092\u8a2d\u5b9a\u3057\u3066\u3044\u307e\u3059 ...\nupdate-rc.d: warning: hadoop-0.20-tasktracker start runlevel arguments (2 3 4 5) do not match LSB Default-Start values (3 5)\nupdate-rc.d: warning: hadoop-0.20-tasktracker stop runlevel arguments (0 1 6) do not match LSB Default-Stop values (0 1 2 4 6)\n\nhadoop-0.20-conf-pseudo (0.20.2+923.256-1~lucid-cdh3) \u3092\u8a2d\u5b9a\u3057\u3066\u3044\u307e\u3059 ...\nupdate-alternatives: \/etc\/hadoop-0.20\/conf (hadoop-0.20-conf) \u3092\u63d0\u4f9b\u3059\u308b\u305f\u3081\u306b \u81ea\u52d5\u30e2\u30fc\u30c9 \u3067 \/etc\/hadoop-0.20\/conf.pseudo \u3092\u4f7f\u3044\u307e\u3059\u3002\n\n\t:\nroot@ubuntu:~#<\/pre>\n<p>\u8a2d\u5b9a\u3092\u78ba\u8a8d\u3057\u3066\u307f\u307e\u3059\u3002<\/p>\n<pre>root@ubuntu:~# cat \/etc\/hadoop-0.20\/conf\/core-site.xml\n\t:\n  &lt;property&gt;\n    &lt;name&gt;fs.default.name&lt;\/name&gt;\n    &lt;value&gt;hdfs:\/\/localhost:8020&lt;\/value&gt;\n  &lt;\/property&gt;\n\n  &lt;property&gt;\n     &lt;name&gt;hadoop.tmp.dir&lt;\/name&gt;\n     &lt;value&gt;\/var\/lib\/hadoop-0.20\/cache\/${user.name}&lt;\/value&gt;\n  &lt;\/property&gt;\n\t:<\/pre>\n<p>NameNode\u306eURI (fs.default.name)\u306f hdfs:\/\/localhost:8020 \u3067\u3001HDFS \u306e\u30c7\u30fc\u30bf\u3092\u4fdd\u5b58\u3059\u308b\u30ed\u30fc\u30ab\u30eb\u306e\u30c7\u30a3\u30ec\u30af\u30c8\u30ea (hadoop.tmp.dir) \u306f \/var\/lib\/hadoop-0.20\/cache\/${user.name} \u3068\u306a\u308a\u307e\u3059\u3002<\/p>\n<pre>root@ubuntu:~# cat \/etc\/hadoop-0.20\/conf\/hdfs-site.xml\n\t:\n  &lt;property&gt;\n    &lt;name&gt;dfs.replication&lt;\/name&gt;\n    &lt;value&gt;1&lt;\/value&gt;\n  &lt;\/property&gt;\n  &lt;property&gt;\n     &lt;name&gt;dfs.permissions&lt;\/name&gt;\n     &lt;value&gt;false&lt;\/value&gt;\n  &lt;\/property&gt;\n\t:\n  &lt;property&gt;\n     &lt;!-- specify this so that running 'hadoop namenode -format' formats the right dir --&gt;\n     &lt;name&gt;dfs.name.dir&lt;\/name&gt;\n     &lt;value&gt;\/var\/lib\/hadoop-0.20\/cache\/hadoop\/dfs\/name&lt;\/value&gt;\n  &lt;\/property&gt;\n\t:<\/pre>\n<p>DataNode\u4e0a\u306b\u3044\u304f\u3064\u30b3\u30d4\u30fc\u3092\u4f5c\u6210\u3059\u308b\u304b (dfs.replication) \u306f\u3001\u7591\u4f3c\u30af\u30e9\u30b9\u30bf\u3067\u306f1\u3064\u3057\u304bDataNode\u304c\u306a\u3044\u306e\u3067\u5fc5\u7136\u7684\u306b 1 \u3068\u306a\u308a\u307e\u3059\u3002\u30d1\u30fc\u30df\u30c3\u30b7\u30e7\u30f3\u30c1\u30a7\u30c3\u30af (dfs.permissions) \u306f false \u306a\u306e\u3067\u884c\u3044\u307e\u305b\u3093\u3002NameNode\u306e\u30c7\u30fc\u30bf\u3092\u4fdd\u5b58\u3059\u308b\u30ed\u30fc\u30ab\u30eb\u306e\u30c7\u30a3\u30ec\u30af\u30c8\u30ea (dfs.name.dir) \u306f \/var\/lib\/hadoop-0.20\/cache\/hadoop\/dfs\/name \u3068\u306a\u308a\u307e\u3059\u3002<\/p>\n<pre>root@ubuntu:~# cat \/etc\/hadoop-0.20\/conf\/mapred-site.xml\n\t:\n  &lt;property&gt;\n    &lt;name&gt;mapred.job.tracker&lt;\/name&gt;\n    &lt;value&gt;localhost:8021&lt;\/value&gt;\n  &lt;\/property&gt;\n\t:<\/pre>\n<p>JobTracker\u306e\u30db\u30b9\u30c8\u540d\u3068IP\u30a2\u30c9\u30ec\u30b9 (mapred.job.tracker) \u306f localhost:8021 \u3067\u3059\u3002<\/p>\n<p>JAVA_HOME\u3092\u8a2d\u5b9a\u3057\u307e\u3059\u3002<\/p>\n<pre>root@ubuntu:~# cp -a \/usr\/lib\/hadoop-0.20\/conf\/hadoop-env.sh \/usr\/lib\/hadoop-0.20\/conf\/hadoop-env.sh.orig\nroot@ubuntu:~# vi \/usr\/lib\/hadoop-0.20\/conf\/hadoop-env.sh\nroot@ubuntu:~# diff -u \/usr\/lib\/hadoop-0.20\/conf\/hadoop-env.sh.orig \/usr\/lib\/hadoop-0.20\/conf\/hadoop-env.sh\n--- \/usr\/lib\/hadoop-0.20\/conf\/hadoop-env.sh.orig        2012-05-08 06:04:31.000000000 +0900\n+++ \/usr\/lib\/hadoop-0.20\/conf\/hadoop-env.sh     2012-05-29 21:29:36.530836405 +0900\n@@ -7,6 +7,7 @@\n\n # The java implementation to use.  Required.\n # export JAVA_HOME=\/usr\/lib\/j2sdk1.6-sun\n+export JAVA_HOME=\/usr\/local\/lib\/jdk1.6.0_26\n\n # Extra Java CLASSPATH elements.  Optional.\n # export HADOOP_CLASSPATH=\"&lt;extra_entries&gt;:$HADOOP_CLASSPATH\"\nroot@ubuntu:~#<\/pre>\n<h2>CDHv3 \u7591\u4f3c\u30af\u30e9\u30b9\u30bf\u306e\u5b9f\u884c<\/h2>\n<p>\u5404\u30c7\u30fc\u30e2\u30f3\u3092\u8d77\u52d5\u3057\u307e\u3059\u3002<\/p>\n<pre>root@ubuntu:~# \/etc\/init.d\/hadoop-0.20-namenode start\nStarting Hadoop namenode daemon: starting namenode, logging to \/usr\/lib\/hadoop-0.20\/logs\/hadoop-hadoop-namenode-ubuntu.out\nhadoop-0.20-namenode.\nroot@ubuntu:~# \n\nroot@ubuntu:~# \/etc\/init.d\/hadoop-0.20-jobtracker start\nStarting Hadoop jobtracker daemon: starting jobtracker, logging to \/usr\/lib\/hadoop-0.20\/logs\/hadoop-hadoop-jobtracker-ubuntu.out\nhadoop-0.20-jobtracker.\nroot@ubuntu:~# \n\nroot@ubuntu:~# \/etc\/init.d\/hadoop-0.20-datanode start\nStarting Hadoop datanode daemon: starting datanode, logging to \/usr\/lib\/hadoop-0.20\/logs\/hadoop-hadoop-datanode-ubuntu.out\nhadoop-0.20-datanode.\nroot@ubuntu:~# \n\nroot@ubuntu:~# \/etc\/init.d\/hadoop-0.20-tasktracker start\nStarting Hadoop tasktracker daemon: starting tasktracker, logging to \/usr\/lib\/hadoop-0.20\/logs\/hadoop-hadoop-tasktracker-ubuntu.out\nhadoop-0.20-tasktracker.\nroot@ubuntu:~#<\/pre>\n<p>\u8d77\u52d5\u306b\u6210\u529f\u3057\u305f\u3089\u3001\u5186\u5468\u7387\u8a08\u7b97\u30d7\u30ed\u30b0\u30e9\u30e0\u3092\u5b9f\u884c\u3057\u307e\u3059\u3002<\/p>\n<pre>cf@ubuntu:~$ hadoop-0.20 jar \/usr\/lib\/hadoop-0.20\/hadoop-0.20.2-cdh3u4-examples.jar pi 4 2000\nNumber of Maps  = 4\nSamples per Map = 2000\nWrote input for Map #0\nWrote input for Map #1\nWrote input for Map #2\nWrote input for Map #3\nStarting Job\n12\/05\/29 22:30:18 INFO mapred.FileInputFormat: Total input paths to process : 4\n12\/05\/29 22:30:18 INFO mapred.JobClient: Running job: job_201205292226_0001\n12\/05\/29 22:30:19 INFO mapred.JobClient:  map 0% reduce 0%\n12\/05\/29 22:30:25 INFO mapred.JobClient:  map 50% reduce 0%\n12\/05\/29 22:30:30 INFO mapred.JobClient:  map 100% reduce 0%\n12\/05\/29 22:30:35 INFO mapred.JobClient:  map 100% reduce 33%\n12\/05\/29 22:30:37 INFO mapred.JobClient:  map 100% reduce 100%\n12\/05\/29 22:30:38 INFO mapred.JobClient: Job complete: job_201205292226_0001\n12\/05\/29 22:30:38 INFO mapred.JobClient: Counters: 27\n12\/05\/29 22:30:38 INFO mapred.JobClient:   Job Counters\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Launched reduce tasks=1\n12\/05\/29 22:30:38 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=18747\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Launched map tasks=4\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Data-local map tasks=4\n12\/05\/29 22:30:38 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=11574\n12\/05\/29 22:30:38 INFO mapred.JobClient:   FileSystemCounters\n12\/05\/29 22:30:38 INFO mapred.JobClient:     FILE_BYTES_READ=94\n12\/05\/29 22:30:38 INFO mapred.JobClient:     HDFS_BYTES_READ=928\n12\/05\/29 22:30:38 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=277187\n12\/05\/29 22:30:38 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=215\n12\/05\/29 22:30:38 INFO mapred.JobClient:   Map-Reduce Framework\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Map input records=4\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Reduce shuffle bytes=112\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Spilled Records=16\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Map output bytes=72\n12\/05\/29 22:30:38 INFO mapred.JobClient:     CPU time spent (ms)=1510\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Total committed heap usage (bytes)=558579712\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Map input bytes=96\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Combine input records=0\n12\/05\/29 22:30:38 INFO mapred.JobClient:     SPLIT_RAW_BYTES=456\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Reduce input records=8\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Reduce input groups=2\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Combine output records=0\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Physical memory (bytes) snapshot=874717184\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Reduce output records=0\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=2528505856\n12\/05\/29 22:30:38 INFO mapred.JobClient:     Map output records=8\nJob Finished in 20.835 seconds\nEstimated value of Pi is 3.14100000000000000000\ncf@ubuntu:~$<\/pre>\n<p>\u3053\u306e\u3088\u3046\u306b\u3001\u5186\u5468\u7387\u8a08\u7b97\u306b\u6210\u529f\u3057\u307e\u3057\u305f\u3002<\/p>\n<p>\u6b21\u306b\u3001<a href=\"https:\/\/ccp.cloudera.com\/display\/SUPPORT\/Hadoop+Tutorial#HadoopTutorial-Example%3AWordCountv1.0\">\u82f1\u5358\u8a9e\u96c6\u8a08\u30d7\u30ed\u30b0\u30e9\u30e0<\/a>\u3092\u5b9f\u884c\u3057\u307e\u3059\u3002<\/p>\n<pre>cf@ubuntu:~$ export HADOOP_HOME=\/usr\/lib\/hadoop-0.20\ncf@ubuntu:~$ export HADOOP_VERSION=0.20.2-cdh3u4\ncf@ubuntu:~$\n\ncf@ubuntu:~$ javac -classpath ${HADOOP_HOME}\/hadoop-${HADOOP_VERSION}-core.jar -d wordcount_classes WordCount.java\ncf@ubuntu:~$ \n\ncf@ubuntu:~$ jar -cvf wordcount.jar -C wordcount_classes\/ .\n\u30de\u30cb\u30d5\u30a7\u30b9\u30c8\u304c\u8ffd\u52a0\u3055\u308c\u307e\u3057\u305f\u3002\norg\/ \u3092\u8ffd\u52a0\u4e2d\u3067\u3059\u3002(\u5165 = 0) (\u51fa = 0)(0% \u683c\u7d0d\u3055\u308c\u307e\u3057\u305f)\norg\/myorg\/ \u3092\u8ffd\u52a0\u4e2d\u3067\u3059\u3002(\u5165 = 0) (\u51fa = 0)(0% \u683c\u7d0d\u3055\u308c\u307e\u3057\u305f)\norg\/myorg\/WordCount.class \u3092\u8ffd\u52a0\u4e2d\u3067\u3059\u3002(\u5165 = 1546) (\u51fa = 749)(51% \u53ce\u7e2e\u3055\u308c\u307e\u3057\u305f)\norg\/myorg\/WordCount$Map.class \u3092\u8ffd\u52a0\u4e2d\u3067\u3059\u3002(\u5165 = 1938) (\u51fa = 798)(58% \u53ce\u7e2e\u3055\u308c\u307e\u3057\u305f)\norg\/myorg\/WordCount$Reduce.class \u3092\u8ffd\u52a0\u4e2d\u3067\u3059\u3002(\u5165 = 1611) (\u51fa = 649)(59% \u53ce\u7e2e\u3055\u308c\u307e\u3057\u305f)\ncf@ubuntu:~$<\/pre>\n<pre>cf@ubuntu:~$ hadoop fs -mkdir \/usr\/joe\/wordcount\/input\ncf@ubuntu:~$ \n\ncf@ubuntu:~$ cat &gt; file01\nHello World Bye World\ncf@ubuntu:~$ cat &gt; file02\nHello Hadoop Goodbye Hadoop\ncf@ubuntu:~$ \n\ncf@ubuntu:~$ hadoop fs -put file01 file02 \/usr\/joe\/wordcount\/input\ncf@ubuntu:~$<\/pre>\n<pre>cf@ubuntu:~$ hadoop jar wordcount.jar org.myorg.WordCount \/usr\/joe\/wordcount\/input \/usr\/joe\/wordcount\/output\n12\/05\/29 22:53:51 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.\n12\/05\/29 22:53:51 WARN snappy.LoadSnappy: Snappy native library is available\n12\/05\/29 22:53:51 INFO util.NativeCodeLoader: Loaded the native-hadoop library\n12\/05\/29 22:53:51 INFO snappy.LoadSnappy: Snappy native library loaded\n12\/05\/29 22:53:51 INFO mapred.FileInputFormat: Total input paths to process : 2\n12\/05\/29 22:53:51 INFO mapred.JobClient: Running job: job_201205292251_0001\n12\/05\/29 22:53:52 INFO mapred.JobClient:  map 0% reduce 0%\n12\/05\/29 22:53:59 INFO mapred.JobClient:  map 66% reduce 0%\n12\/05\/29 22:54:02 INFO mapred.JobClient:  map 100% reduce 0%\n12\/05\/29 22:54:08 INFO mapred.JobClient:  map 100% reduce 33%\n12\/05\/29 22:54:10 INFO mapred.JobClient:  map 100% reduce 100%\n12\/05\/29 22:54:10 INFO mapred.JobClient: Job complete: job_201205292251_0001\n12\/05\/29 22:54:10 INFO mapred.JobClient: Counters: 27\n12\/05\/29 22:54:10 INFO mapred.JobClient:   Job Counters\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Launched reduce tasks=1\n12\/05\/29 22:54:10 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=12458\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Launched map tasks=3\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Data-local map tasks=3\n12\/05\/29 22:54:10 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=10009\n12\/05\/29 22:54:10 INFO mapred.JobClient:   FileSystemCounters\n12\/05\/29 22:54:10 INFO mapred.JobClient:     FILE_BYTES_READ=79\n12\/05\/29 22:54:10 INFO mapred.JobClient:     HDFS_BYTES_READ=354\n12\/05\/29 22:54:10 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=221338\n12\/05\/29 22:54:10 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=41\n12\/05\/29 22:54:10 INFO mapred.JobClient:   Map-Reduce Framework\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Map input records=2\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Reduce shuffle bytes=91\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Spilled Records=12\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Map output bytes=82\n12\/05\/29 22:54:10 INFO mapred.JobClient:     CPU time spent (ms)=1220\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Total committed heap usage (bytes)=426913792\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Map input bytes=50\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Combine input records=8\n12\/05\/29 22:54:10 INFO mapred.JobClient:     SPLIT_RAW_BYTES=300\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Reduce input records=6\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Reduce input groups=5\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Combine output records=6\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Physical memory (bytes) snapshot=681357312\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Reduce output records=5\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=2033528832\n12\/05\/29 22:54:10 INFO mapred.JobClient:     Map output records=8\ncf@ubuntu:~$<\/pre>\n<pre>cf@ubuntu:~$ hadoop dfs -cat \/usr\/joe\/wordcount\/output\/part-00000\nBye\t1\nGoodbye\t1\nHadoop\t2\nHello\t2\nWorld\t2\ncf@ubuntu:~$<\/pre>\n<p>\u82f1\u5358\u8a9e\u96c6\u8a08\u30d7\u30ed\u30b0\u30e9\u30e0\u306f\u6b63\u5e38\u306b\u5b9f\u884c\u3055\u308c\u307e\u3057\u305f\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>CDHv3\u3092Ubuntu Server\u306b\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb \u524d\u56de\u306f\u7c73Cloudera\u793e\u304c\u63d0\u4f9b\u3057\u3066\u3044\u308bKVM\u7528\u306e\u30c7\u30e2\u30a4\u30e1\u30fc\u30b8\u3092\u4f7f\u3063\u3066Hadoop\u3092\u4f53\u9a13\u3057\u307e\u3057\u305f\u3002 \u4eca\u56de\u306fUbuntu Server 10.04 LTS (x86_6 [&#8230;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","footnotes":""},"categories":[31],"tags":[],"class_list":["post-1930","post","type-post","status-publish","format-standard","hentry","category-higuchi"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Hadoop\u3092\u4f7f\u3063\u3066\u307f\u3088\u3046 [3] - Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3<\/title>\n<meta name=\"description\" content=\"d-higuchi |CDHv3\u3092Ubuntu Server\u306b\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb \u524d\u56de\u306f\u7c73Cloudera\u793e\u304c\u63d0\u4f9b\u3057\u3066\u3044\u308bKVM\u7528\u306e\u30c7\u30e2\u30a4\u30e1\u30fc\u30b8\u3092\u4f7f\u3063\u3066Hadoop\u3092\u4f53\u9a13\u3057\u307e\u3057\u305f\u3002\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.creationline.com\/tech-blog\/1930\" \/>\n<meta property=\"og:locale\" content=\"ja_JP\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Hadoop\u3092\u4f7f\u3063\u3066\u307f\u3088\u3046 [3] - Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3\" \/>\n<meta property=\"og:description\" content=\"d-higuchi |CDHv3\u3092Ubuntu Server\u306b\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb \u524d\u56de\u306f\u7c73Cloudera\u793e\u304c\u63d0\u4f9b\u3057\u3066\u3044\u308bKVM\u7528\u306e\u30c7\u30e2\u30a4\u30e1\u30fc\u30b8\u3092\u4f7f\u3063\u3066Hadoop\u3092\u4f53\u9a13\u3057\u307e\u3057\u305f\u3002\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.creationline.com\/tech-blog\/1930\" \/>\n<meta property=\"og:site_name\" content=\"Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/creationline\" \/>\n<meta property=\"article:published_time\" content=\"2012-06-16T02:20:19+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-08-29T02:10:21+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.creationline.com\/tech-blog\/cms_x3GWkuX\/wp-content\/uploads\/2026\/01\/screenshot.png\" \/>\n\t<meta property=\"og:image:width\" content=\"470\" \/>\n\t<meta property=\"og:image:height\" content=\"394\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Daisuke Higuchi\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@creationline\" \/>\n<meta name=\"twitter:site\" content=\"@creationline\" \/>\n<meta name=\"twitter:label1\" content=\"\u57f7\u7b46\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"Daisuke Higuchi\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u63a8\u5b9a\u8aad\u307f\u53d6\u308a\u6642\u9593\" \/>\n\t<meta name=\"twitter:data2\" content=\"9\u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/1930#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/1930\"},\"author\":{\"name\":\"Daisuke Higuchi\",\"@id\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/#\\\/schema\\\/person\\\/16f1373831fb6fd17387f16ae1195206\"},\"headline\":\"Hadoop\u3092\u4f7f\u3063\u3066\u307f\u3088\u3046 [3]\",\"datePublished\":\"2012-06-16T02:20:19+00:00\",\"dateModified\":\"2023-08-29T02:10:21+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/1930\"},\"wordCount\":74,\"articleSection\":[\"d-higuchi\"],\"inLanguage\":\"ja\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/1930\",\"url\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/1930\",\"name\":\"Hadoop\u3092\u4f7f\u3063\u3066\u307f\u3088\u3046 [3] - Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/#website\"},\"datePublished\":\"2012-06-16T02:20:19+00:00\",\"dateModified\":\"2023-08-29T02:10:21+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/#\\\/schema\\\/person\\\/16f1373831fb6fd17387f16ae1195206\"},\"description\":\"d-higuchi |CDHv3\u3092Ubuntu Server\u306b\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb \u524d\u56de\u306f\u7c73Cloudera\u793e\u304c\u63d0\u4f9b\u3057\u3066\u3044\u308bKVM\u7528\u306e\u30c7\u30e2\u30a4\u30e1\u30fc\u30b8\u3092\u4f7f\u3063\u3066Hadoop\u3092\u4f53\u9a13\u3057\u307e\u3057\u305f\u3002\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/1930#breadcrumb\"},\"inLanguage\":\"ja\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/1930\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/1930#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"HOME\",\"item\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Hadoop\u3092\u4f7f\u3063\u3066\u307f\u3088\u3046 [3]\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/#website\",\"url\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/\",\"name\":\"Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3\",\"description\":\"\u30a2\u30b8\u30e3\u30a4\u30eb\uff06DevOps\u3001\u30af\u30e9\u30a6\u30c9\u30cd\u30a4\u30c6\u30a3\u30d6\u3001AI\uff06LLM\u306e\u5148\u7aef\u6280\u8853\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"ja\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/#\\\/schema\\\/person\\\/16f1373831fb6fd17387f16ae1195206\",\"name\":\"Daisuke Higuchi\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"ja\",\"@id\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/cms_x3GWkuX\\\/wp-content\\\/uploads\\\/2023\\\/08\\\/d-higuchi-wp-icon-230x230.png\",\"url\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/cms_x3GWkuX\\\/wp-content\\\/uploads\\\/2023\\\/08\\\/d-higuchi-wp-icon-230x230.png\",\"contentUrl\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/cms_x3GWkuX\\\/wp-content\\\/uploads\\\/2023\\\/08\\\/d-higuchi-wp-icon-230x230.png\",\"caption\":\"Daisuke Higuchi\"},\"description\":\"Chef\u30fbDocker\u30fbMirantis\u88fd\u54c1\u306a\u3069\u306e\u6280\u8853\u8981\u7d20\u306b\u52a0\u3048\u3066\u3001\u4f1a\u8b70\u306e\u9032\u3081\u65b9\u30fb\u6587\u7ae0\u306e\u66f8\u304d\u65b9\u306a\u3069\u306e\u696d\u52d9\u6539\u5584\u306b\u3082\u53d6\u308a\u7d44\u3093\u3067\u3044\u307e\u3059\u3002\u300cChef\u6d3b\u7528\u30ac\u30a4\u30c9\u300d\u5171\u8457\u306e\u307b\u304b\u3001Debian Official Developer\u3082\u3084\u3063\u3066\u3044\u307e\u3059\u3002\",\"url\":\"https:\\\/\\\/www.creationline.com\\\/tech-blog\\\/author\\\/higuchi\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Hadoop\u3092\u4f7f\u3063\u3066\u307f\u3088\u3046 [3] - Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3","description":"d-higuchi |CDHv3\u3092Ubuntu Server\u306b\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb \u524d\u56de\u306f\u7c73Cloudera\u793e\u304c\u63d0\u4f9b\u3057\u3066\u3044\u308bKVM\u7528\u306e\u30c7\u30e2\u30a4\u30e1\u30fc\u30b8\u3092\u4f7f\u3063\u3066Hadoop\u3092\u4f53\u9a13\u3057\u307e\u3057\u305f\u3002","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.creationline.com\/tech-blog\/1930","og_locale":"ja_JP","og_type":"article","og_title":"Hadoop\u3092\u4f7f\u3063\u3066\u307f\u3088\u3046 [3] - Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3","og_description":"d-higuchi |CDHv3\u3092Ubuntu Server\u306b\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb \u524d\u56de\u306f\u7c73Cloudera\u793e\u304c\u63d0\u4f9b\u3057\u3066\u3044\u308bKVM\u7528\u306e\u30c7\u30e2\u30a4\u30e1\u30fc\u30b8\u3092\u4f7f\u3063\u3066Hadoop\u3092\u4f53\u9a13\u3057\u307e\u3057\u305f\u3002","og_url":"https:\/\/www.creationline.com\/tech-blog\/1930","og_site_name":"Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3","article_publisher":"https:\/\/www.facebook.com\/creationline","article_published_time":"2012-06-16T02:20:19+00:00","article_modified_time":"2023-08-29T02:10:21+00:00","og_image":[{"width":470,"height":394,"url":"https:\/\/www.creationline.com\/tech-blog\/cms_x3GWkuX\/wp-content\/uploads\/2026\/01\/screenshot.png","type":"image\/png"}],"author":"Daisuke Higuchi","twitter_card":"summary_large_image","twitter_creator":"@creationline","twitter_site":"@creationline","twitter_misc":{"\u57f7\u7b46\u8005":"Daisuke Higuchi","\u63a8\u5b9a\u8aad\u307f\u53d6\u308a\u6642\u9593":"9\u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.creationline.com\/tech-blog\/1930#article","isPartOf":{"@id":"https:\/\/www.creationline.com\/tech-blog\/1930"},"author":{"name":"Daisuke Higuchi","@id":"https:\/\/www.creationline.com\/tech-blog\/#\/schema\/person\/16f1373831fb6fd17387f16ae1195206"},"headline":"Hadoop\u3092\u4f7f\u3063\u3066\u307f\u3088\u3046 [3]","datePublished":"2012-06-16T02:20:19+00:00","dateModified":"2023-08-29T02:10:21+00:00","mainEntityOfPage":{"@id":"https:\/\/www.creationline.com\/tech-blog\/1930"},"wordCount":74,"articleSection":["d-higuchi"],"inLanguage":"ja"},{"@type":"WebPage","@id":"https:\/\/www.creationline.com\/tech-blog\/1930","url":"https:\/\/www.creationline.com\/tech-blog\/1930","name":"Hadoop\u3092\u4f7f\u3063\u3066\u307f\u3088\u3046 [3] - Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3","isPartOf":{"@id":"https:\/\/www.creationline.com\/tech-blog\/#website"},"datePublished":"2012-06-16T02:20:19+00:00","dateModified":"2023-08-29T02:10:21+00:00","author":{"@id":"https:\/\/www.creationline.com\/tech-blog\/#\/schema\/person\/16f1373831fb6fd17387f16ae1195206"},"description":"d-higuchi |CDHv3\u3092Ubuntu Server\u306b\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb \u524d\u56de\u306f\u7c73Cloudera\u793e\u304c\u63d0\u4f9b\u3057\u3066\u3044\u308bKVM\u7528\u306e\u30c7\u30e2\u30a4\u30e1\u30fc\u30b8\u3092\u4f7f\u3063\u3066Hadoop\u3092\u4f53\u9a13\u3057\u307e\u3057\u305f\u3002","breadcrumb":{"@id":"https:\/\/www.creationline.com\/tech-blog\/1930#breadcrumb"},"inLanguage":"ja","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.creationline.com\/tech-blog\/1930"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.creationline.com\/tech-blog\/1930#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"HOME","item":"https:\/\/www.creationline.com\/tech-blog"},{"@type":"ListItem","position":2,"name":"Hadoop\u3092\u4f7f\u3063\u3066\u307f\u3088\u3046 [3]"}]},{"@type":"WebSite","@id":"https:\/\/www.creationline.com\/tech-blog\/#website","url":"https:\/\/www.creationline.com\/tech-blog\/","name":"Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3","description":"\u30a2\u30b8\u30e3\u30a4\u30eb\uff06DevOps\u3001\u30af\u30e9\u30a6\u30c9\u30cd\u30a4\u30c6\u30a3\u30d6\u3001AI\uff06LLM\u306e\u5148\u7aef\u6280\u8853","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.creationline.com\/tech-blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"ja"},{"@type":"Person","@id":"https:\/\/www.creationline.com\/tech-blog\/#\/schema\/person\/16f1373831fb6fd17387f16ae1195206","name":"Daisuke Higuchi","image":{"@type":"ImageObject","inLanguage":"ja","@id":"https:\/\/www.creationline.com\/tech-blog\/cms_x3GWkuX\/wp-content\/uploads\/2023\/08\/d-higuchi-wp-icon-230x230.png","url":"https:\/\/www.creationline.com\/tech-blog\/cms_x3GWkuX\/wp-content\/uploads\/2023\/08\/d-higuchi-wp-icon-230x230.png","contentUrl":"https:\/\/www.creationline.com\/tech-blog\/cms_x3GWkuX\/wp-content\/uploads\/2023\/08\/d-higuchi-wp-icon-230x230.png","caption":"Daisuke Higuchi"},"description":"Chef\u30fbDocker\u30fbMirantis\u88fd\u54c1\u306a\u3069\u306e\u6280\u8853\u8981\u7d20\u306b\u52a0\u3048\u3066\u3001\u4f1a\u8b70\u306e\u9032\u3081\u65b9\u30fb\u6587\u7ae0\u306e\u66f8\u304d\u65b9\u306a\u3069\u306e\u696d\u52d9\u6539\u5584\u306b\u3082\u53d6\u308a\u7d44\u3093\u3067\u3044\u307e\u3059\u3002\u300cChef\u6d3b\u7528\u30ac\u30a4\u30c9\u300d\u5171\u8457\u306e\u307b\u304b\u3001Debian Official Developer\u3082\u3084\u3063\u3066\u3044\u307e\u3059\u3002","url":"https:\/\/www.creationline.com\/tech-blog\/author\/higuchi"}]}},"_links":{"self":[{"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/posts\/1930","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/comments?post=1930"}],"version-history":[{"count":1,"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/posts\/1930\/revisions"}],"predecessor-version":[{"id":65701,"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/posts\/1930\/revisions\/65701"}],"wp:attachment":[{"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/media?parent=1930"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/categories?post=1930"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/tags?post=1930"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}