https://aripd.com/tags/mapreduce/ Recent content in MapReduce on ARI Systems Hugo en-us ARI Systems Sat, 16 May 2026 06:19:44 +0000 https://aripd.com/blog/hadoop/ Wed, 10 May 2017 09:58:00 +0000 https://aripd.com/blog/hadoop/ <h2 id="references">References <a href="#references" class="permalink"><i class="bi bi-link-45deg"></i></a></h2><ul> <li><a href="https://amodernstory.com/2014/09/23/installing-hadoop-on-mac-osx-yosemite/" target="_blank" rel="noopener noreferrer">Installing Hadoop on Mac</a></li> <li><a href="https://www.youtube.com/watch?v=DidEZ6qbcbI&amp;index=1&amp;list=PLh9ECzBB8tJOFZwrh12DAYIhy0oz3FR-s" target="_blank" rel="noopener noreferrer">Hadoop Eğitim Serisi (Veri Madenciliği)</a></li> <li><a href="http://hadoop.apache.org/docs/r2.8.0/hadoop-project-dist/hadoop-common/FileSystemShell.html" target="_blank" rel="noopener noreferrer">Hadoop File System Shell</a></li> </ul> <h2 id="prerequisites">Prerequisites <a href="#prerequisites" class="permalink"><i class="bi bi-link-45deg"></i></a></h2><ol> <li>Homebrew</li> </ol> <h2 id="installing-hadoop">Installing Hadoop <a href="#installing-hadoop" class="permalink"><i class="bi bi-link-45deg"></i></a></h2><div class="code-container"> <div class="code-block"> <div> <div class="code-copy" style="float: right"> <a class="icon-link icon-link-hover link-opacity-50 link-opacity-100-hover" href="#" aria-label="Copy code">Copy</a> </div> </div> <div class="highlight"><div style="color:#000;background-color:#fff;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"> <table style="border-spacing:0;padding:0;margin:0;border:0;"><tr><td style="vertical-align:top;padding:0;margin:0;border:0;"> <pre tabindex="0" style="color:#000;background-color:#fff;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code><span style="white-space:pre;-webkit-user-select:none;user-select:none;margin-right:0.4em;padding:0 0.4em 0 0.4em;color:#7f7f7f">1 </span></code></pre></td> <td style="vertical-align:top;padding:0;margin:0;border:0;;width:100%"> <pre tabindex="0" style="color:#000;background-color:#fff;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-bash" data-lang="bash"><span style="display:flex;"><span>$ brew install hadoop</span></span></code></pre></td></tr></table> </div> </div> </div> </div><p>Hadoop will be installed in the following directory /usr/local/Cellar/hadoop</p> <h2 id="configuring-hadoop">Configuring Hadoop <a href="#configuring-hadoop" class="permalink"><i class="bi bi-link-45deg"></i></a></h2><h3 id="edit-hadoop-envsh">Edit hadoop-env.sh <a href="#edit-hadoop-envsh" class="permalink"><i class="bi bi-link-45deg"></i></a></h3><p>The file can be located at /usr/local/Cellar/hadoop/2.8.0/libexec/etc/hadoop/hadoop-env.sh where 2.8.0 is the hadoop version.</p> <p>Find the line with</p> <div class="code-container"> <div class="code-block"> <div> <div class="code-copy" style="float: right"> <a class="icon-link icon-link-hover link-opacity-50 link-opacity-100-hover" href="#" aria-label="Copy code">Copy</a> </div> </div> <div class="highlight"><div style="color:#000;background-color:#fff;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"> <table style="border-spacing:0;padding:0;margin:0;border:0;"><tr><td style="vertical-align:top;padding:0;margin:0;border:0;"> <pre tabindex="0" style="color:#000;background-color:#fff;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code><span style="white-space:pre;-webkit-user-select:none;user-select:none;margin-right:0.4em;padding:0 0.4em 0 0.4em;color:#7f7f7f">1 </span></code></pre></td> <td style="vertical-align:top;padding:0;margin:0;border:0;;width:100%"> <pre tabindex="0" style="color:#000;background-color:#fff;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-gdscript3" data-lang="gdscript3"><span style="display:flex;"><span><span style="color:#5317ac">export</span> HADOOP_OPTS<span style="color:#00538b">=</span><span style="color:#2544bb">&#34;$HADOOP_OPTS -Djava.net.preferIPv4Stack=true&#34;</span></span></span></code></pre></td></tr></table> </div> </div> </div> </div><p>and change it to</p>