Hadoop1.2.1安装以及部署
实验目的: 1 熟悉hadoop集群以及hadoop起源历史。 2 了解hadoop使用范围以及所需基础知识。 3 安装hadoop 1.x 实验版本。 实验设备以及所用软件: 笔记本电脑、VMware、Centos6.3(3台虚拟机) 实验过程: 1、 启动VMware-准备好三台虚拟机的安装,这里使用
实验目的:
1 熟悉hadoop集群以及hadoop起源历史。
2 了解hadoop使用范围以及所需基础知识。
3 安装hadoop 1.x 实验版本。
实验设备以及所用软件:
笔记本电脑、VMware、Centos6.3(3台虚拟机)
实验过程:
1、 启动VMware-准备好三台虚拟机的安装,这里使用的是Centos6.3简易版的安装,三台机器分别命名为master,slave,slave1,开启gpm服务,启动三台虚拟机,使用ifconfig命令查得master,slave,slave1的ip地址分别为192.168.1.112,192.168.1.111,192.168.1.109。在root权限下使用chkconfigiptables off命令关闭防火墙。
2、 ssh 免密码登陆普通用户模式下,首先ssh ip地址测试三台机子能否互相通信,若不能通信则检查ip是否在同一个网段,cd命令返回根目录,三台都使用命令
ssh-keygen –t rsa,命令行ls –a,检查根目录下是否有.ssh这个目录,cd .ssh进入目录下,ls -a检查是否有id_rsa.pub和id_rsa。接下来,通过命令
scp ./id_rsa.pub hadoop@ip:/home/hadoop/.ssh/authorized_keys,鼠标命令将三台机子的公钥全部复制粘贴进authorized-keys,放到每台虚拟系统的.ssh目录下,然后通过ssh ip三台机子检测是否成功。注意:这里ssh ip成功的前提条件是用户名相同,不然使用ssh 用户名@ip才能成功,用户名相同也是这个实验成功的条件。
3.网上下载jdk1.8.0_05和hadoop1.2.1版本到master上,使用tar –xzvf jdk包或hadoop包,这是个漫长的等待过程,大家耐心等待。
4.接下来修改hadoop相关文件命令,在根目录时,cd hadoop1.2.1,cd conf,
vi hadoop-env.sh,修改jdk所在目录位置。
vi core-site.xml
vi mapred-site.xml
vi hdfs-site.xml
vi masters
vi slaves
5.把hadoop1.2.1以及jdk1.8.0_05发送到另外两台机器上(scp -r ./文件名 用户名@ip:/位置)
6.三台机器中修改hosts文件,vi /etc/hosts,把ip地址跟用户名写入文件,然后ping slave1,ping slave,ping master,检测hosts文件是否有错误。
进入hadoop1.2.1文件(cd hadoop1.2.1),执行bin/start-all.sh成功!!!
7.最后去jdk里面的jpm服务里面检测,成功!

Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

AI Hentai Generator
Generate AI Hentai for free.

Hot Article

Hot Tools

Notepad++7.3.1
Easy-to-use and free code editor

SublimeText3 Chinese version
Chinese version, very easy to use

Zend Studio 13.0.1
Powerful PHP integrated development environment

Dreamweaver CS6
Visual web development tools

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Hot Topics

Solution to the problem that Win11 system cannot install Chinese language pack With the launch of Windows 11 system, many users began to upgrade their operating system to experience new functions and interfaces. However, some users found that they were unable to install the Chinese language pack after upgrading, which troubled their experience. In this article, we will discuss the reasons why Win11 system cannot install the Chinese language pack and provide some solutions to help users solve this problem. Cause Analysis First, let us analyze the inability of Win11 system to

You may not be able to install guest additions to a virtual machine in OracleVirtualBox. When we click on Devices>InstallGuestAdditionsCDImage, it just throws an error as shown below: VirtualBox - Error: Unable to insert virtual disc C: Programming FilesOracleVirtualBoxVBoxGuestAdditions.iso into ubuntu machine In this post we will understand what happens when you What to do when you can't install guest additions in VirtualBox. Unable to install guest additions in VirtualBox If you can't install it in Virtua

If you have successfully downloaded the installation file of Baidu Netdisk, but cannot install it normally, it may be that there is an error in the integrity of the software file or there is a problem with the residual files and registry entries. Let this site take care of it for users. Let’s introduce the analysis of the problem that Baidu Netdisk is successfully downloaded but cannot be installed. Analysis of the problem that Baidu Netdisk downloaded successfully but could not be installed 1. Check the integrity of the installation file: Make sure that the downloaded installation file is complete and not damaged. You can download it again, or try to download the installation file from another trusted source. 2. Turn off anti-virus software and firewall: Some anti-virus software or firewall programs may prevent the installation program from running properly. Try disabling or exiting the anti-virus software and firewall, then re-run the installation

Installing Android applications on Linux has always been a concern for many users. Especially for Linux users who like to use Android applications, it is very important to master how to install Android applications on Linux systems. Although running Android applications directly on Linux is not as simple as on the Android platform, by using emulators or third-party tools, we can still happily enjoy Android applications on Linux. The following will introduce how to install Android applications on Linux systems.

If you have used Docker, you must understand daemons, containers, and their functions. A daemon is a service that runs in the background when a container is already in use in any system. Podman is a free management tool for managing and creating containers without relying on any daemon such as Docker. Therefore, it has advantages in managing containers without the need for long-term backend services. Additionally, Podman does not require root-level permissions to be used. This guide discusses in detail how to install Podman on Ubuntu24. To update the system, we first need to update the system and open the Terminal shell of Ubuntu24. During both installation and upgrade processes, we need to use the command line. a simple

While studying in high school, some students take very clear and accurate notes, taking more notes than others in the same class. For some, note-taking is a hobby, while for others, it is a necessity when they easily forget small information about anything important. Microsoft's NTFS application is particularly useful for students who wish to save important notes beyond regular lectures. In this article, we will describe the installation of Ubuntu applications on Ubuntu24. Updating the Ubuntu System Before installing the Ubuntu installer, on Ubuntu24 we need to ensure that the newly configured system has been updated. We can use the most famous "a" in Ubuntu system

1. Introduction Over the past few years, YOLOs have become the dominant paradigm in the field of real-time object detection due to its effective balance between computational cost and detection performance. Researchers have explored YOLO's architectural design, optimization goals, data expansion strategies, etc., and have made significant progress. At the same time, relying on non-maximum suppression (NMS) for post-processing hinders end-to-end deployment of YOLO and adversely affects inference latency. In YOLOs, the design of various components lacks comprehensive and thorough inspection, resulting in significant computational redundancy and limiting the capabilities of the model. It offers suboptimal efficiency, and relatively large potential for performance improvement. In this work, the goal is to further improve the performance efficiency boundary of YOLO from both post-processing and model architecture. to this end

Detailed steps to install Go language on Win7 computer Go (also known as Golang) is an open source programming language developed by Google. It is simple, efficient and has excellent concurrency performance. It is suitable for the development of cloud services, network applications and back-end systems. . Installing the Go language on a Win7 computer allows you to quickly get started with the language and start writing Go programs. The following will introduce in detail the steps to install the Go language on a Win7 computer, and attach specific code examples. Step 1: Download the Go language installation package and visit the Go official website
