目录

大数据环境部署

../../images/weixin_public.png

centos 系统安装基础 开发环境

1
2
yum groupinstall "Development Tools"
yum install net-tools -y

配置免密切换生成

1
2
3
4
ssh-keygen
ssh-copy-id root@192.168.75.41
ssh-copy-id root@192.168.75.42
ssh-copy-id root@192.168.75.43

配置集群主机名映射

1
/etc/hosts

配置集群系统环境变量

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38

edit /etc/profile
export JMX_PORT=9999

# JAVA
JAVA_HOME=/usr/local/java
PATH=$PATH:$JAVA_HOME/bin
CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export JAVA_HOME  CLASSPATH  PATH

# ES_JAVA_HOME
ES_JAVA_HOME=/bigdata/elasticsearch7/jdk
export PATH=$ES_JAVA_HOME/bin:$PATH
export PATH

# Zookeeper
export ZK_HOME=/bigdata/zookeeper
export PATH=$ZK_HOME/bin:$PATH
export PATH

# Kafka
export KAFKA_HOME=/bigdata/kafka
export PATH=$KAFKA_HOME/bin:$PATH
export PATH

# Flink
export FLINK_HOME=/bigdata/flink
export PATH=$FLINK_HOME/bin:$PATH
export PATH

#hodoop
export HADOOP_HOME=/bigdata/hadoop
export PATH=${HADOOP_HOME}/bin:${HADOOP_HOME/sbin}:$PATH

#HBASE
export HBASE_HOME=/bigdata/hbase
export PATH=$PATH:$HBASE_HOME/bin

选配JMX_PORT

1
2
3
edit /etc/profile
export JMX_PORT=9999

Zookeeper 集群环境命令行

1
2
zkServer.sh start      --- 启动集群服务
zkServer.sh stop       --- 结束集群服务
1
2
start-cluster.sh       --- 启动集群服务
stop-cluster.sh        --- 结束集群服务

Hdfs 集群环境命令行

1
2
start-dfs.sh           --- 启动集群服务
stop-dfs.sh            --- 结束集群服务

Hbase 集群环境命令行

1
2
start-hbase.sh         --- 启动集群服务
stop-hbase.sh          --- 结束集群服务