大数据环境部署
约 278 字
预计阅读 1 分钟

centos 系统安装基础 开发环境
1
2
|
yum groupinstall "Development Tools"
yum install net-tools -y
|
配置免密切换生成
1
2
3
4
|
ssh-keygen
ssh-copy-id root@192.168.75.41
ssh-copy-id root@192.168.75.42
ssh-copy-id root@192.168.75.43
|
配置集群主机名映射
配置集群系统环境变量
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
|
edit /etc/profile
或
export JMX_PORT=9999
# JAVA
JAVA_HOME=/usr/local/java
PATH=$PATH:$JAVA_HOME/bin
CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export JAVA_HOME CLASSPATH PATH
# ES_JAVA_HOME
ES_JAVA_HOME=/bigdata/elasticsearch7/jdk
export PATH=$ES_JAVA_HOME/bin:$PATH
export PATH
# Zookeeper
export ZK_HOME=/bigdata/zookeeper
export PATH=$ZK_HOME/bin:$PATH
export PATH
# Kafka
export KAFKA_HOME=/bigdata/kafka
export PATH=$KAFKA_HOME/bin:$PATH
export PATH
# Flink
export FLINK_HOME=/bigdata/flink
export PATH=$FLINK_HOME/bin:$PATH
export PATH
#hodoop
export HADOOP_HOME=/bigdata/hadoop
export PATH=${HADOOP_HOME}/bin:${HADOOP_HOME/sbin}:$PATH
#HBASE
export HBASE_HOME=/bigdata/hbase
export PATH=$PATH:$HBASE_HOME/bin
|
选配JMX_PORT
1
2
3
|
edit /etc/profile
或
export JMX_PORT=9999
|
Zookeeper 集群环境命令行
1
2
|
zkServer.sh start --- 启动集群服务
zkServer.sh stop --- 结束集群服务
|
Flink 集群环境命令行
1
2
|
start-cluster.sh --- 启动集群服务
stop-cluster.sh --- 结束集群服务
|
Hdfs 集群环境命令行
1
2
|
start-dfs.sh --- 启动集群服务
stop-dfs.sh --- 结束集群服务
|
Hbase 集群环境命令行
1
2
|
start-hbase.sh --- 启动集群服务
stop-hbase.sh --- 结束集群服务
|