Flink構成standaloneクラスタの高可用性とYARNクラスタの高可用性
1407 ワード
1.standaloneクラスタの高可用性
1.1構成方法
2.yarnクラスタの高可用性の構成
standalone JobManager , JobManager JobManagers, JobNamager 。
, JobManager , 。 JobManager 。 JobManager 。
1.1構成方法
1. cd {flink_home}/conf
2. vim zoo.cfg
# , zookeeper
server.1=master:2888:3888
server.2=node1:2888:3888
3. vim master
# master JobManagers Web
master:8081
node1:8081
node2:8081
4. vim flink-conf.yaml
#
high-availability: zookeeper
high-availability.zookeeper.quorum:master:2181,node1:2181
#
high-availability.storageDir: hdfs:///flink/ha/
5. zookeeper , Flink
start-zookeeper-quorum.sh
start-cluster.sh
2.yarnクラスタの高可用性の構成
1. vim yarn-site.xml
# , application master
yarn.resourcemanager.am.max-attempts
4
The maximum number of application master execution attempts.
2. vim flink-conf.yaml
#
high-availability: zookeeper
high-availability.zookeeper.quorum:master:2181,node1:2181
#
high-availability.storageDir: hdfs:///flink/ha/
#
yarn.application-attempts: 10
3. zookeeper , Flink
start-zookeeper-quorum.sh
start-cluster.sh