Flink構成standaloneクラスタの高可用性とYARNクラスタの高可用性

1407 ワード

1.standaloneクラスタの高可用性
standalone     JobManager         ,          JobManager       JobManagers,             JobNamager     。
            ,    JobManager     ,           。   JobManager            。   JobManager          。

1.1構成方法
1. cd {flink_home}/conf
2. vim zoo.cfg
		#     ,  zookeeper         
		server.1=master:2888:3888
		server.2=node1:2888:3888
3. vim master
		# master       JobManagers         Web          
		master:8081
		node1:8081
		node2:8081
4. vim flink-conf.yaml
		#        
		high-availability: zookeeper
		high-availability.zookeeper.quorum:master:2181,node1:2181
		#       
		high-availability.storageDir: hdfs:///flink/ha/
		
5.    zookeeper  ,    Flink
		start-zookeeper-quorum.sh
		start-cluster.sh

2.yarnクラスタの高可用性の構成
1. vim yarn-site.xml
		#      ,   application master        
		
			  yarn.resourcemanager.am.max-attempts
			  4
			  
			    The maximum number of application master execution attempts.
			  
		
2.  vim flink-conf.yaml
		#        
		high-availability: zookeeper
		high-availability.zookeeper.quorum:master:2181,node1:2181
		#       
		high-availability.storageDir: hdfs:///flink/ha/
		#         
		yarn.application-attempts: 10

3.    zookeeper  ,    Flink
		start-zookeeper-quorum.sh
		start-cluster.sh