開発ログ2017年8月31日
今日のミッション
Javaクライアント接続Hbaseの問題の解決
ログ＃ログ＃
2017年8月31日10:27:09
Ambariがダウンロードしたhbase-site.xmlをプロファイルとして使用してテストクラスを実行
Zookeeperの接続に何か問題があるように見えて、ずっと再接続して、解決しようとしています
2017年8月31日10:46:44
ホストファイルを修正して、中のマッピング名が間違っていることに気づきました
2017年8月31日11:02:14
あいつがつながった
2017年8月31日11:22:40
ノートを書いていろいろな穴を記録してください.
2017年8月31日14:18:57
メモ完了.オリジナルJava APIを使用してHBAseに接続する問題は解決されました.次にspring-data-hadoopの問題を解決します
2017年8月31日15:30:31
spring-data-hadoopが操作を実行した後にいつも1つの間違いを報告する問題を解決する方法を考えます
接続を解除するときに何か問題があったように見えます
本日のまとめ
その後spring-data-hadoopの問題も解決した.しかし、解決策は何か手段を使って実行させないだけだ.どうせ何をしているのか分からないので、新聞が見えなければOKではないでしょうか.
冗談ですが、私はどうしてそんなに無責任な人ですか.実はJIRAで問題の提出を見つけましたが、解決していないようです.
またspring-data-hadoopの更新速度はHBAseに遅れている.公式最新版のreference guideには、最新版Hbase-clientでdeprecatedされたインタフェースと様々な方法が書かれています.
また、退勤間際に新たな緊急任務を受けた.っていうかそんなに緊急でもないし・・・でも緊張した雰囲気でした.いろいろなインターフェースが本当にイライラしています.
PS:有道雲markdownは字が多い時本当にカードが爆発しました.開発ログを記録するのに適したツールがありますか?
//end
Javaクライアント接続Hbaseの問題の解決
ログ＃ログ＃
2017年8月31日10:27:09
Ambariがダウンロードしたhbase-site.xmlをプロファイルとして使用してテストクラスを実行
@Test
public void test2() {
try {
Configuration conf = HBaseConfiguration.create();
Connection connection = ConnectionFactory.createConnection(conf);
System.out.println("-----------------------1");
Admin admin = connection.getAdmin();
System.out.println("-----------------------2");
System.out.println(admin.tableExists(TableName.valueOf("testtable")));
System.out.println("-----------------------3");
} catch (Exception e) {
e.printStackTrace();
}
}admin.tableExists(TableName.valueOf("testtable"))のコンテンツの実行時にコンソール出力2017-08-31 10:28:57.533 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 3,4 replyHeader:: 3,42949673282,0 request:: '/hbase-unsecure/meta-region-server,F response:: #ffffffff0001a726567696f6e7365727665723a3630303230ffffffdd391a3760ffffffd4ffffff8dffffffe750425546afa26e3210fffffff4ffffffd4318ffffffbcffffffdeffffff8fffffffe8ffffffe22b100,s{42949673005,42949673039,1503993833049,1503994134386,1,0,0,0,54,0,42949673005}
2017-08-31 10:28:57.542 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 4,8 replyHeader:: 4,42949673282,0 request:: '/hbase-unsecure,F response:: v{'meta-region-server,'backup-masters,'region-in-transition,'draining,'table,'running,'table-lock,'master,'namespace,'hbaseid,'online-snapshot,'replication,'splitWAL,'recovering-regions,'rs}
2017-08-31 10:29:00.213 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 5,4 replyHeader:: 5,42949673282,0 request:: '/hbase-unsecure/meta-region-server,F response:: #ffffffff0001a726567696f6e7365727665723a3630303230ffffffdd391a3760ffffffd4ffffff8dffffffe750425546afa26e3210fffffff4ffffffd4318ffffffbcffffffdeffffff8fffffffe8ffffffe22b100,s{42949673005,42949673039,1503993833049,1503994134386,1,0,0,0,54,0,42949673005}
2017-08-31 10:29:00.217 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,42949673282,0 request:: '/hbase-unsecure,F response:: v{'meta-region-server,'backup-masters,'region-in-transition,'draining,'table,'running,'table-lock,'master,'namespace,'hbaseid,'online-snapshot,'replication,'splitWAL,'recovering-regions,'rs}
2017-08-31 10:29:00.421 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 7,4 replyHeader:: 7,42949673282,0 request:: '/hbase-unsecure/meta-region-server,F response:: #ffffffff0001a726567696f6e7365727665723a3630303230ffffffdd391a3760ffffffd4ffffff8dffffffe750425546afa26e3210fffffff4ffffffd4318ffffffbcffffffdeffffff8fffffffe8ffffffe22b100,s{42949673005,42949673039,1503993833049,1503994134386,1,0,0,0,54,0,42949673005}
2017-08-31 10:29:00.425 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,42949673282,0 request:: '/hbase-unsecure,F response:: v{'meta-region-server,'backup-masters,'region-in-transition,'draining,'table,'running,'table-lock,'master,'namespace,'hbaseid,'online-snapshot,'replication,'splitWAL,'recovering-regions,'rs}
2017-08-31 10:29:00.731 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 9,4 replyHeader:: 9,42949673282,0 request:: '/hbase-unsecure/meta-region-server,F response:: #ffffffff0001a726567696f6e7365727665723a3630303230ffffffdd391a3760ffffffd4ffffff8dffffffe750425546afa26e3210fffffff4ffffffd4318ffffffbcffffffdeffffff8fffffffe8ffffffe22b100,s{42949673005,42949673039,1503993833049,1503994134386,1,0,0,0,54,0,42949673005}
2017-08-31 10:29:00.736 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 10,8 replyHeader:: 10,42949673282,0 request:: '/hbase-unsecure,F response:: v{'meta-region-server,'backup-masters,'region-in-transition,'draining,'table,'running,'table-lock,'master,'namespace,'hbaseid,'online-snapshot,'replication,'splitWAL,'recovering-regions,'rs}
2017-08-31 10:29:01.243 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 11,4 replyHeader:: 11,42949673282,0 request:: '/hbase-unsecure/meta-region-server,F response:: #ffffffff0001a726567696f6e7365727665723a3630303230ffffffdd391a3760ffffffd4ffffff8dffffffe750425546afa26e3210fffffff4ffffffd4318ffffffbcffffffdeffffff8fffffffe8ffffffe22b100,s{42949673005,42949673039,1503993833049,1503994134386,1,0,0,0,54,0,42949673005}
2017-08-31 10:29:01.248 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 12,8 replyHeader:: 12,42949673282,0 request:: '/hbase-unsecure,F response:: v{'meta-region-server,'backup-masters,'region-in-transition,'draining,'table,'running,'table-lock,'master,'namespace,'hbaseid,'online-snapshot,'replication,'splitWAL,'recovering-regions,'rs}
2017-08-31 10:29:02.256 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 13,4 replyHeader:: 13,42949673282,0 request:: '/hbase-unsecure/meta-region-server,F response:: #ffffffff0001a726567696f6e7365727665723a3630303230ffffffdd391a3760ffffffd4ffffff8dffffffe750425546afa26e3210fffffff4ffffffd4318ffffffbcffffffdeffffff8fffffffe8ffffffe22b100,s{42949673005,42949673039,1503993833049,1503994134386,1,0,0,0,54,0,42949673005}
2017-08-31 10:29:02.260 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 14,8 replyHeader:: 14,42949673282,0 request:: '/hbase-unsecure,F response:: v{'meta-region-server,'backup-masters,'region-in-transition,'draining,'table,'running,'table-lock,'master,'namespace,'hbaseid,'online-snapshot,'replication,'splitWAL,'recovering-regions,'rs}
2017-08-31 10:29:04.281 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 15,4 replyHeader:: 15,42949673282,0 request:: '/hbase-unsecure/meta-region-server,F response:: #ffffffff0001a726567696f6e7365727665723a3630303230ffffffdd391a3760ffffffd4ffffff8dffffffe750425546afa26e3210fffffff4ffffffd4318ffffffbcffffffdeffffff8fffffffe8ffffffe22b100,s{42949673005,42949673039,1503993833049,1503994134386,1,0,0,0,54,0,42949673005}
2017-08-31 10:29:04.285 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 16,8 replyHeader:: 16,42949673282,0 request:: '/hbase-unsecure,F response:: v{'meta-region-server,'backup-masters,'region-in-transition,'draining,'table,'running,'table-lock,'master,'namespace,'hbaseid,'online-snapshot,'replication,'splitWAL,'recovering-regions,'rs}
2017-08-31 10:29:08.319 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 17,4 replyHeader:: 17,42949673282,0 request:: '/hbase-unsecure/meta-region-server,F response:: #ffffffff0001a726567696f6e7365727665723a3630303230ffffffdd391a3760ffffffd4ffffff8dffffffe750425546afa26e3210fffffff4ffffffd4318ffffffbcffffffdeffffff8fffffffe8ffffffe22b100,s{42949673005,42949673039,1503993833049,1503994134386,1,0,0,0,54,0,42949673005}
2017-08-31 10:29:08.321 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 18,8 replyHeader:: 18,42949673282,0 request:: '/hbase-unsecure,F response:: v{'meta-region-server,'backup-masters,'region-in-transition,'draining,'table,'running,'table-lock,'master,'namespace,'hbaseid,'online-snapshot,'replication,'splitWAL,'recovering-regions,'rs}
2017-08-31 10:29:18.322 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Got ping response for sessionid: 0x25e2d00f9630013 after 1ms
2017-08-31 10:29:18.359 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 19,4 replyHeader:: 19,42949673282,0 request:: '/hbase-unsecure/meta-region-server,F response:: #ffffffff0001a726567696f6e7365727665723a3630303230ffffffdd391a3760ffffffd4ffffff8dffffffe750425546afa26e3210fffffff4ffffffd4318ffffffbcffffffdeffffff8fffffffe8ffffffe22b100,s{42949673005,42949673039,1503993833049,1503994134386,1,0,0,0,54,0,42949673005}
2017-08-31 10:29:18.363 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 20,8 replyHeader:: 20,42949673282,0 request:: '/hbase-unsecure,F response:: v{'meta-region-server,'backup-masters,'region-in-transition,'draining,'table,'running,'table-lock,'master,'namespace,'hbaseid,'online-snapshot,'replication,'splitWAL,'recovering-regions,'rs}
2017-08-31 10:29:28.363 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Got ping response for sessionid: 0x25e2d00f9630013 after 0ms
2017-08-31 10:29:30.686 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 21,4 replyHeader:: 21,42949673282,0 request:: '/hbase-unsecure/meta-region-server,F response:: #ffffffff0001a726567696f6e7365727665723a3630303230ffffffdd391a3760ffffffd4ffffff8dffffffe750425546afa26e3210fffffff4ffffffd4318ffffffbcffffffdeffffff8fffffffe8ffffffe22b100,s{42949673005,42949673039,1503993833049,1503994134386,1,0,0,0,54,0,42949673005}
2017-08-31 10:29:30.689 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 22,8 replyHeader:: 22,42949673282,0 request:: '/hbase-unsecure,F response:: v{'meta-region-server,'backup-masters,'region-in-transition,'draining,'table,'running,'table-lock,'master,'namespace,'hbaseid,'online-snapshot,'replication,'splitWAL,'recovering-regions,'rs}
2017-08-31 10:29:40.690 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Got ping response for sessionid: 0x25e2d00f9630013 after 1ms
2017-08-31 10:29:43.015 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 23,4 replyHeader:: 23,42949673282,0 request:: '/hbase-unsecure/meta-region-server,F response:: #ffffffff0001a726567696f6e7365727665723a3630303230ffffffdd391a3760ffffffd4ffffff8dffffffe750425546afa26e3210fffffff4ffffffd4318ffffffbcffffffdeffffff8fffffffe8ffffffe22b100,s{42949673005,42949673039,1503993833049,1503994134386,1,0,0,0,54,0,42949673005}
2017-08-31 10:29:43.019 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 24,8 replyHeader:: 24,42949673282,0 request:: '/hbase-unsecure,F response:: v{'meta-region-server,'backup-masters,'region-in-transition,'draining,'table,'running,'table-lock,'master,'namespace,'hbaseid,'online-snapshot,'replication,'splitWAL,'recovering-regions,'rs}
2017-08-31 10:29:45.274 [hconnection-0x5e53e1f3-shared--pool1-t1] INFO org.apache.hadoop.hbase.client.RpcRetryingCaller - Call exception, tries=10, retries=35, started=47726 ms ago, cancelled=false, msg=n2 row 'testtable,,' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=n2,60020,1503993786172, seqNum=0
2017-08-31 10:29:53.021 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Got ping response for sessionid: 0x25e2d00f9630013 after 0ms
2017-08-31 10:29:55.346 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 25,4 replyHeader:: 25,42949673282,0 request:: '/hbase-unsecure/meta-region-server,F response:: #ffffffff0001a726567696f6e7365727665723a3630303230ffffffdd391a3760ffffffd4ffffff8dffffffe750425546afa26e3210fffffff4ffffffd4318ffffffbcffffffdeffffff8fffffffe8ffffffe22b100,s{42949673005,42949673039,1503993833049,1503994134386,1,0,0,0,54,0,42949673005}
2017-08-31 10:29:55.350 [main-SendThread(n0:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x25e2d00f9630013, packet:: clientPath:null serverPath:null finished:false header:: 26,8 replyHeader:: 26,42949673282,0 request:: '/hbase-unsecure,F response:: v{'meta-region-server,'backup-masters,'region-in-transition,'draining,'table,'running,'table-lock,'master,'namespace,'hbaseid,'online-snapshot,'replication,'splitWAL,'recovering-regions,'rs}
2017-08-31 10:29:57.602 [hconnection-0x5e53e1f3-shared--pool1-t1] INFO org.apache.hadoop.hbase.client.RpcRetryingCaller - Call exception, tries=11, retries=35, started=60057 ms ago, cancelled=false, msg=n2 row 'testtable,,' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=n2,60020,1503993786172, seqNum=0
org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=36, exceptions:
Thu Aug 31 10:29:57 CST 2017, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=80058: n2 row 'testtable,,' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=n2,60020,1503993786172, seqNum=0
at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:276)
at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:210)
at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:60)
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:212)
at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:314)
at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:289)
at org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:164)
at org.apache.hadoop.hbase.client.ClientScanner.(ClientScanner.java:159)
at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:796)
at org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:602)
at org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:366)
at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:408)
at com.thunisoft.ddap.common.HbaseConnect.test2(HbaseConnect.java:43)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:86)
at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:459)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:675)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:382)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:192)
Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=80058: n2 row ' testtable,,' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=n2,60020,1503993786172, seqNum=0
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:171)
at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.net.UnknownHostException: n2
at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.(AbstractRpcClient.java:315)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient.createBlockingRpcChannel(AbstractRpcClient.java:267)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getClient(ConnectionManager.java:1641)
at org.apache.hadoop.hbase.client.ScannerCallable.prepare(ScannerCallable.java:163)
at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.prepare(ScannerCallableWithReplicas.java:376)
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:135)
... 4 more Zookeeperの接続に何か問題があるように見えて、ずっと再接続して、解決しようとしています
2017年8月31日10:46:44
ホストファイルを修正して、中のマッピング名が間違っていることに気づきました
2017年8月31日11:02:14
あいつがつながった
2017年8月31日11:22:40
ノートを書いていろいろな穴を記録してください.
2017年8月31日14:18:57
メモ完了.オリジナルJava APIを使用してHBAseに接続する問題は解決されました.次にspring-data-hadoopの問題を解決します
2017年8月31日15:30:31
spring-data-hadoopが操作を実行した後にいつも1つの間違いを報告する問題を解決する方法を考えます
017-08-31 15:21:40.616 [Thread-1] ERROR org.apache.hadoop.hbase.client.ConnectionManager - Connection not found in the list, can't delete it (connection key=HConnectionKey{properties={hbase.rpc.timeout=60000, hbase.zookeeper.property.clientPort=2181, hbase.client.pause=100, zookeeper.znode.parent=/hbase-unsecure, hbase.client.retries.number=35, hbase.zookeeper.quorum=limulus,n0,n1}, username='dlgaoqiang'}). May be the key was modified?
java.lang.Exception: null
at org.apache.hadoop.hbase.client.ConnectionManager.deleteConnection(ConnectionManager.java:510)
at org.apache.hadoop.hbase.client.ConnectionManager.deleteConnection(ConnectionManager.java:444)
at org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(HConnectionManager.java:249)
at org.springframework.data.hadoop.hbase.HbaseConfigurationFactoryBean.destroy(HbaseConfigurationFactoryBean.java:80)
at org.springframework.beans.factory.support.DisposableBeanAdapter.destroy(DisposableBeanAdapter.java:272)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroyBean(DefaultSingletonBeanRegistry.java:578)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroySingleton(DefaultSingletonBeanRegistry.java:554)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.destroySingleton(DefaultListableBeanFactory.java:961)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroySingletons(DefaultSingletonBeanRegistry.java:523)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.destroySingletons(DefaultListableBeanFactory.java:968)
at org.springframework.context.support.AbstractApplicationContext.destroyBeans(AbstractApplicationContext.java:1030)
at org.springframework.context.support.AbstractApplicationContext.doClose(AbstractApplicationContext.java:1006)
at org.springframework.context.support.AbstractApplicationContext$2.run(AbstractApplicationContext.java:929)接続を解除するときに何か問題があったように見えます
本日のまとめ
その後spring-data-hadoopの問題も解決した.しかし、解決策は何か手段を使って実行させないだけだ.どうせ何をしているのか分からないので、新聞が見えなければOKではないでしょうか.
冗談ですが、私はどうしてそんなに無責任な人ですか.実はJIRAで問題の提出を見つけましたが、解決していないようです.
またspring-data-hadoopの更新速度はHBAseに遅れている.公式最新版のreference guideには、最新版Hbase-clientでdeprecatedされたインタフェースと様々な方法が書かれています.
また、退勤間際に新たな緊急任務を受けた.っていうかそんなに緊急でもないし・・・でも緊張した雰囲気でした.いろいろなインターフェースが本当にイライラしています.
PS:有道雲markdownは字が多い時本当にカードが爆発しました.開発ログを記録するのに適したツールがありますか?
//end