consul重启导致服务必须跟着重启解决方案

今天药忘吃喽~ 2023-07-10 08:12 22阅读 0赞

问题：consul作为注册中心和eureka的机制不同。

当微服务启动后首先向注册中心发注册请求，这点两者一致。之后consul在维护可用服务列表时，采用的是主动向微服务发健康检查的接口（也可以配置成微服务主动向consul发心跳，但是我看完官网和各类文章都没说清楚具体怎么搞）。如果微服务正常返回，那么就认为服务正常。eureka是等待微服务主动向eureka发心跳，eureka收到心跳后，就给这个服务续约，认为服务是正常的。

正是因为这点差异就产生了大问题！

场景一：consul和微服务间的网络不稳定，断开了几分钟。

在此情况下，consul向微服务发的健康检查请求发不通，认为微服务挂了，就从服务列表里剔除他。

当网络恢复后，注意，已经剔除的服务，consul是不会主动再发健康检查的。那么服务列表里没有他，

也就不正常了。网关的转发都是需要获取可用服务列表，才能做转发的！

这时候，你想让微服务注册上consul就只能重启微服务了。这在生产环境意味着什么就不用多说了吧。

是不是很坑？

场景二：consul因为某种情况需要重启。（可能是consul也需要投产，或者其他原因，总之就是需要重启consul）

这个场景和上面的类似。当consul重启后，之前已经注册上来的，状态正常的服务，consul忘记了。

因为他重启了，他不记得前世的服务列表。

所以这种情况下，也需要重启我们的微服务，才能使状态正常。

综上，因为consul的健康检查机制是consul主动发，跟eureka不同才导致这种问题。

问题很清楚了，要怎么解决呢？

我查了很多资料，除了consul可以用ttl的方式，让微服务主动发心跳来续约外，好像没有想成的方案。

但是这个ttl的方案，官网没仔细说，网上的文章也是一大抄，没人说的明白。

我经过研究后，发现consul提供了好多rest接口。可以通过接口注册，注销，查询等。

那么我们就可以仿照eureka的方式，主动查consul的服务列表，类似心跳。

如果没查到，或者发不通（consul挂了）那么久开始发注册的接口，把自己注册上去。

不停的发，直至成功。

我用2个服务来模拟，一个是springcloudgateway网关gate，一个是微服务one

在应用启动后起一个定时任务：

package com.example.one.init;
    
    
    import java.time.LocalDateTime;
    import java.time.format.DateTimeFormatter;
    import java.util.Iterator;
    import java.util.Map;
    import java.util.concurrent.Executors;
    import java.util.concurrent.ScheduledExecutorService;
    import java.util.concurrent.TimeUnit;
    
    import org.slf4j.Logger;
    import org.slf4j.LoggerFactory;
    import org.springframework.beans.factory.annotation.Autowired;
    import org.springframework.beans.factory.annotation.Value;
    import org.springframework.boot.ApplicationArguments;
    import org.springframework.boot.ApplicationRunner;
    import org.springframework.http.HttpEntity;
    import org.springframework.http.HttpHeaders;
    import org.springframework.http.HttpMethod;
    import org.springframework.http.MediaType;
    import org.springframework.http.ResponseEntity;
    import org.springframework.stereotype.Component;
    import org.springframework.web.client.RestTemplate;
    //CommandLineRunner ApplicationRunner
    
    
    @Component
    public class InitRunner implements ApplicationRunner {
            private static final Logger logger = LoggerFactory.getLogger(InitRunner.class);
    
            
            @Value("${spring.cloud.consul.host}")
        	private String consulip;
            
            @Value("${spring.cloud.consul.port}")
        	private String consulport;
            
        	@Value("${spring.cloud.client.ip-address}")
        	private String ip;
        
        	@Value("${spring.application.name}")
        	private String servername;
        
        	@Value("${server.port}")
        	private String port;
        	
        	@Value("${my.consul.check.register:false}")
        	private String registerFlag;//检查服务在consul列表不存在，或者consul访问不通，就不停的注册自己。保证consul因为网络不稳定或者重启，服务不正常。（微服务只有在启动是会注册自己，这样做是为了不重启服务）
            
        	@Value("${my.consul.check.interval:10}")
        	private String interval;//检查服务在consul中是否正常的频率，每interval秒检查一次
        	
        	private long intervalNum=10;//interval转成long类型
        	
            public long getIntervalNum() {
            	if(interval!=null) {
            		try {
            			intervalNum = Long.valueOf(interval.trim());
    				} catch (NumberFormatException e) {
    					intervalNum=10;
    					e.printStackTrace();
    				}
            	}
    			return intervalNum;
    		}
    		public void setIntervalNum(long intervalNum) {
    			this.intervalNum = intervalNum;
    		}
    		
    		public String getRegisterFlag() {
            	//保证只有2个值
            	if(registerFlag!=null && registerFlag.trim().equals("true")) {
            		return "true";
            	}
    			return "false";
    		}
    
    
    		public void setRegisterFlag(String registerFlag) {
    			this.registerFlag = registerFlag;
    		}
    
    
    		@Autowired
        	private RestTemplate restTemplate;
    //        @Autowired
    //        private DbRouteDefinitionRepository dbRouteDefinitionRepository;
    
            public RestTemplate getRestTemplate() {
    			return restTemplate;
    		}
    
    
    		public void setRestTemplate(RestTemplate restTemplate) {
    			this.restTemplate = restTemplate;
    		}
    
    
            @Override
            public void run(ApplicationArguments args) throws Exception {
            	DateTimeFormatter df = DateTimeFormatter.ofPattern("yyyy-MM-dd HH:mm:ss");
            	String dateStr=LocalDateTime.now().format(df);
            	String serverInfo="["+servername+":"+ip+":"+port+"]";
            	
            	System.out.println(serverInfo+",InitRunner初始化逻辑。。。");
            	
            	/
            	
    //          LocalDateTime startTime = LocalDateTime.now();
        		String message=serverInfo;
        		
        		//gate-192-168-124-17-8888
        		String defalutConsulId=servername+"-"+ip.replace(".", "-")+"-"+port;
        		
    //    		long interVal=10;
            	ScheduledExecutorService scheduledThreadPool = Executors.newScheduledThreadPool(5);
            	scheduledThreadPool.scheduleWithFixedDelay(new Runnable() {
            	    @Override
            	    public void run() {
            	    	if(getRegisterFlag().equals("false")) {
            	    		logger.info("InitRunner consul检查纠正服务开关未开启，不执行检查纠错服务。。。。。");
            	    		return;
            	    	}
            	    	try {
            	    		logger.info("InitRunner 执行consul检查纠正服务"+serverInfo+"。。。delay "+getIntervalNum()+" seconds...");
                	    	
                	    	//查询consul的已经注册的服务列表
                	    	String consulQueryUrl="http://"+consulip+":"+consulport+"/v1/agent/services";
                	    	String consulRegisterUrl="http://"+consulip+":"+consulport+"/v1/agent/service/register";
                	    	
    //            	    	getRestTemplate().getForObject(url, responseType, uriVariables)
                	        HttpHeaders headers = new HttpHeaders();
                	        headers.setContentType(MediaType.APPLICATION_JSON_UTF8);
                	        HttpEntity<String> entity = new HttpEntity<String>(headers);
    //            	        String strbody=restTemplate.exchange(consulUrl, HttpMethod.GET, entity,String.class).getBody();
    //            	        Map responseData=restTemplate.exchange(consulUrl, HttpMethod.GET, entity,Map.class).getBody();
                	        
                	        ResponseEntity<Map> responseEntity=restTemplate.exchange(consulQueryUrl, HttpMethod.GET, entity,Map.class);
                	        Map responseData = responseEntity.getBody();
                	        
                	        boolean isExistSelf=false;//是否能从consul查到自己的信息。查不到说明自己没注册上或者被注销了，需要主动注册。
                	        if(responseData!=null) {
                	        	logger.info("InitRunner 执行consul检查纠正服务。。。返回 ：\r\n"+responseData.toString());
                	        	
                	        	Iterator it= responseData.keySet().iterator();
                	        	while(it.hasNext()) {
                	        		String key= (String) it.next();
                	        		Map instance = (Map) responseData.get(key);
                	        		if(instance!=null) {
                    	        		String Service =(String) instance.get("Service");
                    	        		String Address =(String) instance.get("Address");
                    	        		String Port =null;
                    	        		if(instance.get("Port")!=null) {
                    	        			Port =""+ instance.get("Port");
                    	        		}
                    	        		String ID =(String) instance.get("ID");
                    	        		
                    	        		if(Service.equalsIgnoreCase(servername) && Address.equals(ip) && Port.equals(port)) {
                    	        			logger.info("InitRunner 执行consul检查纠正服务，找到本实例的ID==="+ID);
                    	        			isExistSelf=true;
                    	        		}
                    	        	}
                	        		
                	        	}
                	        	logger.info("InitRunner 执行consul检查纠正服务。。。遍历完毕\r\n");
                	        }else {
                	        	logger.info("InitRunner 执行consul检查纠正服务。。。返回null");
                	        }
                	        
                	        //判断自己是否正常注册在consul.不正常就再注册一次自己
                	        if(!isExistSelf) {
                	        	logger.info("InitRunner 执行consul检查纠正服务。。。没有查到自己在consul的信息，准备进行注册。。。。。。defalutConsulId=="+defalutConsulId);
                	        	
                	        	HttpHeaders headers2 = new HttpHeaders();
                	        	headers2.setContentType(MediaType.APPLICATION_JSON_UTF8);
                	        	String reqBodyJson=getConsulregisterInfoJson();
                    	        HttpEntity<String> entity2 = new HttpEntity<String>(reqBodyJson,headers2);
                    	        
                	        	ResponseEntity<String> responseEntity2=restTemplate.exchange(consulRegisterUrl, HttpMethod.PUT, entity2,String.class);
                	        	String responseData2 = responseEntity2.getBody();
                    	        int statusCode = responseEntity2.getStatusCode().value();
                    	        logger.info("InitRunner 执行consul检查纠正服务。。。没有查到自己在consul的信息，准备进行注册。。。。。。defalutConsulId=="
                    	        +defalutConsulId+",请求返回码statusCode==="+statusCode);
                	        }
    					} catch (Exception e) {
    						// TODO Auto-generated catch block
    						e.printStackTrace();
    					}
            	    	
            	    	
            	    }//end run 
            	}, 5, getIntervalNum(), TimeUnit.SECONDS);
            	
            	
            }
    
            /**
             * 拼装consul注册请求的requestbody。
             * 注意是PUT请求
             * @return
             */
            public String getConsulregisterInfoJson() {
            	String defalutConsulId=servername+"-"+ip.replace(".", "-")+"-"+port;
            	
            	String template="{\r\n" + 
            			"    \"id\": \""+defalutConsulId+"\",\r\n" + 
            			"    \"name\": \""+servername+"\",\r\n" + 
            			"    \"address\": \""+ip+"\",\r\n" + 
            			"    \"port\": "+port+",\r\n" + 
            			"    \"tags\": [\r\n" + 
            			"        \"secure=false\"\r\n" + 
            			"    ],\r\n" + 
            			"    \"checks\": [\r\n" + 
            			"        {\r\n" + 
            			"        	\"deregister_critical_service_after\": \"10s\",\r\n" + 
            			"            \"http\": \"http://"+ip+":"+port+"/actuator/health\",\r\n" + 
            			"            \"interval\": \"5s\"\r\n" + 
            			"        }\r\n" + 
            			"    ]\r\n" + 
            			"}";
            	
            	//正确样例
    //        	String template="{\r\n" + 
    //        			"    \"id\": \"gate-192-168-124-17-8888\",\r\n" + 
    //        			"    \"name\": \"gate\",\r\n" + 
    //        			"    \"address\": \"192.168.124.17\",\r\n" + 
    //        			"    \"port\": 8888,\r\n" + 
    //        			"    \"tags\": [\r\n" + 
    //        			"        \"secure=false\"\r\n" + 
    //        			"    ],\r\n" + 
    //        			"    \"checks\": [\r\n" + 
    //        			"        {\r\n" + 
    //        			"        	\"deregister_critical_service_after\": \"10s\",\r\n" + 
    //        			"            \"http\": \"http://192.168.124.17:8888/actuator/health\",\r\n" + 
    //        			"            \"interval\": \"5s\"\r\n" + 
    //        			"        }\r\n" + 
    //        			"    ]\r\n" + 
    //        			"}";
            	
            	return template;
            }
        	
    }
    
    /*
      查询服务返回样例
    get
    http://127.0.0.1:8500/v1/agent/services
    
    {
        "gate-192-168-124-17-8888": {
            "ID": "gate-192-168-124-17-8888",
            "Service": "gate",
            "Tags": [
                "secure=false"
            ],
            "Meta": {},
            "Port": 8888,
            "Address": "192.168.124.17",
            "Weights": {
                "Passing": 1,
                "Warning": 1
            },
            "EnableTagOverride": false
        },
        "one-192-168-124-17-8901": {
            "ID": "one-192-168-124-17-8901",
            "Service": "one",
            "Tags": [
                "secure=false"
            ],
            "Meta": {},
            "Port": 8901,
            "Address": "192.168.124.17",
            "Weights": {
                "Passing": 1,
                "Warning": 1
            },
            "EnableTagOverride": false
        }
    }
     * 
    */

gate和one都起这样的定时任务。

当我把consul关闭后，打印如下：

2020-03-01 00:34:41.153 [main] INFO  o.s.boot.web.embedded.tomcat.TomcatWebServer - Tomcat started on port(s): 8901 (http) with context path ''
    2020-03-01 00:34:41.187 [main] INFO  o.s.c.consul.serviceregistry.ConsulServiceRegistry - Registering service with consul: NewService{id='one-192-168-124-17-8901', name='one', tags=[secure=false], address='192.168.124.17', port=8901, enableTagOverride=null, check=Check{script='null', interval='5s', ttl='null', http='http://192.168.124.17:8901/actuator/health', tcp='null', timeout='null', deregisterCriticalServiceAfter='2s', tlsSkipVerify=null, status='null'}, checks=null}
    2020-03-01 00:34:41.217 [main] INFO  com.example.one.OneApplication - Started OneApplication in 9.459 seconds (JVM running for 10.321)
    [one:192.168.124.17:8901],InitRunner初始化逻辑。。。
    2020-03-01 00:34:43.035 [RMI TCP Connection(1)-169.254.225.88] INFO  o.a.c.core.ContainerBase.[Tomcat].[localhost].[/] - Initializing Spring FrameworkServlet 'dispatcherServlet'
    2020-03-01 00:34:43.036 [RMI TCP Connection(1)-169.254.225.88] INFO  org.springframework.web.servlet.DispatcherServlet - FrameworkServlet 'dispatcherServlet': initialization started
    2020-03-01 00:34:43.060 [RMI TCP Connection(1)-169.254.225.88] INFO  org.springframework.web.servlet.DispatcherServlet - FrameworkServlet 'dispatcherServlet': initialization completed in 24 ms
    2020-03-01 00:34:46.234 [pool-2-thread-1] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务[one:192.168.124.17:8901]。。。delay 10 seconds...
    2020-03-01 00:34:46.303 [pool-2-thread-1] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务。。。返回 ：
    {gate-192-168-124-17-8888={ID=gate-192-168-124-17-8888, Service=gate, Tags=[secure=false], Meta={}, Port=8888, Address=192.168.124.17, Weights={Passing=1, Warning=1}, EnableTagOverride=false}, one-192-168-124-17-8901={ID=one-192-168-124-17-8901, Service=one, Tags=[secure=false], Meta={}, Port=8901, Address=192.168.124.17, Weights={Passing=1, Warning=1}, EnableTagOverride=false}}
    2020-03-01 00:34:46.303 [pool-2-thread-1] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务，找到本实例的ID===one-192-168-124-17-8901
    2020-03-01 00:34:46.303 [pool-2-thread-1] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务。。。遍历完毕
    
    hello !  I am   <span style="color:red">[one:192.168.124.17:8901]</span>...2020-03-01 00:34:48
    2020-03-01 00:34:52.382 [catalogWatchTaskScheduler-1] INFO  org.apache.http.impl.execchain.RetryExec - I/O exception (java.net.SocketException) caught when processing request to {}->http://127.0.0.1:8500: Connection reset by peer: socket write error
    2020-03-01 00:34:52.383 [catalogWatchTaskScheduler-1] INFO  org.apache.http.impl.execchain.RetryExec - Retrying request to {}->http://127.0.0.1:8500
    2020-03-01 00:34:53.408 [catalogWatchTaskScheduler-1] ERROR o.s.cloud.consul.discovery.ConsulDiscoveryClient - Error watching Consul CatalogServices
    com.ecwid.consul.transport.TransportException: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:8500 [/127.0.0.1] failed: Connection refused: connect
    	at com.ecwid.consul.transport.AbstractHttpTransport.executeRequest(AbstractHttpTransport.java:77) ~[consul-api-1.3.1.jar:na]
    	at com.ecwid.consul.transport.AbstractHttpTransport.makeGetRequest(AbstractHttpTransport.java:34) ~[consul-api-1.3.1.jar:na]
    	at com.ecwid.consul.v1.ConsulRawClient.makeGetRequest(ConsulRawClient.java:128) ~[consul-api-1.3.1.jar:na]
    	at com.ecwid.consul.v1.catalog.CatalogConsulClient.getCatalogServices(CatalogConsulClient.java:120) ~[consul-api-1.3.1.jar:na]
    	at com.ecwid.consul.v1.catalog.CatalogConsulClient.getCatalogServices(CatalogConsulClient.java:114) ~[consul-api-1.3.1.jar:na]
    	at com.ecwid.consul.v1.ConsulClient.getCatalogServices(ConsulClient.java:367) ~[consul-api-1.3.1.jar:na]
    	at org.springframework.cloud.consul.discovery.ConsulCatalogWatch.catalogServicesWatch(ConsulCatalogWatch.java:120) ~[spring-cloud-consul-discovery-2.0.1.RELEASE.jar:2.0.1.RELEASE]
    	at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) ~[spring-context-5.0.9.RELEASE.jar:5.0.9.RELEASE]
    	at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.8.0_191]
    	at java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:1.8.0_191]
    	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(Unknown Source) ~[na:1.8.0_191]
    	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:1.8.0_191]
    	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:1.8.0_191]
    	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.8.0_191]
    	at java.lang.Thread.run(Unknown Source) ~[na:1.8.0_191]
    Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:8500 [/127.0.0.1] failed: Connection refused: connect
    	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:373) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:394) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:72) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:221) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:165) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:140) ~[httpclient-4.5.6.jar:4.5.6]
    	at com.ecwid.consul.transport.AbstractHttpTransport.executeRequest(AbstractHttpTransport.java:61) ~[consul-api-1.3.1.jar:na]
    	... 14 common frames omitted
    Caused by: java.net.ConnectException: Connection refused: connect
    	at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method) ~[na:1.8.0_191]
    	at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source) ~[na:1.8.0_191]
    	at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:1.8.0_191]
    	at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:1.8.0_191]
    	at java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:1.8.0_191]
    	at java.net.PlainSocketImpl.connect(Unknown Source) ~[na:1.8.0_191]
    	at java.net.SocksSocketImpl.connect(Unknown Source) ~[na:1.8.0_191]
    	at java.net.Socket.connect(Unknown Source) ~[na:1.8.0_191]
    	at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.6.jar:4.5.6]
    	... 26 common frames omitted

这时候，consul已经挂了，网关无法转发请求。

然后再不重启服务的情况下，把consul起起来。

打印：

2020-03-01 00:35:07.314 [pool-2-thread-2] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务[one:192.168.124.17:8901]。。。delay 10 seconds...
    2020-03-01 00:35:07.612 [catalogWatchTaskScheduler-1] ERROR o.s.cloud.consul.discovery.ConsulDiscoveryClient - Error watching Consul CatalogServices
    com.ecwid.consul.transport.TransportException: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:8500 [/127.0.0.1] failed: Connection refused: connect
    	at com.ecwid.consul.transport.AbstractHttpTransport.executeRequest(AbstractHttpTransport.java:77) ~[consul-api-1.3.1.jar:na]
    	at com.ecwid.consul.transport.AbstractHttpTransport.makeGetRequest(AbstractHttpTransport.java:34) ~[consul-api-1.3.1.jar:na]
    	at com.ecwid.consul.v1.ConsulRawClient.makeGetRequest(ConsulRawClient.java:128) ~[consul-api-1.3.1.jar:na]
    	at com.ecwid.consul.v1.catalog.CatalogConsulClient.getCatalogServices(CatalogConsulClient.java:120) ~[consul-api-1.3.1.jar:na]
    	at com.ecwid.consul.v1.catalog.CatalogConsulClient.getCatalogServices(CatalogConsulClient.java:114) ~[consul-api-1.3.1.jar:na]
    	at com.ecwid.consul.v1.ConsulClient.getCatalogServices(ConsulClient.java:367) ~[consul-api-1.3.1.jar:na]
    	at org.springframework.cloud.consul.discovery.ConsulCatalogWatch.catalogServicesWatch(ConsulCatalogWatch.java:120) ~[spring-cloud-consul-discovery-2.0.1.RELEASE.jar:2.0.1.RELEASE]
    	at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) ~[spring-context-5.0.9.RELEASE.jar:5.0.9.RELEASE]
    	at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.8.0_191]
    	at java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:1.8.0_191]
    	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(Unknown Source) ~[na:1.8.0_191]
    	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:1.8.0_191]
    	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:1.8.0_191]
    	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.8.0_191]
    	at java.lang.Thread.run(Unknown Source) ~[na:1.8.0_191]
    Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:8500 [/127.0.0.1] failed: Connection refused: connect
    	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:373) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:394) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:72) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:221) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:165) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:140) ~[httpclient-4.5.6.jar:4.5.6]
    	at com.ecwid.consul.transport.AbstractHttpTransport.executeRequest(AbstractHttpTransport.java:61) ~[consul-api-1.3.1.jar:na]
    	... 14 common frames omitted
    Caused by: java.net.ConnectException: Connection refused: connect
    	at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method) ~[na:1.8.0_191]
    	at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source) ~[na:1.8.0_191]
    	at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:1.8.0_191]
    	at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:1.8.0_191]
    	at java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:1.8.0_191]
    	at java.net.PlainSocketImpl.connect(Unknown Source) ~[na:1.8.0_191]
    	at java.net.SocksSocketImpl.connect(Unknown Source) ~[na:1.8.0_191]
    	at java.net.Socket.connect(Unknown Source) ~[na:1.8.0_191]
    	at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.6.jar:4.5.6]
    	... 26 common frames omitted
    org.springframework.web.client.ResourceAccessException: I/O error on GET request for "http://127.0.0.1:8500/v1/agent/services": Connect to 127.0.0.1:8500 [/127.0.0.1] failed: Connection refused: connect; nested exception is org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:8500 [/127.0.0.1] failed: Connection refused: connect
    	at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:696)
    	at org.springframework.web.client.RestTemplate.execute(RestTemplate.java:644)
    	at org.springframework.web.client.RestTemplate.exchange(RestTemplate.java:564)
    	at com.example.one.init.InitRunner$1.run(InitRunner.java:139)
    	at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
    	at java.util.concurrent.FutureTask.runAndReset(Unknown Source)
    	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(Unknown Source)
    	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
    	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
    	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
    	at java.lang.Thread.run(Unknown Source)
    Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:8500 [/127.0.0.1] failed: Connection refused: connect
    	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
    	at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:373)
    	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:394)
    	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
    	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
    	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
    	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
    	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
    	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
    	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
    	at org.springframework.http.client.HttpComponentsClientHttpRequest.executeInternal(HttpComponentsClientHttpRequest.java:87)
    	at org.springframework.http.client.AbstractBufferingClientHttpRequest.executeInternal(AbstractBufferingClientHttpRequest.java:48)
    	at org.springframework.http.client.AbstractClientHttpRequest.execute(AbstractClientHttpRequest.java:53)
    	at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:687)
    	... 10 more
    Caused by: java.net.ConnectException: Connection refused: connect
    	at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method)
    	at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source)
    	at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
    	at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
    	at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
    	at java.net.PlainSocketImpl.connect(Unknown Source)
    	at java.net.SocksSocketImpl.connect(Unknown Source)
    	at java.net.Socket.connect(Unknown Source)
    	at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75)
    	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
    	... 23 more
    2020-03-01 00:35:09.647 [catalogWatchTaskScheduler-1] ERROR o.s.cloud.consul.discovery.ConsulDiscoveryClient - Error watching Consul CatalogServices
    com.ecwid.consul.transport.TransportException: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:8500 [/127.0.0.1] failed: Connection refused: connect
    	at com.ecwid.consul.transport.AbstractHttpTransport.executeRequest(AbstractHttpTransport.java:77) ~[consul-api-1.3.1.jar:na]
    	at com.ecwid.consul.transport.AbstractHttpTransport.makeGetRequest(AbstractHttpTransport.java:34) ~[consul-api-1.3.1.jar:na]
    	at com.ecwid.consul.v1.ConsulRawClient.makeGetRequest(ConsulRawClient.java:128) ~[consul-api-1.3.1.jar:na]
    	at com.ecwid.consul.v1.catalog.CatalogConsulClient.getCatalogServices(CatalogConsulClient.java:120) ~[consul-api-1.3.1.jar:na]
    	at com.ecwid.consul.v1.catalog.CatalogConsulClient.getCatalogServices(CatalogConsulClient.java:114) ~[consul-api-1.3.1.jar:na]
    	at com.ecwid.consul.v1.ConsulClient.getCatalogServices(ConsulClient.java:367) ~[consul-api-1.3.1.jar:na]
    	at org.springframework.cloud.consul.discovery.ConsulCatalogWatch.catalogServicesWatch(ConsulCatalogWatch.java:120) ~[spring-cloud-consul-discovery-2.0.1.RELEASE.jar:2.0.1.RELEASE]
    	at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) ~[spring-context-5.0.9.RELEASE.jar:5.0.9.RELEASE]
    	at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.8.0_191]
    	at java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:1.8.0_191]
    	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(Unknown Source) ~[na:1.8.0_191]
    	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:1.8.0_191]
    	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:1.8.0_191]
    	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.8.0_191]
    	at java.lang.Thread.run(Unknown Source) ~[na:1.8.0_191]
    Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:8500 [/127.0.0.1] failed: Connection refused: connect
    	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:373) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:394) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:72) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:221) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:165) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:140) ~[httpclient-4.5.6.jar:4.5.6]
    	at com.ecwid.consul.transport.AbstractHttpTransport.executeRequest(AbstractHttpTransport.java:61) ~[consul-api-1.3.1.jar:na]
    	... 14 common frames omitted
    Caused by: java.net.ConnectException: Connection refused: connect
    	at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method) ~[na:1.8.0_191]
    	at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source) ~[na:1.8.0_191]
    	at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:1.8.0_191]
    	at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:1.8.0_191]
    	at java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:1.8.0_191]
    	at java.net.PlainSocketImpl.connect(Unknown Source) ~[na:1.8.0_191]
    	at java.net.SocksSocketImpl.connect(Unknown Source) ~[na:1.8.0_191]
    	at java.net.Socket.connect(Unknown Source) ~[na:1.8.0_191]
    	at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75) ~[httpclient-4.5.6.jar:4.5.6]
    	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.6.jar:4.5.6]
    	... 26 common frames omitted
    2020-03-01 00:35:18.328 [pool-2-thread-2] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务[one:192.168.124.17:8901]。。。delay 10 seconds...
    2020-03-01 00:35:18.331 [pool-2-thread-2] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务。。。返回 ：
    {gate-192-168-124-17-8888={ID=gate-192-168-124-17-8888, Service=gate, Tags=[secure=false], Meta={}, Port=8888, Address=192.168.124.17, Weights={Passing=1, Warning=1}, EnableTagOverride=false}}
    2020-03-01 00:35:18.331 [pool-2-thread-2] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务。。。遍历完毕
    
    2020-03-01 00:35:18.331 [pool-2-thread-2] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务。。。没有查到自己在consul的信息，准备进行注册。。。。。。defalutConsulId==one-192-168-124-17-8901
    2020-03-01 00:35:18.344 [pool-2-thread-2] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务。。。没有查到自己在consul的信息，准备进行注册。。。。。。defalutConsulId==one-192-168-124-17-8901,请求返回码statusCode===200
    2020-03-01 00:35:28.346 [pool-2-thread-3] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务[one:192.168.124.17:8901]。。。delay 10 seconds...
    2020-03-01 00:35:28.354 [pool-2-thread-3] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务。。。返回 ：
    {gate-192-168-124-17-8888={ID=gate-192-168-124-17-8888, Service=gate, Tags=[secure=false], Meta={}, Port=8888, Address=192.168.124.17, Weights={Passing=1, Warning=1}, EnableTagOverride=false}, one-192-168-124-17-8901={ID=one-192-168-124-17-8901, Service=one, Tags=[secure=false], Meta={}, Port=8901, Address=192.168.124.17, Weights={Passing=1, Warning=1}, EnableTagOverride=false}}
    2020-03-01 00:35:28.354 [pool-2-thread-3] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务，找到本实例的ID===one-192-168-124-17-8901
    2020-03-01 00:35:28.354 [pool-2-thread-3] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务。。。遍历完毕
    
    2020-03-01 00:35:38.355 [pool-2-thread-3] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务[one:192.168.124.17:8901]。。。delay 10 seconds...
    2020-03-01 00:35:38.359 [pool-2-thread-3] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务。。。返回 ：
    {gate-192-168-124-17-8888={ID=gate-192-168-124-17-8888, Service=gate, Tags=[secure=false], Meta={}, Port=8888, Address=192.168.124.17, Weights={Passing=1, Warning=1}, EnableTagOverride=false}, one-192-168-124-17-8901={ID=one-192-168-124-17-8901, Service=one, Tags=[secure=false], Meta={}, Port=8901, Address=192.168.124.17, Weights={Passing=1, Warning=1}, EnableTagOverride=false}}
    2020-03-01 00:35:38.359 [pool-2-thread-3] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务，找到本实例的ID===one-192-168-124-17-8901
    2020-03-01 00:35:38.359 [pool-2-thread-3] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务。。。遍历完毕
    
    2020-03-01 00:35:48.360 [pool-2-thread-3] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务[one:192.168.124.17:8901]。。。delay 10 seconds...
    2020-03-01 00:35:48.369 [pool-2-thread-3] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务。。。返回 ：
    {gate-192-168-124-17-8888={ID=gate-192-168-124-17-8888, Service=gate, Tags=[secure=false], Meta={}, Port=8888, Address=192.168.124.17, Weights={Passing=1, Warning=1}, EnableTagOverride=false}, one-192-168-124-17-8901={ID=one-192-168-124-17-8901, Service=one, Tags=[secure=false], Meta={}, Port=8901, Address=192.168.124.17, Weights={Passing=1, Warning=1}, EnableTagOverride=false}}
    2020-03-01 00:35:48.370 [pool-2-thread-3] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务，找到本实例的ID===one-192-168-124-17-8901
    2020-03-01 00:35:48.370 [pool-2-thread-3] INFO  com.example.one.init.InitRunner - InitRunner 执行consul检查纠正服务。。。遍历完毕

重新注册的接口发通了！！！

服务自己又注册到了consul上！这下问题解决了。

不知道其他人怎么解决问题的，我只是自己搞定了，先写下来。有bug的话，请各位大佬指出。

备注：我在yml用参数做了这个定时任务的开关，和每隔几秒走定时。

#是否启动注册状态检查，启动后发现在注册中心状态有问题就不停的注册自己，直至成功。
    my: 
      consul: 
        check: 
          register: true
          interval: 10

===============后续更新=======================

我这段时间在研究consul集群重启后（所有server节点都当掉），微服务不会主动再注册的问题。

前段时间写的这文章，在此更正下：consul其实有解决方案，我之前有些孤陋寡闻了，现在补充下。

因为时间关系，我没时间具体写出来，但是又怕看到这文章的人很多，误导大家，所以先简单把方案说出来。

后续有时间再详细补充。

首先，我之前测试consul集群重启，微服务不会主动注册现象是真的。

consul自己的解决方案是：

在微服务的机器上部署一个client节点，微服务注册的地址就是这个client节点的IP（127.0.0.1）。

微服务注册信息在data\_dir路径下（你可以观察下，路径下有个service，里面有注册信息）。

当server集群节点挂掉后，要用一个配置参数保证健康检查失败也不注销服务，只是让服务进入critical状态。

当server节点重启后，因为节点没从服务列表注销，此时健康检查一直在发，这个时候健康检查就通过了。

服务也就正常了。

spring:
      application:
        name: gate
      redis:
        host: localhost
        password:
        port: 6379
      cloud:
        consul:
          host: 127.0.0.1  #注册中心的ip或host。也是集群地址，配置一个即可。注释掉整个consul这段就可以启动，即使没有注册中心也不报错。有这段就必须有一个可用的注册中心，否则启动报错
          port: 8500
          discovery:
            enabled: true #默认true。Consul Discovery Client是否注册到注册中心。和register同时设置成false，就不需要起consul服务。
            register: true #是否将服务注册到Consul集群中心.。这个参数和上面的enabled参数同时设置成false，应用才不会注册注册中心，才可以不起consul服务！
            deregister: true #默认true，服务停止时注销服务，即从服务列表中删除。设置成false的话，？？？
            #service-name: ${spring.application.name}  #注册在consul上面的名字，在consul的调用中，是通过此名字调用的。默认服务名,不要改
            instance-id: ${spring.application.name}-${spring.cloud.client.ip-address}:${server.port} #只供显示用,在ID列显示
            health-check-interval: 10s  #配置 Consul 健康检查频率，也就是心跳频率。
            health-check-timeout: 10s #健康检查超时
    #        health-check-critical-timeout: 10s #注册成功之后，如果关闭微服务，consul将检测60s,如果60s之后还检测不到此服务，将会把此服务从注册列表中移除.如果想重启consul，服务能主动注册到consul，这个参数必须注释掉！！！
            #health-check-path: /tmp #健康检查路径
            prefer-ip-address: true #表示注册时使用IP而不是hostname

yml里面有个参数 health-check-critical-timeout 不能写他，要注释掉。有这个参数在，健康检查失败后，微服务的状态在编程critical后会被注销，也就是不在服务列表了（UI上也看不到了）。这个参数待研究，亲测是这个参数引起的。

那重启server集群后，因为微服务不再服务列表，健康检查自然就不会发，微服务因为没有重启，也不会再注册一遍自己。

导致的现象就是，微服务不会主动注册自己，必须重启我们的服务了。

这也是之前我做实验的现象。

按照consul这个解决方案，我们只要保证yml配置正确，应用服务机器上部署client节点，保证client节点不重启。

那么server节点集群重启也不会注销微服务。当重启好后，健康检查就会通过。表现为，服务状态都正常了。实现了高可用。