Skip to content
This repository has been archived by the owner on Apr 25, 2024. It is now read-only.

创建了service 指定了LoadBalancer，把service删掉之后eip还在 #52

Closed
hello2mao opened this issue Feb 27, 2019 · 1 comment · Fixed by #53
Closed

创建了service 指定了LoadBalancer，把service删掉之后eip还在 #52

hello2mao opened this issue Feb 27, 2019 · 1 comment · Fixed by #53

Comments

@hello2mao
Copy link
Contributor

Create Service Log:

Feb 27 12:47:16 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:16.538606    2948 log.go:172] Request: httpMethod = GET, requestUrl = http://100.64.253.28:8693/internal-api/v1/blb?address=&bccId=&blbId=lb-7e564fe3&name=, requestHeader = map[Host:[10
0.64.253.28:8693] Authorization:[bce-auth-v1/8e2fdc833cf44b4895afd0bce14f43cf/2019-02-27T04:47:16Z/1800/content-type;host;x-bce-date/5090a360473b04e76f810a95f7b50b22b5526085336824d8c6fdd6435049d975] X-Bce-Date:[2019-02-27T04:47:16Z] User-Agent:[cce-k8s:c-V0opPltc] Conte
nt-Type:[application/json]]
Feb 27 12:47:17 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:17.199945    2948 log.go:172] http request: http://100.64.253.28:8693/internal-api/v1/blb?address=&bccId=&blbId=lb-7e564fe3&name=  do use time: 661.271879ms
Feb 27 12:47:17 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:17.200459    2948 log.go:172] Response: status code = 200, httpMethod = GET, requestUrl = http://100.64.253.28:8693/internal-api/v1/blb?address=&bccId=&blbId=lb-7e564fe3&name=
Feb 27 12:47:17 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:17.200509    2948 log.go:172] Response Header:  = map[Content-Type:[application/json;charset=UTF-8] Date:[Wed, 27 Feb 2019 04:47:16 GMT] Server:[BWS] X-Bce-Request-Id:[2f3a4117-2091-423
f-8359-6a6064bbd300] Cache-Control:[no-cache]]
Feb 27 12:47:17 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:17.200518    2948 log.go:172] Response body:  = {"blbList":[{"blbId":"lb-7e564fe3","name":"c-V0opPltc/w-ne6znjt7-new/nginx-q4","desc":"auto generated by cce:c-V0opPltc","address":"192.1
68.17.172","status":"available","publicIp":null}],"marker":"blb-6442A1BC","nextMarker":null,"maxKeys":1000,"truncated":false}
Feb 27 12:47:17 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:17.200576    2948 load_balancer.go:714] BLB status is : available
Feb 27 12:47:17 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:17.200586    2948 load_balancer.go:721] BindEip:  &{180.76.50.228 BLB lb-7e564fe3}
Feb 27 12:47:17 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:17.200598    2948 load_balancer.go:722] Bind BLB: &{lb-7e564fe3 c-V0opPltc/w-ne6znjt7-new/nginx-q4 auto generated by cce:c-V0opPltc 192.168.17.172 available }
Feb 27 12:47:17 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:17.200752    2948 log.go:172] Request: httpMethod = PUT, requestUrl = http://100.64.253.28:8693/internal-api/v1/eip/180.76.50.228?bind=&clientToken=KSldySAmwziQ9BkBy78Sk37sqxvFuYqg, req
uestHeader = map[User-Agent:[cce-k8s:c-V0opPltc] Content-Type:[application/json] X-Bce-Date:[2019-02-27T04:47:17Z] Host:[100.64.253.28:8693] Authorization:[bce-auth-v1/8e2fdc833cf44b4895afd0bce14f43cf/2019-02-27T04:47:17Z/1800/content-type;host;x-bce-date/4d01e35dde33ca
ec7830024e21c3249c611a5521e88268fc24d4aa12b6dd5c90]]
Feb 27 12:47:18 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:18.420225    2948 leaderelection.go:209] successfully renewed lease kube-system/cloud-controller-manager
Feb 27 12:47:19 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:19.338338    2948 log.go:172] http request: http://100.64.253.28:8693/internal-api/v1/eip/180.76.50.228?bind=&clientToken=KSldySAmwziQ9BkBy78Sk37sqxvFuYqg  do use time: 2.13753387s
Feb 27 12:47:19 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:19.338405    2948 log.go:172] Response: status code = 200, httpMethod = PUT, requestUrl = http://100.64.253.28:8693/internal-api/v1/eip/180.76.50.228?bind=&clientToken=KSldySAmwziQ9BkBy
78Sk37sqxvFuYqg
Feb 27 12:47:19 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:19.338438    2948 log.go:172] Response Header:  = map[Server:[BWS] X-Bce-Request-Id:[d3fafb1c-ba84-4969-a961-df385045c5a7] Cache-Control:[no-cache] Content-Length:[0] Date:[Wed, 27 Feb
2019 04:47:19 GMT]]
Feb 27 12:47:19 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:19.338445    2948 log.go:172] Response body:  =
Feb 27 12:47:19 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:19.338455    2948 load_balancer.go:729] createEIP: lb.PublicIp is 180.76.50.228
Feb 27 12:47:19 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:19.338463    2948 load_balancer.go:309] EnsureLoadBalancer: EXTERNAL-IP is 180.76.50.228
Feb 27 12:47:19 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:19.338721    2948 event.go:221] Event(v1.ObjectReference{Kind:"Service", Namespace:"w-ne6znjt7-new", Name:"nginx-q4", UID:"a19d397b-3a4a-11e9-935f-fa163e00fb79", APIVersion:"v1", Resour
ceVersion:"346887", FieldPath:""}): type: 'Normal' reason: 'EnsuredLoadBalancer' Ensured load balancer
Feb 27 12:47:19 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:19.342916    2948 service_controller.go:716] Finished syncing service "w-ne6znjt7-new/nginx-q4" (43.743521604s)
Feb 27 12:47:19 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: E0227 12:47:19.342968    2948 service_controller.go:219] error processing service w-ne6znjt7-new/nginx-q4 (will retry): not persisting update to service 'w-ne6znjt7-new/nginx-q4' that has been chan
ged since we received it: Operation cannot be fulfilled on services "nginx-q4": StorageError: invalid object, Code: 4, Key: /registry/services/specs/w-ne6znjt7-new/nginx-q4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a19d397b-3a4a-
11e9-935f-fa163e00fb79, UID in object meta:

Delete Service Log:

Feb 27 12:47:24 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:24.616639    2948 service_controller.go:716] Finished syncing service "w-ne6znjt7-new/nginx-q3" (1.699406043s)
Feb 27 12:47:24 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:24.616681    2948 service_controller.go:729] Service has been deleted w-ne6znjt7-new/nginx-q4. Attempting to cleanup load balancer resources
Feb 27 12:47:24 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:24.616777    2948 event.go:221] Event(v1.ObjectReference{Kind:"Service", Namespace:"w-ne6znjt7-new", Name:"nginx-q3", UID:"980295df-3a4a-11e9-8c85-fa163e544b38", APIVersion:"v1", ResourceVersion:"346846", FieldPath:""}): type: 'Normal' reason: 'DeletedLoadBalancer' Deleted load balancer
Feb 27 12:47:24 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:24.616844    2948 event.go:221] Event(v1.ObjectReference{Kind:"Service", Namespace:"w-ne6znjt7-new", Name:"nginx-q4", UID:"a19d397b-3a4a-11e9-935f-fa163e00fb79", APIVersion:"v1", ResourceVersion:"346887", FieldPath:""}): type: 'Normal' reason: 'DeletingLoadBalancer' Deleting load balancer
Feb 27 12:47:24 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:24.616929    2948 log.go:172] Request: httpMethod = GET, requestUrl = http://100.64.253.28:8693/internal-api/v1/blb?address=&bccId=&blbId=&name=aa19d397b3a4a11e9935ffa163e00fb7, requestHeader = map[User-Agent:[cce-k8s:c-V0opPltc] Content-Type:[application/json] X-Bce-Date:[2019-02-27T04:47:24Z] Host:[100.64.253.28:8693] Authorization:[bce-auth-v1/8e2fdc833cf44b4895afd0bce14f43cf/2019-02-27T04:47:24Z/1800/content-type;host;x-bce-date/849ecb2bacca76019ac4188f93bd7db98652d7d333201522c8288a2a2c5ea0a1]]
Feb 27 12:47:24 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:24.881937    2948 log.go:172] http request: http://100.64.253.28:8693/internal-api/v1/blb?address=&bccId=&blbId=&name=aa19d397b3a4a11e9935ffa163e00fb7  do use time: 264.958371ms
Feb 27 12:47:24 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:24.882321    2948 log.go:172] Response: status code = 200, httpMethod = GET, requestUrl = http://100.64.253.28:8693/internal-api/v1/blb?address=&bccId=&blbId=&name=aa19d397b3a4a11e9935ffa163e00fb7
Feb 27 12:47:24 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:24.882346    2948 log.go:172] Response Header:  = map[Date:[Wed, 27 Feb 2019 04:47:24 GMT] Server:[BWS] X-Bce-Request-Id:[8780143a-98b0-46c2-a4ab-449138719ed5] Cache-Control:[no-cache] Content-Type:[application/json;charset=UTF-8]]
Feb 27 12:47:24 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:24.882353    2948 log.go:172] Response body:  = {"blbList":[],"marker":null,"nextMarker":null,"maxKeys":1000,"truncated":false}
Feb 27 12:47:24 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:24.882406    2948 load_balancer.go:402] getBCELoadBalancer len(lbs) != 1: []
Feb 27 12:47:24 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:24.882424    2948 options.go:32] start to ExtractAnnotationRequest: map[service.beta.kubernetes.io/cce-load-balancer-id:lb-7e564fe3]
Feb 27 12:47:24 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:24.882442    2948 load_balancer.go:334] delete(w-ne6znjt7-new/nginx-q4): START clusterName="kubernetes" lbId="lb-7e564fe3"
Feb 27 12:47:24 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:24.882576    2948 log.go:172] Request: httpMethod = GET, requestUrl = http://100.64.253.28:8693/internal-api/v1/blb?address=&bccId=&blbId=lb-7e564fe3&name=, requestHeader = map[User-Agent:[cce-k8s:c-V0opPltc] Content-Type:[application/json] Host:[100.64.253.28:8693] Authorization:[bce-auth-v1/8e2fdc833cf44b4895afd0bce14f43cf/2019-02-27T04:47:24Z/1800/content-type;host;x-bce-date/ddc279a22555dad667fd5cdaade72f4f132d4437e152e8f5855e36f20a121d98] X-Bce-Date:[2019-02-27T04:47:24Z]]
Feb 27 12:47:25 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:25.556418    2948 log.go:172] http request: http://100.64.253.28:8693/internal-api/v1/blb?address=&bccId=&blbId=lb-7e564fe3&name=  do use time: 673.80273ms
Feb 27 12:47:25 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:25.557079    2948 log.go:172] Response: status code = 200, httpMethod = GET, requestUrl = http://100.64.253.28:8693/internal-api/v1/blb?address=&bccId=&blbId=lb-7e564fe3&name=
Feb 27 12:47:25 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:25.557118    2948 log.go:172] Response Header:  = map[Date:[Wed, 27 Feb 2019 04:47:25 GMT] Server:[BWS] X-Bce-Request-Id:[f8e1be37-d03a-4a3e-8d7a-2441c3b1c21b] Cache-Control:[no-cache] Content-Type:[application/json;charset=UTF-8]]
Feb 27 12:47:25 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:25.557126    2948 log.go:172] Response body:  = {"blbList":[{"blbId":"lb-7e564fe3","name":"c-V0opPltc/w-ne6znjt7-new/nginx-q4","desc":"auto generated by cce:c-V0opPltc","address":"192.168.17.172","status":"available","publicIp":null}],"marker":"blb-6442A1BC","nextMarker":null,"maxKeys":1000,"truncated":false}
Feb 27 12:47:25 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:25.557175    2948 load_balancer.go:340] EnsureLoadBalancerDeleted getBCELoadBalancer : lb-7e564fe3
Feb 27 12:47:25 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:25.557183    2948 load_balancer.go:350] Start delete BLB: lb-7e564fe3
Feb 27 12:47:25 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:25.557351    2948 log.go:172] Request: httpMethod = DELETE, requestUrl = http://100.64.253.28:8693/internal-api/v1/blb/lb-7e564fe3?clientToken=D2c0JSbHZw1narVIzj1g4Xo3zJ1oIZUE, requestHeader = map[Content-Type:[application/json] X-Bce-Date:[2019-02-27T04:47:25Z] User-Agent:[cce-k8s:c-V0opPltc] Host:[100.64.253.28:8693] Authorization:[bce-auth-v1/8e2fdc833cf44b4895afd0bce14f43cf/2019-02-27T04:47:25Z/1800/content-type;host;x-bce-date/ba0e337aa8494b4f8e36ccda9b84a40e50e27cdbd56f76df159b667b47d9d9cb]]
Feb 27 12:47:26 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:26.288079    2948 log.go:172] http request: http://100.64.253.28:8693/internal-api/v1/blb/lb-7e564fe3?clientToken=D2c0JSbHZw1narVIzj1g4Xo3zJ1oIZUE  do use time: 730.678177ms
Feb 27 12:47:26 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:26.288138    2948 log.go:172] Response: status code = 200, httpMethod = DELETE, requestUrl = http://100.64.253.28:8693/internal-api/v1/blb/lb-7e564fe3?clientToken=D2c0JSbHZw1narVIzj1g4Xo3zJ1oIZUE
Feb 27 12:47:26 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:26.288172    2948 log.go:172] Response Header:  = map[X-Bce-Request-Id:[2c618558-3353-49f1-943b-b87729d3a176] Cache-Control:[no-cache] Content-Length:[0] Date:[Wed, 27 Feb 2019 04:47:25 GMT] Server:[BWS]]
Feb 27 12:47:26 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:26.288180    2948 log.go:172] Response body:  =
Feb 27 12:47:26 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:26.288193    2948 load_balancer.go:371] delete(w-ne6znjt7-new/nginx-q4): FINISH
Feb 27 12:47:26 instance-tw2ou554-1 kube-cloud-controller-manager[2948]: I0227 12:47:26.288244    2948 service_controller.go:716] Finished syncing service "w-ne6znjt7-new/nginx-q4" (1.671572848s)
@hello2mao
Copy link
Contributor Author

Create Time: Feb 27 12:47:17
Delete Time：Feb 27 12:47:24
Dur: 7s

@hello2mao hello2mao mentioned this issue Feb 27, 2019
Merged
@hello2mao hello2mao changed the title 创建了service 制定了LoadBalancer，把service删掉之后eip还在 创建了service 指定了LoadBalancer，把service删掉之后eip还在 Mar 29, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Safe delete eip hello2mao/cloud-provider-baiducloud
1 participant
@hello2mao