minikube start hangs for v1.12.3 cluster, cannot find ionice in path.

[phyllisstein]

Is this a BUG REPORT or FEATURE REQUEST? (choose one): Bug Report

Environment:

• Minikube version (use minikube version): v0.30.0
• OS (e.g. from /etc/os-release): macOS 10.14.2 (18C52a)
• VM Driver (e.g. cat ~/.minikube/machines/minikube/config.json | grep DriverName): vmwarefusion
• ISO version (e.g. cat ~/.minikube/machines/minikube/config.json | grep -i ISO or minikube ssh cat /etc/VERSION): v0.30.0
• Install tools: brew cask install minikube

What happened:
Running minikube start --kubernetes-version=v1.12.3 --vm-driver=vmwarefusion followed by minikube stop followed by minikube start again causes minikube to hang forever on "Starting cluster components...," while the VM logs errors that it cannot find ionice in its PATH.

What you expected to happen:
The second start command should have brought up the minikube VM successfully.

How to reproduce it (as minimally and precisely as possible):
Start, stop, and attempt to restart a cluster with K8S 1.12.3 and/or the VMWare Fusion driver.

Output of minikube logs (if applicable):

-- Logs begin at Thu 2018-11-29 20:12:15 UTC, end at Fri 2018-11-30 01:14:47 UTC. --
Nov 30 01:12:27 cate.bxm.cloud systemd[1]: Started kubelet: The Kubernetes Node Agent.
Nov 30 01:12:27 cate.bxm.cloud kubelet[3854]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 30 01:12:27 cate.bxm.cloud kubelet[3854]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 30 01:12:27 cate.bxm.cloud kubelet[3854]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 30 01:12:27 cate.bxm.cloud kubelet[3854]: Flag --allow-privileged has been deprecated, will be removed in a future version
Nov 30 01:12:27 cate.bxm.cloud kubelet[3854]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 30 01:12:27 cate.bxm.cloud kubelet[3854]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 30 01:12:27 cate.bxm.cloud kubelet[3854]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 30 01:12:27 cate.bxm.cloud kubelet[3854]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 30 01:12:27 cate.bxm.cloud kubelet[3854]: I1130 01:12:27.271201    3854 server.go:408] Version: v1.12.3
Nov 30 01:12:27 cate.bxm.cloud kubelet[3854]: I1130 01:12:27.271403    3854 plugins.go:99] No cloud provider specified.
Nov 30 01:12:27 cate.bxm.cloud kubelet[3854]: F1130 01:12:27.271430    3854 server.go:262] failed to run Kubelet: unable to load bootstrap kubeconfig: stat /etc/kubernetes/bootstrap-kubelet.conf: no such file or directory
Nov 30 01:12:27 cate.bxm.cloud systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
Nov 30 01:12:27 cate.bxm.cloud systemd[1]: kubelet.service: Failed with result 'exit-code'.
Nov 30 01:12:37 cate.bxm.cloud systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
Nov 30 01:12:37 cate.bxm.cloud systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1.
Nov 30 01:12:37 cate.bxm.cloud systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Nov 30 01:12:37 cate.bxm.cloud systemd[1]: Started kubelet: The Kubernetes Node Agent.
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: Flag --allow-privileged has been deprecated, will be removed in a future version
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.577558    3927 server.go:408] Version: v1.12.3
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.577792    3927 plugins.go:99] No cloud provider specified.
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.640358    3927 server.go:667] --cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.640873    3927 container_manager_linux.go:247] container manager verified user specified cgroup-root exists: []
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.640945    3927 container_manager_linux.go:252] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:docker CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>} {Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.15} GracePeriod:0s MinReclaim:<nil>} {Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>}]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms}
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.651617    3927 container_manager_linux.go:271] Creating device plugin manager: true
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.651754    3927 state_mem.go:36] [cpumanager] initializing new in-memory state store
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.658217    3927 state_mem.go:84] [cpumanager] updated default cpuset: ""
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.658308    3927 state_mem.go:92] [cpumanager] updated cpuset assignments: "map[]"
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.658464    3927 kubelet.go:279] Adding pod path: /etc/kubernetes/manifests
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.658497    3927 kubelet.go:304] Watching apiserver
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: E1130 01:12:37.662718    3927 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: E1130 01:12:37.662800    3927 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/kubelet.go:442: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: E1130 01:12:37.662849    3927 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.669132    3927 client.go:75] Connecting to docker on unix:///var/run/docker.sock
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.669174    3927 client.go:104] Start docker client with request timeout=2m0s
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: W1130 01:12:37.670532    3927 docker_service.go:540] Hairpin mode set to "promiscuous-bridge" but kubenet is not enabled, falling back to "hairpin-veth"
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.670567    3927 docker_service.go:236] Hairpin mode set to "hairpin-veth"
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: W1130 01:12:37.673132    3927 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.674146    3927 docker_service.go:251] Docker cri networking managed by kubernetes.io/no-op
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.689395    3927 docker_service.go:256] Docker Info: &{ID:ZLYH:5VLJ:PTWN:BOIO:7QDV:AXMY:C3JA:H34Z:BTZW:A2T5:O2YK:KTEW Containers:10 ContainersRunning:0 ContainersPaused:0 ContainersStopped:10 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:[] Plugins:{Volume:[local] Network:[bridge host macvlan null overlay] Authorization:[] Log:[awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6tables:true Debug:false NFd:22 OomKillDisable:true NGoroutines:34 SystemTime:2018-11-30T01:12:37.676092956Z LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.15.0 OperatingSystem:Buildroot 2018.05 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:0xc420856930 NCPU:2 MemTotal:2087497728 GenericResources:[] DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:cate.bxm.cloud Labels:[provider=vmwarefusion] ExperimentalBuild:false ServerVersion:17.12.1-ce ClusterStore: ClusterAdvertise: Runtimes:map[runc:{Path:docker-runc Args:[]}] DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:[] Nodes:0 Managers:0 Cluster:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9b55aab90508bd389d7654c4baf173a981477d55 Expected:9b55aab90508bd389d7654c4baf173a981477d55} RuncCommit:{ID:9f9c96235cc97674e935002fc3d78361b696a69e Expected:9f9c96235cc97674e935002fc3d78361b696a69e} InitCommit:{ID:N/A Expected:} SecurityOptions:[name=seccomp,profile=default]}
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.689497    3927 docker_service.go:269] Setting cgroupDriver to cgroupfs
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.711341    3927 kuberuntime_manager.go:197] Container runtime docker initialized, version: 17.12.1-ce, apiVersion: 1.35.0
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: W1130 01:12:37.711520    3927 probe.go:270] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating.
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.733100    3927 server.go:1013] Started kubelet
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: E1130 01:12:37.734122    3927 event.go:212] Unable to write event: 'Post https://localhost:8443/api/v1/namespaces/default/events: dial tcp 127.0.0.1:8443: connect: connection refused' (may retry after sleeping)
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.734157    3927 server.go:133] Starting to listen on 0.0.0.0:10250
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.735163    3927 server.go:318] Adding debug handlers to kubelet server.
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: E1130 01:12:37.736684    3927 kubelet.go:1287] Image garbage collection failed once. Stats initialization may not have completed yet: failed to get imageFs info: unable to find data in memory cache
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.740507    3927 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.740616    3927 status_manager.go:152] Starting to sync pod status with apiserver
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.740631    3927 kubelet.go:1804] Starting kubelet main sync loop.
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.740705    3927 kubelet.go:1821] skipping pod synchronization - [container runtime is down PLEG is not healthy: pleg was last seen active 2562047h47m16.854775807s ago; threshold is 3m0s]
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.741285    3927 volume_manager.go:248] Starting Kubelet Volume Manager
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.743120    3927 desired_state_of_world_populator.go:130] Desired state populator starts to run
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.860078    3927 kubelet.go:1821] skipping pod synchronization - [container runtime is down]
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: I1130 01:12:37.860113    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: E1130 01:12:37.860605    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:37 cate.bxm.cloud kubelet[3927]: E1130 01:12:37.975142    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.014662    3927 kubelet_node_status.go:70] Attempting to register node minikube
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.015128    3927 kubelet_node_status.go:92] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.015728    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.055993    3927 cpu_manager.go:155] [cpumanager] starting with none policy
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.056028    3927 cpu_manager.go:156] [cpumanager] reconciling every 10s
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.056037    3927 policy_none.go:42] [cpumanager] none policy: Start
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.063744    3927 kubelet.go:1821] skipping pod synchronization - [container runtime is down]
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.077777    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.078600    3927 eviction_manager.go:243] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.179792    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.216813    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.256876    3927 kubelet_node_status.go:70] Attempting to register node minikube
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.257308    3927 kubelet_node_status.go:92] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.281962    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.382827    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.433032    3927 event.go:212] Unable to write event: 'Post https://localhost:8443/api/v1/namespaces/default/events: dial tcp 127.0.0.1:8443: connect: connection refused' (may retry after sleeping)
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.465753    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.483578    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.512941    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.513409    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: W1130 01:12:38.554907    3927 status_manager.go:485] Failed to get status for pod "kube-apiserver-minikube_kube-system(bc49bbda02a5471b3b4e702f12a4d1f1)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-minikube: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.562525    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.562719    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.585725    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.586252    3927 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "k8s-certs" (UniqueName: "kubernetes.io/host-path/edefc1e2d12e2d9f7675afe0ea9e3d4f-k8s-certs") pod "kube-controller-manager-minikube" (UID: "edefc1e2d12e2d9f7675afe0ea9e3d4f")
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.586371    3927 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs" (UniqueName: "kubernetes.io/host-path/edefc1e2d12e2d9f7675afe0ea9e3d4f-ca-certs") pod "kube-controller-manager-minikube" (UID: "edefc1e2d12e2d9f7675afe0ea9e3d4f")
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.586521    3927 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/edefc1e2d12e2d9f7675afe0ea9e3d4f-kubeconfig") pod "kube-controller-manager-minikube" (UID: "edefc1e2d12e2d9f7675afe0ea9e3d4f")
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.586635    3927 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "usr-share-ca-certificates" (UniqueName: "kubernetes.io/host-path/edefc1e2d12e2d9f7675afe0ea9e3d4f-usr-share-ca-certificates") pod "kube-controller-manager-minikube" (UID: "edefc1e2d12e2d9f7675afe0ea9e3d4f")
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.586823    3927 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "k8s-certs" (UniqueName: "kubernetes.io/host-path/bc49bbda02a5471b3b4e702f12a4d1f1-k8s-certs") pod "kube-apiserver-minikube" (UID: "bc49bbda02a5471b3b4e702f12a4d1f1")
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.586952    3927 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs" (UniqueName: "kubernetes.io/host-path/bc49bbda02a5471b3b4e702f12a4d1f1-ca-certs") pod "kube-apiserver-minikube" (UID: "bc49bbda02a5471b3b4e702f12a4d1f1")
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.586979    3927 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "usr-share-ca-certificates" (UniqueName: "kubernetes.io/host-path/bc49bbda02a5471b3b4e702f12a4d1f1-usr-share-ca-certificates") pod "kube-apiserver-minikube" (UID: "bc49bbda02a5471b3b4e702f12a4d1f1")
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.605500    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.605812    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: W1130 01:12:38.606089    3927 status_manager.go:485] Failed to get status for pod "kube-controller-manager-minikube_kube-system(edefc1e2d12e2d9f7675afe0ea9e3d4f)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.659443    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.664140    3927 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.664892    3927 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/kubelet.go:442: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.669641    3927 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.677418    3927 kubelet_node_status.go:70] Attempting to register node minikube
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.677822    3927 kubelet_node_status.go:92] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: W1130 01:12:38.680244    3927 status_manager.go:485] Failed to get status for pod "kube-scheduler-minikube_kube-system(7f99b6875de942b000954351c4ac09b5)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-minikube: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.681711    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.682073    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.688657    3927 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "addons" (UniqueName: "kubernetes.io/host-path/d682efea6fd7d1c11b13f78e8c81af08-addons") pod "kube-addon-manager-minikube" (UID: "d682efea6fd7d1c11b13f78e8c81af08")
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.688904    3927 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/7f99b6875de942b000954351c4ac09b5-kubeconfig") pod "kube-scheduler-minikube" (UID: "7f99b6875de942b000954351c4ac09b5")
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.689031    3927 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/d682efea6fd7d1c11b13f78e8c81af08-kubeconfig") pod "kube-addon-manager-minikube" (UID: "d682efea6fd7d1c11b13f78e8c81af08")
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.690170    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: W1130 01:12:38.741291    3927 status_manager.go:485] Failed to get status for pod "kube-addon-manager-minikube_kube-system(d682efea6fd7d1c11b13f78e8c81af08)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-addon-manager-minikube: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.741610    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.742611    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: W1130 01:12:38.773346    3927 pod_container_deletor.go:75] Container "207f36c1b70a06b7ad6f3a311de366c534bb1e321d2e8c6bab4a3f188699445b" not found in pod's containers
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.773511    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: W1130 01:12:38.776804    3927 status_manager.go:485] Failed to get status for pod "etcd-minikube_kube-system(400930335566057521570dcbaf3dbb0b)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/etcd-minikube: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.789539    3927 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "etcd-data" (UniqueName: "kubernetes.io/host-path/400930335566057521570dcbaf3dbb0b-etcd-data") pod "etcd-minikube" (UID: "400930335566057521570dcbaf3dbb0b")
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.789699    3927 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "etcd-certs" (UniqueName: "kubernetes.io/host-path/400930335566057521570dcbaf3dbb0b-etcd-certs") pod "etcd-minikube" (UID: "400930335566057521570dcbaf3dbb0b")
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.790645    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.813453    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: W1130 01:12:38.849032    3927 pod_container_deletor.go:75] Container "e0f799144b901a80d786b37e2be443064ec70c874ebd2f16626e26c8ec2b014c" not found in pod's containers
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.849233    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: I1130 01:12:38.887634    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.892454    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:38 cate.bxm.cloud kubelet[3927]: E1130 01:12:38.992594    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: W1130 01:12:39.065079    3927 pod_container_deletor.go:75] Container "61e0b17810823cf7610dac5c1a320c52e3282ef9993dc5d7ffff80d32e27446a" not found in pod's containers
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: W1130 01:12:39.065181    3927 pod_container_deletor.go:75] Container "ec859a5050ab401f0151bdbfb4e91c428c579494af8634fe073aa57d504be28e" not found in pod's containers
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: I1130 01:12:39.065313    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: E1130 01:12:39.092853    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: I1130 01:12:39.154038    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: E1130 01:12:39.192985    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: W1130 01:12:39.214998    3927 pod_container_deletor.go:75] Container "e3153c27384e4ba3c382224250fe74c5bf5d4b98641eb9507a4a21f5b5f3d2c1" not found in pod's containers
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: E1130 01:12:39.296549    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: I1130 01:12:39.390285    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: E1130 01:12:39.396676    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: I1130 01:12:39.478270    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: E1130 01:12:39.496803    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: E1130 01:12:39.597915    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: E1130 01:12:39.664695    3927 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: E1130 01:12:39.666030    3927 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/kubelet.go:442: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: E1130 01:12:39.670247    3927 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: E1130 01:12:39.702682    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: E1130 01:12:39.803935    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:39 cate.bxm.cloud kubelet[3927]: E1130 01:12:39.904110    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: E1130 01:12:40.004308    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: E1130 01:12:40.104580    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: E1130 01:12:40.204760    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: E1130 01:12:40.304946    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: E1130 01:12:40.405131    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: I1130 01:12:40.429216    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: I1130 01:12:40.455081    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: I1130 01:12:40.471090    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: I1130 01:12:40.505146    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: E1130 01:12:40.506813    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: E1130 01:12:40.606999    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: E1130 01:12:40.666615    3927 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: E1130 01:12:40.668710    3927 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/kubelet.go:442: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: E1130 01:12:40.673271    3927 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: E1130 01:12:40.707362    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: E1130 01:12:40.807579    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:40 cate.bxm.cloud kubelet[3927]: E1130 01:12:40.907884    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:41 cate.bxm.cloud kubelet[3927]: E1130 01:12:41.008053    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:41 cate.bxm.cloud kubelet[3927]: E1130 01:12:41.108695    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:41 cate.bxm.cloud kubelet[3927]: E1130 01:12:41.208892    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:41 cate.bxm.cloud kubelet[3927]: E1130 01:12:41.309180    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:41 cate.bxm.cloud kubelet[3927]: E1130 01:12:41.409278    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:41 cate.bxm.cloud kubelet[3927]: E1130 01:12:41.509572    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:41 cate.bxm.cloud kubelet[3927]: E1130 01:12:41.609760    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:41 cate.bxm.cloud kubelet[3927]: E1130 01:12:41.710145    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:41 cate.bxm.cloud kubelet[3927]: E1130 01:12:41.810419    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:41 cate.bxm.cloud kubelet[3927]: E1130 01:12:41.910527    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: E1130 01:12:42.010701    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: E1130 01:12:42.110996    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: E1130 01:12:42.211233    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: E1130 01:12:42.311415    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: E1130 01:12:42.411630    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: E1130 01:12:42.511878    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: E1130 01:12:42.612289    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: E1130 01:12:42.712424    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: I1130 01:12:42.784970    3927 kubelet_node_status.go:70] Attempting to register node minikube
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: W1130 01:12:42.785177    3927 pod_container_deletor.go:75] Container "0c5d24a12b77e7edafa254d51fdb7d1b6d45149d3b391f41b36dd8c3adefd7e6" not found in pod's containers
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: I1130 01:12:42.785486    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: E1130 01:12:42.812561    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: E1130 01:12:42.912787    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: W1130 01:12:42.988941    3927 pod_container_deletor.go:75] Container "17811eb35daf0b91cf818ab10c9f7938edb4ebb32bbc62c6cce99ab491b244a4" not found in pod's containers
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: I1130 01:12:42.989460    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:42 cate.bxm.cloud kubelet[3927]: I1130 01:12:42.989601    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: E1130 01:12:43.013427    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: W1130 01:12:43.084889    3927 pod_container_deletor.go:75] Container "238420f38e29cc8bab3fd3d42df2d7ac6c13691880563d77377f32f69a996954" not found in pod's containers
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: E1130 01:12:43.114515    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: E1130 01:12:43.215018    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: E1130 01:12:43.316609    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: E1130 01:12:43.417660    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: E1130 01:12:43.519278    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: I1130 01:12:43.563169    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: I1130 01:12:43.563304    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: I1130 01:12:43.563419    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: I1130 01:12:43.563437    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: I1130 01:12:43.563490    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: E1130 01:12:43.620643    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: E1130 01:12:43.722871    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: E1130 01:12:43.823704    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:43 cate.bxm.cloud kubelet[3927]: E1130 01:12:43.924004    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:44 cate.bxm.cloud kubelet[3927]: E1130 01:12:44.024312    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:44 cate.bxm.cloud kubelet[3927]: E1130 01:12:44.124554    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:44 cate.bxm.cloud kubelet[3927]: E1130 01:12:44.224676    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:44 cate.bxm.cloud kubelet[3927]: E1130 01:12:44.324933    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:44 cate.bxm.cloud kubelet[3927]: E1130 01:12:44.425234    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:44 cate.bxm.cloud kubelet[3927]: E1130 01:12:44.525429    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:44 cate.bxm.cloud kubelet[3927]: I1130 01:12:44.569016    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:44 cate.bxm.cloud kubelet[3927]: I1130 01:12:44.569157    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:44 cate.bxm.cloud kubelet[3927]: I1130 01:12:44.569250    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:44 cate.bxm.cloud kubelet[3927]: I1130 01:12:44.569016    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:44 cate.bxm.cloud kubelet[3927]: I1130 01:12:44.569468    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:44 cate.bxm.cloud kubelet[3927]: E1130 01:12:44.625722    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:44 cate.bxm.cloud kubelet[3927]: E1130 01:12:44.725855    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:44 cate.bxm.cloud kubelet[3927]: E1130 01:12:44.826059    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:44 cate.bxm.cloud kubelet[3927]: E1130 01:12:44.926182    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:45 cate.bxm.cloud kubelet[3927]: E1130 01:12:45.026289    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:45 cate.bxm.cloud kubelet[3927]: E1130 01:12:45.126594    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:45 cate.bxm.cloud kubelet[3927]: E1130 01:12:45.226821    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:45 cate.bxm.cloud kubelet[3927]: E1130 01:12:45.326955    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:45 cate.bxm.cloud kubelet[3927]: E1130 01:12:45.427256    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:45 cate.bxm.cloud kubelet[3927]: E1130 01:12:45.527428    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:45 cate.bxm.cloud kubelet[3927]: E1130 01:12:45.628144    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:45 cate.bxm.cloud kubelet[3927]: E1130 01:12:45.728665    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:45 cate.bxm.cloud kubelet[3927]: E1130 01:12:45.828768    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:45 cate.bxm.cloud kubelet[3927]: E1130 01:12:45.929010    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:46 cate.bxm.cloud kubelet[3927]: E1130 01:12:46.029500    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:46 cate.bxm.cloud kubelet[3927]: E1130 01:12:46.129732    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:46 cate.bxm.cloud kubelet[3927]: E1130 01:12:46.229833    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:46 cate.bxm.cloud kubelet[3927]: E1130 01:12:46.330445    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:46 cate.bxm.cloud kubelet[3927]: E1130 01:12:46.430673    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:46 cate.bxm.cloud kubelet[3927]: E1130 01:12:46.530881    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:46 cate.bxm.cloud kubelet[3927]: E1130 01:12:46.630981    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:46 cate.bxm.cloud kubelet[3927]: E1130 01:12:46.731181    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:46 cate.bxm.cloud kubelet[3927]: E1130 01:12:46.831283    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:46 cate.bxm.cloud kubelet[3927]: E1130 01:12:46.931487    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:47 cate.bxm.cloud kubelet[3927]: E1130 01:12:47.031578    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:47 cate.bxm.cloud kubelet[3927]: E1130 01:12:47.131849    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:47 cate.bxm.cloud kubelet[3927]: E1130 01:12:47.232056    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:47 cate.bxm.cloud kubelet[3927]: E1130 01:12:47.332310    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:47 cate.bxm.cloud kubelet[3927]: E1130 01:12:47.432948    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:47 cate.bxm.cloud kubelet[3927]: E1130 01:12:47.533549    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:47 cate.bxm.cloud kubelet[3927]: E1130 01:12:47.634314    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:47 cate.bxm.cloud kubelet[3927]: E1130 01:12:47.734467    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:47 cate.bxm.cloud kubelet[3927]: E1130 01:12:47.834572    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:47 cate.bxm.cloud kubelet[3927]: E1130 01:12:47.934872    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:48 cate.bxm.cloud kubelet[3927]: E1130 01:12:48.034967    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:48 cate.bxm.cloud kubelet[3927]: E1130 01:12:48.078799    3927 eviction_manager.go:243] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found
Nov 30 01:12:48 cate.bxm.cloud kubelet[3927]: E1130 01:12:48.135192    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:48 cate.bxm.cloud kubelet[3927]: E1130 01:12:48.235332    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:48 cate.bxm.cloud kubelet[3927]: E1130 01:12:48.335521    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:48 cate.bxm.cloud kubelet[3927]: E1130 01:12:48.435656    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:48 cate.bxm.cloud kubelet[3927]: E1130 01:12:48.535794    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:48 cate.bxm.cloud kubelet[3927]: E1130 01:12:48.635943    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:48 cate.bxm.cloud kubelet[3927]: E1130 01:12:48.736072    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:48 cate.bxm.cloud kubelet[3927]: E1130 01:12:48.836236    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:48 cate.bxm.cloud kubelet[3927]: E1130 01:12:48.936351    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:49 cate.bxm.cloud kubelet[3927]: E1130 01:12:49.036505    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:49 cate.bxm.cloud kubelet[3927]: E1130 01:12:49.136719    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:49 cate.bxm.cloud kubelet[3927]: E1130 01:12:49.237177    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:49 cate.bxm.cloud kubelet[3927]: E1130 01:12:49.337313    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:49 cate.bxm.cloud kubelet[3927]: E1130 01:12:49.437463    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:49 cate.bxm.cloud kubelet[3927]: E1130 01:12:49.537761    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:49 cate.bxm.cloud kubelet[3927]: E1130 01:12:49.638486    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:49 cate.bxm.cloud kubelet[3927]: E1130 01:12:49.739645    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:49 cate.bxm.cloud kubelet[3927]: E1130 01:12:49.839749    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:49 cate.bxm.cloud kubelet[3927]: E1130 01:12:49.939888    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:50 cate.bxm.cloud kubelet[3927]: E1130 01:12:50.040211    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:50 cate.bxm.cloud kubelet[3927]: E1130 01:12:50.140580    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:50 cate.bxm.cloud kubelet[3927]: E1130 01:12:50.240859    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:50 cate.bxm.cloud kubelet[3927]: E1130 01:12:50.341151    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:50 cate.bxm.cloud kubelet[3927]: E1130 01:12:50.441487    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:50 cate.bxm.cloud kubelet[3927]: E1130 01:12:50.541687    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:50 cate.bxm.cloud kubelet[3927]: E1130 01:12:50.641911    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:50 cate.bxm.cloud kubelet[3927]: E1130 01:12:50.742394    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:50 cate.bxm.cloud kubelet[3927]: E1130 01:12:50.842971    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:50 cate.bxm.cloud kubelet[3927]: E1130 01:12:50.943129    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:51 cate.bxm.cloud kubelet[3927]: E1130 01:12:51.043287    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:51 cate.bxm.cloud kubelet[3927]: E1130 01:12:51.143601    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:51 cate.bxm.cloud kubelet[3927]: E1130 01:12:51.243895    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:51 cate.bxm.cloud kubelet[3927]: E1130 01:12:51.344025    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:51 cate.bxm.cloud kubelet[3927]: E1130 01:12:51.444144    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:51 cate.bxm.cloud kubelet[3927]: E1130 01:12:51.544434    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:51 cate.bxm.cloud kubelet[3927]: E1130 01:12:51.644517    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:51 cate.bxm.cloud kubelet[3927]: E1130 01:12:51.668135    3927 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: net/http: TLS handshake timeout
Nov 30 01:12:51 cate.bxm.cloud kubelet[3927]: E1130 01:12:51.669795    3927 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/kubelet.go:442: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: net/http: TLS handshake timeout
Nov 30 01:12:51 cate.bxm.cloud kubelet[3927]: E1130 01:12:51.674411    3927 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: net/http: TLS handshake timeout
Nov 30 01:12:51 cate.bxm.cloud kubelet[3927]: E1130 01:12:51.745153    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:51 cate.bxm.cloud kubelet[3927]: E1130 01:12:51.845292    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:51 cate.bxm.cloud kubelet[3927]: E1130 01:12:51.945429    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:52 cate.bxm.cloud kubelet[3927]: E1130 01:12:52.045584    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:52 cate.bxm.cloud kubelet[3927]: E1130 01:12:52.145746    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:52 cate.bxm.cloud kubelet[3927]: E1130 01:12:52.246046    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:52 cate.bxm.cloud kubelet[3927]: E1130 01:12:52.346264    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:52 cate.bxm.cloud kubelet[3927]: E1130 01:12:52.446469    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:52 cate.bxm.cloud kubelet[3927]: E1130 01:12:52.546740    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:52 cate.bxm.cloud kubelet[3927]: E1130 01:12:52.647048    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:52 cate.bxm.cloud kubelet[3927]: E1130 01:12:52.747196    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:52 cate.bxm.cloud kubelet[3927]: W1130 01:12:52.784995    3927 status_manager.go:485] Failed to get status for pod "kube-scheduler-minikube_kube-system(7f99b6875de942b000954351c4ac09b5)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-minikube: net/http: TLS handshake timeout
Nov 30 01:12:52 cate.bxm.cloud kubelet[3927]: E1130 01:12:52.785935    3927 kubelet_node_status.go:92] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: net/http: TLS handshake timeout
Nov 30 01:12:52 cate.bxm.cloud kubelet[3927]: E1130 01:12:52.847522    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:52 cate.bxm.cloud kubelet[3927]: E1130 01:12:52.947679    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:53 cate.bxm.cloud kubelet[3927]: E1130 01:12:53.047931    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:53 cate.bxm.cloud kubelet[3927]: E1130 01:12:53.148150    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:53 cate.bxm.cloud kubelet[3927]: I1130 01:12:53.247535    3927 reconciler.go:154] Reconciler: start to sync state
Nov 30 01:12:53 cate.bxm.cloud kubelet[3927]: E1130 01:12:53.248310    3927 kubelet.go:2236] node "minikube" not found
Nov 30 01:12:54 cate.bxm.cloud kubelet[3927]: I1130 01:12:54.387061    3927 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 30 01:12:54 cate.bxm.cloud kubelet[3927]: I1130 01:12:54.419699    3927 kubelet_node_status.go:70] Attempting to register node minikube
Nov 30 01:12:58 cate.bxm.cloud kubelet[3927]: I1130 01:12:58.436397    3927 kubelet_node_status.go:112] Node minikube was previously registered
Nov 30 01:12:58 cate.bxm.cloud kubelet[3927]: I1130 01:12:58.436423    3927 kubelet_node_status.go:73] Successfully registered node minikube
Nov 30 01:13:39 cate.bxm.cloud kubelet[3927]: E1130 01:13:39.354075    3927 fsHandler.go:121] failed to collect filesystem stats - rootDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH, rootInodeErr: failed to exec cmd [ionice -c3 nice -n 19 find /var/lib/docker/overlay2/48d3650b69669f88cb09a08154009c58fbf7d42d96ebfd2b383da675ce0e4cae/diff -xdev -printf .] - exec: "ionice": executable file not found in $PATH; stderr: , extraDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH
Nov 30 01:13:39 cate.bxm.cloud kubelet[3927]: E1130 01:13:39.395436    3927 fsHandler.go:121] failed to collect filesystem stats - rootDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH, rootInodeErr: failed to exec cmd [ionice -c3 nice -n 19 find /var/lib/docker/overlay2/74a690e335a016f69526068be88c557f811c60aa0a6e7b44afc7c5cc34035c43/diff -xdev -printf .] - exec: "ionice": executable file not found in $PATH; stderr: , extraDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH
Nov 30 01:13:39 cate.bxm.cloud kubelet[3927]: E1130 01:13:39.404692    3927 fsHandler.go:121] failed to collect filesystem stats - rootDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH, rootInodeErr: failed to exec cmd [ionice -c3 nice -n 19 find /var/lib/docker/overlay2/3658615ac3e203131beb2ecc16e0d324b3156b0d3d815d7d5a6c4657e82ed8e0/diff -xdev -printf .] - exec: "ionice": executable file not found in $PATH; stderr: , extraDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH
Nov 30 01:13:39 cate.bxm.cloud kubelet[3927]: E1130 01:13:39.445520    3927 fsHandler.go:121] failed to collect filesystem stats - rootDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH, rootInodeErr: failed to exec cmd [ionice -c3 nice -n 19 find /var/lib/docker/overlay2/9cf4802df9e730d3036f69707e36d4a489312994858d2f105437cb0364af3aef/diff -xdev -printf .] - exec: "ionice": executable file not found in $PATH; stderr: , extraDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH
Nov 30 01:13:39 cate.bxm.cloud kubelet[3927]: E1130 01:13:39.476698    3927 fsHandler.go:121] failed to collect filesystem stats - rootDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH, rootInodeErr: failed to exec cmd [ionice -c3 nice -n 19 find /var/lib/docker/overlay2/50db280255e45186547f1f01745952ba228cf22b424ee0b5ea56ca04316b7ec9/diff -xdev -printf .] - exec: "ionice": executable file not found in $PATH; stderr: , extraDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH
Nov 30 01:13:39 cate.bxm.cloud kubelet[3927]: E1130 01:13:39.801842    3927 fsHandler.go:121] failed to collect filesystem stats - rootDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH, rootInodeErr: failed to exec cmd [ionice -c3 nice -n 19 find /var/lib/docker/overlay2/7938a03abdf77e042b6ae389b44d8d15138b65f94032cb9623844a8d0b2f4c40/diff -xdev -printf .] - exec: "ionice": executable file not found in $PATH; stderr: , extraDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH
Nov 30 01:13:39 cate.bxm.cloud kubelet[3927]: E1130 01:13:39.876005    3927 fsHandler.go:121] failed to collect filesystem stats - rootDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH, rootInodeErr: failed to exec cmd [ionice -c3 nice -n 19 find /var/lib/docker/overlay2/90ccd27c36550d24b2a67ba21411f2d84ba589d4a96b42bcd44f99ae8a752b0d/diff -xdev -printf .] - exec: "ionice": executable file not found in $PATH; stderr: , extraDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH
Nov 30 01:13:39 cate.bxm.cloud kubelet[3927]: E1130 01:13:39.881007    3927 fsHandler.go:121] failed to collect filesystem stats - rootDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH, rootInodeErr: failed to exec cmd [ionice -c3 nice -n 19 find /var/lib/docker/overlay2/82b7bd5501b95eedbbfa1088bece62d64ab381b0dd103a33c5ec6fac724567be/diff -xdev -printf .] - exec: "ionice": executable file not found in $PATH; stderr: , extraDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH
Nov 30 01:13:39 cate.bxm.cloud kubelet[3927]: E1130 01:13:39.904051    3927 fsHandler.go:121] failed to collect filesystem stats - rootDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH, rootInodeErr: failed to exec cmd [ionice -c3 nice -n 19 find /var/lib/docker/overlay2/6a0975915476972c940b2c133648f434146539438fe7121b8a8443a4f9e280ab/diff -xdev -printf .] - exec: "ionice": executable file not found in $PATH; stderr: , extraDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH
Nov 30 01:13:39 cate.bxm.cloud kubelet[3927]: E1130 01:13:39.939488    3927 fsHandler.go:121] failed to collect filesystem stats - rootDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH, rootInodeErr: failed to exec cmd [ionice -c3 nice -n 19 find /var/lib/docker/overlay2/f119003d2570a6321d5e12461f3951f6a9fa2ec8f0baea5ef169c495372adbe1/diff -xdev -printf .] - exec: "ionice": executable file not found in $PATH; stderr: , extraDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH

Anything else do we need to know:
Thanks in advance for any guidance you can provide! ✨

[tstromberg]

I tried to recreate from the master branch with v1.12.3 and virtualbox, but it ran properly. I did see the following errors, however:

Dec 04 05:54:33 minikube kubelet[2739]: E1204 05:54:33.631346    2739 fsHandler.go:121] failed to collect filesystem stats - rootDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH, rootInodeErr: failed to exec cmd [ionice -c3 nice -n 19 find /var/lib/docker/overlay2/aef75bb7ea5876aa4f0be828e6d3ae84718499f3856ed1e0ed50d65229932c02/diff -xdev -printf .] - exec: "ionice": executable file not found in $PATH; stderr: , extraDiskErr: failed to exec du - exec: "ionice": executable file not found in $PATH

[nrvnrvn]

Plenty of them:

$ sudo journalctl | grep ionice | wc -l
2518

[phyllisstein]

Thanks for looking into it! I built from master (8f128a7d1) and tried again, and I was able to create a cluster, spin it down, and spin it up again without any trouble. Definitely should'a tried that on my own, but I appreciate your pointing me in the right direction 😅.

[phyllisstein]

Whoops---turns out this is still an issue on master. Here's the sequence of commands that I ran to produce it again:

$ minikube start --kubernetes-version=v1.12.3 --cpus=4 --memory=4096 --vm-driver=vmwarefusion
$ minikube stop
$ minikube start

This caused the hang on "Starting cluster components..." that I described above. The strange thing is that this sequence of commands worked just fine:

$ minikube start --kubernetes-version=v1.12.3 --cpus=4 --memory=4096 --vm-driver=vmwarefusion
$ minikube stop
$ minikube start --kubernetes-version=v1.12.3 --cpus=4 --memory=4096 --vm-driver=vmwarefusion

I imagine one of the four flags has to be specified explicitly on each start, rather than being inferred from the VM's previous state. A little guesswork and testing suggests that it might be --kubernetes-version: it looks like minikube doesn't check for preexisting state before copying new files into the VM, and winds up clobbering v1.12.3 with v1.10.0 unless I've politely asked it to not. But I defer to the experts regarding whether that's what the trouble is, and whether it's a genuine bug in minikube's bootstrap process or basic user error.

[nrvnrvn]

There is ionice in the latest release!

$ which ionice
/bin/ionice