-
Notifications
You must be signed in to change notification settings - Fork 4.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
docker driver: don't mount to /var as it causes race condition #8179
Comments
Probably same as #8100, triggered by enabling Docker Desktop file sharing. Try |
I tried but i get the same error like here #7818
later i tried to create the VM using |
Kubernetes requires Linux, so you can't run the "none" driver (kubeadm) on a Windows host. |
ok i will try to do the minikube guide in ubuntu, thanks for the help |
Were you able to try disabling preloading, while using Docker Desktop ?
|
yes i was try but i get the same error of #7818 |
That was about another architecture, it seems unlikely here (unless you run Windows on ARM) Just wondered if this was the issue as #8100 or not, but if you want to swich to Ubuntu that's OK |
Despite this issue being closed as a duplicate, I hit the exact same issue as clearly described/depicted here. @afbjorklund workaround by removing the preload=false did fix the initialisation errors. |
Sorry but i tried using preload=false without success. Let me know if you want to see another log, i still have the docker with the minikube in my windows |
I also stuck here, I run CentOS7.6, lastest minikube version. |
Above is my |
Hey @rh01 would you mind trying with the The command line would look like:
It would be really helpful if you could let us know if that does or doesn't fix the bug; I've been trying to fix it but have found it difficult to reproduce. Thank you! |
strace output for this failure:
|
It seems this bug is caused by a race condition between mounting /var to the container and calling "/var/lib/dpkg/alternatives/iptables" from the entrypoint script |
@priyawadhwa : this problem also applies to the "podman" driver, since it uses the same mounts and the same image and volume setup as the "docker" driver |
@priyawadhwa cloud code team also has this issue on mac they seem to fix it with minikube delete --all |
Steps to reproduce the issue:
Im following the official guide to use minikube and i am getting an error inside the container image
INFO: ensuring we can execute /bin/mount even with userns-remap
INFO: remounting /sys read-only
INFO: making mounts shared
INFO: fix cgroup mounts for all subsystems
INFO: clearing and regenerating /etc/machine-id
Initializing machine ID from random generator.
INFO: faking /sys/class/dmi/id/product_name to be "kind"
INFO: faking /sys/class/dmi/id/product_uuid to be random
INFO: faking /sys/devices/virtual/dmi/id/product_uuid as well
INFO: setting iptables to detected mode: legacy
update-alternatives: error: no alternatives for iptables
i use windows 10 and my docker desktop version is 2.3.0.2
Full output of failed command:
I0516 17:24:50.867547 12524 start.go:99] hostinfo: {"hostname":"DESKTOP-CFDRBNO","uptime":28728,"bootTime":1589631962,"procs":243,"os":"windows","platform":"Microsoft Windows 10 Enterprise","platformFamily":"Standalone Workstation","platformVersion":"10.0.18362 Build 18362","kernelVersion":"","virtualizationSystem":"","virtualizationRole":"","hostid":"d16cd74e-4922-43f3-8935-a8a21e85fb43"}
W0516 17:24:50.867547 12524 start.go:107] gopshost.Virtualization returned error: not implemented yet
I0516 17:24:50.881545 12524 notify.go:125] Checking for updates...
I0516 17:24:50.884546 12524 driver.go:253] Setting default libvirt URI to qemu:///system
I0516 17:24:51.279998 12524 docker.go:95] docker version: linux-19.03.8
I0516 17:24:51.285999 12524 start.go:215] selected driver: docker
I0516 17:24:51.286998 12524 start.go:594] validating driver "docker" against &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 Memory:1989 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.18.2 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.244.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.2 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true]}
I0516 17:24:51.286998 12524 start.go:600] status for docker: {Installed:true Healthy:true Error: Fix: Doc:}
I0516 17:24:51.287999 12524 start.go:917] auto setting extra-config to "kubeadm.pod-network-cidr=10.244.0.0/16".
I0516 17:24:51.292004 12524 cache.go:104] Beginning downloading kic artifacts for docker with docker
I0516 17:24:51.464001 12524 image.go:88] Found gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 in local docker daemon, skipping pull
I0516 17:24:51.464001 12524 preload.go:81] Checking if preload exists for k8s version v1.18.2 and runtime docker
I0516 17:24:51.465998 12524 preload.go:96] Found local preload: C:\Users\Lepa.minikube\cache\preloaded-tarball\preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4
I0516 17:24:51.465998 12524 cache.go:48] Caching tarball of preloaded images
I0516 17:24:51.466999 12524 preload.go:122] Found C:\Users\Lepa.minikube\cache\preloaded-tarball\preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0516 17:24:51.467999 12524 cache.go:51] Finished verifying existence of preloaded tar for v1.18.2 on docker
I0516 17:24:51.468998 12524 profile.go:156] Saving config to C:\Users\Lepa.minikube\profiles\minikube\config.json ...
I0516 17:24:51.470998 12524 cache.go:132] Successfully downloaded all kic artifacts
I0516 17:24:51.471998 12524 start.go:223] acquiring machines lock for minikube: {Name:mkd0ecf026d95e036f7a91a8d78fbc6cb8d50d6f Clock:{} Delay:500ms Timeout:15m0s Cancel:}
I0516 17:24:51.471998 12524 start.go:227] acquired machines lock for "minikube" in 0s
I0516 17:24:51.471998 12524 start.go:87] Skipping create...Using existing machine configuration
I0516 17:24:51.472998 12524 fix.go:53] fixHost starting:
I0516 17:24:51.519001 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:51.656003 12524 fix.go:105] recreateIfNeeded on minikube: state=Stopped err=
W0516 17:24:51.656998 12524 fix.go:131] unexpected machine state, will restart:
I0516 17:24:51.687998 12524 cli_runner.go:108] Run: docker start minikube
I0516 17:24:52.246999 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:52.604000 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:52.758997 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:52.918001 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:53.080999 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:53.245998 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:53.409997 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:53.568998 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:53.736997 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:53.896998 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:54.072998 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:54.263997 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:54.476998 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:54.679004 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:54.936998 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:55.223011 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:55.602012 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:56.047013 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:56.602057 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:57.632049 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:58.584195 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:24:59.911981 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:02.223268 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:06.390494 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:14.200094 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:21.035955 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:31.262799 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:31.408802 12524 fix.go:55] fixHost completed within 39.9348019s
I0516 17:25:31.408802 12524 start.go:74] releasing machines lock for "minikube", held for 39.9368033s
! StartHost failed, but will try again: driver start: expected container state be running but got "Stopped"
I0516 17:25:36.411282 12524 start.go:223] acquiring machines lock for minikube: {Name:mkd0ecf026d95e036f7a91a8d78fbc6cb8d50d6f Clock:{} Delay:500ms Timeout:15m0s Cancel:}
I0516 17:25:36.412285 12524 start.go:227] acquired machines lock for "minikube" in 0s
I0516 17:25:36.414276 12524 start.go:87] Skipping create...Using existing machine configuration
I0516 17:25:36.414276 12524 fix.go:53] fixHost starting:
I0516 17:25:36.465281 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:36.609284 12524 fix.go:105] recreateIfNeeded on minikube: state=Stopped err=
W0516 17:25:36.609284 12524 fix.go:131] unexpected machine state, will restart:
I0516 17:25:36.637277 12524 cli_runner.go:108] Run: docker start minikube
I0516 17:25:37.097246 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:37.408239 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:37.569241 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:37.726240 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:37.892239 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:38.052244 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:38.218241 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:38.388240 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:38.553239 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:38.727241 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:38.892241 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:39.079242 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:39.267241 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:39.495240 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:39.734409 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:40.002405 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:40.386424 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:40.914258 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:42.952233 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:43.788253 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:45.090653 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:46.497019 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:25:48.603142 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:26:10.953385 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0516 17:26:11.106385 12524 fix.go:55] fixHost completed within 34.6921086s
I0516 17:26:11.106385 12524 start.go:74] releasing machines lock for "minikube", held for 34.6931059s
I0516 17:26:11.109383 12524 exit.go:58] WithError(error provisioning host)=Failed to start host: driver start: expected container state be running but got "Stopped" called from:
goroutine 1 [running]:
runtime/debug.Stack(0x40acf1, 0x18d3660, 0x18b8300)
/usr/local/go/src/runtime/debug/stack.go:24 +0xa4
k8s.io/minikube/pkg/minikube/exit.WithError(0x1b3f8de, 0x17, 0x1dfc340, 0xc000396640)
/app/pkg/minikube/exit/exit.go:58 +0x3b
k8s.io/minikube/cmd/minikube/cmd.runStart(0x2b53760, 0xc0002f5410, 0x0, 0x1)
/app/cmd/minikube/cmd/start.go:170 +0xac9
github.com/spf13/cobra.(*Command).execute(0x2b53760, 0xc0002f5400, 0x1, 0x1, 0x2b53760, 0xc0002f5400)
/go/pkg/mod/github.com/spf13/[email protected]/command.go:846 +0x2b1
github.com/spf13/cobra.(*Command).ExecuteC(0x2b527a0, 0x0, 0x0, 0xc000005001)
/go/pkg/mod/github.com/spf13/[email protected]/command.go:950 +0x350
github.com/spf13/cobra.(*Command).Execute(...)
/go/pkg/mod/github.com/spf13/[email protected]/command.go:887
k8s.io/minikube/cmd/minikube/cmd.Execute()
/app/cmd/minikube/cmd/root.go:112 +0x6f5
main.main()
/app/cmd/minikube/main.go:66 +0xf1
W0516 17:26:11.110383 12524 out.go:201] error provisioning host: Failed to start host: driver start: expected container state be running but got "Stopped"
Optional: Full output of
minikube logs
command:The text was updated successfully, but these errors were encountered: