Skip to content
This repository has been archived by the owner on May 12, 2021. It is now read-only.

Revert "vc: change container rootfs to be a mount" #1577

Merged
merged 1 commit into from
Apr 25, 2019

Conversation

chavafg
Copy link
Contributor

@chavafg chavafg commented Apr 23, 2019

This reverts commit 196661b.

Reverting because cri-o with devicemapper started
to fail after this commit was merged.

Fixes: #1574.

@devimc
Copy link

devimc commented Apr 23, 2019

/test

@chavafg
Copy link
Contributor Author

chavafg commented Apr 23, 2019

I want to do this revert since cri-o CI is failing because and we are blocking them.
/cc @bergwolf @amshinde @egernst @sboeuf

chavafg added a commit to chavafg/tests-1 that referenced this pull request Apr 23, 2019
Do not restrict ubuntu version to run with devicemapper.
We have now moved most of our jobs to ubuntu 18.04
and we were not testing with devicemapper.
With this change, we will test cri-o with devicemapper
on all ubuntu versions.

Fixes: kata-containers#1493.

Depends-on: github.com/kata-containers/runtime#1577

Signed-off-by: Salvador Fuentes <[email protected]>
This reverts commit 196661b.

Reverting because cri-o with devicemapper started
to fail after this commit was merged.

Fixes: kata-containers#1574.

Signed-off-by: Salvador Fuentes <[email protected]>
@chavafg chavafg force-pushed the topic/revert-mount-pr branch 2 times, most recently from 0fd4dc5 to bc9b9e2 Compare April 23, 2019 14:01
@sboeuf
Copy link

sboeuf commented Apr 23, 2019

@bergwolf please chime in on this one, as this was your PR.

@chavafg
Copy link
Contributor Author

chavafg commented Apr 23, 2019

/test

@gnawux
Copy link
Member

gnawux commented Apr 23, 2019

weird.... @chavafg do you mean the kata changes blocked the CI of CRI-O project?

@chavafg
Copy link
Contributor Author

chavafg commented Apr 23, 2019

@gnawux yes, we have a CI job running on their repo.

@gnawux
Copy link
Member

gnawux commented Apr 23, 2019

It's unusual that an internal change of a project breaks the CI of another project. Does this mean we do not have device mapper being tested in our CI?

@chavafg
Copy link
Contributor Author

chavafg commented Apr 23, 2019

We stopped testing with devicemapper when we moved from ubuntu 16.04 to 18.04, Didn't realized honestly until this failure. I have opened kata-containers/tests#1494 to fix that.

@gnawux
Copy link
Member

gnawux commented Apr 23, 2019

ping @bergwolf, take a look here

@bergwolf
Copy link
Member

@jcvenegas I don't have a cri-o setup to reproduce it. Do you have full logs somewhere that I can access to see what happened there?

@chavafg
Copy link
Contributor Author

chavafg commented Apr 23, 2019

@bergwolf I think you can check the logs in http://jenkins.katacontainers.io/job/kata-containers-crio-PR/1702/

@bergwolf
Copy link
Member

cri-o first umounted the mountpoint and then removed the device mapper device(ba6957dbb3b068c72b0d877a99f4908e5b6bd93c6643ca1ad49f723401dd6782). After that it reports that umount failed with EBUSY. Not the removal operation? That one would be easier to guess.

I did test containerd devmapper snapshotter (w/ both v1 and v2 shims) and docker device mapper graphdriver, and didn't see such failure. So I guess it is something special with cri-o. I need to setup a cri-o environment to understand its workflow there. In the meantime, feel free to merge this PR if you are certain that it is the root cause for the cri-o failure.

23:16:28 # time="2019-04-23 15:16:07.052129433Z" level=debug msg="devmapper: UnmountDevice START(hash=ba6957dbb3b068c72b0d877a99f4908e5b6bd93c6643ca1ad49f723401dd6782)"
23:16:28 # time="2019-04-23 15:16:07.052687136Z" level=debug msg="devmapper: Unmount(/tmp/tmp.XZ9I6Eb6VZ/crio/devicemapper/mnt/ba6957dbb3b068c72b0d877a99f4908e5b6bd93c6643ca1ad49f723401dd6782)"
23:16:28 # time="2019-04-23 15:16:07.078521171Z" level=debug msg="devmapper: Unmount done"
23:16:28 # time="2019-04-23 15:16:07.078558771Z" level=debug msg="devmapper: deactivateDevice START(ba6957dbb3b068c72b0d877a99f4908e5b6bd93c6643ca1ad49f723401dd6782)"
23:16:28 # time="2019-04-23 15:16:07.078673472Z" level=debug msg="devmapper: removeDevice START(container-8:1-1280011-ba6957dbb3b068c72b0d877a99f4908e5b6bd93c6643ca1ad49f723401dd6782)"
23:16:28 # time="2019-04-23 15:16:27.133753351Z" level=debug msg="devmapper: removeDevice END(container-8:1-1280011-ba6957dbb3b068c72b0d877a99f4908e5b6bd93c6643ca1ad49f723401dd6782)"
23:16:28 # time="2019-04-23 15:16:27.133804752Z" level=debug msg="devmapper: deactivateDevice END(ba6957dbb3b068c72b0d877a99f4908e5b6bd93c6643ca1ad49f723401dd6782)"
23:16:28 # time="2019-04-23 15:16:27.133816552Z" level=debug msg="devmapper: UnmountDevice END(hash=ba6957dbb3b068c72b0d877a99f4908e5b6bd93c6643ca1ad49f723401dd6782)"
23:16:28 # time="2019-04-23 15:16:27.133829452Z" level=error msg="devmapper: Error unmounting device ba6957dbb3b068c72b0d877a99f4908e5b6bd93c6643ca1ad49f723401dd6782: Device is Busy"
23:16:28 # time="2019-04-23 15:16:27.192205649Z" level=debug msg="failed to unmount container \"f1dd8a9102a85957216bd2b026b1ba4aef9a87e1a7623570f9c9013d1d7deca2\": Device is Busy"

@chavafg
Copy link
Contributor Author

chavafg commented Apr 23, 2019

@kata-containers/runtime ptal and provide approvals if you agree, so this can be merged. @bergwolf has agreed to merge it while he takes a look at the issue.

@sboeuf
Copy link

sboeuf commented Apr 23, 2019

@egernst @amshinde PTAL

@amshinde amshinde merged commit b5aa8d4 into kata-containers:master Apr 25, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

cri-o: devmapper: Error unmounting device
7 participants