[Tracking Issue] Support for cgroups v1

[utam0k]

This issue is for tracking the implementation of cgroups.
Since devices of cgoups has already been implemented, you can implement it while referring to it.
If you are interested, you can comment on this issue and I will assign it to you.

• devices
• network(assigned @tsturzl)
  The integration test is this: https://github.com/opencontainers/runtime-tools/tree/master/validation/linux_cgroups_network
• pids (assigned @0xdco) Bump libc from 0.2.108 to 0.2.109 utam0k/youki#26
• hugepageLimits(assigned @Furisto) Bump futures-sink from 0.3.17 to 0.3.18 utam0k/youki#15
• memory (assigned @tsturzl) Bump anyhow from 1.0.45 to 1.0.48 utam0k/youki#16
• cpu(assigned @Furisto) Support for cgroup v1 cpu and cpuset subsystem #63
  The integration test is this: https://github.com/opencontainers/runtime-tools/tree/master/validation/linux_cgroups_cpus
• blockIO(assigned @Furisto) Bump libc from 0.2.108 to 0.2.110 utam0k/youki#31
• cpuacct (assigned @yjuba) [WIP] Add support for cpuacct in cgroup v1. #92
• cpuset (assigned @Furisto) Support for cgroup v1 cpu and cpuset subsystem #63
• perf_event (assigned @fbrv) add perf_event to cgroups v1 #166
• freezer (assigned @duduainankai ) Add cgroup v1 freezer controller #93

Goal

Each of them will be targeted to pass integration tests. If possible, it is good to have unit tests as well.
It would be helpful to have a look at the GitHub Actions file to see how to run the integration tests.

Reference

• https://github.com/opencontainers/runtime-spec/blob/master/config-linux.md#control-groups
• https://www.kernel.org/doc/html/latest/admin-guide/cgroup-v1/index.html

[sensaiankit]

I would like to work on this issue, but as I am a beginner i didn't understood the issue so can you please guide me

[kmpzr]

Hi @utam0k, thanks for your work so far! I'm looking for some tasks to hone my Rust skills and I guess this issue looks like a perfect candidate, I'm interested in the assignment. I'll go through the cgroups to check the details, but I guess it would be beneficial to all if we could somehow have a in depth implementation discussion to better align with your vision of the project. You can DM me on Twitter: @0xdco.

[utam0k]

@sensaiankit How about this issue(utam0k#8), which is more recommended for beginners?
For example, src/namespaces already has one sample test, so you can use that as an example to increase.

[utam0k]

@0xdco Thanks! I'd like to assign you to one of cgroup's controller.
Which controller are you most interested in?
Or do you want to modify or refactor the architecture? If you have any advice on architecture or code I'd love to hear it :)

[sensaiankit]

@sensaiankit How about this issue(#8), which is more recommended for beginners?
For example, src/namespaces already has one sample test, so you can use that as an example to increase.

Okay cool looking forward for that issue. I still would like to get guidance from you, would you mind connecting somewhere like either twitter or discord

[utam0k]

@sensaiankit Of course! If you want my guidance you can contact me on Twitter DM. I will do my best to accommodate you as my time permits. Sorry if it takes me a while to reply.

[sensaiankit]

@sensaiankit Of course! If you want my guidance you can contact me on Twitter DM. I will do my best to accommodate you as my time permits. Sorry if it takes me a while to reply.

I saw your twitter account but i cant really do a dm will you please open it ?

[utam0k]

@sensaiankit Of course! If you want my guidance you can contact me on Twitter DM. I will do my best to accommodate you as my time permits. Sorry if it takes me a while to reply.

I saw your twitter account but i cant really do a dm will you please open it ?

Sorry... I opened it.

[kmpzr]

@0xdco Thanks! I'd like to assign you to one of cgroup's controller.
Which controller are you most interested in?
Or do you want to modify or refactor the architecture? If you have any advice on architecture or code I'd love to hear it :)

You can assign me to whichever controller you think is a good easy / introductory point to the project as I'm still reading the code and the documentation(s) to get started. I will be able to start tackling it during the weekend. Depending on how successful I am in my endeavor, I might take over other available controllers to write as well. I have no plans to modify or refactor the architecture but let's see after the implementation if there are opportunities to do some cleanups.
I'm also taking a look in the railcar implementation in the hope it gives me some insights on how to implement it on youki.
Furthermore, it would be awesome if you could point me out to any resource or workflow you used to test / check the changes (other than the already stated on the README) as I'm not quite familiar with runc nor runtime-spec (taking a look at it already).

[utam0k]

@0xdco
I assigned you to the pids of the controller. I'm thinking that it's probably not that difficult.
How about using this test provided by the opencontainers to guarantee operation? (You can test this by setting an environment variable called RUNTIME in the youki exec file.)
https://github.com/opencontainers/runtime-tools/tree/master/validation/linux_cgroups_pids
runtime-spec's document about groups is here.
https://github.com/opencontainers/runtime-spec/blob/master/config-linux.md#control-groups

It is a very good idea!

I'm also taking a look in the railcar implementation in the hope it gives me some insights on how to implement it on youki.

[reynn]

Can I be assigned the CPU and/or Memory, any tips you may already know of would be awesome but should be able to handle either way!

[utam0k]

@reynn
Thanks for your interest!
I would like to assign the CPU of the controller to you. If you finish soon, I may assign another to you.
I look forward to your PR.

[tsturzl]

I'd be happy to take the memory cgroup controller.

[tsturzl]

this is another great resource for everyone: https://www.kernel.org/doc/html/latest/admin-guide/cgroup-v1/index.html

Basically the cgroup controller is configured by interaction with a virtual filesystem. You're basically just writing specific things to certain files in a certain directory. The implementation for these should be relatively easy and straightforward for each of these once you know what needs to go where. Happy hacking!

[utam0k]

@tsturzl
Thanks for your interest. Of course, I assigned it to you.

I'd be happy to take the memory cgroup controller.

This reference is so cool. I added it in this issue description.

this is another great resource for everyone: https://www.kernel.org/doc/html/latest/admin-guide/cgroup-v1/index.html

I think so too. That's why I'm making this issue a good first issue.

Basically the cgroup controller is configured by interaction with a virtual filesystem. You're basically just writing specific things to certain files in a certain directory. The implementation for these should be relatively easy and straightforward for each of these once you know what needs to go where. Happy hacking!

[Furisto]

I would like to work on the hugepage cgroup controller.

[utam0k]

@Furisto
Sure! I assigned you. I am sincerely waiting for your PR.

[tsturzl]

I can go ahead an take the network controller on. The memory controller PR is just waiting to be merged after I integrate with the changes @Furisto made. I can probably be finished up with the network controller by Monday.

[utam0k]

@tsturzl
Your work is amazing!
Okay, I'll assign you to it. I don't intend to rush it, so it would be great if you could proceed. I am sincerely waiting for your PR.

[kmpzr]

I'm happy to take another controller if there is still any available :)

[Furisto]

I have started with the blkio controller. Can you assign me @utam0k ?

[utam0k]

@Furisto @tsturzl
I updated the description of this issue. Can you please check if it is correct?

[tsturzl]

@utam0k This looks good. I'm not seeing any missing subsystems that I'm aware of.

[Furisto]

@utam0k Fine from my site as well

[thinking-tower]

@utam0k I'd like to work on perf_event!

[utam0k]

@thinking-tower Sure, I assigned you it.

[utam0k]

@thinking-tower There are no integration tests in this controller. So, I would like to add unit tests as much as possible. I'm looking forward to your PR :)

[lizhemingi]

I would like to have a try on freezer.

[utam0k]

I would like to have a try on freezer.

@duduainankai of course. I assigned you it.

[yjuba]

I would like to work on cpuacct.

[yjuba]

I overlooked this PR.
You can forget about my earlier comment.

#72

[utam0k]

@yjuba Thank you for your interest. There is also a v2 with a similar challenge, what about that one?
#78

[yjuba]

@utam0k
Thank you for your replies.
I will try to work on cpuacct (v2).

[Furisto]

Hey @yjuba, you can have cpuacct if you want it. @PeterYordanov unfortunately doesn't have the time to complete it anymore.

[yjuba]

@Furisto
Thank you for your replies.
I will try to work on v1-cpuacct.

[utam0k]

@thinking-tower Do you have any problem? Can I help you?

[utam0k]

@thinking-tower I'm sorry, but since there seems to be no response, I'm going to remove the assignment.

[utam0k]

@fbrv Are you interested in implementing perf_event?

[fbrv]

It should be pretty easy to implement, just writing the PID in the cgroup.procs file.

[utam0k]

This issue was completed!
Special thanks @0xdco @reynn @tsturzl @Furisto @yjuba @fbrv @duduainankai

[thinking-tower]

@utam0k no worries, thanks for the opportunity!