-
Notifications
You must be signed in to change notification settings - Fork 41
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Enable sriov-network-device-plugin vfio mode #37
Conversation
Adding a cni to mirror MAC address of VF on a veth pair with results from ipam applied to enable DPDK apps to configure themselves when operating sriov-network-device-plugin in vfio mode Updated helper sriov.sh to allow for binding VFs to vfio-pci on boot Signed-off-by: Saikrishna Edupuganti <[email protected]>
@@ -16,10 +16,18 @@ RUN git clone -q https://github.com/intel/sriov-network-device-plugin.git /go/sr | |||
WORKDIR /go/src/github.com/intel/sriov-network-device-plugin | |||
RUN make | |||
|
|||
# Build vfioveth plugin | |||
FROM busybox as vfioveth | |||
RUN wget -O /bin/vfioveth https://raw.githubusercontent.com/clearlinux/cloud-native-setup/master/clr-k8s-examples/9-multi-network/cni/vfioveth && \ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
need to change this one to COPY
since its local
@@ -1,3 +1,6 @@ | |||
# If you set "deviceType": "vfio", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Have both examples maybe?
@@ -1,3 +1,6 @@ | |||
# If you set "deviceType": "vfio", | |||
# - uncomment line `bind_vfs_vfio $pf` in systemd/sriov.sh |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
accept an option --vfio
in the script that says whether to bind to vfio-pci
or leave it with kernel
@@ -1,3 +1,6 @@ | |||
# If you set "deviceType": "vfio", | |||
# - uncomment line `bind_vfs_vfio $pf` in systemd/sriov.sh | |||
# - set "type": "vfioveth" in test/sriov/0-sriov-net.yaml |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
add extra network to show use of vfioveth
Addressing comments - 1a. added flag to `sriov.sh` to indicate bind to vfio-pci 1b. systemd unit sets up two pools 1 per mode 2a. updated `sriov-conf.yaml` to use the two pools 3a. included network examples for both resource pools 3b. included pod examples for both resource pools Signed-off-by: Saikrishna Edupuganti <[email protected]>
Signed-off-by: Saikrishna Edupuganti <[email protected]>
592c0d4
to
0a00800
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM.
We need to see how we can make it a little more generic.
Say an central IPAM and some sort of simple inter node connectivity.
One use case is to create a rook storage network
/cc @ganeshmaharaj rook has multiple network support right?
Adding a CNI to mirror MAC address of VF on a veth pair, along with results
from ipam applied, to enable DPDK apps to configure themselves when
operating sriov-network-device-plugin in vfio mode. k8snetworkplumbingwg/sriov-cni#37
Updated helper sriov.sh to allow for binding VFs to vfio-pci on boot
Signed-off-by: Saikrishna Edupuganti [email protected]