Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable sriov-network-device-plugin vfio mode #37

Merged
merged 4 commits into from
Feb 6, 2019

Conversation

krsna1729
Copy link
Contributor

@krsna1729 krsna1729 commented Jan 25, 2019

Adding a CNI to mirror MAC address of VF on a veth pair, along with results
from ipam applied, to enable DPDK apps to configure themselves when
operating sriov-network-device-plugin in vfio mode. k8snetworkplumbingwg/sriov-cni#37

Updated helper sriov.sh to allow for binding VFs to vfio-pci on boot

Signed-off-by: Saikrishna Edupuganti [email protected]

Adding a cni to mirror MAC address of VF on a veth pair with results
from ipam applied to enable DPDK apps to configure themselves when
operating sriov-network-device-plugin in vfio mode

Updated helper sriov.sh to allow for binding VFs to vfio-pci on boot

Signed-off-by: Saikrishna Edupuganti <[email protected]>
@krsna1729 krsna1729 requested a review from mcastelino January 25, 2019 23:50
@@ -16,10 +16,18 @@ RUN git clone -q https://github.com/intel/sriov-network-device-plugin.git /go/sr
WORKDIR /go/src/github.com/intel/sriov-network-device-plugin
RUN make

# Build vfioveth plugin
FROM busybox as vfioveth
RUN wget -O /bin/vfioveth https://raw.githubusercontent.com/clearlinux/cloud-native-setup/master/clr-k8s-examples/9-multi-network/cni/vfioveth && \
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

need to change this one to COPY since its local

@@ -1,3 +1,6 @@
# If you set "deviceType": "vfio",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have both examples maybe?

@@ -1,3 +1,6 @@
# If you set "deviceType": "vfio",
# - uncomment line `bind_vfs_vfio $pf` in systemd/sriov.sh
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

accept an option --vfio in the script that says whether to bind to vfio-pci or leave it with kernel

@@ -1,3 +1,6 @@
# If you set "deviceType": "vfio",
# - uncomment line `bind_vfs_vfio $pf` in systemd/sriov.sh
# - set "type": "vfioveth" in test/sriov/0-sriov-net.yaml
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add extra network to show use of vfioveth

@krsna1729 krsna1729 added the do-not-merge work in progress label Jan 26, 2019
Addressing comments -
1a. added flag to `sriov.sh` to indicate bind to vfio-pci
1b. systemd unit sets up two pools 1 per mode
2a. updated `sriov-conf.yaml` to use the two pools
3a. included network examples for both resource pools
3b. included pod examples for both resource pools

Signed-off-by: Saikrishna Edupuganti <[email protected]>
@krsna1729 krsna1729 added do-not-merge work in progress and removed do-not-merge work in progress labels Jan 26, 2019
@krsna1729 krsna1729 force-pushed the topic/sriov-improvements branch from 592c0d4 to 0a00800 Compare January 26, 2019 17:48
@krsna1729 krsna1729 removed the do-not-merge work in progress label Jan 26, 2019
Copy link
Contributor

@mcastelino mcastelino left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

We need to see how we can make it a little more generic.

Say an central IPAM and some sort of simple inter node connectivity.

One use case is to create a rook storage network

/cc @ganeshmaharaj rook has multiple network support right?

@mcastelino mcastelino merged commit f238ed6 into master Feb 6, 2019
@krsna1729 krsna1729 deleted the topic/sriov-improvements branch February 7, 2019 19:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants