Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create the SPDK socket under /var/run/ceph/<fsid> and not /var/tmp #296

Merged
merged 1 commit into from
Oct 30, 2023

Conversation

gbregman
Copy link
Contributor

@gbregman gbregman commented Oct 29, 2023

Fixes #216

Notice that this works for an SPDK run from within the gateway. If SPDK is run as a stand alone container (which we don't do), the socket file would still be created in /var/tmp/

@gbregman gbregman self-assigned this Oct 29, 2023
@gbregman gbregman requested review from barakda and caroav October 29, 2023 11:40
@gbregman
Copy link
Contributor Author

@caroav , once this change is merged there will be a little change to ceph-nvmeof.conf which you might want to update the Cephadm people about. The rpc_socket attribute was deleted two new attributes were added. They are commented out in the conf file so we just use the default values:

  • rpc_socket_dir
  • rpc_socket_name

These are only needed if we want to change the default behavior. In case the old "rpc_socket" is still in the conf file it will be used and not the new attributes. This will maintain backward compatibility with old conf file.

Copy link
Collaborator

@barakda barakda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is the next line (in file Dockerfile.spdk) should be updated as well?
CMD [ "-u", "-r", "/var/tmp/spdk.sock" ]

ceph-nvmeof.conf Show resolved Hide resolved
@gbregman
Copy link
Contributor Author

@barakda I saw the reference in Dockerfile.spdk but I didn't see it made any difference. I'll have another look.

@gbregman
Copy link
Contributor Author

@barakda Dockerfile.spdk is relevant only when we run SPDK as a container. We don't do that. We start SPDK from within the gateway. When we do it we already know the Ceph FSID and can use it for the directory. As this value is dynamic we can't use it Dockerfile.spdk. So, if somehow the SPDK would be started as a container the socket file will be created in the old place, /var/tmp.

@gbregman gbregman requested a review from barakda October 29, 2023 14:21
@gbregman gbregman merged commit 9b0239b into ceph:devel Oct 30, 2023
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

exposes a socket file in /var/run/ceph/<fsid>
2 participants