Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Installation from source does lack functionality, while installing from apt universe does not. #14611

Closed
aamkye opened this issue Mar 11, 2023 · 5 comments
Closed

Installation from source does lack functionality, while installing from apt universe does not. #14611

aamkye opened this issue Mar 11, 2023 · 5 comments
Labels
Type: Defect Incorrect behavior (e.g. crash, hang)

Comments

@aamkye
Copy link

aamkye commented Mar 11, 2023 •
edited
Loading

System information

Type Version/Name
Distribution Name Ubuntu Server (minimal)
Distribution Version 22.10 (kinetic)
Kernel Version latest -> 6.2.5-060205-generic (from mainline)
Architecture amd64 under Proxmox
OpenZFS Version latest -> 2.1.9-1 (build from source from tag latest -> 2.1.9)

Describe the problem you're observing

Installation info is not sufficient.
Main observation is: while installing zfs from apt universe, pools are reappearing after reboot. While using debs built from source, pools are gone after each restart, there are no services for ZFS, no cron jobs, no ZED configured, etc.

Describe how to reproduce the problem

N/a

build steps (no extra params added, general guide from openzfs.github.io)

./autogen.sh
./configure
make clean
make -s -j$(nproc)
make deb
apt install ./!(*devel*|*test*).deb
@aamkye aamkye added the Type: Defect Incorrect behavior (e.g. crash, hang) label Mar 11, 2023
@aamkye
Copy link
Author

aamkye commented Mar 12, 2023

ZFS from apt universe

user@server:/opt/zfs$ sudo apt install ./!(*devel*|*test*).deb
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Note, selecting 'kmod-zfs-6.2.5-060205-generic' instead of './kmod-zfs-6.2.5-060205-generic_2.1.9-1_amd64.deb'
Note, selecting 'libnvpair3' instead of './libnvpair3_2.1.9-1_amd64.deb'
Note, selecting 'libuutil3' instead of './libuutil3_2.1.9-1_amd64.deb'
Note, selecting 'libzfs5' instead of './libzfs5_2.1.9-1_amd64.deb'
Note, selecting 'libzpool5' instead of './libzpool5_2.1.9-1_amd64.deb'
Note, selecting 'python3-pyzfs' instead of './python3-pyzfs_2.1.9-1_amd64.deb'
Note, selecting 'zfs' instead of './zfs_2.1.9-1_amd64.deb'
Note, selecting 'zfs-dkms' instead of './zfs-dkms_2.1.9-1_amd64.deb'
Note, selecting 'zfs-dracut' instead of './zfs-dracut_2.1.9-1_amd64.deb'
Note, selecting 'zfs-initramfs' instead of './zfs-initramfs_2.1.9-1_amd64.deb'
The following NEW packages will be installed:
  kmod-zfs-6.2.5-060205-generic libnvpair3 libuutil3 libzfs5 libzpool5 python3-pyzfs zfs zfs-dkms zfs-dracut
  zfs-initramfs
0 upgraded, 10 newly installed, 0 to remove and 1 not upgraded.
Need to get 0 B/49.5 MB of archives.
After this operation, 168 MB of additional disk space will be used.
Get:1 /opt/zfs/kmod-zfs-6.2.5-060205-generic_2.1.9-1_amd64.deb kmod-zfs-6.2.5-060205-generic amd64 2.1.9-1 [16.5 MB]
Get:2 /opt/zfs/libnvpair3_2.1.9-1_amd64.deb libnvpair3 amd64 2.1.9-1 [34.7 kB]
Get:3 /opt/zfs/libuutil3_2.1.9-1_amd64.deb libuutil3 amd64 2.1.9-1 [26.8 kB]
Get:4 /opt/zfs/libzfs5_2.1.9-1_amd64.deb libzfs5 amd64 2.1.9-1 [232 kB]
Get:5 /opt/zfs/libzpool5_2.1.9-1_amd64.deb libzpool5 amd64 2.1.9-1 [1,404 kB]
Get:6 /opt/zfs/python3-pyzfs_2.1.9-1_amd64.deb python3-pyzfs amd64 2.1.9-1 [109 kB]
Get:7 /opt/zfs/zfs_2.1.9-1_amd64.deb zfs amd64 2.1.9-1 [637 kB]
Get:8 /opt/zfs/zfs-dkms_2.1.9-1_amd64.deb zfs-dkms amd64 2.1.9-1 [30.5 MB]
Get:9 /opt/zfs/zfs-dracut_2.1.9-1_amd64.deb zfs-dracut amd64 2.1.9-1 [10.0 kB]
Get:10 /opt/zfs/zfs-initramfs_2.1.9-1_amd64.deb zfs-initramfs amd64 2.1.9-1 [12.6 kB]
Selecting previously unselected package kmod-zfs-6.2.5-060205-generic.
(Reading database ... 172691 files and directories currently installed.)
Preparing to unpack .../0-kmod-zfs-6.2.5-060205-generic_2.1.9-1_amd64.deb ...
Unpacking kmod-zfs-6.2.5-060205-generic (2.1.9-1) ...
Selecting previously unselected package libnvpair3.
Preparing to unpack .../1-libnvpair3_2.1.9-1_amd64.deb ...
Unpacking libnvpair3 (2.1.9-1) ...
Selecting previously unselected package libuutil3.
Preparing to unpack .../2-libuutil3_2.1.9-1_amd64.deb ...
Unpacking libuutil3 (2.1.9-1) ...
Selecting previously unselected package libzfs5.
Preparing to unpack .../3-libzfs5_2.1.9-1_amd64.deb ...
Unpacking libzfs5 (2.1.9-1) ...
Selecting previously unselected package libzpool5.
Preparing to unpack .../4-libzpool5_2.1.9-1_amd64.deb ...
Unpacking libzpool5 (2.1.9-1) ...
Selecting previously unselected package python3-pyzfs.
Preparing to unpack .../5-python3-pyzfs_2.1.9-1_amd64.deb ...
Unpacking python3-pyzfs (2.1.9-1) ...
Selecting previously unselected package zfs.
Preparing to unpack .../6-zfs_2.1.9-1_amd64.deb ...
Unpacking zfs (2.1.9-1) ...
Selecting previously unselected package zfs-dkms.
Preparing to unpack .../7-zfs-dkms_2.1.9-1_amd64.deb ...
Unpacking zfs-dkms (2.1.9-1) ...
Selecting previously unselected package zfs-dracut.
Preparing to unpack .../8-zfs-dracut_2.1.9-1_amd64.deb ...
Unpacking zfs-dracut (2.1.9-1) ...
Selecting previously unselected package zfs-initramfs.
Preparing to unpack .../9-zfs-initramfs_2.1.9-1_amd64.deb ...
Unpacking zfs-initramfs (2.1.9-1) ...
Setting up libnvpair3 (2.1.9-1) ...
Setting up zfs-dracut (2.1.9-1) ...
Setting up zfs (2.1.9-1) ...
Setting up zfs-dkms (2.1.9-1) ...
Loading new zfs-2.1.9 DKMS files...
Building for 6.2.5-060205-generic
Building initial module for 6.2.5-060205-generic
Done.

zavl.ko:
Running module version sanity check.
Error! Module version 2.1.9-1 for zavl.ko
is not newer than what is already found in kernel 6.2.5-060205-generic (2.1.9-1).
You may override by specifying --force.

znvpair.ko:
Running module version sanity check.
Error! Module version 2.1.9-1 for znvpair.ko
is not newer than what is already found in kernel 6.2.5-060205-generic (2.1.9-1).
You may override by specifying --force.

zunicode.ko:
Running module version sanity check.
Error! Module version 2.1.9-1 for zunicode.ko
is not newer than what is already found in kernel 6.2.5-060205-generic (2.1.9-1).
You may override by specifying --force.

zcommon.ko:
Running module version sanity check.
Error! Module version 2.1.9-1 for zcommon.ko
is not newer than what is already found in kernel 6.2.5-060205-generic (2.1.9-1).
You may override by specifying --force.

zfs.ko:
Running module version sanity check.
Error! Module version 2.1.9-1 for zfs.ko
is not newer than what is already found in kernel 6.2.5-060205-generic (2.1.9-1).
You may override by specifying --force.

icp.ko:
Running module version sanity check.
Error! Module version 2.1.9-1 for icp.ko
is not newer than what is already found in kernel 6.2.5-060205-generic (2.1.9-1).
You may override by specifying --force.

zlua.ko:
Running module version sanity check.
Error! Module version 2.1.9-1 for zlua.ko
is not newer than what is already found in kernel 6.2.5-060205-generic (2.1.9-1).
You may override by specifying --force.

spl.ko:
Running module version sanity check.
Error! Module version 2.1.9-1 for spl.ko
is not newer than what is already found in kernel 6.2.5-060205-generic (2.1.9-1).
You may override by specifying --force.

zzstd.ko:
Running module version sanity check.
Error! Module version 1.4.5a for zzstd.ko
is not newer than what is already found in kernel 6.2.5-060205-generic (1.4.5a).
You may override by specifying --force.
depmod....
Setting up zfs-initramfs (2.1.9-1) ...
Setting up python3-pyzfs (2.1.9-1) ...
Setting up libzfs5 (2.1.9-1) ...
Setting up libuutil3 (2.1.9-1) ...
Setting up kmod-zfs-6.2.5-060205-generic (2.1.9-1) ...
Setting up libzpool5 (2.1.9-1) ...
Processing triggers for man-db (2.10.2-2) ...
Processing triggers for libc-bin (2.36-0ubuntu4) ...
Scanning processes...
Scanning candidates...
Scanning processor microcode...
Scanning linux images...

Running kernel seems to be up-to-date.

Failed to check for processor microcode upgrades.

@aamkye
Copy link
Author

aamkye commented Mar 12, 2023

ZFS from compiled deb

user@server:~$ sudo apt install -y zfsutils-linux
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following additional packages will be installed:
  libnvpair3linux libuutil3linux libzfs4linux libzpool5linux zfs-zed
Suggested packages:
  nfs-kernel-server samba-common-bin zfs-initramfs | zfs-dracut
The following NEW packages will be installed:
  libnvpair3linux libuutil3linux libzfs4linux libzpool5linux zfs-zed zfsutils-linux
0 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.
Need to get 2,231 kB of archives.
After this operation, 7,075 kB of additional disk space will be used.
Get:1 http://es.archive.ubuntu.com/ubuntu kinetic/main amd64 libnvpair3linux amd64 2.1.5-1ubuntu6 [54.0 kB]
Get:2 http://es.archive.ubuntu.com/ubuntu kinetic/main amd64 libuutil3linux amd64 2.1.5-1ubuntu6 [47.1 kB]
Get:3 http://es.archive.ubuntu.com/ubuntu kinetic/main amd64 libzfs4linux amd64 2.1.5-1ubuntu6 [227 kB]
Get:4 http://es.archive.ubuntu.com/ubuntu kinetic/main amd64 libzpool5linux amd64 2.1.5-1ubuntu6 [1,343 kB]
Get:5 http://es.archive.ubuntu.com/ubuntu kinetic/main amd64 zfsutils-linux amd64 2.1.5-1ubuntu6 [495 kB]
Get:6 http://es.archive.ubuntu.com/ubuntu kinetic/main amd64 zfs-zed amd64 2.1.5-1ubuntu6 [64.8 kB]
Fetched 2,231 kB in 2s (1,484 kB/s)
Selecting previously unselected package libnvpair3linux.
(Reading database ... 74891 files and directories currently installed.)
Preparing to unpack .../0-libnvpair3linux_2.1.5-1ubuntu6_amd64.deb ...
Unpacking libnvpair3linux (2.1.5-1ubuntu6) ...
Selecting previously unselected package libuutil3linux.
Preparing to unpack .../1-libuutil3linux_2.1.5-1ubuntu6_amd64.deb ...
Unpacking libuutil3linux (2.1.5-1ubuntu6) ...
Selecting previously unselected package libzfs4linux.
Preparing to unpack .../2-libzfs4linux_2.1.5-1ubuntu6_amd64.deb ...
Unpacking libzfs4linux (2.1.5-1ubuntu6) ...
Selecting previously unselected package libzpool5linux.
Preparing to unpack .../3-libzpool5linux_2.1.5-1ubuntu6_amd64.deb ...
Unpacking libzpool5linux (2.1.5-1ubuntu6) ...
Selecting previously unselected package zfsutils-linux.
Preparing to unpack .../4-zfsutils-linux_2.1.5-1ubuntu6_amd64.deb ...
Unpacking zfsutils-linux (2.1.5-1ubuntu6) ...
Selecting previously unselected package zfs-zed.
Preparing to unpack .../5-zfs-zed_2.1.5-1ubuntu6_amd64.deb ...
Unpacking zfs-zed (2.1.5-1ubuntu6) ...
Setting up libnvpair3linux (2.1.5-1ubuntu6) ...
Setting up libuutil3linux (2.1.5-1ubuntu6) ...
Setting up libzfs4linux (2.1.5-1ubuntu6) ...
Setting up libzpool5linux (2.1.5-1ubuntu6) ...
Setting up zfsutils-linux (2.1.5-1ubuntu6) ...
insmod /lib/modules/5.19.0-21-generic/kernel/zfs/spl.ko
insmod /lib/modules/5.19.0-21-generic/kernel/zfs/znvpair.ko
insmod /lib/modules/5.19.0-21-generic/kernel/zfs/zcommon.ko
insmod /lib/modules/5.19.0-21-generic/kernel/zfs/icp.ko
insmod /lib/modules/5.19.0-21-generic/kernel/zfs/zavl.ko
insmod /lib/modules/5.19.0-21-generic/kernel/zfs/zlua.ko
insmod /lib/modules/5.19.0-21-generic/kernel/zfs/zzstd.ko
insmod /lib/modules/5.19.0-21-generic/kernel/zfs/zunicode.ko
insmod /lib/modules/5.19.0-21-generic/kernel/zfs/zfs.ko
Created symlink /etc/systemd/system/zfs-import.target.wants/zfs-import-cache.service → /lib/systemd/system/zfs-import-cache.service.
Created symlink /etc/systemd/system/zfs.target.wants/zfs-import.target → /lib/systemd/system/zfs-import.target.
Created symlink /etc/systemd/system/zfs-mount.service.wants/zfs-load-module.service → /lib/systemd/system/zfs-load-module.service.
Created symlink /etc/systemd/system/zfs.target.wants/zfs-load-module.service → /lib/systemd/system/zfs-load-module.service.
Created symlink /etc/systemd/system/zfs.target.wants/zfs-mount.service → /lib/systemd/system/zfs-mount.service.
Created symlink /etc/systemd/system/zfs.target.wants/zfs-share.service → /lib/systemd/system/zfs-share.service.
Created symlink /etc/systemd/system/zfs-volumes.target.wants/zfs-volume-wait.service → /lib/systemd/system/zfs-volume-wait.service.
Created symlink /etc/systemd/system/zfs.target.wants/zfs-volumes.target → /lib/systemd/system/zfs-volumes.target.
Created symlink /etc/systemd/system/multi-user.target.wants/zfs.target → /lib/systemd/system/zfs.target.
zfs-import-scan.service is a disabled or a static unit, not starting it.
Setting up zfs-zed (2.1.5-1ubuntu6) ...
Created symlink /etc/systemd/system/zed.service → /lib/systemd/system/zfs-zed.service.
Created symlink /etc/systemd/system/zfs.target.wants/zfs-zed.service → /lib/systemd/system/zfs-zed.service.
Processing triggers for man-db (2.10.2-2) ...
Processing triggers for libc-bin (2.36-0ubuntu4) ...
Scanning processes...
Scanning processor microcode...
Scanning linux images...

@aamkye
Copy link
Author

aamkye commented Mar 12, 2023

As shown, installs are different, from the scope to the functionality.
I'll be glad to make PR into the docs, but I need help determining how to build zfs-zed and zfsutils-linux packages from source.

@gdevenyi
Copy link
Contributor

The difference is that Ubuntu and debian packages enable services. The source debs do not. The documentation states you need to do it yourself.

@aamkye
Copy link
Author

aamkye commented Mar 12, 2023

this is exactly what I've found:

- name: Ensure zfs-related systemd units are enabled
  become: true
  ansible.builtin.systemd:
    name: "{{ item }}"
    state: started
    enabled: yes
  loop:
    - zfs-import-cache.service
    - zfs-import.target
    - zfs-mount.service
    - zfs-share.service
    - zfs-zed.service
    - zfs-volume-wait.service
    - zfs.target

I'm about to add this to the docs, thanks!

@aamkye aamkye closed this as completed Mar 12, 2023
aamkye pushed a commit to aamkye/openzfs-docs that referenced this issue Mar 16, 2023
[openzfs/zfs#14611] Fix missing install from source steps.
6209662
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Type: Defect Incorrect behavior (e.g. crash, hang)
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@gdevenyi @aamkye