An error occurred while importing faiss

[JQZhai]

Summary

I get an error when I try to import faiss in python3

Platform

jetson xavier NX

OS:

Faiss version: 1.7.1

Installed from: compiled by myself

Faiss compilation options:

cmake -B build . -DFAISS_ENABLE_GPU=OFF
make -C build -j faiss
make -C build -j swigfaiss
(cd build/faiss/python && sudo python3 setup.py install)

Running on:

• CPU

Interface:

• Python

Reproduction instructions

Type "help", "copyright", "credits" or "license" for more information.

import faiss
Traceback (most recent call last):
File "/home/mec/Downloads/faiss/build/faiss/python/faiss/swigfaiss.py", line 14, in swig_import_helper
return importlib.import_module(mname)
File "/usr/lib/python3.6/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 994, in _gcd_import
File "", line 971, in _find_and_load
File "", line 955, in _find_and_load_unlocked
File "", line 658, in _load_unlocked
File "", line 571, in module_from_spec
File "", line 922, in create_module
File "", line 219, in _call_with_frames_removed
ImportError: /home/mec/Downloads/faiss/build/faiss/python/faiss/_swigfaiss.so: undefined symbol: Z9vsubq_u1612__Uint16x8_tS

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "", line 1, in
File "/home/mec/Downloads/faiss/build/faiss/python/faiss/init.py", line 18, in
from .loader import *
File "/home/mec/Downloads/faiss/build/faiss/python/faiss/loader.py", line 65, in
from .swigfaiss import *
File "/home/mec/Downloads/faiss/build/faiss/python/faiss/swigfaiss.py", line 17, in
_swigfaiss = swig_import_helper()
File "/home/mec/Downloads/faiss/build/faiss/python/faiss/swigfaiss.py", line 16, in swig_import_helper
return importlib.import_module('_swigfaiss')
File "/usr/lib/python3.6/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
ImportError: /home/mec/Downloads/faiss/build/faiss/python/_swigfaiss.so: undefined symbol: Z9vsubq_u1612__Uint16x8_tS

[derneuere]

@JQZhai I have the same error. Did you find a workaround, or do older versions work?

[vorj]

@JQZhai #1916 (comment)

[derneuere]

This argument did not solve my error. This was my dockerfile: https://github.com/LibrePhotos/librephotos-docker/blob/038972324dcd6f225adbfc4377aa4a6b85aecab5/backend/dependencies/Dockerfile

This is the job that failed: https://github.com/LibrePhotos/librephotos-docker/runs/3414502894?check_suite_focus=true

I don't even get an error, the job just stops.

[vorj]

@derneuere How did you determine the cause of stopping job was on faiss in spite of no error?

[derneuere]

@vorj Just by trial and error. I removed the argument and the job finished. This is the current file that builds: https://github.com/LibrePhotos/librephotos-docker/blob/c904870f451b8ba1e1aa2e109981fba231397caa/backend/dependencies/Dockerfile

Again, it works on x64 after building without the parameter, but it fails on arm when starting up. I use docker buildx with github actions to build it for multiple architectures.

[vorj]

@derneuere Isn't that just an OOM killing caused by make -j on a low memory environment rather than the issue of building faiss for ARM?
If you had read INSTALL.md of faiss attentively, you would have found the below note:

The -j option enables parallel compilation of multiple units, leading to a faster build, but increasing the chances of running out of memory, in which case it is recommended to set the -j option to a fixed value (such as -j4).

CI of this project, too, limits the count of simultaneous make jobs due to avoid OOM.

I also recommend you to read the man page of make before using that if you forget or don't know the usage.

Finally if you want more discussion about your problem, please create the new issue about it, because your problem has no relation about this (error while importing faiss) issue.