Windows WSL2

[llcool]

If the try to running:-
./llava-v1.5-7b-q4-server.llamafile
And get:-
error: APE is running on WIN32 inside WSL. You need to run: sudo sh -c 'echo -1 > /proc/sys/fs/binfmt_misc/WSLInterop'

Try:-
sudo sh -c 'echo -1 > /proc/sys/fs/binfmt_misc/WSLInterop'

But ./llava-v1.5-7b-q4-server.llamafile still does not run check that the service systemd-binfmt is running.
○ systemd-binfmt.service
Loaded: masked (Reason: Unit systemd-binfmt.service is masked.)
Active: inactive (dead)

If not running:-
sudo sh -c 'echo :WSLInterop:M::MZ::/init:PF > /usr/lib/binfmt.d/WSLInterop.conf'
sudo systemctl unmask systemd-binfmt.service
sudo systemctl restart systemd-binfmt
sudo systemctl mask systemd-binfmt.service
sudo sh -c 'echo -1 > /proc/sys/fs/binfmt_misc/WSLInterop'
./llava-v1.5-7b-q4-server.llamafile

Now it is running....
warning: couldn't find nvcc (nvidia c compiler) try setting $CUDA_PATH if it's installed prebuilt binary /zip/ggml-cuda.so not found {"timestamp":1702568274,"level":"INFO","function":"main","line":2669,"message":"build info","build":1500,"commit":"a30b324"} {"timestamp":1702568274,"level":"INFO","function":"main","line":2672,"message":"system info","n_threads":4,"n_threads_batch":-1,"total_threads":8,"system_info":"AVX = 0 | AVX2 = 0 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | FMA = 0 | NEON = 1 | ARM_FMA = 1 | F16C = 0 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 0 | SSE3 = 0 | SSSE3 = 0 | VSX = 0 | "} Multi Modal Mode Enabledclip_model_load: model name: openai/clip-vit-large-patch14-336

[georgbasler]

Great! However, VSCode won't start after running this (and probably other things as well):

/mnt/c/Program Files/Microsoft VS Code/bin/code: 61: /mnt/c/Program Files/Microsoft VS Code/Code.exe: Exec format error

I simply start VSCode first and then execute the service stuff above...

[aeryskyB]

This one might help on WSL2 (tested on: WSL version - 2.3.24.0, kernel - 5.15.153.1-2) - #275