This content originally appeared on DEV Community and was authored by Vitalii Yulieff
The current Ollama version in Arch is outdated (0.1.44 vs 0.2.1 latest). The official install script doesn't support some Manjaro configurations, but don't worry—I've got the fix!
The Problem 🤔
When I tried running the install script, I got hit with this:
curl -fsSL https://ollama.com/install.sh | sh
# sh: line 252: VERSION_ID: unbound variable
This cryptic error just means you're missing those NVIDIA drivers, and Ollama can't sort that out for you.
Step-by-Step Fix 🏌️
step 1: find your linux kernel verion:
uname -r
# 6.9.5-1-MANJARO
pamac search "linux.*header"
# linux69-headers 6.9.5-1 [Installed]
step 2 install everything you need
pamac install nvidia nvidia-utils cuda linux69-headers
step 3 you might want to restart your Linux just to be on the safe side
step 4 Now, run the install script again:
curl -fsSL https://ollama.com/install.sh | sh
# ollama successfully installs on your Manjaro system!
🏆 Boom! Done!
Troubleshooting 🕵️♂️
Here's how you can check the successful installation:
1) Run nvidia-smi and your video card should show up.
2) Make sure that your video card and its device ID are in the OLLAMA's logs
journalctl -u ollama | grep "id=.*NVIDIA"
# ollama[2174]: [...] id=GPU-3a31a7cb-e46b-458c-9a92-ea9708b0c7fa library=cuda compute=8.9 driver=12.4 name="NVIDIA GeForce RTX 4090 Laptop GPU" total="15.7 GiB" available="15.5 GiB"
Quick Note for Wayland + GNOME Users
Even after I installed drivers, my Wayland still uses integrated video graphics.
This content originally appeared on DEV Community and was authored by Vitalii Yulieff
Vitalii Yulieff | Sciencx (2024-07-11T11:54:12+00:00) Fixing Ollama Installation on Manjaro + NVIDIA. Retrieved from https://www.scien.cx/2024/07/11/fixing-ollama-installation-on-manjaro-nvidia/
Please log in to upload a file.
There are no updates yet.
Click the Upload button above to add an update.