Skip to content

Linux

Instructions for installing Jan on Linux.

System requirements:

  • Debian
  • Ubuntu and derivatives:
    • Ubuntu Desktop LTS (official)/Ubuntu Server LTS (only for server)
    • Edubuntu
    • Kubuntu
    • Lubuntu
    • Ubuntu Budgie
    • Ubuntu Cinnamon
    • Ubuntu Kylin
    • Ubuntu MATE
    • Linux Mint
    • Pop!_OS
  • RHEL-based (Server only)
  • Fedora
  • Arch Linux
  • SteamOS
  • openSUSE

Installation steps:

Available releases:

Stable release:

Installation commands:

Terminal window
sudo dpkg -i jan-linux-amd64-{version}.deb
Terminal window
sudo apt-get install ./jan-linux-amd64-{version}.deb

Default locations:

Terminal window
# Custom installation directory
$XDG_CONFIG_HOME = /home/username/custom_config
# or
# Default installation directory
~/.config/Jan/data

See Jan Data Folder for details.

Configuration for GPU support:

1.1. Check GPU Detection

Terminal window
lspci | grep -i nvidia

1.2. Install Required components

NVIDIA Driver:

  1. Install the NVIDIA Driver, ideally via your package manager.
  2. Verify:
Terminal window
nvidia-smi

CUDA Toolkit:

  1. Install the CUDA toolkit, ideally from your package manager (11.7+)
  2. Verify:
Terminal window
nvcc --version

Additional Requirements:

Terminal window
sudo apt update
sudo apt install gcc-11 g++-11 cpp-11
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/cuda/lib64

Documentation

  1. Navigate to Settings > Local Engine > Llama.cpp
  2. Select appropriate backend in llama-cpp Backend. Details in our guide.

Removal commands:

Terminal window
sudo apt-get remove jan
rm -rf Jan
rm -rf ~/.config/Jan/data
rm -rf ~/.config/Jan/cache