oRKLLM

OpenAI-compatible LLM inference for Rockchip NPU

Install via APT

# 1. Trust the signing key
curl -fsSL https://mafischer.github.io/oRKLLM/orkllm.gpg \
  | sudo gpg --dearmor -o /usr/share/keyrings/orkllm.gpg

# 2. Add the repository
echo "deb [arch=arm64 signed-by=/usr/share/keyrings/orkllm.gpg] \
  https://mafischer.github.io/oRKLLM stable main" \
  | sudo tee /etc/apt/sources.list.d/orkllm.list

# 3. Install
sudo apt update && sudo apt install orkllm

Managing the service

sudo systemctl start orkllm      # Start
sudo systemctl stop orkllm       # Stop
sudo systemctl restart orkllm    # Restart
journalctl -u orkllm -f          # Live logs

Links

• GitHub Repository
• Releases
• GPG Signing Key