Orange Pi LLM
Running a 35-billion parameter language model on a single-board computer.
Hardware
- Board
- Orange Pi 5 Plus
- SoC
- Rockchip RK3588
- RAM
- 32GB LPDDR5
- CPU
- 4x A76 + 4x A55
Model
- Model
- Qwen3.5-35B-A3B
- Quantization
- IQ4_NL (18.5 GiB)
- Runtime
- ik_llama.cpp
- Speed
- ~9 tokens/sec
- Context
- 16K tokens