OpenNPU

An open compiler and runtime for the RK3588 NPU

An open compiler and runtime that runs transformer models on the RK3588 NPU without the vendor toolchain, built after reverse-engineering the hardware.

  • Runs GPT-2 at 36 tok/s on the NPU.
  • No vendor SDK required.

Writeup: OpenNPU v1.0