https://docs.radxa.com/rock5/rock5b/app-development/rkllm_deepseek_r1
Radxa had just released the guide from their docs!
Deepseek r1 distill-qwen-1.5B is available for Rock5B!
4 Likes
I tried it just a few days ago. It’s amazingly usable and using all three npu cores. First time in two years that they are used xD
3 Likes
could you pls kindly share us the img configured with deepseek readily for use? 
i just got lazy but really want to play with it!
1 Like
Lol. To be fair, I’ve been using the npu cores for object detection with my NVR (Frigate). 4 x 1080p/15 feeds with less than 25 ms inference.
1 Like