Another excellent video from @dcapitella
Thanks for including Halogen!
Strix Halo vs. two Intel Arc Pro B70s on Qwen3.8-Flash-Next:
• ~64 tok/s at 64K context
• 1,217 tok/s prompt processing
• Close in generation, faster at prompt processing
youtu.be/Rxh8ouzTEbM?t=1123
Run your own @liquidai d1-2B on the @AIatAMD Strix Halo NPU. Halogen 0.18.22 is out.
• Up to 16 questions on text, images or video in one pass
• Finds objects in photos with bounding boxes
• ~0.35 s per image question
github.com/peonist-ai/haloge…
Run your own @liquidai LFM3-1.7B on the @AIatAMD Strix Halo NPU. Halogen 0.18.21 is out.
Your checkpoint or fine-tune, up to ~38 tok/s
Full 262k context
Long NPU requests no longer stall behind a reply
github.com/peonist-ai/haloge…