antirez/ds4: DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
Why CEREBRO kept it
Local DeepSeek inference engine; strong open model efficiency play.
The text below is an automated extraction of the article at https://github.com/antirez/ds4, stored verbatim in the public cerebro-vault repository. Copyright remains with the original publisher (github.com).
DwarfStar is a small native inference engine optimized first for DeepSeek V4 Flash. It also supports GLM 5.2 and, on very high-memory machines, DeepSeek V4 PRO. It is self-contained and deliberately narrow, not a general GGUF runner. Model loading, prompt rendering, tool calls, KV state, the HTTP server, and the coding agent are built and tested together. The repository also includes tools and data for GGUF, imatrix, quality, and speed. Supported backends: - Metal, the primary target, on Macs with 96 GB or more. Smaller machines can use SSD streaming. - NVIDIA CUDA, including multi-GPU systems
Backlinks
Appeared in 1 briefing