vibehacker
News
GitHub (deepseek-ai/DeepInfer) ·

DeepSeek open-sources DeepInfer, the inference engine behind its V4.1-Flash API

Released Oct 20 under Apache 2.0, DeepInfer runs DeepSeek-V4.1-Flash on NVIDIA SM100 GPUs or Huawei Ascend 950 NPUs with DeepSeek's own kernels, expert parallelism, speculative decoding, deterministic sampling, and structured outputs. It's offline batch inference only for now: KV-cache management, prefill/decode disaggregation, and load balancing stay internal (The New Stack).

More news

View all

Spotted something we missed? Start a thread.

DeepSeek open-sources DeepInfer, the inference engine behind its V4.1-Flash API · VibeHacker