News
DeepSeek open-sources DeepInfer, the inference framework behind its production service, minus the KV cache system
DeepInfer ships under Apache 2.0 with support for DeepSeek-V4.1-Flash on NVIDIA SM100 and Huawei Ascend 950, but leaves out the parts needed for a complete serving stack.
audiotale.net team6 min read