DeepSeek released DeepInfer, the in-house software it uses to run its V4.1 Flash model for customers, under a permissive open-source license, per tech outlet Xinzhiyuan. The engine supports both Nvidia's current Blackwell data center GPUs and Huawei's Ascend 950 AI chips. DeepSeek said a single one of its clusters handles 155 trillion tokens, the units of text a model processes, per day, and that on average 96% of input is served from stored results without being recomputed. The company held back the parts of its code tied too closely to internal systems, publishing design notes instead. DeepSeek said inferenceInferenceRunning a trained AI model to answer a query, as distinct from training it. Inference is where most ongoing compute and energy demand now sits, and it is what chip export rules increasingly target alongside training. code for its future models will be released through DeepInfer.
Read at 36Kr ↗
Chinese autonomous delivery vehicle company Neolix said it had closed a Series E round of nearly $400 million, co-led by Boyu Capital and a state fund, TechNode reported. Financial outlet Jiemian, citing people familiar with the deal, identified that fund as the National Artificial Intelligence Industry Investment Fund, a 60 billion yuan ($9 billion) vehicle backed by the central government. Alibaba's AEF NextGen Hong Kong fund, Vertex Growth and GAC Capital also invested. Neolix said it will spend the money on expanding its overseas operating and customer service network and on data collection and training for its autonomous driving models. The round follows a Series D of more than $600 million last year and lifts the company's total funding above 10 billion yuan ($1.5 billion).
Read at Jiemian ↗ • Read at TechNode ↗
Tencent opened Yuanbao Search, the retrieval system that feeds web results to its own AI products, to outside developers and businesses as a paid Tencent Cloud service, per Phoenix Technology. The service draws on public web pages and Tencent's own content platforms to supply current information to large language models and AI agentsAI agentAn AI system that carries out multi-step tasks on its own, such as browsing, writing code or making purchases, rather than answering a single prompt. Agents raise new questions about liability, security and oversight because they act rather than just advise.. Tencent said the index holds hundreds of billions of entries and handles hundreds of millions of calls a day for more than 50 internal products, including its WorkBuddy agent and Tencent Video. It links to 157 information sources in 13 sectors, including finance, health care and law, and refreshes news, weather and market prices within minutes.
Read at Phoenix Technology ↗ • Read at TechNode ↗
Ant Group, the Alibaba-affiliated fintech company, and the community behind vLLM, widely used open-source software for running AI models, released Humming, a library that speeds up models compressed to use less memory, tech blog Pandaily reported. The library fully supports the Zhenwu 810E, an AI accelerator from Alibaba chip unit T-Head built to run software written for Nvidia's CUDA programming platform, so the same code works on the Chinese chip. The teams claim speeds roughly three to four times those of Nvidia's standard math library at small workloads, based on their own tests that have not been independently verified. Starting with version 0.29.0, vLLM installs Humming by default on systems using CUDA.
Read at Pandaily ↗