DeepSeek open sources DSpark, a new framework to speed up LLM inference by up to 85%

DSpark can make decoding faster, but acceptance quality still determines how much speed the system actually realizes.

Upbound open-sources Modelplane to optimize inference clusters

Upbound Inc. today released Modelplane, a new open-source tool for managing artificial intelligence inference clusters. San Francisco-based Upbound is backed by $69 million from Alphabet Inc.’s GV ...

OpenAI unveils first custom AI inference chip, Jalapeño, with Broadcom — and its development was sped-up with OpenAI's own models

The companies attributed this speed to a deep software-hardware co-development process that actively used OpenAI’s own models ...
Tech Times

AI Inference and World Model Startups Pull $1.8B in Two Days as Foundation Models Commoditize

AI inference infrastructure investment pulled $1.8 billion in 48 hours as Baseten’s $1.5B round at a $13B valuation and ...
techtimes

OpenAI Cerebras Bet Spawns Jalapeño Chip as GPT-5.6 Faces Government Gate

OpenAI launched its first model on non-Nvidia hardware in February, slashing AI coding response times from seconds to milliseconds — and in less than five months, that experiment has produced a ...

DeepSeek's DSpark just made Nvidia's most important new bet harder to close

DeepSeek just released DSpark, an inference module that makes its AI models 60% to 85% faster without new hardware. Nvidia is ...