Follow the latest coverage, related explainers and connected technology stories.
The French startup Kog believes traditional graphics processing units can still deliver higher speeds for AI model inference through deep software improvements. But it must first prove that its approach, which achieved 3,000 tokens per second with a small model, works with larger language models.