The New Frontier Of LLM Inference: Where The Next Tenfold Gains Will Come From

This brute-force scaling approach is slowly fading and giving way to innovations in inference engines rooted in core computer ...
Forbes

Making A More Accurate And Sustainable AI Model

Forbes contributors publish independent expert analyses and insights. I had an opportunity to talk with the founders of a company called PiLogic recently about their approach to solving certain ...
insideHPC

Crusoe Launches Managed Inference AI

SAN FRANCISCO – Nov 20, 2025 – Crusoe, a vertically integrated AI infrastructure provider, today announced the general availability of Crusoe Managed Inference, a service designed to run model ...
EDN

NTT develops AI inference chip for 4K video processing

At its Upgrade 2025 annual research and innovation summit, NTT Corporation (NTT) unveiled an AI inference large-scale integration (LSI) for the real-time processing of ultra-high-definition (UHD) ...
Semiconductor Engineering

What’s The Best Way To Sell An Inference Engine?

The burgeoning AI market has seen innumerable startups funded on the strength of their ideas about building faster, lower-power, and/or lower-cost AI inference engines. Part of the go-to-market ...