The New Frontier Of LLM Inference: Where The Next Tenfold Gains Will Come From

This brute-force scaling approach is slowly fading and giving way to innovations in inference engines rooted in core computer ...
Nature

Specification Mining and Behavioral Model Inference

The field of specification mining and behavioural model inference addresses the challenge of automatically extracting formal specifications and models of software systems from various forms of data ...
Bloomberg L.P.

The journey to build Bloomberg’s ML Inference Platform Using KServe (formerly KFServing)

This post details the beginning of Bloomberg’s journey to build a machine learning inference platform. For those readers who are less familiar with the technical concepts involved in machine learning ...
ZDNet

Nvidia doubles down on AI language models and inference as a substrate for the Metaverse, in data centers, the cloud and at the edge

Machine learning, task automation and robotics are already widely used in business. These and other AI technologies are about to multiply, and we look at how organizations can best take advantage of ...
Forbes

Nvidia Dynamo — Next-Gen AI Inference Server For Enterprises

At the GTC 2025 conference, Nvidia introduced Dynamo, a new open-source AI inference server designed to serve the latest generation of large AI models at scale. Dynamo is the successor to Nvidia’s ...