Train-to-Test scaling explained: How to optimize your end-to-end AI compute budget for inference

AI reasoning does not necessarily require spending huge amounts on frontier models. Instead, smaller models can yield ...
SiliconANGLE

MLCommons releases results of its latest MLPerf AI inference benchmark test

MLCommons today released the latest results of its MLPerf Inference benchmark test, which compares the speed of artificial intelligence systems from different hardware makers. MLCommons is an industry ...
EurekAlert!

Common way to test for leaks in large language models may be flawed

This slide shows how a membership inference attack might start. Assessing the product of an app asked to generate an image of a professor teaching students in “the style of” artist Monet could lead to ...
VentureBeat

Hugging Face shows how test-time scaling helps small language models punch above their weight

In a new case study, Hugging Face researchers have demonstrated how small language models (SLMs) can be configured to outperform much larger models. Their findings show that a Llama 3 model with 3B ...
SDxCentral

NVIDIA Grace Hopper superchip sweeps MLPerf inference benchmarks

In its debut on the MLPerf industry benchmarks, the NVIDIA GH200 Grace Hopper Superchip ran all data center inference tests. The GH200 links a Hopper GPU with a Grace CPU in one superchip. The ...
Seeking Alpha

Nvidia Stock Is Set To Surge From OpenAI's o3 Breakthrough

OpenAI's recent o3 breakthrough signals massive demand for Nvidia Corporation's inference GPUs in the coming years. Nvidia now has two major vectors of scaling to pull demand from, which are ...
Business Insider

Google DeepMind researchers think they found a solution to AI's 'peak data' problem

The AI industry has hit "peak data," OpenAI cofounder Ilya Sutskever said recently. DeepMind researchers see outputs from new "reasoning" models as a source of fresh AI training data. A new AI ...