The first Annual Report of SWEO is published! The 2024 Annual Report provides an update on the work and achievements of the office and highlights lessons learned from system-wide evaluation activities ...

The SPEC CPU 2026 features more tests and an emphasis on portability, running on everything from fleets of servers down to a ...

Experimental - This project is still in development, and not ready for the prime time. A minimal, secure Python interpreter written in Rust for use by AI. Monty avoids the cost, latency, complexity ...

Abstract: The first linear programming bound is the best known asymptotic upper bound for binary codes, for a certain subrange of distances. Starting from the work of Friedman and Tillich (2005), ...

There appears to be a recent epidemic of users hijacking companies’ AI-powered customer service bots to turn them into generic AI assistants. The goal is to get the branded bots to do their bidding, ...

Crypto Trading Certificates and broader Blockchain certification programs are drawing more attention as companies expand their use of distributed systems and digital assets. In practical terms, that ...

Automated red teaming holds substantial promise for uncovering and mitigating the risks associated with the malicious use of large language models (LLMs), yet the field lacks a standardized evaluation ...

Abstract: This paper introduces DSrepair, a knowledge-enhanced program repair approach designed to repair the buggy code generated by LLMs in the data science domain. DSrepair uses knowledge graph ...