AI Security Institute (AISI)

One of the most underrated things about AISI: the open-source testing infrastructure it builds and shares openly with the whole field. Last week we released Transect - a tool that turns the increasingly complex agent evaluation transcripts into interactive timelines. And that's just the tip of the iceberg. A quick tour: Transect runs on AISI's Inspect platform. Inspect is an open-source framework for evaluating frontier AI models across coding, reasoning, agentic, and multi-modal tasks. We open-sourced Inspect in May 2024, and it's become the standard evaluation platform used by frontier AI companies and safety orgs including AI security bodies in the US, EU, Japan and South Korea. Inspect is also expanding thanks to those from safety institutes, frontier labs and research groups who use it. Anthropic built Petri on top of it. The Allen Institute chose it as the foundation for AstaBench. It's available through AISI's GitHub, which you can access here: inspect.aisi.org.uk Inspect was the gateway to a suite of custom-built and open sourced eval tools. A few more AISI has released: - Inspect Cyber - build and run agentic cyber evals, from simple CTFs to full cyber ranges. - Inspect Sandbox - plugins for agentic eval environments. We use it internally; it's helped CAISSI, METR and Apollo adopt open-source sandbox providers too. - ControlArena - built with Redwood Research, for running AI control experiments. Already used by Redwood, Google DeepMind, Anthropic and MATS. It shows up in OpenAI's GPT-5.6 system card. - Inspect Scout - transcript analysis. Turns thousands of transcripts into structured results, surfacing failure modes and safety-relevant behaviours. Underlying Inspect is the AISI Engineering Playbook - an open guide to the infrastructure behind our frontier evals written by AISI's Engineering team, so that organisations wanting to stand up their own eval capabilities don't need to start from scratch. aisi.gov.uk/blog/releasing-a…