Inspect: A framework for large language model evaluations
AI Security Institute (AISI)
Sub organisation
https://www.gov.uk/government/organisations/ai-security-institute
Part of Cabinet Office
Stars of active repositories
4,667
Active repositories
41
Live repositories
115
Unavailable repositories
83
Languages of active repositories
- 1.Python (44%)
- 2.Java (17%)
- 3.C# (10%)
Active: currently on GitHub, not archived, and pushed to within 180 days. Live: currently on GitHub. Unavailable: previously on GitHub but not currently found.
GitHub accounts
Repositories
Showing all 41 active repositories, sorted by stars
Collection of evals for Inspect AI
ControlArena is a collection of settings, model organisms and protocols - for running control experiments.
Extract residual-stream activations and apply steering vectors (including activation oracles) to any vLLM model during inference.
An Inspect extension for agentic cyber evaluations
A Kubernetes sandbox environment for use with inspect_ai
Reproducing "Natural Emergent Misalignment from Reward Hacking" (MacDiarmid et al., Anthropic 2025) with open-source models. Includes reward-hackable RL environments, misalignment evaluations, training configs, and evaluation scripts. Models trained on OLMo (7B, 32B) and GPT-OSS (20B, 120B).
Optimal stopping package for LLM evaluations
Example cyber range using Inspect Cyber
A Proxmox sandbox environment for use with inspect_ai
An EC2 sandbox environment for use with inspect_ai
Report Official Development Assistance (RODA)
This repository created for public search portal
Lie Detectors for the Did you lie? paper
Application code repository for ESOS (Energy Savings Opportunity Scheme)
Source code report for METS (Manage your UK Emissions Trading Scheme reporting service)
Application code for the UK Emissions Trading Scheme Registry
Bulk upload of subsidery awards into data base by using excel file
Climate Change Agreements service application code
CHPQA Application Repository
Analysis code and pseudonymised data for "Conversational AI increases political knowledge as effectively as self-directed internet (arXiv:2509.05219). UK AI Security Institute.
A Python library for running AI debate experiments โ orchestrate LLM debaters, judges, datasets, and protocols, and measure whether debate improves AI judge accuracy.