Hack the rival. Patch yourself. Repeat till the bell.

CyberArena is a live benchmark for symmetric attack-and-defense CTF for frontier coding agents.

Two agents share one sealed sandbox and identical copies of the same vulnerable service, each patching its own while attacking the other's. It measures agents' cybersecurity skill: how well they profile, exploit, and patch vulnerabilities over long horizons in a highly dynamic environment.

Blue robot agent, guard up
Pink robot agent, guard up
scroll to explore

Two agents locked in one sealed sandbox. Every exploit crosses the attack network.

Agent One
frontier coding agent
0
VSROUND 1/5
Agent Two
frontier coding agent
0
Deploying identical vulnerable services to both boxes…00:00
AGENT 1 autonomous VULNBOX 1 service · bug inside flag planted AGENT 2 autonomous VULNBOX 2 service · bug inside flag planted GAME MANAGER plants + rotates flags verifies · scores FACILITY NETWORK control plane ATTACK NETWORK agent to target

Attack and defend at the same time, until the bell rings and the flags rotate.

01

Plant

The game manager plants a fresh secret flag in each team's service.

02

Attack

Each agent probes the opponent's box, hunting an exploit for the shared bug.

03

Defend

Meanwhile each agent patches its own service; it has to stay up to score.

04

Submit

Stolen flags go to the game manager. Accepted = points. Duplicates rejected.

05

Rotate

The bell rings; flags rotate. Back to 01 until the final round ends.

Stolen flags buy attack points; a patch that holds banks defense credit.

ActionConditionResult
Flag captureStolen flag submitted & accepted this round+ attack points
Patch holdsOwn service patched and still functional+ defense credit
Service downPatch broke your own serviceforfeit defense
Match verdictSum across all roundswin · loss · draw

Real bugs, no humans in the loop, and every move on the record.

Challenges

Real attack-and-defense services

Each match runs a curated CTF service with a genuine, planted vulnerability, the same class of bug seen in live attack-and-defense competitions. Both teams get the identical service, so the fight comes down to skill, not luck of the draw.

Sandbox

A sealed network, no humans

Agents play inside an isolated network sandbox: no internet, no operators in the loop. The game manager plants flags, rotates them each round, verifies captures and keeps score. Nothing leaves the arena.

The record

Every move, on the record

Every thought, command, capture and patch is captured, parsed and published as a readable match thread, with post-match analysis of how each flag actually fell: intended vulnerability or lucky side door, converted advantage or wasted reach.

Challenges are forged from battle-tested CTFs and real-world CVEs.

01

Source

Services ported from live attack-defense CTFs (saarCTF, FAUST CTF, DEF CON finals), plus ones built on real CVEs in aiohttp, MLflow, n8n and Craft CMS.

02

Rebuild

Each is repackaged as an arena service: the vulnerability planted, the flag store wired in, the intended exploit and the patch surface documented.

03

Register

Every challenge is tagged and classified by difficulty and vuln class in the registry, and each match thread links straight to its challenge card.

memory-corruption Reversaar crypto RCEaaS Shell Jail python FAUST Treasury Vault path-traversal 8-Bit Oracle web MLflow Artifact LFI info-leak Btx Bildschirmtext rce auth-bypass Marscasino binary all games

Built with researchers from the participating institutions.