Tasks come from 14 specialist partners. The overall score weights domains equally and combines binary or partial grading depending on the task. It therefore does not directly represent the share of jobs or business assignments that can be automated.
The authors say safety mechanisms can reduce some scores, particularly in cybersecurity, biology and alignment. Results depend on testing conditions and the tools provided to agents.
These are SemiAnalysis’s figures, rather than independently reproduced performance measurements.