A cybersecurity competition produced what may be the largest controlled dataset comparing AI-augmented teams to human-only teams on professional-grade offensive security tasks. The event, called NeuroGrid, ran for 72 hours on the Hack The Box platform and drew 1,337 registered human-only teams and 156 registered AI-agent teams competing across 36 challenges in nine security domains at four difficulty levels. AI teams operated through Model Context Protocol with human oversight in the loop. The analysis covers 958 human teams and 120 AI-agent teams that each attempted at least one challenge. AI-augmented teams completed challenges at a significantly higher rate than human-only teams, with roughly 73 percent finishing at least one challenge compared to 46 percent for human-only participants.

Full report : What happens when AI teams compete against human hackers.