LLM Agents in Offensive Security
I evaluate how LLM agents perform reverse engineering and binary exploitation, tracing where they succeed, make mistakes, or stop. My aim is to measure how efficiently and automatically exploits can be built, and to use that to find out which software protections can withstand them.
CTF tasks let me follow the sequence from understanding a program to constructing an exploit. By examining execution logs and failure patterns, I study how different protections affect the agent’s reasoning and tool use. This provides a more detailed view of its capabilities than a success rate alone.