Terrorist groups repeatedly include operatives of varying commitment and often rely on a common set of security-reducing bureaucratic tools to manage these individuals. This is puzzling in that covert organizations are commonly thought to screen their operatives very carefully and pay a particularly heavy price for record keeping. The authors use terrorist memoirs and the internal correspondence of one particularly prominent group to highlight the organizational challenges terrorist groups face and use a game-theoretic model of moral hazard in a finitely sized organization to explain why record keeping and bureaucracy emerge in these groups. The model provides two novel results. First, in small heterogeneous organizations longer institutional memory can enhance organizational efficiency. Second, such organizations will use worse agents in equilibrium under certain conditions. The core logic is that in small organizations the punishment strategies that allow leaders to extract greater effort are credible only when operatives can identify and react to deviations from the leaders' equilibrium strategy. This dynamic creates incentives for record keeping and means that small organizations will periodically use problematic agents in equilibrium as part of a strategy that optimally motivates their best operatives.