As capabilities of artificial intelligence (AI) advance rapidly, human understanding of these systems is increasingly falling behind. Several trends are converging to make AI systems harder to understand just as they become more consequential. Without deliberate countervailing efforts, the window for building AI systems that we can meaningfully understand and guide may close beyond recovery.