The evolution of Artificial Intelligence (AI) and Machine Learning (ML) enables new ways to envision how computer tools will aid, work with, and even guide human teams. This paper explores this new paradigm of design by considering emerging variations of AI-Human collaboration: AI used as a design tool versus AI employed as a guide to human problem solvers, and AI agents which only react to their human counterparts versus AI agents which proactively identify and address needs. The different combinations can be mapped onto a 2×2 AI-Human Teaming Matrix which isolates and highlights these different AI capabilities in teaming. The paper introduces the matrix and its quadrants, illustrating these different AI agents and their application and impact, and then provides a road map to researching and developing effective AI team collaborators.