Agent-based social simulations have historically been evaluated using two criteria: verification and validation. This article questions the adequacy of this dual evaluation scheme. It claims that the scheme does not conform to everyday practices of evaluation, and has, over time, fostered a theory-practice gap in the assessment of social simulations. This gap originates because the dual evaluation scheme, inherited from computer science and software engineering, on one hand, overemphasizes the technical and formal aspects of the implementation process and, on the other hand, misrepresents the connection between the conceptual and the computational model. The mismatch between evaluation theory and practice, it is suggested, might be overcome if practitioners of agent-based social simulation adopt a single criterion evaluation scheme in which: i) the technical/formal issues of the implementation process are tackled as a matter of debugging or instrument calibration, and ii) the epistemological issues surrounding the connection between conceptual and computational models are addressed as a matter of validation.

Studies of creativity have tended to focus on isolated individuals, under the assumption that it can be defined as a characteristic of an extraordinary person, product, or process. Existing computational models of creative behavior have inherited this emphasis on independent generative processes. However, an increasing multidisciplinary consensus regards creativity as a systems property, and extends the focus of inquiry to include the interaction between generative individuals and evaluative social groups. To acknowledge the complementarity of evaluative processes by social groups, experts, and peers, this paper presents experimentation with a framework of design as a social activity. This model is used to inspect phenomena associated with creativity in the interaction between designers and their societies. In particular, this paper describes the strength of social ties as a mechanism of social organization, and explores its potential relation to creativity in a computational social simulation. These experiments illustrate ways in which the role of designers as change agents of their societies can be largely determined by how the evaluating group self-organizes over time. A key potential implication is that the isolated characteristics of designers may be insufficient to formulate conclusions about the nature and effects of their behavior. Instead, causality could be attributed to situational factors that define the relationship between designers and their evaluators.