Skip to main content Accessibility help
×
Hostname: page-component-78c5997874-m6dg7 Total loading time: 0 Render date: 2024-11-05T10:38:15.214Z Has data issue: false hasContentIssue false

2 - Introduction to Part I: rational and optimal decision making

from Part I - Rational and optimal decision making

Published online by Cambridge University Press:  05 November 2011

Anil K. Seth
Affiliation:
University of Sussex
Tony J. Prescott
Affiliation:
University of Sheffield
Joanna J. Bryson
Affiliation:
University of Bath
Get access

Summary

When an animal does one thing rather than another, it is natural to ask ‘why?’ A common explanation is that the action is optimal with respect to some goal. For example, when observing the foraging behaviour of a shorebird, one may ask whether the intake of food is being maximised. This ‘normative’ view, a direct extension of Darwinian principles, has its more recent roots in behavioural ecology (Krebs and Davies, 1997) and optimal foraging theory (Stephens and Krebs, 1986). Adopting a normative perspective on action selection can be very useful in placing constraints on possible underlying mechanisms, for developing and comparing theoretical frameworks relating behaviour to mechanism, and for explaining instances of apparently irrational or suboptimal behaviour. The seven chapters within this section present new insights and modelling results relevant to each of these issues. They also connect with the other parts of this book in important ways. The constraints on underlying mechanisms are thoroughly explored by the computational neuroscience models described in Part II, and patterns of both rational and irrational social behaviour are encountered in a variety of forms in Part III.

Suboptimality and ‘matching’

Assessing animal behaviour from a normative perspective has particular value when observations deviate from predictions, because the scientist is now forced to consider the origin of the apparently suboptimal – or ‘irrational’ – behaviour. In one important example, many animals behave according to Herrnstein's (1961) ‘matching law’, in which responses are allocated in proportion to the reward obtained from each response. However, as both Houston et al. (this volume) and Seth (this volume) note, matching is not always optimal. One response to this observation is to propose that suboptimal matching arises as a side-effect of some underlying principle of behaviour, such as Thorndike's ‘law of effect’, which proposes that behaviour shifts towards alternatives that have higher immediate value (Thorndike, 1911). Another is given by the notion of ecological rationality – that cognitive mechanisms fit the demands of particular ecological niches and may deliver predictably suboptimal behaviour when operating outside these niches (Gigerenzer et al., 1999). In line with ecological rationality, Seth (this volume) shows that simple decision rules that lead to optimal foraging in competitive environments with multiple foragers also lead individual foragers to obey the matching law. The remainder of Seth's chapter describes a novel methodological approach that combines agent-based modelling and optimal/normative approaches via the use of genetic algorithms. The resulting approach, which is given the label ‘optimal agent-based modelling’, achieves the important task of integrating function and mechanism in explanations of action selection (McNamara and Houston, 2009).

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Berniker, MKörding, K 2008 Estimating the sources of motor errors for adaptation and generalizationNat. Neurosci. 11 1454CrossRefGoogle ScholarPubMed
Gigerenzer, GTodd, P 1999 Simple Heuristics that Make us SmartCambridgeCambridge University PressGoogle Scholar
Herrnstein, R. J 1961 Relative and absolute strength of response as a function of frequency of reinforcementJ. Exp. Anal. Behav 4 267CrossRefGoogle Scholar
Körding, K 2007 Decision theory: what ‘should’ the nervous system do?Science 318 606CrossRefGoogle Scholar
Krebs, JDavies, N 1997 Behavioral Ecology: An Evolutionary ApproachOxfordBlackwell PublishersGoogle Scholar
McNamara, J. MHouston, A. I 2009 Integrating function and mechanismTrends Ecol. Evol 24 670CrossRefGoogle ScholarPubMed
Posner, M. I 1980 Orienting of attentionQ. J. Exp. Psychol 32 3CrossRefGoogle ScholarPubMed
Stephens, DKrebs, J 1986 Foraging TheoryPrinceton, NJPrinceton University PressGoogle Scholar
Thorndike, E. L 1911 Animal IntelligenceNew YorkMacmillanGoogle Scholar
Usher, MMcClelland, J. L 2001 The time course of perceptual choice: the leaky, competing accumulator modelPsychol. Rev 108 550CrossRefGoogle ScholarPubMed

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×