Hostname: page-component-7bb8b95d7b-pwrkn Total loading time: 0 Render date: 2024-09-25T17:59:27.373Z Has data issue: false hasContentIssue false

The added value of affective processes for models of human cognition and learning

Published online by Cambridge University Press:  23 September 2024

Yoann Stussi*
Affiliation:
Swiss Center for Affective Sciences, Campus Biotech, University of Geneva, Geneva, Switzerland yoann.stussi@unige.ch daniel.dukes@unige.ch david.sander@unige.ch https://www.unige.ch/fapse/e3lab/members1/senior-researchers-and-lecturers/dr-yoann-stussi https://dukes.space/ https://www.unige.ch/fapse/e3lab/director/ Department of Psychology, FPSE, University of Geneva, Geneva, Switzerland
Daniel Dukes
Affiliation:
Swiss Center for Affective Sciences, Campus Biotech, University of Geneva, Geneva, Switzerland yoann.stussi@unige.ch daniel.dukes@unige.ch david.sander@unige.ch https://www.unige.ch/fapse/e3lab/members1/senior-researchers-and-lecturers/dr-yoann-stussi https://dukes.space/ https://www.unige.ch/fapse/e3lab/director/
David Sander
Affiliation:
Swiss Center for Affective Sciences, Campus Biotech, University of Geneva, Geneva, Switzerland yoann.stussi@unige.ch daniel.dukes@unige.ch david.sander@unige.ch https://www.unige.ch/fapse/e3lab/members1/senior-researchers-and-lecturers/dr-yoann-stussi https://dukes.space/ https://www.unige.ch/fapse/e3lab/director/ Department of Psychology, FPSE, University of Geneva, Geneva, Switzerland
*
*Corresponding author.

Abstract

Building on the affectivism approach, we expand on Binz et al.'s meta-learning research program by highlighting that emotion and other affective phenomena should be key to the modeling of human learning. We illustrate the added value of affective processes for models of learning across multiple domains with a focus on reinforcement learning, knowledge acquisition, and social learning.

Type
Open Peer Commentary
Copyright
Copyright © The Author(s), 2024. Published by Cambridge University Press

Binz et al. bid to establish an ambitious research program to model human cognition using a meta-learning framework. They effectively illustrate the potential and advantages of meta-learned models, showcasing the ability of such models to acquire inductive biases through experience. Notably, the authors outline a compelling blueprint for how these models could foster the development of a domain-general model of human learning. Here, we seek to complement this blueprint by highlighting a key element that is left mostly unexplored in the target article: Affective processes.

Affective processes – typically emotions, feelings, motivations, moods, or attitudes – are not only inherently linked to well-being, but also drive behavioral and cognitive processes such as attention, learning, memory, and decision-making (e.g., LaBar & Cabeza, Reference LaBar and Cabeza2006; Lerner, Li, Valdesolo, & Kassam, Reference Lerner, Li, Valdesolo and Kassam2015; Phelps, Reference Phelps2006; Pool, Brosch, Delplanque, & Sander, Reference Pool, Brosch, Delplanque and Sander2016). This grants affective processes high explanatory power in understanding human behavior and cognition, a central argument of the affectivism approach (Dukes et al., Reference Dukes, Abrams, Adolphs, Ahmed, Beatty, Berridge and Sander2021). As such, we suggest that considering affective processes is pivotal to the modeling of human cognition, and especially of learning. Affective processes are indeed central to – and exert a pervasive influence on – how humans learn (e.g., Öhman & Mineka, Reference Öhman and Mineka2001; Vollberg & Sander, Reference Vollberg and Sander2024; Wuensch, Pool, & Sander, Reference Wuensch, Pool and Sander2021). Below, we illustrate how emotion and other affective phenomena are central to human learning across various domains, with a particular focus on reinforcement learning, knowledge acquisition, and social learning.

Affective processes emerge as important factors in reinforcement learning. This fundamental learning process enables individuals to attribute value to states or stimuli and actions via teaching signals such as rewards and punishments. These reinforcers and their associated stimuli typically evoke affective responses, which are core components of reward-seeking and threat-related behaviors (Levy & Schiller, Reference Levy and Schiller2021; Stussi & Pool, Reference Stussi and Pool2022). Affective processes also modulate how individuals learn from reinforcers. Studies on Pavlovian conditioning – a basic form of reinforcement learning – have shown that stimuli with heightened affective relevance, such as both threat-relevant (e.g., angry faces) and positive emotional (e.g., baby faces) stimuli, are more rapidly and persistently associated with an aversive outcome than neutral stimuli (Stussi, Pourtois, & Sander, Reference Stussi, Pourtois and Sander2018; Stussi, Pourtois, Olsson, & Sander, Reference Stussi, Pourtois, Olsson and Sander2021). At the computational level, these studies indicate that affective relevance modulates how individuals learn from prediction errors: Affectively relevant stimuli were associated with a lower learning rate for negative prediction errors (i.e., when the aversive outcome was expected but omitted), enhancing the persistence of their association with the aversive outcome (Stussi et al., Reference Stussi, Pourtois and Sander2018, Reference Stussi, Pourtois, Olsson and Sander2021). Similarly, substantial evidence has demonstrated that individuals learn differently about positive and negative outcomes in the instrumental domain (Dorfman, Bhui, Hughes, & Gershman, Reference Dorfman, Bhui, Hughes and Gershman2019; Lefebvre, Lebreton, Meyniel, Bourgeois-Gironde, & Palminteri, Reference Lefebvre, Lebreton, Meyniel, Bourgeois-Gironde and Palminteri2017). Positively valenced prediction errors are generally associated with a higher learning rate than negatively valenced prediction errors, providing a computational correlate of such learning asymmetry (Palminteri & Lebreton, Reference Palminteri and Lebreton2022). Altogether, these findings highlight that affective mechanisms shape basic reinforcement learning processes.

Affective processes likewise support epistemic learning. Both positive and negative emotions have long been studied for their roles in the encoding, consolidation, and recall of episodic memories (Levine & Pizarro, Reference Levine and Pizarro2004), as well as in academic learning in educational settings (see Pekrun & Linnenbrink-Garcia, Reference Pekrun and Linnenbrink-Garcia2014). Epistemic emotions are the key family of emotions supporting knowledge exploration and acquisition (see Muis, Chevrier, & Singh, Reference Muis, Chevrier and Singh2018). Emotions such as interest, curiosity, confusion, surprise, wonder, or awe are drivers of learning (e.g., Chevrier, Muis, Trevors, Pekrun, & Sinatra, Reference Chevrier, Muis, Trevors, Pekrun and Sinatra2019; Vogl, Pekrun, Murayama, & Loderer, Reference Vogl, Pekrun, Murayama and Loderer2020). As an illustration of the central role of epistemic emotions in learning, the “trivia questions” paradigm is typically used to understand how epistemic curiosity enhances memory. Using this paradigm, research has shown that the more participants are curious to know the response to a question (e.g., “who is the most cited psychologist of the 21st century?”), the more they later remember the response (e.g., Kang et al., Reference Kang, Hsu, Krajbich, Loewenstein, McClure, Wang and Camerer2009; Marvin & Shohamy, Reference Marvin and Shohamy2016). The impact of curiosity on knowledge exploration and acquisition, partly relying on reward-related processes, is therefore a salient example of how the intrinsic value of information can enhance learning (Murayama, Reference Murayama2022).

While many things can be learned by exploring one's own environment, this individual approach has its limitation. Some information simply cannot be gleaned in this way and requires input from other (human) sources (Harris & Koenig, Reference Harris and Koenig2006). Critically, such social learning fundamentally relies on affective processes. Social learning has historically been seen as either a non-human primate phenomenon that explains how behavior can be learned from conspecifics (Zentall & Galef, Reference Zentall and Galef1988), or a human cognitive developmental phenomenon concerned with learning from others’ testimony (Harris, Reference Harris2012). However, affective social learning not only points out that these two branches of social learning originate from the same tree (Gruber, Bazhydai, Sievers, Clément, & Dukes, Reference Gruber, Bazhydai, Sievers, Clément and Dukes2022), but also that it is possible to learn from others’ affective attitudes about the value of objects (e.g., ideas, people, customs). An important part of who we are – our values, ethics, and morality – is based on our perception, attention, and memory of interaction with and learning from others, whether or not this information is communicated ostensively (Dukes & Clément, Reference Dukes and Clément2017; Egyed, Király, & Gergely, Reference Egyed, Király and Gergely2013). And indeed, what we perceive, attend to, and remember is largely defined by how important, valuable, and affective those objects of perception, attention, and memory are. Not only do we remember what is affectively relevant to us as individuals, but others, serving as proxy relevant detectors, can also signal what is more or less relevant, to be learned or forgotten (Dukes & Clément, Reference Dukes and Clément2019; see also Sorce, Emde, Campos, & Klinnert, Reference Sorce, Emde, Campos and Klinnert1985).

In conclusion, affective processes play a fundamental role in learning across various domains and their consideration is key to the modeling of human learning. Given that emotions are not immutable and static but flexibly arise from the interaction between an individual and their environment (Scherer & Moors, Reference Scherer and Moors2019), it could be particularly enlightening to conceptualize emotion as a kind of inductive bias attuned by experience within the meta-learning framework proposed by Binz et al. Such conceptualization could offer a promising way of modeling the effects of emotion on learning, thereby providing added value to the meta-learning research agenda.

Acknowledgements

The authors thank Dr. Eva R. Pool, Professor Dr. Maël Lebreton, and Professor Dr. Fabrice Clément for insightful discussions.

Financial support

Y. S. is supported by an ERC Starting Grant (INFORL-948671) awarded to Professor Dr. Maël Lebreton.

Competing interest

None.

References

Chevrier, M., Muis, K. R., Trevors, G. J., Pekrun, R., & Sinatra, G. M. (2019). Exploring the antecedents and consequences of epistemic emotions. Learning and Instruction, 63, Article 101209. https://doi.org/10.1016/j.learninstruc.2019.05.006CrossRefGoogle Scholar
Dorfman, H. M., Bhui, R., Hughes, B. L., & Gershman, S. J. (2019). Causal inference about good and bad outcomes. Psychological Science, 30(4), 516525. https://doi.org/10.1177/0956797619828724CrossRefGoogle ScholarPubMed
Dukes, D., Abrams, K., Adolphs, R., Ahmed, M. E., Beatty, A., Berridge, K. C., … …Sander, D. (2021). The rise of affectivism. Nature Human Behaviour, 5, 816820. https://doi.org/10.1038/s41562-021-01130-8CrossRefGoogle ScholarPubMed
Dukes, D., & Clément, F. (2017). Author reply: Clarifying the importance of ostensive communication in long-life, affective social learning. Emotion Review, 9(3), 267269. https://doi.org/10.1177/1754073916679006CrossRefGoogle Scholar
Dukes, D., & Clément, F. (Eds.). (2019). Foundations of affective social learning: Conceptualizing the social transmission of value. Cambridge University Press. https://doi.org/10.1017/9781108661362CrossRefGoogle Scholar
Egyed, K., Király, I., & Gergely, G. (2013). Communicating shared knowledge in infancy. Psychological Science, 24(7), 13481353. https://doi.org/10.1177/0956797612471952CrossRefGoogle ScholarPubMed
Gruber, T., Bazhydai, M., Sievers, C., Clément, F., & Dukes, D. (2022). The ABC of social learning: Affect, behavior, and cognition. Psychological Review, 129(6), 12961318. https://doi.org/10.1037/rev0000311CrossRefGoogle ScholarPubMed
Harris, P. L. (2012). Trusting what you're told: How children learn from others. Harvard University Press. https://doi.org/10.4159/harvard.9780674065192Google Scholar
Harris, P. L., & Koenig, M. A. (2006). Trust in testimony: How children learn about science and religion. Child Development, 77(3), 505524. https://doi.org/10.1111/j.1467-8624.2006.00886.xCrossRefGoogle ScholarPubMed
Kang, M. J., Hsu, M., Krajbich, I. M., Loewenstein, G., McClure, S. M., Wang, J. T., & Camerer, C. F. (2009). The wick in the candle of learning: Epistemic curiosity activates reward circuitry and enhanced memory. Psychological Science, 20(8), 963973. https://doi.org/10.1111/j.1467-9280.2009.02402.xCrossRefGoogle Scholar
LaBar, K. S., & Cabeza, R. (2006). Cognitive neuroscience of emotional memory. Nature Reviews Neuroscience, 7, 5464. https://doi.org/10.1038/nrn1825CrossRefGoogle ScholarPubMed
Lefebvre, G., Lebreton, M., Meyniel, F., Bourgeois-Gironde, S., & Palminteri, S. (2017). Behavioural and neural characterization of optimistic reinforcement learning. Nature Human Behaviour, 1, Article 0067. https://doi.org/10.1038/s41562-017-0067CrossRefGoogle Scholar
Lerner, J. S., Li, Y., Valdesolo, P., & Kassam, K. S. (2015). Emotion and decision making. Annual Review of Psychology, 66, 799823. https://doi.org/10.1146/annurev-psych-010213-115043CrossRefGoogle ScholarPubMed
Levine, L. J., & Pizarro, D. A. (2004). Emotion and memory research: A grumpy overview. Social Cognition, 22(5), 530554. https://doi.org/10.1521/soco.22.5.530.50767CrossRefGoogle Scholar
Levy, I., & Schiller, D. (2021). Neural computations of threat. Trends in Cognitive Sciences, 25(2), 151171. https://doi.org/10.1016/j.tics.2020.11.007CrossRefGoogle ScholarPubMed
Marvin, C. B., & Shohamy, D. (2016). Curiosity and reward: Valence predicts choice and information prediction errors enhance learning. Journal of Experimental Psychology: General, 145(3), 266272. https://doi.org/10.1037/xge0000140CrossRefGoogle ScholarPubMed
Muis, K. R., Chevrier, M., & Singh, C. A. (2018). The role of epistemic emotions in personal epistemology and self-regulated learning. Educational Psychologist, 53(3), 165184. https://doi.org/10.1080/00461520.2017.1421465CrossRefGoogle Scholar
Murayama, K. (2022). A reward-learning framework of knowledge acquisition: An integrated account of curiosity, interest, and intrinsic-extrinsic rewards. Psychological Review, 129(1), 175198. https://doi.org/10.1037/rev0000349CrossRefGoogle ScholarPubMed
Öhman, A., & Mineka, S. (2001). Fears, phobias, and preparedness: Toward an evolved module of fear and fear learning. Psychological Review, 108(3), 483522. https://doi.org/10.1037/0033-295X.108.3.483CrossRefGoogle ScholarPubMed
Palminteri, S., & Lebreton, M. (2022). The computational roots of positivity and confirmation biases in reinforcement learning. Trends in Cognitive Sciences, 26(7), 607621. https://doi.org/10.1016/j.tics.2022.04.005CrossRefGoogle ScholarPubMed
Pekrun, R., & Linnenbrink-Garcia, L. (Eds.). (2014). International handbook of emotion in education. Routledge.CrossRefGoogle Scholar
Phelps, E. A. (2006). Emotion and cognition: Insights from studies of the human amygdala. Annual Review of Psychology, 57, 2753. https://doi.org/10.1146/annurev.psych.56.091103.070234CrossRefGoogle ScholarPubMed
Pool, E., Brosch, T., Delplanque, S., & Sander, D. (2016). Attentional bias for positive emotional stimuli: A meta-analytic investigation. Psychological Bulletin, 142(1), 79106. https://doi.org/10.1037/bul0000026CrossRefGoogle ScholarPubMed
Scherer, K. R., & Moors, A. (2019). The emotion process: Event appraisal and component differentiation. Annual Review of Psychology, 70, 719745. https://doi.org/10.1146/annurev-psych-122216-011854CrossRefGoogle ScholarPubMed
Sorce, J. F., Emde, R. N., Campos, J. J., & Klinnert, M. D. (1985). Maternal emotional signaling: Its effect on the visual cliff behavior of 1-year-olds. Developmental Psychology, 21(1), 195200. https://doi.org/10.1037/0012-1649.21.1.195CrossRefGoogle Scholar
Stussi, Y., & Pool, E. R. (2022). Multicomponential affective processes modulating food-seeking behaviors. Current Opinion in Behavioral Sciences, 48, Article 101226. https://doi.org/10.1016/j.cobeha.2022.101226CrossRefGoogle Scholar
Stussi, Y., Pourtois, G., Olsson, A., & Sander, D. (2021). Learning biases to angry and happy faces during Pavlovian aversive conditioning. Emotion, 21(4), 742756. https://doi.org/10.1037/emo0000733CrossRefGoogle ScholarPubMed
Stussi, Y., Pourtois, G., & Sander, D. (2018). Enhanced Pavlovian aversive conditioning to positive emotional stimuli. Journal of Experimental Psychology: General, 147(6), 905923. https://doi.org/10.1037/xge0000424CrossRefGoogle ScholarPubMed
Vogl, E., Pekrun, R., Murayama, K., & Loderer, K. (2020). Surprised-curious-confused: Epistemic emotions and knowledge exploration. Emotion, 20(4), 625641. https://doi.org/10.1037/emo0000578CrossRefGoogle ScholarPubMed
Vollberg, M. C., & Sander, D. (2024). Hidden reward: Affect and its prediction errors as windows into subjective value. Current Directions in Psychological Science. Advance online publication. https://doi.org/10.1177/09637214231217678CrossRefGoogle ScholarPubMed
Wuensch, L., Pool, E. R., & Sander, D. (2021). Individual differences in learning positive affective value. Current Opinion in Behavioral Sciences, 39, 1926. https://doi.org/10.1016/j.cobeha.2020.11.001CrossRefGoogle Scholar
Zentall, T. R., & Galef, B. G. (Eds.). (1988). Social learning: Psychological and biological perspectives. Psychology Press.Google Scholar