Cover not available
Article published In:
Gesture
Vol. 20:3 (2021) ► pp.376–416

Representational gestures correlated with meaning-associated aspects of L2 speech performance

| Capital Normal University
| University of International Business and Economics
| University of Auckland
Gesture and speech are closely associated channels involved in conveying meaning. Previous studies have reported the relationship between gesture use and speech performance for highly proficient speakers. This study extends the investigation of this relationship by correlating the representational gesture rate and complexity, accuracy, and fluency measures for L2 speech produced by lower-intermediate-level EFL learners with Chinese as their L1. Three speech tasks were adopted with two activating concrete concepts and one abstract concepts. The results showed that the representational gesture rate was correlated with meaning-associated but not form-associated speech measures for L2 learners, and that the task type did not influence the relationship between gesture and speech. This study suggests that representational gesture use has a close relationship with meaning-related speech measures for lower proficiency L2 speakers when they talk about both concrete and abstract concepts.
Keywords: representational gesture, L2 speech performance, concrete speech content, abstract speech content
Article outline
  • Background
    • The facilitating effect of representational gestures on speech production
    • Representational gestures and speech performance
    • Complexity, accuracy, and fluency in L2
    • Representational gestures and speech content
  • Method
    • Participants
    • Instruments
    • Procedures
    • Transcription
    • Calculation and coding of speech measures
    • Coding and calculation of gesture measures
  • Results
    • Research question 1: Correlations of the representational gesture rate and speech performance
    • Research question 2: Interaction effects of the representational gesture rate and the task type on speech performance
  • Discussion
    • Correlations of the representational gesture rate and speech performance measures for L2 learners
    • Interaction effects of the representational gesture rate and the task type on L2 speech performance
  • Conclusion
  • Notes
  • References
Published online: 30 August 2022
DOI logo
https://doi.org/10.1075/gest.19017.ma
References (66)
References
Alibali, Martha W. (2005). Gesture in spatial cognition: Expressing, communicating, and thinking about spatial information. Spatial Cognition & Computation, 5  (4), 307–331. DOI logoGoogle Scholar
Alibali, Martha W., Kita, Sotaro, & Young, Amanda J. (2000). Gesture and the process of speech production: We think, therefore we gesture. Language & Cognitive Processes, 15  (6), 593–613. DOI logoGoogle Scholar
Aziz, Jasmine R. & Nicoladis, Elena. (2019). “My French is rusty”: Proficiency and bilingual gesture use in a majority English community. Bilingualism: Language & Cognition, 22  (4), 826–835. DOI logoGoogle Scholar
Boroditsky, Lera. (2000). Metaphoric structuring: Understanding time through spatial metaphors. Cognition, 75 (1), 1–28. DOI logoGoogle Scholar
Burns, Patrick, Mccormack, Teresa, Jaroslawska, Agnieszka J., O’Connor, Patrick A., & Caruso, Eugene M. (2019). Time points: A gestural study of the development of space-time mappings. Cognitive Science, 43  (12). DOI logoGoogle Scholar
Cartmill, Erica A. & Goldin-Meadow, Susan. (2016). Gesture. In David Matsumoto, Hyisung C. Hwang, & Mark G. Frank (Eds.), APA handbook of nonverbal communication (pp. 307–333). Washington, DC: American Psychological Association. DOI logoGoogle Scholar
Chu, Mingyuan, Meyer, Antje, Foulkes, Lucy, & Kita, Sotaro. (2014). Individual differences in frequency and saliency of speech-accompanying gestures: The role of cognitive abilities and empathy. Journal of Experimental Psychology General, 143  (2), 694–709. DOI logoGoogle Scholar
Chui, Kawai. (2011). Conceptual metaphors in gesture. Cognitive Linguistics, 22  (3), 437–458. DOI logoGoogle Scholar
Cienki, Alan & Müller, Cornelia (Eds.), (2008). Metaphor and gesture. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Cook, Susan Wagner, Yip, Terina Kuang Yi, & Goldin-Meadow, Susan. (2012). Gestures, but not meaningless movements, lighten working memory load when explaining math. Language & Cognitive Processes, 27  (4), 594–610. DOI logoGoogle Scholar
Dewaele, Jean-Marc & Furnham, Adrian. (2000). Personality and speech production: A pilot study of second language learners. Personality & Individual Differences, 28  (2), 355–365. DOI logoGoogle Scholar
Ellis, Rod & Barkhuizen, Gary. (2005). Analysing learner language. Oxford: Oxford University Press.Google Scholar
Feyereisen, Pierre & Havard, Isabelle. (1999). Mental imagery and production of hand gestures while speaking in younger and older adults. Journal of Nonverbal Behavior, 23  (2), 153–171. DOI logoGoogle Scholar
Forceville, Charles. (2009). Non-verbal and multimodal metaphor in a cognitivist framework: Agendas for research. In Charles J. Forceville & Eduardo Urios-Aparisi (Eds.), Multimodal metaphor (pp. 19–42). Berlin &  New York: Mouton de Gruyter. DOI logoGoogle Scholar
Foster, Pauline, Tonkyn, Alan, & Wigglesworth, Gillian. (2000). Measuring spoken language: A unit for all reasons. Applied Linguistics, 21 (3), 354–375. DOI logoGoogle Scholar
Frick-Horbury, Donna. (2002). The use of hand gestures as self-generated cues for recall of verbally associated targets. The American Journal of Psychology, 115  (1), 1–20. DOI logoGoogle Scholar
Goldin-Meadow, Susan. (2003). Hearing gesture: How our hands help us think. Cambridge, MA.: Harvard University Press.Google Scholar
Goldin-Meadow, Susan, Nusbaum, Howard, Kelly, Spencer, & Wagner, Susan. (2001). Explaining math: Gesturing lightens the load. Psychological Science, 12  (6), 516–522. DOI logoGoogle Scholar
Gullberg, Marianne. (1998). Gesture as a communication strategy in second language discourse: A study of learners of French and Swedish. Doctoral dissertation, Lund University, Lund.
Hostetter, Autumn B. & Alibali, Martha W. (2004). On the tip of the mind: Gesture as a key to conceptualization. Proceedings of the Annual Meeting of the Cognitive Science Society, 26 1, 589–594. Retrieved from [URL]
(2007). Raise your hand if you’re spatial: Relations between verbal and spatial skills and gesture production. Gesture, 7 (1), 73–95. DOI logoGoogle Scholar
Hostetter, Autumn B., Alibali, Martha W., & Kita, Sotaro. (2007). I see it in my hands’ eye: Representational gestures reflect conceptual demands. Language & Cognitive Processes, 22  (3), 313–336. DOI logoGoogle Scholar
Hostetter, Autumn B. & Potthoff, Andrea L. (2012). Effects of personality and social situation on representational gesture production. Gesture, 12  (1), 63–84. DOI logoGoogle Scholar
Johnson, Mark. (1987). The body in the mind: The bodily basis of meaning, imagination, and reason. Chicago: University of Chicago Press. DOI logoGoogle Scholar
Kendon, Adam. (2004). Gesture: Visible action as utterance. Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Kita, Sotaro, Alibali, Martha W., & Chu, Mingyuan. (2017). How do gestures influence thinking and speaking? The gesture-for-conceptualization hypothesis. Psychological Review, 124  (3), 245–266. DOI logoGoogle Scholar
Kita, Sotaro & Davies, Thomas S. (2009). Competing conceptual representations trigger co-speech representational gestures. Language & Cognitive Processes, 24  (5), 761–775. DOI logoGoogle Scholar
Kormos, Judit. (2006). Speech production and second language acquisition. Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Kövecses, Zoltán. (2000). Metaphor and emotion: Language, culture, and body in human feeling. Cambridge: Cambridge University Press.Google Scholar
Krauss, Robert M. & Hadar, Uri. (1999). The role of speech-related arm/hand gestures in word retrieval. In Lynn S. Messing & Ruth Campbell (Eds.), Gesture, speech, and sign (pp. 93–116). Oxford: Oxford University Press. DOI logoGoogle Scholar
Lakoff, George. (1987). Women, fire, and dangerous things: What categories reveal about the mind. Chicago: The University of Chicago Press. DOI logoGoogle Scholar
. (1993). The contemporary theory of metaphor. In Andrew Ortony (Ed.), Metaphor and thought (2nd ed.) (pp. 202–251). Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Lakoff, George & Johnson, Mark. (1980). Metaphors we live by. Chicago: The University of Chicago Press.Google Scholar
Laurent, Angélique & Nicoladis, Elena. (2015). Gesture restriction affects French-English bilinguals’ speech only in French. Bilingualism: Language & Cognition, 18  (2), 340–349. DOI logoGoogle Scholar
Laurent, Angélique, Nicoladis, Elena, & Marentette, Paula. (2015). The development of storytelling in two languages with words and gestures. International Journal of Bilingualism, 19  (1), 56–74. DOI logoGoogle Scholar
Lausberg, Hedda & Sloetjes, Han. (2009). Coding gestural behavior with the NEUROGES-ELAN system. Behavior Research Methods, Instruments, & Computers, 41 (3), 841–849. DOI logoGoogle Scholar
Lavergne, Joanne & Kimura, Doreen. (1987). Hand movement asymmetry during speech: No effect of speaking topic. Neuropsychologia, 25  (4), 689–693. DOI logoGoogle Scholar
Levelt, Willem J. M. (1989). Speaking: From intention to articulation. Cambridge, MA: MIT Press.Google Scholar
Li, Shaofeng & Fu, Mengxia. (2018). Strategic and unpressured within-task planning and their associations with working memory. Language Teaching Research, 22  (2), 230–253. DOI logoGoogle Scholar
Lin, Yen-Liang. (2017). Co-occurrence of speech and gestures: A multimodal corpus linguistic approach to intercultural interaction. Journal of Pragmatics, 117 1, 155–167. DOI logoGoogle Scholar
Lindstromberg, Seth. (2010). English prepositions explained (Revised edition). Amsterdam & Philadelphia: John Benjamins. DOI logoGoogle Scholar
McCarthy, Philip M. & Jarvis, Scott. (2010). MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment. Behavior Research Methods, 42  (2), 381–392. DOI logoGoogle Scholar
McNeill, David. (1992). Hand and mind: What the hands reveal about thought. Chicago, IL: University of Chicago Press.Google Scholar
Melinger, Alissa & Kita, Sotaro. (2007). Conceptualization load triggers gesture production. Language & Cognitive Processes, 22  (4), 473–500. DOI logoGoogle Scholar
Mori, Souma. (2019). A cognitive analysis of the preposition OVER: Image-schema transformations and metaphorical extensions. Canadian Journal of Linguistics, 64  (3), 444–474. DOI logoGoogle Scholar
Morsella, Ezequiel & Krauss, Robert M. (2004). The role of gestures in spatial working memory and speech. The American Journal of Psychology, 117  (3), 411–424. DOI logoGoogle Scholar
Mota, Mailce B. (2005). Working memory capacity and fluency, accuracy, complexity, and lexical density in L2 speech production. Fragmentos, 24 1, 69–104. Retrieved from [URL]
Nagpal, Jaya, Nicoladis, Elena, & Marentette, Paula. (2011). Predicting individual differences in L2 speakers’ gestures. International Journal of Bilingualism, 15  (2), 205–214. DOI logoGoogle Scholar
Nicoladis, Elena, Marentette, Paula, & Navarro, Samuel. (2016). Gesture frequency linked primarily to story length in 4-10-year old children’s stories. Journal of Psycholinguistic Research, 45  (2), 189–204. DOI logoGoogle Scholar
Nicoladis, Elena, Mayberry, Rachel I., & Genesee, Fred. (1999). Gesture and early bilingual development. Developmental Psychology, 35  (2), 514–526. DOI logoGoogle Scholar
Nicoladis, Elena, Pika, Simone, Yin, Hui, & Marentette, Paula. (2007). Gesture use in story recall by Chinese-English bilinguals. Applied Psycholinguistics, 28  (4), 721–735. DOI logoGoogle Scholar
Nicoladis, Elena, Pika, Simone, & Marentette, Paula. (2009). Do French-English bilingual children gesture more than monolingual children? Journal of Psycholinguistic Research, 38  (6), 573–585. DOI logoGoogle Scholar
Oya, Taeko, Manalo, Emmanuel, & Greenwood, Jackie. (2004). The influence of personality and anxiety on the oral performance of Japanese speakers of English. Applied Cognitive Psychology, 18  (7), 841–855. DOI logoGoogle Scholar
Peng, Jian-E. (2014). Willingness to communicate in the Chinese EFL university classroom: An ecological perspective. Bristol: Multilingual Matters. DOI logoGoogle Scholar
Rauscher, Frances H., Krauss, Robert M., & Chen, Yihsiu. (1996). Gesture, speech, and lexical access: The role of lexical movements in speech production. Psychological Science, 7  (4), 226–231. DOI logoGoogle Scholar
Skehan, Peter. (1998). A cognitive approach to language learning. Oxford: Oxford University Press.Google Scholar
. (2009). Modelling second language performance: Integrating complexity, accuracy, fluency, and lexis. Applied Linguistics, 30  (4), 510–532. DOI logoGoogle Scholar
(Ed.). (2014). Processing perspectives on task performance. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Skehan, Peter & Foster, Pauline. (1999). The influence of task structure and processing conditions on narrative retellings. Language Learning, 49  (1), 93–120. DOI logoGoogle Scholar
. (2001). Cognition and tasks. In Peter Robinson (Ed.), Cognition and second language instruction (pp. 183–205). Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Smithson, Lisa, Nicoladis, Elena & Marentette, Paula. (2011). Bilingual children’s gesture use. Gesture, 11  (3), 330–347. DOI logoGoogle Scholar
So, Wing C. (2010). Cross-cultural transfer in gesture frequency in Chinese-English bilinguals. Language & Cognitive Processes, 25  (10), 1335–1353. DOI logoGoogle Scholar
Stam, Gale. (2016). Gesture as a window onto conceptualization in multiple tasks: Implications for second language teaching. Yearbook of the German Cognitive Linguistics Association, 4  (1), 289–314. DOI logoGoogle Scholar
Wang, Shouren (王守仁). (2018). The application of China’s Standards of English Language Ability to college English teaching (中国英语能力等级量表在大学英语教学中的应用). Foreign Language Education (《外语教学》), 39  (4), 1–4. DOI logoGoogle Scholar
Willems, Roel M., Özyürek, Aslı, & Hagoort, Peter. (2007). When language meets action: The neural integration of gesture and speech. Cerebral Cortex, 17  (10), 2322–2333. DOI logoGoogle Scholar
Yuan, Fangyuan & Ellis, Rod. (2003). The effects of pre-task planning and on-line planning on fluency, complexity and accuracy in L2 monologic oral production. Applied Linguistics, 24  (1), 1–27. DOI logoGoogle Scholar