Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-848d4c4894-2xdlg Total loading time: 0 Render date: 2024-06-30T16:39:56.014Z Has data issue: false hasContentIssue false

10 - Creation and Analysis of the Multimedia Russian Corpus for Gesture Research

from Part II - Ways of Approaching Gesture Analysis

Published online by Cambridge University Press:  01 May 2024

By
Ekaterina Rakhilina  and
Alan Cienki
Edited by
Alan Cienki
Alan Cienki
Affiliation:
Vrije Universiteit, Amsterdam
Get access

Summary

The chapter considers gesture studies in relation to corpus linguistic work. The focus is on the Multimedia Russian Corpus (MURCO), part of the Russian National Corpus. The chapter includes a brief biography of the creator of this corpus, Elena Grishina. The compilation of the corpus out of a set of Russian classic feature films and recorded lectures is described as well as the methods of annotating it in detail. The gesture coding is not limited to manual/hand gestures, but also includes head gestures and use of eye gaze. The chapter considers the findings from the corpus, and reported in Grishina’s posthumously published volume on Russian gestures from a linguistic point of view. The categories include pointing gestures, representational gestures, auxiliary (discourse-structuring) gestures, and several cross-cutting categories, including gestures in relation to pragmatics and to grammatical categories, like verbal aspect. Additional consideration is given to other video corpora in English (and other languages) which are being used for gesture research, namely the UCLA NewsScape library being managed by the Red Hen Lab and the Television Archive.

Keywords

Grishinacorpus linguisticsRussiangrammarhead gesturespointingdeicticrepresentational gesturespragmaticsfilm
Type
Chapter
Information
The Cambridge Handbook of Gesture Studies , pp. 249 - 272
Publisher: Cambridge University Press
Print publication year: 2024

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Bressem, J. (2013). A linguistic perspective on the notation of form features in gestures. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Teßendorf, S. (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 1, pp. 1079–1098). Berlin, Germany: De Gruyter Mouton.Google Scholar
Bressem, J., & Müller, C. (2014a). The family of Away gestures: Negation, refusal, and negative assessment. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Bressem, J. (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 2, pp. 1592–1604). Berlin, Germany: De Gruyter Mouton.Google Scholar
Bressem, J., & Müller, C. (2014b). A repertoire of recurrent gestures of German. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Bressem, J. (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 2, pp. 1575–1591). Berlin, Germany: De Gruyter Mouton.Google Scholar
Calbris, G. (2011). Elements of meaning in gesture. Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Cienki, A. (2013). Cognitive linguistics: Spoken language and gesture as expressions of conceptualization. In Müller, C., Cienki, A., Ladewig, S., McNeill, D., & Teßendorf, S. (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 1, pp. 182–201). Berlin, the Netherlands: Mouton de Gruyter.Google Scholar
Clark, H. H. (2003). Pointing and place. In Kita, S. (Ed.), Pointing: Where language, culture, and cognition meet (pp. 243–268). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Fedorova, O. V. (2018). O russkoj zhestikuljacii s lingvisticheskoj tochki zrenija (k vykhodu monografii E. A. Grishinoj) [Russian gestures from a linguistic perspective (dedicated to the publication of Elena A. Grishina’s monograph)]. Voprosy Jazykoznanija [Issues in Linguistics], 5, 114–123. https://doi.org/10.31857/S0373658X0001400-9CrossRefGoogle Scholar
Goodwin, C. (1981). Conversational organization: Interaction between speakers and hearers. New York, NY: Academic Press.Google Scholar
Grishina, E. A. (2017). Russkaja zhestikuljacija s lingvisticheskoj tochki zrenija: Korpusnye issledovania [Russian gesticulation from a linguistic point of view: Corpus studies]. Moscow, Russia: Languages of Slavic Culture.Google Scholar
Gullberg, M. (2011). Thinking, speaking and gesturing about motion in more than one language. In Pavlenko, A. (Ed.), Thinking and speaking in two languages (pp. 143–169). Bristol, UK: Multilingual Matters.CrossRefGoogle Scholar
Hassemer, J., & McCleary, L. (2018). The multidimensionality of pointing. Gesture, 17(3), 417–463. https://doi.org/10.1075/gest.17018.hasCrossRefGoogle Scholar
Iosad, P., Koptjevskaja-Tamm, M., Piperski, A., & Sitchinava, D. (2018). Depth, brilliance, clarity: Andrey Anatolyevich Zaliznyak (1935–2017). Linguistic Typology, 22(1), 175–184. https://doi.org/10.1515/lingty-2018-0006CrossRefGoogle Scholar
Kemmerer, D., Chandrasekaran, B., & Tranel, D. (2007). A case of impaired verbalization but preserved gesticulation of motion events. Cognitive Neuropsychology, 24(1), 70–114. https://doi.org/10.1080/02643290600926667CrossRefGoogle ScholarPubMed
Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Kendon, A., & Versante, L. (2003). Pointing by hand in “Neapolitan”. In Kita, S. (Ed.), Pointing: Where language, culture and cognition meet (pp. 109–137). Mahwah, NJ: Lawrence Erlbaum.Google Scholar
Kita, S., & Özyürek, A. 2003. What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48(1), 16–32. https://doi.org/10.1016/S0749-596X(02)00505-3CrossRefGoogle Scholar
Loehr, D. (2007). Aspects of rhythm in gesture and speech. Gesture, 7(2), 179–214. https://doi.org/10.1075/gest.7.2.04loeCrossRefGoogle Scholar
McNeill, D., Cassell, J., & Levy, E. T. (1993). Abstract deixis. Semiotica, 95(1/2), 5–19. https://doi.org/10.1515/semi.1993.95.1-2.5CrossRefGoogle Scholar
McNeill, D., & Levy, E. T. (1993). Cohesion and gesture. Discourse Processes, 16, 363–386. https://doi.org/10.1080/01638539309544845CrossRefGoogle Scholar
Mittelberg, I. (2010). Geometric and image-schematic patterns in gesture space. In Evans, V. & Chilton, P. (Eds.), Language, cognition and space: The state of the art and new directions (pp. 351–385). London, UK: Equinox.Google Scholar
Müller, C. (2004). Forms and uses of the Palm Up Open Hand. A case of a gesture family? In Müller, C. & Posner, R. (Eds.), Semantics and pragmatics of everyday gestures (pp. 233–256). Berlin, Germany: Weidler Verlag.Google Scholar
Özyürek, A., Kita, S., Allen, S., Furman, R., & Brown, A. (2005). How does linguistic framing of events influence co-speech gestures? Insights from crosslinguistic variations and similarities. Gesture, 5(1/2), 219–240. https://doi.org/10.1075/gest.5.1.15ozyCrossRefGoogle Scholar
Prozorova, E. V. (2009). Markery lokal’noj struktury diskursa v russkom zhestovom jazyke [Markers of local discourse structure in Russian Sign Language]. (Unpublished doctoral dissertation). Lomonosov Moscow State University.Google Scholar
Rakhilina, E. V., Bychkova, P. A., & Zhukova, S. Ju. (2021). Rechevye akty kak lingvisticheskaja kategorija. Diskursivnye formuly [Speech acts as a linguistic category: Discursive formulas]. Voprosy Jazykoznanija [Issues in Linguistics], 2, 7–27.CrossRefGoogle Scholar
Savchuk, S., & Makhova, A. (2021). Multimodal Russian Corpus and its use in emotional studies. Russian Journal of Communication, 13(1), 42–61. https://doi.org/10.1080/19409419.2021.1887991CrossRefGoogle Scholar
Stelma, J. H., & Cameron, L. J. (2007). Intonation units in spoken interaction: Developing transcription skills. Text and Talk, 27(3), 361–393. https://doi.org/10.1515/TEXT.2007.015CrossRefGoogle Scholar
Wiemann, J. M., & Knapp, M. L. (1975). Turn-taking in conversations. Journal of Communication, 25(2), 75–92.CrossRefGoogle Scholar
Winter, B., Perlman, M., & Matlock, T. (2013). Using space to talk and gesture about numbers: Evidence from the TV News Archive. Gesture, 13(3), 377–408. https://doi.org/10.1075/gest.13.3.06winCrossRefGoogle Scholar
Zaliznjak, A. A. (2004). Drevnenovgorodskij dialekt [The Old Novgorod dialect]. Moscow, Russia: Languages of Slavic Culture.Google Scholar
Zaliznjak, A. A. (2010). Trudy po akcentologii. Tom I. [Works on accentology. Volume 1]. Moscow, Russia: Languages of Slavic Culture.Google Scholar
Zaliznjak, A. A. (2011). Trudy po akcentologii. T. II: Drevnerusskij i starovelikorusskij akcentologicheskij slovar’-ukazatel’ (XIV–XVII vv) [Works on accentology. Volume 2: Old Russian and Old Great Russian accentual dictionary-catalogue (14th–17th C.)]. Moscow, Russia: Languages of Slavic Culture.Google Scholar
Zima, E., & Bergs, A. (2017). Special issue: Towards a multimodal construction grammar. Linguistics Vanguard, 3(s1). https://www.degruyter.com/journal/key/lingvan/3/s1/htmlCrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×