Multimodality, the study of the interaction of language with other semiotic resources such as images and sound resources, has significant implications for computer assisted language learning (CALL) with regards to understanding the impact of digital environments on language teaching and learning. In this paper, we explore recent manifestations of CALL in 3-D virtual worlds, illustrated by the example of Second Life. The multimodal analyses of a conventional face-to-face lesson and three language learning activities in Second Life highlight some of the affordances and challenges presented by 3-D virtual environments. The results suggest that while multimodal resources integrate naturally to facilitate language teaching and learning in an orderly, structured and goal-orientated manner in classroom lessons, the often uncoordinated use (or absence) of avatars’ gaze, facial expression, body posture, gesture, as well as the unclear proxemics and use of space pose problems for effective communication in a 3-D virtual world. In addition, a “technology-oriented” register, alongside traditional instructional and regulative genres and registers, is introduced to help students cope with the demands of learning a language in a 3-D virtual environment. The study raises the issue of the relative effectiveness of 3-D virtual worlds for language teaching and learning. In doing so, a digital approach to multimodal research is proposed in order to address the complexity of multimodal learning environments and the various challenges for CALL.

Recent research indicates that Web 2.0 applications contribute to supporting a social constructivist approach for language learning. However, students encounter different types of barrier associated with technologies and learning tasks, which can cause disengagement during different phases of learning. Thus, based on flow theory and the strategic motivation framework, this study aims to investigate students’ motivation and their engagement patterns while participating in Web 2.0 digital storytelling activities. The participants are 24 elementary school students of a suburban school in northern Taiwan. Over 19 weeks of observations on students aged 9–10 years in a third-grade classroom, data were collected through three sources: surveys, students’ digital stories, and English tests. The analysis of the data showed that motivation was a dynamic process, initially low but increasing in later phases. A dynamic pattern was also identified in the students’ flow perceptions, which included two cycles of disengagement and reengagement. Students encountered different challenges that led to disengagement phases, which highlighted the need for specific types of learning support in elementary school contexts. In addition, the participants’ vocabulary and oral fluency were found to have been enhanced by the end of the study. The implications for educational practice are discussed and the direction for future studies addressed.

Qualitative research focusing primarily on advanced-proficiency second language (L2) learners suggests that online corpora can function as useful reference tools for language learners, especially when addressing phraseological issues. However, the feasibility and effectiveness of online corpus consultation for learners at a basic level of L2 proficiency have been relatively unexplored. The current study of Japanese-L1 (first language) learners in an EFL (English as a foreign language) context (N=117) addresses these gaps in research. A preliminary investigation (Experiment 1) examined EFL learners (n=78) as they used the Corpus of Contemporary American English (COCA: Davies, 2008–) to revise essays. Experiment 2 (n=39) used a within-subjects comparison to determine whether participants attained greater accuracy in supplying the missing word in a gap-fill test when using an electronic dictionary or COCA. The survey results from the two experiments revealed that participants generally found using an online corpus difficult. In Experiment 2, a paired-samples t-test showed that participants, at an alpha of p=.05 two-tailed, were marginally better able to answer test questions when using the online corpus than they were when using an electronic dictionary, p=0.030. The implications of the study within the context of previous research are discussed along with pedagogical recommendations and possible avenues for future research.

In this study of affordances for second language (L2) learning in World of Warcraft (WoW) group play, we compared three gameplay episodes spanning a semester-long course. Applying multimodal analysis framed by ecological, dialogical and distributed (EDD) views (Zheng and Newgarden, forthcoming), we explored four English as a second language learners’ verbalizations and avatar actions. Players learned to take skilled linguistic action as they coordinated recurrent WoW gameplay activities (questing, planning next moves, traveling, learning a skill, etc.). Frequent activities matched Common European Framework of Reference (CEFR) speaking proficiency descriptors, used widely in L2 teaching and learning (L2TL), providing evidence that players engaged in the types of communicative activities interaction-oriented classroom approaches develop. However, in the WoW context, interactions were not planned, but emerged as players dynamically directed the course of play. Furthermore, modalities of avatar-embodiment and conversing over Skype allowed players to flexibly integrate language and actions to co-act toward game goals, discuss non-game topics during play, or demonstrate comprehension with avatar actions alone, an affordance for less verbal players. This research builds on previous work (Zheng, Newgarden & Young, 2012) relating WoW’s multiplayer activities and L2 learners’ skilled linguistic actions. We refer to Chemero’s (2009) model of the animal-environment system to explain how L2 learners develop abilities to take skilled linguistic action by acting on affordances in WoW. The EDD framework presented may enable other researchers to account for more of the complexities involved in L2 learning in multimodal, multiplayer virtual environments.

Undergraduate students whose programme includes a full academic year on an Erasmus study visit require a range of support before, during and after their year abroad. This study focuses on the support provided by the home academic coordinator during the students’ period of study abroad. The research is based on a case-study which explores how the maintenance of an online journal can enhance students’ new learning experiences. The outcomes of this investigation are of interest at a pragmatic level to Erasmus coordinators and educational institutions whose programmes include a study visit or an internship. At a theoretical level, this study brings together a number of areas that have each been the subject of prior research but that so far have not been pulled together, particularly in the context of a study visit to a foreign country. The areas referred to include the benefits and challenges of rolling out educational online journals; the use of blogging in language learning; the design of rubrics as a form of feedback and the activity of reflective writing in an online environment. The findings and the discussion show how the online journal has added a positive dimension to the year abroad, particularly in the areas of communication and feedback, peer support, language learning and technology.

Lexis-based views of second or foreign language (L2) teaching place prime importance on the teaching of conventionalized multi-word lexical items, or unanalyzed chunks, as a useful mechanism for fostering learners’ creative production of forms and their subsequent development of L2 competence. This pretest/posttest quasi-experimental study probed the use of teacher-designed multi-purpose instructional lexis software, dubbed LexisBOARD, on L2 learners’ vocabulary achievement in an Iranian EFL (English as a foreign language) context. A cohort of 50 Iranian junior-high-school students participated in the main instructional phase of the study. Instruction on L2 lexical items (e.g., concordances, polywords, or formulaic sequences) was mainly given to the experimental group using LexisBOARD, which was designed to be user-friendly and attuned to learners’ communicative and curricular needs. LexisBOARD offered further practice or feedback affordances through engaging students in lexical exercises (with word partnerships and collocations) for each unit and several quizzes for self-assessment. The control group was only taught using their mainstream EFL textbooks focusing on grammatical rules, discrete vocabulary items with fixed meanings, and reading texts, without any use of corpus-based activities. The results of the groups’ vocabulary test scores indicate that the lexis group significantly outperformed the control group, pointing to the superiority of practicing and learning L2 vocabulary when lexical items are seen in larger, more holistic ways and, especially, when engaging and experimenting with lexis is scaffolded through computer affordances.

This paper introduces an open learner model approach to learning analytics to combine the variety of data available from the range of applications and technologies in language learning, for visualisation of language learning competences to learners and teachers in the European language context. Specific examples are provided as illustrations (Facebook, Second Life and mobile assisted language learning (MALL)), though the approach is a general one. We describe the Next-TELL open learner model as an exemplar that can encompass a range of data from a variety of technologies and activities, and as a competence-focussed visual analytics tool that can be readily used inside and outside the classroom.

The Next-TELL open learner model offers several visualisations for learners and teachers to explore the learner’s current competences, which can be selected according to user preferences or the purpose of viewing the learning data. The selection of visualisations means that the open learner model is appropriate for school, university and other learning contexts. Viewing this data can help students to reflect on and monitor their learning, and can support teachers’ decision-making during classroom activities or later, in their planning of subsequent sessions. As an example, we outline the use of the Next-TELL open learner model in a school in Norway.

Online language learning and teaching in multimodal contexts has been identified as one of the key research areas in computer-aided learning (CALL) (Lamy, 2013; White, 2014).1 This paper aims to explore meaning-making in online language learner interactions via desktop videoconferencing (DVC) and in doing so illustrate multimodal transcription and analysis as well as the application of theoretical frameworks from other fields. Recordings of learner DVC interactions and interviews are qualitatively analysed within a case study methodology. The analysis focuses on how semiotic resources available in DVC are used for meaning-making, drawing on semiotics, interactional sociolinguistics, nonverbal communication, multimodal interaction analysis and conversation analysis. The findings demonstrate the use of contextualization cues, five codes of the body, paralinguistic elements for emotional expression, gestures and overlapping speech in meaning-making. The paper concludes with recommendations for teachers and researchers using and investigating language learning and teaching in multimodal contexts.

Collaborative learning has attracted attention as pedagogic mediation to assist learners’ corpus consultation, but some studies have pointed to negative aspects of collaboration. Based on the two sides of collaboration in language learning, this study presents a qualitative investigation of different effects of collaboration depending on task types used in learners’ corpus consultation. This study examined two types of tasks: a conceptual task, which tested students’ competence to draw a generalizable conclusion through a meaning-making process of corpus consultation; and a procedural task, which asked students to complete problem-solving activities strategically through corpus analysis. Two groups of three students were given the same tasks of corpus consultation but asked to complete the tasks either collaboratively or individually. The students’ verbal and nonverbal behaviors during the task completion, pre-and post-interviews, and the instructor’s observation notes were the main sources of data for analysis. The results of this study showed that collaboration has significantly different effects depending on the task types of corpus consultation. The collaborative group (CG) outperformed the individual group (IG) in the conceptual corpus consultation task, but the procedural task was more efficiently completed by the IG than the CG. The underperformance of the CG in the procedural task seemed to be partly attributable to the role of established intersubjectivity and the power inequality in the CG. Despite some limitations, the findings of this study reveal task-dependent effects of collaboration in corpus consultation and suggest practical implications for more effective and pedagogically beneficial use of learners’ corpus consultation in second language (L2) instruction.

In webconferencing-supported teaching, the webcam mediates and organizes the pedagogical interaction. Previous research has provided a mixed picture of the use of the webcam: while it is seen as a useful medium to contribute to the personalization of the interlocutors’ relationship, help regulate interaction and facilitate learner comprehension and involvement, the limited access to visual cues provided by the webcam is felt to be useless or even disruptive.

This study examines the meaning-making potential of the webcam in pedagogical interactions from a semiotic perspective by exploring how trainee teachers use the affordances of the webcam to produce non-verbal cues that may be useful for mutual comprehension. The research context is a telecollaborative project where trainee teachers of French as a foreign language (FFL) met for online sessions in French with undergraduate Business students at an Irish university. Using multimodal transcriptions of the interaction data from these sessions, screen shot data, and students’ post-course interviews, it was found, firstly, that while a head and shoulders framing shot was favoured by the trainee teachers, there does not appear to be an optimal framing choice for desktop videoconferencing among the three framing types identified. Secondly, there was a loss between the number of gestures performed by the trainee teachers and those that were visible for the students. Thirdly, when trainee teachers were able to coordinate the audio and kinesic modalities, communicative gestures that were framed, and held long enough to be perceived by the learners, were more likely to be valuable for mutual comprehension.

The study highlights the need for trainee teachers to develop critical semiotic awareness to gain a better perception of the image they project of themselves in order to actualise the potential of the webcam and add more relief to their online teacher presence.

Despite the availability and growing use of digital story software for authoring and instructional purposes, little is known about learners’ perceptions on its integration in the foreign language writing class. Following both a social semiotics approach and activity theory, this study focuses on six advanced Spanish learners’ perceptions about the production of a digital story in which they integrated a variety of modes (written, oral, images, sounds) and manipulated the semiotic resources within each mode (size, color, lines in the image mode), to convey meaning. Analyzing participants’ reflections, questionnaires, and online journals, results highlight learners’ (a) interpretation of the tools and artifacts and their effect on their understanding of a final product, (b) connections between short-term goal-oriented actions and the longer-term object-oriented activity of developing a multimodal text, and (c) linguistic reorientations when creating a digital story.

Within the field of computer assisted language learning (CALL), scant literature exists regarding the effectiveness and practicality for secondary students to utilize data-driven learning (DDL) for vocabulary acquisition. In this study, there were 100 participants, who had a mean age of thirteen years, and were attending an international school in Ho Chi Minh City, Vietnam. This particular milieu unsurprisingly comprised ‘third culture kids’ (TCKs) and ‘cross-cultural kids’ (CCKs). They were assigned to a control and experimental group; both had several intensive weeks of online-dictionary learning training, while the experimental group also experienced intensive DDL training. This was done prior to the start of the eight-week longitudinal study. Major findings included a significant longitudinal main effect for both groups, significantly overall higher results for the experimental group than the control, and a significant difference among subjects’ grade level was discovered. Furthermore, the experimental group exhibited a significantly marked increase in vocabulary results in the later weeks of the experiment. In general, these results show that DDL can be successful in the secondary school English as a foreign language (EFL) context and that it promotes significantly better vocabulary acquisition when used in conjunction with online-dictionary vocabulary learning methods, especially for a sustained longitudinal period of time.

Despite a growing body of research on task-based language learning (TBLT) (Samuda & Bygate, 2008; Ellis, 2003), there is still little information available regarding the pedagogical design behind tasks and how they are implemented (Samuda & Bygate, 2008). Scholars in computer-mediated second language (L2) learning have called for research to fill in this gap by reflecting critically on task design and the subsequent implementation process (Fuchs, Hauck & Müller-Hartmann, 2012; Hampel, 2010; Hampel & Hauck, 2006; Hampel & Plaines, 2013; Hauck, 2010), instead of considering a task an “unproblematic fait accompli” (O’Dowd & Ware, 2009: 174). In response to this charge, the present case study provides a critical analysis of tasks carried out in a first-year German language course built around the weekly TV-series, Rosenheim-Cops (ZDF). These tasks drew from research on multimodality (Kress & van Leeuwen, 2001; Norris & Maier, 2014) providing a framework for understanding how multiple semiotic systems work together to create meaning. The insights provided by this study have relevance for research on multimodal task design (Hampel & Hauck, 2006) through examining the possibilities and limitations of beginner second language (L2) learners’ effective use of authentic resources. The results suggest that the tasks encouraged semiotic awareness, helped activate referential knowledge useful for accessing multimodal resources, and elicited a positive response to authentic L2 use in context. The challenges of implementing these tasks included variation in learners’ engagement with authentic multimedia resources, either due to L2 skills levels or the level of interest in the particular resource used.

This article presents the first study on using a parallel corpus to teach Cantonese, the variety of Chinese spoken in Hong Kong. We evaluated this approach with Mandarin-speaking undergraduate students at the beginner level. Exploiting their knowledge of Mandarin, a closely related language, the students studied Cantonese with authentic material in a Cantonese-Mandarin parallel corpus, transcribed from television programs. They were given a list of Mandarin words that yield a range of possible Cantonese translations, depending on the linguistic context. Leveraging sentence and word alignments in the parallel corpus, the students independently searched for example sentences to discover these translation equivalents. Experimental results showed that, in both the short- and long-term, this data-driven learning approach helped students improve their knowledge of Cantonese vocabulary. These results suggest the potential of applying parallel corpora at even the beginners’ level for other L1-L2 pairs of closely related languages.

It has been suggested that current research in computer-assisted language learning (CALL) should seek to understand the conditions and circumstances that govern students’ use of technology (Steel & Levy, 2013). This paper attempts to identify critical factors accounting for student choices, first, by investigating advanced learners’ reported use as well as their views on the potential of specific technological resources for language learning, and, second, by widening the perspective and surveying students’ ideal learning environments. Learners’ reasons for preferring teacher-fronted classes, blended learning, immersion or technology-mediated settings yield useful information on how students perceive the strengths and weaknesses of interaction/engagement with material (i.e. technological) as well as social (i.e. human) resources, and how the roles of teachers/classes can be conceptualised today.

Data was collected via a survey of 175 Austrian university students which included Likert-type ratings and free text responses to open questions. Findings indicate that though the cohort routinely use a wide range of technology tools in their everyday lives and show awareness of the potential of ICT for language learning, a number of barriers exist based on learner beliefs/conceptions and learning aims. Thus the notion that enhancement of communicative competence is intrinsically tied to personal interaction with native speakers means that the potential of communication technologies such as Skype is not fully appreciated. It was further established that though many students are well versed in blending different technological resources in line with the criteria identified, thus displaying the hallmarks of autonomous learners, there was a clear preference for real-life compared to virtual environments.

Research on data-driven learning (DDL), or teaching and learning languages with the help of electronic corpora, has shown that it is both effective and efficient. Nevertheless, DDL is still far from common pedagogical practice, not least because the empirical research on it is still limited and narrowly focused. This study addresses some gaps in that research by exploring the effectiveness of DDL for teaching low-proficiency learners lexico-grammatical constructions (verb-preposition collocations) in German, a morphologically rich language. The study employed a pretest-posttest design with intact third- and fourth-semester classes for German as a foreign language at a US university. The same collocations were taught to each group during one class period, with one group at each course level taking a paper-based DDL lesson with concordance lines from a native-speaker corpus and the other one taking a traditional rule-based lesson with textbook exercises. These constructions were new to third-semester students, whereas fourth-semester students had been exposed to them in the previous semester. The results show that, whereas the DDL method and the traditional method were both effective and resulted in lexical and grammatical gains, DDL was more effective for teaching new collocations. The study thus argues in favor of using paper-based DDL in the classroom at lower proficiency levels and for languages other than English.