| With the continuous development of Internet + education,online learning has become a popular way of learning for college students.Massive Open courses and online learning platforms provide college students with abundant learning resources and equal learning opportunities.Laptops and other Internet access devices are helpful for college students to carry out online learning,but at the same time,media-rich online learning environment is more likely to induce college students’ media multitasking behavior.Online learning for college students is often accompanied by media behaviors such as social media use,music listening and web browsing.This growing use of media has raised concerns about the effectiveness of online learning.In order to study the influence of media multitasking on online learning effect of college students and explore the internal mechanism of influencing the effect of media multitasking online learning.This study focuses on four questions: "How to evaluate the effect of media multitasking on online learning","What influence does media multitasking have on the effect of online learning","What will affect the effectiveness of media multitasking online learning" and "How do these factors affect the effect of media multitasking on online learning",and conducts experimental research.In this study,Collect multimodal data of college students during online learning through eye tracking technology,facial expression recognition technology,screen recording technology,questionnaire surveys,and knowledge testing.By comprehensively analyzing multimodal data,we uncover the cognitive,behavioral,and emotional patterns of media multitasking online learning,analyze the internal mechanisms that affect the effectiveness of media multitasking online learning,and provide empirical suggestions for college students’ online learning.In order to solve the above problems,this study conducted the following research work:using the literature research method to analyze the current research status of media multitasking and learning effectiveness research topics,and identify the shortcomings of existing research.Sort out relevant research on learning analysis using multimodal data,establish the corresponding relationship between learning indicators and multimodal data,and find a research basis and foothold for this study.Using experimental research methods,two experiments were designed and implemented.In Experiment 1,30 college students were selected,and the independent variable was the type of secondary task.Three experimental groups and a control group were set up to study the impact of secondary task types on online learning effectiveness and the internal mechanism.In Experiment 2,64 college students were selected to conduct a two-factor mixed experiment of 2(learning style: sequential type,comprehensive type)* 2(knowledge type: declarative knowledge,procedural knowledge),with learning style as an inter subject variable and knowledge type as an intra subject variable.To study the internal mechanism of the impact of learning style knowledge types on the effectiveness of media multitasking online learning.The dependent variables were learning engagement,cognitive load and attention.The study found that the secondary task of auditory dispersion does not affect the effect of online learning.When the secondary task is the visual dispersive task,it will have a negative impact on the effect of online learning,reduce the time invested in the learning task and reduce the understanding of knowledge.Research shows that not all media multitasking will have a negative impact on online learning.Media multitasking behavior has a negative impact on online learning through affecting visual information processing channels.Learning style has a significant effect on attention allocation and cognitive load of video resources,while knowledge type has a significant effect on attention allocation and cognitive load of video and text resources.Both learning style and knowledge type have significant influence on external load.The number of messages sent is negatively correlated with attention control.The research shows that college students with comprehensive learning style are more adaptable to media multitasking online learning,and college students are more suitable to learn procedural knowledge under this situation.At the end of the study,the author puts forward some suggestions for college students’ online learning,which can provide reference for improving the effect of college students’ online learning and promoting the development and application of media learning resources. |