Predicting Knowledge Gain During Web Search Based on Multimedia Resource Consumption

verfasst von

Christian Otto, Ran Yu, Georg Pardi, Johannes Von Hoyer, Markus Rokicki, Anett Hoppe, Peter Holtz, Yvonne Kammerer, Stefan Dietze, Ralph Ewerth

Abstract

In informal learning scenarios the popularity of multimedia content, such as video tutorials or lectures, has significantly increased. Yet, the users’ interactions, navigation behavior, and consequently learning outcome, have not been researched extensively. Related work in this field, also called search as learning, has focused on behavioral or text resource features to predict learning outcome and knowledge gain. In this paper, we investigate whether we can exploit features representing multimedia resource consumption to predict the knowledge gain (KG) during Web search from in-session data, that is without prior knowledge about the learner. For this purpose, we suggest a set of multimedia features related to image and video consumption. Our feature extraction is evaluated in a lab study with 113 participants where we collected data for a given search as learning task on the formation of thunderstorms and lightning. We automatically analyze the monitored log data and utilize state-of-the-art computer vision methods to extract features about the seen multimedia resources. Experimental results demonstrate that multimedia features can improve KG prediction. Finally, we provide an analysis on feature importance (text and multimedia) for KG prediction.

Organisationseinheit(en)

Forschungszentrum L3S

Externe Organisation(en)

Technische Informationsbibliothek (TIB) Leibniz-Informationszentrum Technik und Naturwissenschaften und Universitätsbibliothek
GESIS - Leibniz-Institut für Sozialwissenschaften
Leibniz-Institut für Wissensmedien (IWM)

Typ

Aufsatz in Konferenzband

Band

1

Seiten

318-330

Anzahl der Seiten

13

Publikationsdatum

11.06.2021

Publikationsstatus

Veröffentlicht

Peer-reviewed

Ja

ASJC Scopus Sachgebiete

Theoretische Informatik, Informatik (insg.)

Elektronische Version(en)

https://arxiv.org/abs/2106.06244 (Zugang: Offen)
https://doi.org/10.1007/978-3-030-78292-4_26 (Zugang: Geschlossen)