• Medientyp: Dissertation; E-Book; Elektronische Hochschulschrift; Sonstige Veröffentlichung
  • Titel: Automatic understanding of multimodal content for Web-based learning
  • Beteiligte: Otto, Christian Ralf [VerfasserIn]
  • Erschienen: Hannover : Institutionelles Repositorium der Gottfried Wilhelm Leibniz Unviersität Hannover, 2023
  • Ausgabe: published Version
  • Sprache: Deutsch
  • DOI: https://doi.org/10.15488/13887
  • Schlagwörter: knowledge gain prediction ; user study ; deep learning ; Natürliche Sprachverarbeitung ; semantic image-text relation ; multimodal information extraction ; Semantische Lücke ; Web-based learning ; Web-basiertes Lernen ; natural language processing ; Informelles Lernen ; semantic gap ; Vorhersage von Lernerfolg ; Semantische Bild-Text Relation ; Multimodale Informationsextraktion ; semantic image-text class ; Nutzerstudie ; informal learning
  • Entstehung:
  • Anmerkungen: Diese Datenquelle enthält auch Bestandsnachweise, die nicht zu einem Volltext führen.
  • Beschreibung: Web-based learning has become an integral part of everyday life for all ages and backgrounds. On the one hand, the advantages of this learning type, such as availability, accessibility, flexibility, and cost, are apparent. On the other hand, the oversupply of content can lead to learners struggling to find optimal resources efficiently. The interdisciplinary research field Search as Learning is concerned with the analysis and improvement of Web-based learning processes, both on the learner and the computer science side. So far, automatic approaches that assess and recommend learning resources in Search as Learning (SAL) focus on textual, resource, and behavioral features. However, these approaches commonly ignore multimodal aspects. This work addresses this research gap by proposing several approaches that address the question of how multimodal retrieval methods can help support learning on the Web. First, we evaluate whether textual metadata of the TIB AV-Portal can be exploited and enriched by semantic word embeddings to generate video recommendations and, in addition, a video summarization technique to improve exploratory search. Then we turn to the challenging task of knowledge gain prediction that estimates the potential learning success given a specific learning resource. We used data from two user studies for our approaches. The first one observes the knowledge gain when learning with videos in a Massive Open Online Course (MOOC) setting, while the second one provides an informal Web-based learning setting where the subjects have unrestricted access to the Internet. We then extend the purely textual features to include visual, audio, and cross-modal features for a holistic representation of learning resources. By correlating these features with the achieved knowledge gain, we can estimate the impact of a particular learning resource on learning success. We further investigate the influence of multimodal data on the learning process by examining how the combination of visual and textual content generally ...
  • Zugangsstatus: Freier Zugang
  • Rechte-/Nutzungshinweise: Namensnennung (CC BY)