• Media type: E-Article; Text
  • Title: From Evaluating to Forecasting Performance: How to Turn Information Retrieval, Natural Language Processing and Recommender Systems into Predictive Sciences (Dagstuhl Perspectives Workshop 17442)
  • Contributor: Ferro, Nicola [Author]; Fuhr, Norbert [Author]; Grefenstette, Gregory [Author]; Konstan, Joseph A. [Author]; Castells, Pablo [Author]; Daly, Elizabeth M. [Author]; Declerck, Thierry [Author]; Ekstrand, Michael D. [Author]; Geyer, Werner [Author]; Gonzalo, Julio [Author]; Kuflik, Tsvi [Author]; Lindén, Krister [Author]; Magnini, Bernardo [Author]; Nie, Jian-Yun [Author]; Perego, Raffaele [Author]; Shapira, Bracha [Author]; Soboroff, Ian [Author]; Tintarev, Nava [Author]; Verspoor, Karin [Author]; Willemsen, Martijn C. [Author]; Zobel, Justin [Author]
  • imprint: Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2018
  • Language: English
  • DOI: https://doi.org/10.4230/DagMan.7.1.96
  • Keywords: Formal models ; Evaluation ; Information Systems ; User Interaction ; Simulation
  • Origination:
  • Footnote: Diese Datenquelle enthält auch Bestandsnachweise, die nicht zu einem Volltext führen.
  • Description: We describe the state-of-the-art in performance modeling and prediction for Information Retrieval (IR), Natural Language Processing (NLP) and Recommender Systems (RecSys) along with its shortcomings and strengths. We present a framework for further research, identifying five major problem areas: understanding measures, performance analysis, making underlying assumptions explicit, identifying application features determining performance, and the development of prediction models describing the relationship between assumptions, features and resulting performance.
  • Access State: Open Access