Towards Query Performance Prediction for Neural Information Retrieval: Challenges and Opportunities - Sorbonne Université
Conference Papers Year : 2023

Towards Query Performance Prediction for Neural Information Retrieval: Challenges and Opportunities

Abstract

In this work, we propose a novel framework to devise features that can be used by Query Performance Prediction (QPP) models for Neural Information Retrieval (NIR). Using the proposed framework as a periodic table of QPP components, practitioners can devise new predictors better suited for NIR. Through the framework, we detail what challenges and opportunities arise for QPPs at different stages of the NIR pipeline. We show the potential of the proposed framework by using it to devise two types of novel predictors. The first one, named MEMory-based QPP (MEM-QPP), exploits the similarity between test and train queries to measure how much a NIR system can memorize. The second adapts traditional QPPs into NIR-oriented ones by computing the query-corpus semantic similarity. By exploiting the inherent nature of NIR systems, the proposed predictors overcome, under various setups, the current State of the Art, highlighting-at the same time-the versatility of the framework in describing different types of QPPs. CCS CONCEPTS • Information systems → Evaluation of retrieval results.

Dates and versions

hal-04290247 , version 1 (21-02-2024)

Identifiers

Cite

Guglielmo Faggioli, Thibault Formal, Simon Lupart, Stefano Marchesin, Stephane Clinchant, et al.. Towards Query Performance Prediction for Neural Information Retrieval: Challenges and Opportunities. ICTIR '23: The 2023 ACM SIGIR International Conference on the Theory of Information Retrieval, Jul 2023, Taipei Taiwan, Taiwan. pp.51-63, ⟨10.1145/3578337.3605142⟩. ⟨hal-04290247⟩
27 View
11 Download

Altmetric

Share

More