Apr 27, 2021 · In this paper, we systematically meta-evaluate a variety of conversational search metrics. We specifically study three perspectives on those metrics.
Sep 1, 2021 · In this article, we systematically meta-evaluate a variety of conversational search metrics. We specifically study three perspectives on those ...
Meta-evaluation of Conversational Search Evaluation Metrics
www.semanticscholar.org › paper › Meta...
This work establishes the most comprehensive meta-evaluation for conversational search metrics considering all three perspectives, and proves that adapted ...
In this article, we systematically meta-evaluate a variety of conversational search metrics. We specifically study three perspectives on those metrics.
Oct 22, 2024 · In this article, we systematically meta-evaluate a variety of conversational search metrics. We specifically study three perspectives on those ...
This page is a summary of: Meta-evaluation of Conversational Search Evaluation Metrics , ACM Transactions on Information Systems, October 2021, ACM (Association ...
METEOR is, comparatively speaking, the best existing single-turn metric considering all three perspectives. We also demonstrate that adapted session-based ...
METEOR is, comparatively speaking, the best existing single-turn metric considering all three perspectives. We also demonstrate that adapted session-based ...
People also ask
What is meta-evaluation criteria?
What are the evaluation metrics?
What is evaluation metrics in NLP?
What is the meta-evaluation process?
Meta-evaluation of Conversational Search Evaluation Metrics. Zeyang Liu, Ke Zhou, Max L. Wilson. Anthology ID: DBLP:journals/tois/LiuZW21; Volume: 2021 Volume ...
Firstly, we initiate the work by reviewing several representative metrics and engaging in a meta-evaluation of these metrics in conversational search scenarios.