Proxy Indicators for the Quality of Open-domain Dialogues

Authors: Rostislav Nedelchev, Jens Lehmann 0001, Ricardo Usbeck

Year: 2021

Conference: EMNLP 2021

Abstract: The automatic evaluation of open-domain dialogues remains a largely unsolved challenge. Despite the abundance of work done in the field, human judges have to evaluate dialogues’ quality. As a consequence, performing such evaluations at scale is usually expensive. This work investigates using a deep-learning model trained on the General Language Understanding Evaluation (GLUE) benchmark to serve as a quality indication of open-domain dialogues. The aim is to use the various GLUE tasks as different perspectives on judging the quality of conversation, thus reducing the need for additional training data or responses that serve as quality references. Due to this nature, the method can infer various quality metrics and can derive a component-based overall score. We achieve statistically significant correlation coefficients of up to 0.7.

Show BibTeX
@inproceedings{DBLP:conf/emnlp/Nedelchev0U21,
  author       = {Rostislav Nedelchev and
                  Jens Lehmann and
                  Ricardo Usbeck},
  editor       = {Marie{-}Francine Moens and
                  Xuanjing Huang and
                  Lucia Specia and
                  Scott Wen{-}tau Yih},
  title        = {Proxy Indicators for the Quality of Open-domain Dialogues},
  booktitle    = {Proceedings of the 2021 Conference on Empirical Methods in Natural
                  Language Processing, {EMNLP} 2021, Virtual Event / Punta Cana, Dominican
                  Republic, 7-11 November, 2021},
  pages        = {7834--7855},
  publisher    = {Association for Computational Linguistics},
  year         = {2021},
  url          = {https://doi.org/10.18653/v1/2021.emnlp-main.618},
  doi          = {10.18653/V1/2021.EMNLP-MAIN.618},
  timestamp    = {Fri, 16 Feb 2024 08:27:36 +0100},
  biburl       = {https://dblp.org/rec/conf/emnlp/Nedelchev0U21.bib},
  bibsource    = {dblp computer science bibliography, https://dblp.org}
}