UKP-SQUARE: An Online Platform for Question Answering Research
Baumgärtner T, Wang K, Sachdeva R, Eichler M, Geigle G, Poth C, Sterz H, Puerto H, Ribeiro LF, Pfeiffer J, Reimers N, Sahin GG, Gurevych I (2022)
Publication Type: Conference contribution
Publication year: 2022
Publisher: Association for Computational Linguistics (ACL)
Pages Range: 9-22
Conference Proceedings Title: Proceedings of the Annual Meeting of the Association for Computational Linguistics
Event location: Dublin, IRL
ISBN: 9781955917247
DOI: 10.18653/v1/2022.acl-demo.2
Abstract
Recent advances in NLP and information retrieval have given rise to a diverse set of question answering tasks that are of different formats (e.g., extractive, abstractive), require different model architectures (e.g., generative, discriminative), and setups (e.g., with or without retrieval). Despite having a large number of powerful, specialized QA pipelines (which we refer to as Skills) that consider a single domain, model or setup, there exists no framework where users can easily explore and compare such pipelines and can extend them according to their needs. To address this issue, we present UKP-SQUARE, an extensible online QA platform for researchers which allows users to query and analyze a large collection of modern Skills via a user-friendly web interface and integrated behavioural tests. In addition, QA researchers can develop, manage, and share their custom Skills using our microservices that support a wide range of models (Transformers, Adapters, ONNX), data-stores and retrieval techniques (e.g., sparse and dense). UKP-SQUARE is available on https://square.ukp-lab.de.1
Involved external institutions
Technische Universität Darmstadt
Germany (DE)
Hugging Face
United States (USA) (US)
Koç-Universität (KU)
Turkey (TR)
Germany (DE)
Hugging Face
United States (USA) (US)
Koç-Universität (KU)
Turkey (TR)
How to cite
APA:
Baumgärtner, T., Wang, K., Sachdeva, R., Eichler, M., Geigle, G., Poth, C.,... Gurevych, I. (2022). UKP-SQUARE: An Online Platform for Question Answering Research. In Valerio Basile, Zornitsa Kozareva, Sanja Stajner (Eds.), Proceedings of the Annual Meeting of the Association for Computational Linguistics (pp. 9-22). Dublin, IRL: Association for Computational Linguistics (ACL).
MLA:
Baumgärtner, Tim, et al. "UKP-SQUARE: An Online Platform for Question Answering Research." Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, ACL 2022 - System Demonstrations, Dublin, IRL Ed. Valerio Basile, Zornitsa Kozareva, Sanja Stajner, Association for Computational Linguistics (ACL), 2022. 9-22.
BibTeX: Download