Design and Implementation of a Natural Language Interface for Controlling the Web of Things Devices

Gui Z, Kuty L, Harth A (2024)

Publication Language: English

Publication Type: Conference contribution, Original article

Publication year: 2024

Series: A Springer Nature Computer Science book series (CCIS, LNAI, LNBI, LNBIP or LNCS)

Pages Range: 15

Conference Proceedings Title: Natural Language Processing and Information Systems

Event location: Turin, Italy. IT

Abstract

We present a systematic workflow for developing a Natural Language Interface (NLI) using Knowledge Graphs (KGs) and the Web of Things (WoT) specification as an abstraction layer. We first synthesize a data corpus from a given device interface description using manually created templates and parameter sheets. Then we paraphrase the synthesized data corpus with pre-trained Large Language Models (LLMs). The resulting corpus serves as training data for a text-to-code encoder- decoder neural network model, enabling the mapping of diverse natural language commands into an executable code format. To the best of our knowledge, no existing data corpus or NLI system has been tailored for WoT device interactions. Our work provides a baseline and can be ex- tended to a broader range of real world WoT use cases.

Authors with CRIS profile

Zhou Gui Lehrstuhl für Wirtschaftsinformatik, insbesondere Technische Informationssysteme Andreas Harth Lehrstuhl für Wirtschaftsinformatik, insbesondere Technische Informationssysteme

How to cite

APA:

Gui, Z., Kuty, L., & Harth, A. (2024). Design and Implementation of a Natural Language Interface for Controlling the Web of Things Devices. In Amon Rapp, Luigi Di Caro, Farid Meziane, Vijayan Sugumaran (Eds.), Natural Language Processing and Information Systems (pp. 15). Turin, Italy., IT.

MLA:

Gui, Zhou, Layla Kuty, and Andreas Harth. "Design and Implementation of a Natural Language Interface for Controlling the Web of Things Devices." Proceedings of the The 29th International Conference on Natural Language & Information Systems, Turin, Italy. Ed. Amon Rapp, Luigi Di Caro, Farid Meziane, Vijayan Sugumaran, 2024. 15.

BibTeX: Download