Open Access System for Information Sharing

Login Library

 

Article
Cited 37 time in webofscience Cited 58 time in scopus
Metadata Downloads

Data-driven user simulation for automated evaluation of spoken dialog systems SCIE SCOPUS

Title
Data-driven user simulation for automated evaluation of spoken dialog systems
Authors
Sangkeun JungCheongjae LeeKyungduk KimMinwoo JeongLee, GG
Date Issued
2009-10
Publisher
ACADEMIC PRESS LTD ELSEVIER SCIENCE LTD
Abstract
This paper proposes a novel integrated dialog simulation technique for evaluating spoken dialog systems. A data-driven user simulation technique for simulating user intention and utterance is introduced. A novel user intention modeling and generating method is proposed that uses a linear-chain conditional random field, and a two-phase data-driven domain-specific user utterance Simulation method and a linguistic knowledge-based ASR channel simulation method are also presented. Evaluation metrics are introduced to measure the quality of user simulation at intention and utterance. Experiments using these techniques were carried out to evaluate the performance and behavior of dialog systems designed for car navigation dialogs and a building guide robot, and it turned out that Our approach was easy to set tip and showed similar tendencies to real human users. (C) 2009 Elsevier Ltd. All rights reserved.
Keywords
User simulation; Dialog simulation; Evaluation; Data-driven; Spoken dialog system; Dialog system
URI
https://oasis.postech.ac.kr/handle/2014.oak/27750
DOI
10.1016/J.CSL.2009.03.002
ISSN
0885-2308
Article Type
Article
Citation
COMPUTER SPEECH AND LANGUAGE, vol. 23, no. 4, page. 479 - 509, 2009-10
Files in This Item:
There are no files associated with this item.

qr_code

  • mendeley

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Related Researcher

Views & Downloads

Browse