Interactive Dialogue Learning
PI: 蔡宗翰教授, CoPI: 李宏毅老師
計畫簡介：
本團隊以「智慧工廠」為主旨，設計一任務輔助機器人(helper bot)，在使用者組裝機器人(Meccanoid2.0)的過程中給予協助，針對使用者提出之組裝問題提供操作指示。我們將組裝任務切分為多個步驟，組裝過程中透過影像辨識判斷使用者正在組裝之步驟，當使用者發問時，除了分析使用者的問句，也透過影像辨識得知使用者組裝步驟，針對該步驟可能發生之問題提出相對應解答，以期幫助使用者解決組裝難題。
Members
Publications
C. Tsai, H. Lee, "Order-Free Learning Alleviating Exposure Bias in Multi-Label Classification", Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 04, Apr. 2020, pp. 6038-6045.
Y. Chen et al., "Audio Word2vec: Sequence-to-Sequence Autoencoding for Unsupervised Learning of Audio Segmentation and Representation", IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 27, no. 9, 2019, pp. 1481-1493.
C. Wan, S. Chuang and H. Lee, "Towards Audio to Scene Image Synthesis Using Generative Adversarial Network", in ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 496-500.
R. T. Tsai et al., "Using Deep-Q Network to Select Candidates from N-best Speech Recognition Hypotheses for Enhancing Dialogue State Tracking", in ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 7375-7379.
C. Lee, Y. Chen and H. Lee, "Mitigating the Impact of Speech Recognition Errors on Spoken Question Answering by Adversarial Domain Adaptation", in ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 7300-7304.
A. H. Liu, H. Lee and L. Lee, "Adversarial Training of End-to-end Speech Recognition Using a Criticizing Language Model", in ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 6176-6180.
C. Tsai, H. Lee, "Adversarial Learning of Label Dependency: A Novel Framework for Multi-class Classification", in ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3847-3851.
T. Sung et al., "Towards End-to-end Speech-to-text Translation with Two-pass Decoding", in ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 7175-7179.
H. Lee et al., "Interactive Spoken Content Retrieval by Deep Reinforcement Learning", IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 26, no. 12, 2018, pp. 2447-2459.
S. Weng et al., "Question Retrieval with Distributed Representations and Participant Reputation in Community Question Answering", in Proceedings of the 29th Conference on Computational Linguistics and Speech Processing (ROCLING 2017), Taipei, Taiwan: The Association for Computational Linguistics and Chinese Language Processing (ACLCLP), pp. 148–148.
National Central University
