TY - GEN
T1 - Energy-based Self-attentive Learning of Abstractive Communities for Spoken Language Understanding
AU - Shang, Guokan
AU - Tixier, Antoine J.P.
AU - Vazirgiannis, Michalis
AU - Lorré, Jean Pierre
N1 - Publisher Copyright:
© 2020 Association for Computational Linguistics.
PY - 2020/1/1
Y1 - 2020/1/1
N2 - Abstractive community detection is an important spoken language understanding task, whose goal is to group utterances in a conversation according to whether they can be jointly summarized by a common abstractive sentence. This paper provides a novel approach to this task. We first introduce a neural contextual utterance encoder featuring three types of self-attention mechanisms. We then train it using the siamese and triplet energy-based meta-architectures. Experiments on the AMI corpus show that our system outperforms multiple energy-based and non-energy based baselines from the state-of-the-art. Code and data are publicly available.
AB - Abstractive community detection is an important spoken language understanding task, whose goal is to group utterances in a conversation according to whether they can be jointly summarized by a common abstractive sentence. This paper provides a novel approach to this task. We first introduce a neural contextual utterance encoder featuring three types of self-attention mechanisms. We then train it using the siamese and triplet energy-based meta-architectures. Experiments on the AMI corpus show that our system outperforms multiple energy-based and non-energy based baselines from the state-of-the-art. Code and data are publicly available.
UR - https://www.scopus.com/pages/publications/105027221179
U2 - 10.18653/v1/2020.aacl-main.34
DO - 10.18653/v1/2020.aacl-main.34
M3 - Conference contribution
AN - SCOPUS:105027221179
T3 - Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, AACL-IJCNLP 2020
SP - 313
EP - 327
BT - Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, AACL-IJCNLP 2020
A2 - Wong, Kam-Fai
A2 - Knight, Kevin
A2 - Wu, Hua
PB - Association for Computational Linguistics (ACL)
T2 - 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, AACL-IJCNLP 2020
Y2 - 4 December 2020 through 7 December 2020
ER -