Publications of TJUNLP Lab
[ publications ranging from 2018 to 2023 ]

    2023
  1. Zhiyuan Zeng, Deyi Xiong. SCoMoE: Efficient Mixtures of Experts with Structured Communication. ICLR 2023.
  2. Wuwei Huang，Renren Jin，Wen Zhang，Jian Luan，Bin Wang，Deyi Xiong. Joint Training and Decoding for Multilingual End-to-End Simultaneous Speech Translation. ICASSP 2023.
  3. Zhiyuan Zeng and Deyi Xiong. Unsupervised and Few-Shot Parsing from Pretrained Language Models (Extended Abstract). Accepted at the journal track of the 32nd International Joint Conference on Artificial Intelligence (IJCAI-2023).
  4. Shaolin Zhu, Shangjie Li, Yikun Lei and Deyi Xiong. PEIT: Bridging the Modality Gap with Pre-trained Models for End-to-End Image Translation. ACL 2023.
  5. Yuqi Ren and Deyi Xiong. HuaSLIM: Human Attention Motivated Shortcut Learning Identification and Mitigation for Language models. Findings of ACL 2023.
  6. Yikun Lei, Zhengshan Xue, Xiaohu Zhao, Haoran Sun, Shaolin Zhu, Xiaodong Lin and Deyi Xiong. CKDST: Comprehensively and Effectively Distill Knowledge from Machine Translation to End-to-End Speech Translation. Findings of ACL 2023.
  7. Mehrad Moradshahi, Tianhao Shen, Kalika Bali, Monojit Choudhury, Gael de Chalendar, Anmol Goel, Sungkyun Kim, Prashant Kodali, Ponnurangam Kumaraguru, Nasredine Semmar, Sina Semnani, Jiwon Seo, Vivek Seshadri, Manish Shrivastava, Michael Sun, Aditya Yadavalli, Chaobin You, Deyi Xiong and Monica Lam. X-RiSAWOZ: High-Quality End-to-End Multilingual Dialogue Datasets and Few-shot Agents. Findings of ACL 2023.
  8. Chuang Liu, Junzhuo Li and Deyi Xiong. Tab-CQA: A Tabular Conversational Question Answering Dataset on Financial Reports. ACL 2023 Industry Track.
  9. Hang Zhou, Xiaoxu Zheng, Yunhe Wang, Michael Mi, Deyi Xiong, Kai Han. GhostRNN: Reducing State Redundancy in RNN with Cheap Operations. INTERSPEECH 2023.

    10. 2022
  10. Yuqi Ren, Deyi Xiong. Bridging between Cognitive Processing Signals and Linguistic Features via a Unified Attentional Network. AAAI 2022
  11. Zhiyuan Zeng, Deyi Xiong. Unsupervised and Few-Shot Parsing from Pretrained Language Models. Artificial Intelligence, 103665
  12. Erguang Yang, Mingtong Liu, Deyi Xiong, Yujie Zhang, Yao Meng, Jinan Xu, Yufeng Chen. Improving Generation Diversity via Syntax-Controlled Paraphrasing. Neurocomputing 2022
  13. Dexin Wang, Kai Fan, Boxing Chen, Deyi Xiong. Efficient Cluster-based k-Nearest-Neighbor Machine Translation. ACL 2022
  14. Yifei Luo, Minghui Xu, Deyi Xiong. CogTaskonomy: Cognitively Inspired Task Taxonomy Is Beneficial to Transfer Learning in NLP. ACL 2022
  15. Junzhuo Li and Deyi Xiong. KaFSP: Knowledge-Aware Fuzzy Semantic Parsing for Conversational Question Answering over a Large-Scale Knowledge Base. ACL 2022
  16. Linjuan Wu, Shaojuan Wu, Xiaowang Zhang, Deyi Xiong, Shizhan Chen, Zhiqiang Zhuang, Zhiyong Feng. Learning Disentangled Semantic Representations for Zero-Shot Cross-Lingual Transfer in Multilingual Machine Reading Comprehension. ACL 2022
  17. Xinwei Wu, Li Gong, Deyi Xiong. Adaptive Differential Privacy for Language Model Training. FL4NLP@ACL 2022
  18. Erguang Yang, Chenglin Bai, Deyi Xiong, Yujie Zhang, Yao Meng, Jinan Xu, Yufeng Chen. Learning Structural Information for Syntax-Controlled Paraphrase Generation. NAACL 2022
  19. Wenjie Hao, Hongfei Xu, Deyi Xiong, Hongying Zan and Lingling Mu. ParaZh-22M: A Large-Scale Chinese Parabank via Machine Translation. COLING 2022
  20. Yikun Lei, Yuqi Ren and Deyi Xiong. CoDoNMT: Modeling Cohesion Devices for Document-Level Neural Machine Translation. COLING 2022
  21. Renren Jin and Deyi Xiong. Informative Language Representation Learning for Massively Multilingual Neural Machine Translation. COLING 2022
  22. Haoran Sun and Deyi Xiong. Language Branch Gated Multilingual Neural Machine Translation. COLING 2022
  23. Huibin Ge, Xiaohu Zhao, Chuang Liu, Yulong Zeng, Qun Liu, Deyi Xiong. TGEA 2.0: A Large-Scale Diagnostically Annotated Dataset with Benchmark Tasks for Text Generation of Pretrained Language Models. NeurIPS 2022 Datasets and Benchmarks
  24. Sebastian Gehrmann, Abhik Bhattacharjee, Abinaya Mahendiran, Alex Wang, Alexandros Papangelis, Aman Madaan, Angelina McMillan-Major, Anna Shvets, Ashish Upadhyay, Bernd Bohnet, Bingsheng Yao, Bryan Wilie, Chandra Bhagavatula, Craig Thomson, Cristina Garbacea, Dakuo Wang, Daniel Deutsch, Deyi Xiong, Di Jin, Dimitra Gkatzia, Dragomir Radev, Elizabeth Clark, Esin Durmus, Faisal Ladhak, Filip Ginter, Genta Indra Winata, Hendrik Strobelt, Hiroaki Hayashi, Jekaterina Novikova, Jenna Kanerva, Jenny Chim, Jiawei Zhou, João Sedoc, Jordan Clive, Joshua Maynez, Juraj Juraska, Kaustubh Dhole, Khyathi Raghavi Chandu, Laura Perez-Beltrachini, Leonardo F. R. Ribeiro, Lewis Tunstall, Li Zhang, Mahima Pushkarna, Mathias Creutz, Michael White, Mihir Kale, Moussa Kamal Eddine, Nico Daheim, Nishant Subramani, Ondřej Dušek, Paul Pu Liang, Pawan Sasanka Ammanamanchi, Qi Zhu, Ratish Puduppully, Reno Kriz, Rifat Shahriyar, Ronald Ahmed Cardenas, Saad Mahamood, Salomey Osei, Samuel Cahyawijaya, Sanja Stajner, Sebastien Montella, Shailza Jolly, Simon Mille, Tahmid Hasan, Tianhao Shen, Tosin Adewumi, Vikas Raunak, Vipul Raheja, Vitaly Nikolaev, Vivian Tsai, Yacine Jernite, Ying Xu, Yisi Sang, Yixin Liu and Yufang Hou. GEMv2: Multilingual NLG Benchmarking in a Single Line of Code. EMNLP 2022 Demo
  25. Qian Cao, Deyi Xiong, Qinlong Wang and Xia Peng. CoCoID: Learning Contrastive Representations and Compact Clusters for Semi-Supervised Intent Discovery. EMNLP 2022 industry track
  26. Tianhao Shen, Mingtong Liu, Ming Zhou and Deyi Xiong. Recovering Gold from Black Sand: Multilingual Dense Passage Retrieval with Hard and False Negative Samples. EMNLP 2022
  27. Erguang Yang, Mingtong Liu, Deyi Xiong, YUJIE ZHANG, Yufeng Chen and Jinan Xu. Long Text Generation with Topic-aware Discrete Latent Variable Model. EMNLP 2022
  28. Jiazuo Qiu and Deyi Xiong. Generating Questions for Abstractive Answers with a Multi-Channel Fusion Encoder-Decoder Model. IALP 2022
  29. Haoran Sun, Yikun Lei and Deyi Xiong. Multilingual Neural Machine Transliteration with Adaptive Segmentation Schemes. IALP 2022
  30. Shuaibo Wang, Yufeng Chen, Songming Zhang, Deyi Xiong and Jinan Xu. Adversarially Improving NMT Robustness to ASR Errors with Confusion Sets. AACL 2022
  31. Jie He, Wanqiu Long and Deyi Xiong. Evaluating Discourse Cohesion in Pre-trained Language Models. CODI 2022

    32. 2021
  32. Erguang Yang, Mingtong Liu, Deyi Xiong, YUJIE ZHANG, Yao Meng, Changjian Hu, Jinan Xu and Yufeng Chen. Syntactically-Informed UnsupervisedParaphrasing with Non-Parallel Data. Accepted by EMNLP2021.
  33. Huibin Ge, Chenxi Sun, Deyi Xiong and Qun Liu. Chinese WPLC: A Chinese Dataset for Evaluating Pretrained Language Models on Word Prediction Given Long-Range Context. Accepted by EMNLP2021.
  34. Jiachen Tian, Shizhan Chen, Xiaowang Zhang, Zhiyong Feng, Deyi Xiong, Shaojuan Wu and Chunliu Dou. Difficult Samples Re-embedding via Mutual Information Constrained Semantically Oversampling. Accepted by EMNLP2021.
  35. Hongfei Xu, Qiuhui Liu, Josef van Genabith and Deyi Xiong. Learning Hard Retrieval Decoder Attention for Transformers. Accepted by Findings of EMNLP 2021.
  36. Tao Wang, Chengqi Zhao, Mingxuan Wang, Lei Li, Hang Li, Deyi Xiong. Secoco: Self-Correcting Encoding for Neural Machine Translation. Accepted by Findings of EMNLP 2021.
  37. Shiqi Zhang, Yan Liu, Deyi Xiong, Pei Zhang, Boxing Chen. Domain-Aware Self-Attention for Multi-Domain Neural Machine Translation. Accepted by INTERSPEECH2021.
  38. Yuqi Ren and Deyi Xiong. CogAlign: Learning to Align Textual Neural Representations to Cognitive Signals. Accepted by ACL 2021.
  39. Jie He, Bo Peng, Yi Liao, Qun Liu and Deyi Xiong. TGError: An Error-Annotated Dataset and Benchmark Tasks for Text Generation from Pretrained Language Models. Accepted by ACL 2021.
  40. Hongfei Xu, Qiuhui Liu, Josef van Genabith, Deyi Xiong and Meng Zhang. Multi-Head Highly Parallelized LSTM Decoder for Neural Machine Translation. Accepted by ACL 2021.
  41. Hongfei Xu, Qiuhui Liu, Josef van Genabith and Deyi Xiong. Modeling Task-Aware MIMO Cardinality for Efficient Multilingual Neural Machine Translation. Accepted by ACL 2021.
  42. Zhiyuan Zeng and Deyi Xiong. An Empirical Study on Adversarial Attack on NMT: Languages and Positions Matter. Accepted by ACL 2021.
  43. Kaiyu Huang, Junpeng Liu, Degen Huang, Deyi Xiong, Zhuang Liu and Jinsong Su. Exploiting Chinese Word Segmentation via Pseudo Labels for Practicability. Accepted by Findings of ACL 2021.
  44. Wuwei Huang, Dexin Wang and Deyi Xiong. AdaST: Dynamically Adapting Encoder States in the Decoder forEnd-to-End Speech-to-Text Translation. Accepted by Findings of ACL 2021.
  45. Dexin Wang and Deyi Xiong. Efficient Object-Level Visual Context Modeling for Multimodal Machine Translation: Masking Irrelevant Objects Helps Grounding. Accepted by AAAI 2021.
  46. Jun Quan, Meng Yang, Qiang Gan, Deyi Xiong et. al. Integrating Pre-trained Models into Rule-based Dialogue Management. Accepted by AAAI 2021.
  47. Hongfei Xu, Josef van Genabith, Qiuhui Liu, Deyi Xiong. Probing Word Translations in the Transformer and Trading Decoder for Encoder Layers. Accepted by NAACL 2021.
  48. Tao Wang, Chengqi Zhao, Mingxuan Wang, Lei Li and Deyi Xiong. Auto Correcting in the Process of Translation --- Multi-task Learning Improves Dialogue Machine Translation. Accepted by NAACL 2021.
  49. Wenjie Qin, Xiang Li, Yuhui Sun, Deyi Xiong, Jianwei Cui, Bin Wang. Modeling Homophone Noise for Robust Neural Machine Translation. Accepted by ICASSP 2021.
  50. Jinsong Su, Jialong Tang, Hui Jiang, Ziyao Lu, Yubin Ge, Linfeng Song, Deyi Xiong, Le Sun, Jiebo Luo. Enhanced aspect-based sentiment analysis models with progressive self-supervised attention learning. Accepted by Artificial Intelligence. 2021.

    51. 2020
  51. Xu Cao, Deyi Xiong, Chongyang Shi, Chao Wang, Yao Meng and Changjian Hu. Balanced Joint Adversarial Training for Robust Intent Detection and Slot Filling. Accepted by COLING 2020.
  52. Mingtong Liu, Erguang Yang, Deyi Xiong, Yujie Zhang, Yao Meng, Changjian Hu, Jinan Xu and Yufeng Chen. A Learning-Exploring Method to Generate Diverse Paraphrases with Multi-Objective Deep Reinforcement Learning. Accepted by COLING 2020.
  53. Yufang Huang, Wentao Zhu, Deyi Xiong, Yiye Zhang, Changjian Hu and Feiyu Xu. Cycle-Consistent Adversarial Autoencoders for Unsupervised Text Style Transfer. Accepted by COLING 2020.
  54. Jun Quan, Shian Zhang, Qian Cao, Zizhong Li, and Deyi Xiong. RiSAWOZ: A Large-Scale Multi-Domain Wizard-of-Oz Dataset with Rich Semantic Annotations for Task-Oriented Dialogue Modeling. Accepted by EMNLP 2020.
  55. Wanqiu Long, Bonnie Webber and Deyi Xiong. TED-CDB: A Large-Scale Chinese Discourse Relation Dataset on TED Talks. Accepted by EMNLP 2020.
  56. Jie He, Tao Wang, Deyi Xiong and Qun Liu. The Box is in the Pen: Evaluating Commonsense Reasoning in Neural Machine Translation. Accepted by Findings of EMNLP 2020.
  57. Hongfei Xu, Josef van Genabith, Deyi Xiong, Qiuhui Liu, Jingyi Zhang. Learning Source Phrase Representations for Neural Machine Translation. Accepted by ACL 2020.
  58. Hongfei Xu, Qiuhui Liu, Josef van Genabith, Deyi Xiong, Jingyi Zhang. Lipschitz Constrained Parameter Initialization for Deep Transformers. Accepted by ACL 2020.
  59. Hongfei Xu, Josef van Genabith, Deyi Xiong, Qiuhui Liu. Dynamically Adjusting Transformer Batch Size by Monitoring Gradient Direction Change. Accepted by ACL 2020.
  60. Jun Quan and Deyi Xiong. Modeling Long Context for Task-Oriented Dialogue State Generation. Accepted by ACL 2020.
  61. Hongfei Xu, Josef van Genabith, Deyi Xiong, Qiuhui Liu. Efficient Context-Aware Neural Machine Translation with Layer-Wise Weighting and Input-Aware Gating. Accepted by IJCAI- PRICAI 2020.
  62. Mingtong Liu, Erguang Yang, Deyi Xiong, Yujie Zhang, Chen Sheng, Changjian Hu, Jinan Xu, Yufeng Chen. Exploring Bilingual Parallel Corpora for Syntactically Controllable Paraphrase Generation. Accepted by IJCAI- PRICAI 2020.
  63. Biao Zhang, Deyi Xiong, Jun Xie, Jinsong Su. Neural Machine Translation With GRU-Gated Attention Model. Accepted by IEEE Transactions on Neural Networks and Learning Systems. 2020. DOI: 10.1109/TNNLS.2019.2957276. [pdf]
  64. Qian Cao, Shaohui Kuang and Deyi Xiong. Learning to Reuse Translations: Guiding Neural Machine Translation with Examples. Accepted by ECAI 2020. [pdf]
  65. Pei Zhang, Xu Zhang, Wei Chen, Jian Yu, Yanfeng Wang and Deyi Xiong. Learning Contextualized Sentence Representations for Document-Level Neural Machine Translation. Accepted by ECAI 2020.
  66. Wanqiu Long, Xinyi Cai, James E.M.Reid, Bonnie Webber and Deyi Xiong. Shallow Discourse Annotation for Chinese TED Talks. Accepted by LREC 2020. [pdf] [dataset]

    67. 2019
  67. Jiazuo Qiu, Deyi Xiong. "Generating Highly Relevant Questions" Accepted by EMNLP 2019. [pdf]
  68. Jun Quan, Deyi Xiong, Bonnie Webber and Changjian Hu. "GECOR: An End-to-End Generative Ellipsis and Co-reference Resolution Model for Task-Oriented Dialogue" Accepted by EMNLP 2019. Long Paper. [pdf]
  69. Jun Quan, Deyi Xiong. "Effective Data Augmentation Approaches to End-to-End Task-Oriented Dialogue" Accepted by IALP 2019. [pdf]
  70. Yimin Jing, Deyi Xiong, Yan Zhen "BiPaR: A Bilingual Parallel Dataset for Multilingual and Cross-lingual Reading Comprehension on Novels" Accepted as a long paper at EMNLP 2019 [pdf] [code]
  71. Xin Tan, Longyin Zhang, Deyi Xiong and Guodong Zhou. "Hierarchical Modeling of Global Context for Document-Level Neural Machine Translation" Accepted by EMNLP 2019. [pdf]
  72. Xin Tan, Shaohui Kuang, Deyi Xiong "Detecting and Translating Dropped Pronouns in Neural Machine Translation" Accepted by NLPCC 2019. [pdf]
  73. Biao Zhang, Deyi Xiong, Jinsong Su, Jiebo Luo "Future-Aware Knowledge Distillation for Neural Machine Translation" Accepted by IEEE/ACM Transactions on Audio, Speech, and Language Processing 2019. [pdf]
  74. Rodrigo Pereira dos Santos, João M. N. Silva, António Branco, Deyi Xiong "The Direct Path May Not Be The Best: Portuguese-Chinese Neural Machine Translation" Accepted by EPIA 2019. [pdf]

    75. 2018
  75. Cao Q, Xiong D. "Encoding gated translation memory into neural machine translation" [C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing 2018. [pdf]
  76. Biao Zhang, Deyi Xiong, Jinsong Su. 2018. "Neural Machine Translation with Deep Attention" Accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence. [pdf]
  77. Biao Zhang, Deyi Xiong, Jinsong Su, Yue Qin. 2018. "Alignment-Supervised Bidimensional Attention-Based Recursive Autoencoders for Bilingual Phrase Representation" Accepted by IEEE transactions on cybernetics. [pdf]
  78. Jinsong Su, Biao Zhang, Deyi Xiong, Yang Liu, Min Zhang. 2018. "Alignment-consistent recursive neural networks for bilingual phrase embeddings" Accepted by Knowledge-Based Systems. [pdf]
  79. Jinsong Su, Jiali Zeng, Deyi Xiong, Yang Liu, Mingxuan Wang and Jun Xie. "A Hierarchy-to-Sequence Attentional Neural Machine Translation Model" Accepted by IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP) 2018. [pdf]
  80. Deyi XIONG, Junhui LI, Xing WANG and Biao ZHANG. "Neural machine translation with constraints" Accepted by SCIENTIA SINICA Informationis. [pdf]
  81. Biao Zhang, Deyi Xiong, jinsong su and Qian Lin. "Simplifying Neural Machine Translation with Addition-Subtraction Twin-Gated Recurrent Networks" Accepted by EMNLP 2018. [pdf]
  82. Qian Cao and Deyi Xiong. "Encoding Gated Translation Memory into Neural Machine Translation" Accepted by EMNLP 2018. [pdf]
  83. Mingxuan Wang, Jun Xie, Zhixing Tan, Jinsong Su, Deyi Xiong and Chao Bian. "Neural Machine Translation with Decoding History Enhanced Attention" Accepted by COLING 2018. [pdf]
  84. Shiqi Zhang and Deyi Xiong. "Sentence Weighting for Neural Machine Translation Domain Adaptation" Accepted by COLING 2018. [pdf]
  85. Shaohui Kuang, Weihua Luo, Guodong Zhou and Deyi Xiong. "Modeling Coherence for Neural Machine Translation with Dynamic and Topic Caches" Accepted by COLING 2018. [pdf]
  86. Shaohui Kuang and Deyi Xiong. "Fusing Recency into Neural Machine Translation with an Inter-Sentence Gate Model" Accepted by COLING 2018. [pdf]
  87. Biao Zhang, Deyi Xiong and Jinsong Su. "Accelerating Neural Transformer via an Average Attention Network" Accepted by ACL 2018. [pdf]
  88. Shaohui Kuang, Junhui Li, António Branco, Weihua Luo and Deyi Xiong. "Attention Focusing for Neural Machine Translation by Bridging Source and Target Embeddings" Accepted by ACL 2018. [pdf]
  89. Jinsong Su, Shan Wu, Deyi Xiong, Yaojie Lu, Xianpei Han, Biao Zhang. "Variational Recurrent Neural Machine Translation". Accepted by AAAI 2018. [pdf]
  90. Zhiwei Ruan, Jinsong Su, Deyi Xiong, Rongrong Ji. "Context-Aware Phrase Representation for Statistical Machine Translations". Accepted by Pacific Rim International Conference on Artificial Intelligence 2018. [pdf]