I am a second-year Master’s student in the Wangxuan Institute of Computer Technology at Peking University. My advisor is Prof. Xiaojun Wan. My current research interest revolves around human-centered NLP, especially the evaluation of summarization and text generation. For NLG Evaluation, I am interested in automatic evaluation, human evaluation, human-AI collaboration, and reproducibility. Previously, I obtained my Bachelor’s degree in the School of Electronics Engineering and Computer Science at Peking University.

Recent News

• 2024-05: One paper is accepted to ACL 2024.
• 2024-02: A survey paper on LLM-based NLG evaluation.
• 2023-05: Two papers are accepted to ACL 2023 (one at main conference, one at findings).

Preprints

• LLM-based NLG Evaluation: Current Status and Challenges
  Mingqi Gao*, Xinyu Hu*, Jie Ruan, Xiao Pu, Xiaojun Wan
  arXiv:2402.01383 [pdf]

• Human-like Summarization Evaluation with ChatGPT
  Mingqi Gao, Jie Ruan, Renliang Sun, Xunjian Yin, Shiping Yang, Xiaojun Wan
  arXiv:2304.02554 [pdf]

Selected Publications

• Are LLM-based Evaluators Confusing NLG Quality Criteria?
  Xinyu Hu*, Mingqi Gao*, Sen Hu, Yang Zhang, Yicheng Chen, Teng Xu, Xiaojun Wan
  ACL 2024 (to appear) [pdf]

• Is Summary Useful or Not? An Extrinsic Human Evaluation of Text Summaries on Downstream Tasks
  Xiao Pu, Mingqi Gao, Xiaojun Wan
  LREC-COLING 2024 (to appear) [pdf]

• Better than Random: Reliable NLG Human Evaluation with Constrained Active Sampling
  Jie Ruan, Xiao Pu, Mingqi Gao, Xiaojun Wan, Yuesheng Zhu
  AAAI 2024 [pdf]

• Reference Matters: Benchmarking Factual Error Correction for Dialogue Summarization with Fine-grained Evaluation Framework
  Mingqi Gao, Xiaojun Wan, Jia Su, Zhefeng Wang, Baoxing Huai
  ACL 2023 [pdf] [code]

• Evaluating Factuality in Cross-lingual Summarization
  Mingqi Gao*, Wenqing Wang*, Xiaojun Wan, Yuemei Xu
  Findings of ACL 2023 [pdf] [code]

• DialSummEval: Revisiting Summarization Evaluation for Dialogues
  Mingqi Gao, Xiaojun Wan
  NAACL 2022 [pdf] [code]

Academic Services

Served as a reviewer for:

• Conferences: AAAI-2023, EMNLP-2023, ACL Rolling Review 2023 and 2024.
• Workshops: HumEval @ RANLP 2023, LLMAgents @ ICLR 2024.