About Me

I’m a Senior Rearcher at Microsoft. I received my Bachelor’s degree and Ph.D. from Tsinghua University in 2016 and 2021, respectively. My research interest includes Efficient LLM, Generative AI, and Information Extraction.

News

• [03/19/2024] We release LLMLingua-2, an efficient option for task-agnostic prompt compression with good performance and generalizability across different scenario, boasting a 3x-6x speed improvement over LLMLingua.
• [02/28/2024] LLMLingua Series has been added as a document compressor in LangChain.
• [10/26/2023] LLMLingua Series has been integrated into LlamaIndex.
• [10/10/2023] We release LongLLMLingua, aiming to accelerate and enhance LLM inference in long-context scenarios via question-aware prompt compression and content reorganization.
• [10/09/2023] We release LLMLingua, a coarse-to-fine prompt compression method based on perplexity from a small language model such as LLaMA-7B.

Recommended Repos

• LLMLingua Series for Prompt Compression
• Versatile Entity Recognition & disambiguation Toolkit

Selected Publications

• Zhoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin, Victor Rühle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang, LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression, Preprint.
• Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongshegn Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu, LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression, ME-FoMo Workshop, ICLR-2024.
• Tingting Ma, Qianhui Wu, Huiqiang Jiang, Jieru Lin, Börje Karlsson, Tiejun Zhao, Chin-Yew Lin, Decomposed Meta-Learning for Few-Shot Sequence Labeling, TASLP-2024.
• Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, Lili Qiu, LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models, EMNLP-2023.
• Qianhui Wu, Huiqiang Jiang, Haonan Yin, Börje Karlsson, Chin-Yew Lin, Multi-Level Knowledge Distillation for Out-of-Distribution Detection in Text, ACL-2023.
• Tingting Ma, Qianhui Wu, Huiqiang Jiang, Börje Karlsson, Tiejun Zhao, Chin-Yew Lin, CoLaDa: A Collaborative Label Denoising Framework for Cross-lingual Named Entity Recognition, ACL-2023.
• Tingting Ma* , Huiqiang Jiang* , Qianhui Wu*, Tiejun Zhao, Chin-Yew Lin, Decomposed Meta-Learning for Few-Shot Named Entity Recognition, ACL-2022 Findings.
• Tingting Ma, Qianhui Wu, Zhiwei Yu, Tiejun Zhao, Chin-Yew Lin, On the Effectiveness of Sentence Encoding for Intent Detection Meta-Learning, NAACL-2022.
• Yu Mo* , Qianhui Wu*, Xiu Li, Biqing Huang, Remaining Useful Life Estimation via Transformer Encoder Enhanced by a Gated Convolutional Unit, JIM-2021.
• Qianhui Wu, Zijia Lin, Börje Karlsson, Biqing Huang, Jian-Guang Lou, Unitrans: Unifying Model Transfer and Data Transfer for Cross-Lingual Named Entity Recognition with Unlabeled Data, IJCAI-2020.
• Qianhui Wu, Zijia Lin, Börje Karlsson, Jian-Guang Lou, Biqing Huang, Single-/Multi-Source Cross-Lingual NER via Teacher-Student Learning on Unlabeled Data in Target Language, ACL-2020.
• Qianhui Wu, Zijia Lin, Guoxin Wang, Hui Chen, Börje Karlsson, Biqing Huang, Chin-Yew Lin, Enhanced Meta-Learning for Cross-Lingual Named Entity Recognition with Minimal Resources, AAAI-2020.
• Qianhui Wu* , Guoxin Wang*, Yuyin Zhu, Haoyan Liu, Börje Karlsson, DeepMRT at the NTCIR-14 FinNum task: a hybrid neural model for numeral type classification in financial tweets, NTCIR-2019.
• Qianhui Wu, Keqin Ding, Biqing Huang, Approach for Fault Prognosis Using Recurrent Neural Network, JIM-2018.

Honors & Awards

• Microsoft 2023 Global Hackathon Award Winner (2023)
• Outstanding Intern of “Stars of Tomorrow” Program, Microsoft Research Asia (2020)
• Intel Scholarship (2020)
• Second Place Winner of NTCIR-2019 FinNum Task (2019)
• Second-Class Scholarship, Tsinghua University (2018)
• Outstanding (12-9) Counselor Prize, Tsinghua University (2018)
• Outstanding Bachelor Thesis, Tsinghua University (2016)
• Second Prize of Challenge Cup, Tsinghua University (2015)
• National Encouragement Scholarship (2014)
• Scholarship of Art Excellence, Tsinghua University (2014)
• Scholarship of Academic Excellence, Tsinghua University (2013)

Other Information

Academic Service

• Conference Reviewer: ACL, EMNLP, NAACL, AAAI.
• Journal Reviewer: TASLP, JIM.

Other Activities

• Counselor at Center for Student Learning and Development, Tsinghua University (Sep. 2016 - Aug. 2018)
• Member of Chinese National Orchestra, Tsinghua University (Aug. 2012 - Jun. 2021)