👋 I am a research scientist at Meta AI, working on natural language processing and deep learning. I have worked on a variety of NLP tasks, including information extraction (knowledge graphs), open-domain QA, retrieval and summarization. I am recently interested in building large language models that can handle long text sequences.
Prior to Meta, I got my Ph.D. from University of California, Santa
Barbara
in March, 2021 and my bachelor degree from University of Science and Technology of China in 2016.
Publications
(Full publication list at Semantic Scholar or Google Scholar)2022
- Adapting Pretrained Text-to-Text Models for Long Text Sequences
Wenhan Xiong, Anchit Gupta, Shubham Toshniwal, Yashar Mehdad, Wen-tau Yih
Arxiv Preprint, [pdf] [code] - Bridging the Training-Inference Gap for Dense Phrase Retrieval
Gyuwan Kim, Jinhyuk Lee, Barlas Oguz, Wenhan Xiong, Yizhe Zhang, Yashar Mehdad, William Yang Wang
EMNLP 2022 Findings, [pdf] - Scrolls: Standardized comparison over long language sequences
Uri Shaham, Elad Segal, Maor Ivgi, Avia Efrat, Ori Yoran, Adi Haviv, Ankit Gupta, Wenhan Xiong, Mor Geva, Jonathan Berant, Omer Levy
EMNLP 2022, [pdf] - Boosted Dense Retriever
Patrick Lewis, Barlas OÄŸuz, Wenhan Xiong, Fabio Petroni, Wen-tau Yih, Sebastian Riedel
NAACL 2022, [pdf] - Simple Local Attentions Remain Competitive for Long-Context Tasks
Wenhan Xiong, Barlas OÄŸuz, Anchit Gupta, Xilun Chen, Diana Liskovich, Omer Levy, Wen-tau Yih, Yashar Mehdad
NAACL 2022, [pdf]
2021
- Open-domain question-answering for COVID-19 and other emergent domains
Sharon Levy, Kevin Mo, Wenhan Xiong, William Yang Wang
EMNLP 2021 Demo , [pdf] - Zero-shot Fact Verification by Claim Generation
Liangming Pan, Wenhu Chen, Wenhan Xiong, Min-Yen Kan, William Yang Wang
ACL-IJCNLP 2021, [pdf] - Unsupervised multi-hop question answering by question generation
Liangming Pan, Wenhu Chen, Wenhan Xiong, Min-Yen Kan, William Yang Wang
NAACL 2021, [pdf] - "Progressively pretrained dense corpus index for open-domain question answering"
Wenhan Xiong, Hong Wang, William Yang Wang
EACL 2021 , [pdf] - Answering Complex Open-Domain Questions with Multi-Hop Dense Retrieval
Wenhan Xiong*, Xiang Lorraine Li*, Srini Iyer, Jingfei Du, Patrick Lewis, William Yang Wang, Yashar Mehdad, Wen-tau Yih, Sebastian Riedel, Douwe Kiela, Barlas OÄŸuz
ICLR 2021, [code] [pdf]
2020 and before
- Hybridqa: A dataset of multi-hop question answering over tabular and textual data
Wenhu Chen, Hanwen Zha, Zhiyu Chen, Wenhan Xiong, Hong Wang, William Wang
EMNLP 2020 Findings, [pdf] - Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model
Wenhan Xiong, Jingfe Du, William Yang Wang and Veselin Stoyanov
ICLR 2020, [pdf] - Improving Question Answering over Incomplete KBs with Knowledge-Aware Reader
Wenhan Xiong, Mo Yu, Shiyu Chang, Xiaoxiao Guo and William Yang Wang
ACL 2019, short oral PDF. [code] [pdf] - TWEETQA: A Social Media Focused Question Answering Dataset
Wenhan Xiong, Jiawei Wu, Vivek Kulkarni, Mo Yu, Shiyu Chang, Xiaoxiao Guo and William Yang Wang
ACL 2019. [pdf] - Self-supervised learning for contextualized extractive summarization
Hong Wang, Xin Wang, Wenhan Xiong, Mo Yu, Shiyu Chang, Xiaoxiao Guo and William Yang Wang
ACL 2019. [pdf] - Imposing Label-Relational Inductive Bias for Extremely Fine-Grained Entity Typing
Wenhan Xiong, Jiawei Wu, Deren Lei, Mo Yu, Shiyu Chang, Xiaoxiao Guo and William Yang Wang
NAACL 2019. [pdf] - Sentence Embedding Alignment for Lifelong Relation Extraction
Hong Wang, Wenhan Xiong, Mo Yu, Xiaoxiao Guo, Shiyu Chang and William Yang Wang
NAACL 2019. [pdf] - Variational Knowledge Graph Reasoning
Wenhu Chen, Wenhan Xiong, Xifeng Yan and William Yang Wang
NAACL 2018. [pdf] - One-Shot Relational Learning for Knowledge Graphs
Wenhan Xiong, Mo Yu, Shiyu Chang, Xiaoxiao Guo and William Yang Wang
EMNLP 2018. [code] [pdf] - Look before you leap: Bridging model-free and model-based reinforcement learning for planned-ahead vision-and-language navigation
Xin Wang*, Wenhan Xiong*, Hongmin Wang and William Yang Wang
ECCV 2018. [pdf] - "DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoning"
Wenhan Xiong, Thien Hoang and William Yang Wang
EMNLP 2017, long oral [code] [pdf] [slides]