Wenhan

👋 I am a research scientist at Meta AI, working on natural language processing and deep learning. I have worked on a variety of NLP tasks, including information extraction (knowledge graphs), open-domain QA, retrieval and summarization. I am recently interested in building large language models that can handle long text sequences.

Prior to Meta, I got my Ph.D. from University of California, Santa Barbara in March, 2021 and my bachelor degree from University of Science and Technology of China in 2016.

[Resume]   Email: xwhan.cs@gmail.com

Publications

(Full publication list at Semantic Scholar or Google Scholar)

2022

  • Adapting Pretrained Text-to-Text Models for Long Text Sequences
    Wenhan Xiong, Anchit Gupta, Shubham Toshniwal, Yashar Mehdad, Wen-tau Yih
    Arxiv Preprint, [pdf] [code]

  • Bridging the Training-Inference Gap for Dense Phrase Retrieval
    Gyuwan Kim, Jinhyuk Lee, Barlas Oguz, Wenhan Xiong, Yizhe Zhang, Yashar Mehdad, William Yang Wang
    EMNLP 2022 Findings, [pdf]

  • Scrolls: Standardized comparison over long language sequences
    Uri Shaham, Elad Segal, Maor Ivgi, Avia Efrat, Ori Yoran, Adi Haviv, Ankit Gupta, Wenhan Xiong, Mor Geva, Jonathan Berant, Omer Levy
    EMNLP 2022, [pdf]

  • Boosted Dense Retriever
    Patrick Lewis, Barlas OÄŸuz, Wenhan Xiong, Fabio Petroni, Wen-tau Yih, Sebastian Riedel
    NAACL 2022, [pdf]

  • Simple Local Attentions Remain Competitive for Long-Context Tasks
    Wenhan Xiong, Barlas OÄŸuz, Anchit Gupta, Xilun Chen, Diana Liskovich, Omer Levy, Wen-tau Yih, Yashar Mehdad
    NAACL 2022, [pdf]

2021

  • Open-domain question-answering for COVID-19 and other emergent domains
    Sharon Levy, Kevin Mo, Wenhan Xiong, William Yang Wang
    EMNLP 2021 Demo , [pdf]

  • Zero-shot Fact Verification by Claim Generation
    Liangming Pan, Wenhu Chen, Wenhan Xiong, Min-Yen Kan, William Yang Wang
    ACL-IJCNLP 2021, [pdf]

  • Unsupervised multi-hop question answering by question generation
    Liangming Pan, Wenhu Chen, Wenhan Xiong, Min-Yen Kan, William Yang Wang
    NAACL 2021, [pdf]

  • "Progressively pretrained dense corpus index for open-domain question answering"
    Wenhan Xiong, Hong Wang, William Yang Wang
    EACL 2021 , [pdf]

  • Answering Complex Open-Domain Questions with Multi-Hop Dense Retrieval
    Wenhan Xiong*, Xiang Lorraine Li*, Srini Iyer, Jingfei Du, Patrick Lewis, William Yang Wang, Yashar Mehdad, Wen-tau Yih, Sebastian Riedel, Douwe Kiela, Barlas OÄŸuz
    ICLR 2021, [code] [pdf]

2020 and before

  • Hybridqa: A dataset of multi-hop question answering over tabular and textual data
    Wenhu Chen, Hanwen Zha, Zhiyu Chen, Wenhan Xiong, Hong Wang, William Wang
    EMNLP 2020 Findings, [pdf]

  • Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model
    Wenhan Xiong, Jingfe Du, William Yang Wang and Veselin Stoyanov
    ICLR 2020, [pdf]

  • Improving Question Answering over Incomplete KBs with Knowledge-Aware Reader
    Wenhan Xiong, Mo Yu, Shiyu Chang, Xiaoxiao Guo and William Yang Wang
    ACL 2019, short oral PDF. [code] [pdf]

  • TWEETQA: A Social Media Focused Question Answering Dataset
    Wenhan Xiong, Jiawei Wu, Vivek Kulkarni, Mo Yu, Shiyu Chang, Xiaoxiao Guo and William Yang Wang
    ACL 2019. [pdf]

  • Self-supervised learning for contextualized extractive summarization
    Hong Wang, Xin Wang, Wenhan Xiong, Mo Yu, Shiyu Chang, Xiaoxiao Guo and William Yang Wang
    ACL 2019. [pdf]

  • Imposing Label-Relational Inductive Bias for Extremely Fine-Grained Entity Typing
    Wenhan Xiong, Jiawei Wu, Deren Lei, Mo Yu, Shiyu Chang, Xiaoxiao Guo and William Yang Wang
    NAACL 2019. [pdf]

  • Sentence Embedding Alignment for Lifelong Relation Extraction
    Hong Wang, Wenhan Xiong, Mo Yu, Xiaoxiao Guo, Shiyu Chang and William Yang Wang
    NAACL 2019. [pdf]

  • Variational Knowledge Graph Reasoning
    Wenhu Chen, Wenhan Xiong, Xifeng Yan and William Yang Wang
    NAACL 2018. [pdf]

  • One-Shot Relational Learning for Knowledge Graphs
    Wenhan Xiong, Mo Yu, Shiyu Chang, Xiaoxiao Guo and William Yang Wang
    EMNLP 2018. [code] [pdf]

  • Look before you leap: Bridging model-free and model-based reinforcement learning for planned-ahead vision-and-language navigation
    Xin Wang*, Wenhan Xiong*, Hongmin Wang and William Yang Wang
    ECCV 2018. [pdf]

  • "DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoning"
    Wenhan Xiong, Thien Hoang and William Yang Wang
    EMNLP 2017, long oral [code] [pdf] [slides]


Services

Area Chair: EMNLP 2022
Session Chair: ACL 2021, NAACL 2021
Program committee/reviewer: ACL (2018,2019,2020,2021), EMNLP (2018,2019,2020,2021), NAACL (2019,2021), NeurIPS (2021), ICLR (2021), ACL ARR