News
- I served or will serve as a senior area chair for NeurIPS 2026, an area chair for AAAI 2026, ICLR 2026, and ICML 2026, and a reviewer for AAMAS 2026.
- March, 2026 - Our research proposal is accepted by the Amazon Research Award!
- March, 2026 - Our research proposal is accepted by COVA CCI.
- March, 2026 - Our research proposal is accepted by the NVIDIA Research Grant Program.
- January, 2026 - Invited lecture at
Spoon Colearning,
on "Reinforcement Learning for Large Language Models: From Fine-Tuning to Auxiliary Policy Models".
- December, 2025 - Invited keynote talk at
The 3rd International Conference on AI-generated Content (AIGC 2025),
on "Auxiliary Policy Models (APMs):Training Auxiliary Models to Steer LLMs with Light-Weight Reinforcement Learning".
- November, 2025 - Our paper "Speculative Sampling with Reinforcement Learning" is accepted at AAAI 2026.
- October, 2025 - Our paper "SWEET: Large Language Model Benchmark for Scalable Diabetes Patient Education"
is accepted/presented at The Diabetes Technology Meeting (DTM), 2025.
This is a joint work with Stanford University, UCSF, UC-Berkeley, and the Diabetes Technology Society.
- August, 2025 - Our paper "Dynamic Retriever for In-Context Knowledge Editing via Policy Optimization" is accepted at the EMNLP 2025 main conference.
- August, 2025 - Excited to receive an NSF NAIRR computation award to support our research on developing a Text-to-SQL system for automatic database querying.
- August, 2025 - Our short paper "AutoRuleSQL: Hybrid Text-to-SQL via Rule-Driven Fast Paths and LLM Bootstrapping"
is accepted by CIKM 2025 Industrial Day Talk track.
- April, 2025 - Very excited and grateful to receive a two-year grant from William & Mary Applied Research and Innovation Initiative.
The fund will be used to continue our collaborative project among our D^3i Lab,
Ignite Lab, and IIC,
on the theme of "A Data-Driven Decision Intelligence Approach To Enhance Community and Environmental Health Resilience in Kenya".
Load More
- 2025 - This year, I have served as an area chair for ICML and NeurIPS (Dataset & Benchmark Track), Senior PC member for AAAI and IJCAI,
and reviewer for Science, Science Advances, and Journal of Diabetes Science and Technology, ICLR, and RLC.
- April, 2025 - Invited to give a talk on "Learning to Optimize in Networks" at the Math Department, William & Mary.
- February, 2025 - Our work on AI and child vaccine demand analytics in Narok, Kenya is covered in
W&M Alumni Magzine. This is a collaborative work with W&M
Ignite Lab and IIC.
- January, 2025 - Two papers are accepted by ICLR 2025. Congratulations to our interns Xinsong and Yuheng!
- December, 2024 - Our paper "Population Aware Diffusion for Time Series Generation" is accepted by AAAI 2025.
Congratulations to Yang on his first paper!
- November, 2024 - I am honored to be appointed as the vice chair of the
AI Blue Ribbon Collaborative at Center for Telehealth and eHealth Law (CTeL).
- October, 2024 - Our paper "RESTful-Llama: Connecting User Queries to RESTful APIs" is accepted by EMNLP 2024 Industry track.
- October, 2024 - Our paper "Focused ReAct: Improving ReAct through Reiterate and Early Stop" is accepted by the WiNLP workshop at EMNLP 2024.
- July, 2024 - Our paper "SpeCoder: Towards Faster and Personalized Code Generation" is accepted by CIKM 2024 Industry Day track.
- August, 2024 - Attending the wonderful Reinforcement Learning Conference in Amherst, MA.
- June, 2024 - Excited and grateful to receive the National Science Foundation (NSF) CRII award!
The award will support our Data-Driven Decision Intelligence (D3i) Lab to develop reinforcement learning-based algorithms for solving
combinatorial optimization in societal domains such as health, environment, and more.
[Link]
- May, 2024 - Excited and grateful to be selected as one of the 35 projects of the NSF NAIRR Pilot program for the computational resources support!
Check out the announcement.
- May, 2024 - Chenan and Han are joining us as PhD students in the Fall!! Welcome!!
- April, 2024 - Our paper "Decentralized Online Learning in General-Sum Stackelberg Games" is accepted by UAI 2024.
Congratulations Yaolong for his first paper! Yaolong is the first student of D3i lab (as an undergrad research intern).
- 2024 - This year, I served or will serve as area chair for NeurIPS, Senior Program Committee member for AAAI and IJCAI,
and reviewer for ICLR and ICML.
- March, 2024 - We received an exploratory grant from the William & Mary Applied Research and Innovation Initiative.
The fund will be used to establish a collaborative project among D3i,
Ignite Lab, and IIC,
on the theme of "A Data-Driven Decision Intelligence Approach to Enhance Community and Environmental Health Resilience in Kenya".
- February, 2024 - We have signed a collaborative contract with
Generated Health. We will be working on using Generative AI and Reinforcement Learning for their Florence Medical ChatBot system.
Check out the press releases by GH and
W&M.
- February, 2024 - Our paper "Can Speculative Sampling Accelerate ReAct Without Compromising Reasoning Quality?"
is accepted by ICLR 2024 Tiny Papers track.
- January, 2024 - Our paper "S^2AC: Energy-Based Reinforcement Learning with Stein Soft Actor Critic" is accepted by ICLR 2024!
[OpenReview]
[Code]
- January, 2024 - I am giving an invited talk at Southeast University (virtual), China, on the theme of
"AI for Population Health: Learning and Optimization in Network and Combinatorial Spaces."
- November, 2023 - I am giving a tutorial on reinforcement learning at The 2023 annual workshop on Artificial Intelligence for
the Electron Ion Collider (AI4EIC-2023). [Slides]
- November, 2023 - Our paper "S^2AC: Energy-Based Reinforcement Learning with Stein Soft Actor Critic" is accepted by
the Foundation Models for Decision Making Workshop at NeurIPS 2023.
- August, 2023 - I am organizing the Workshop on Reinforcement Learning
in the Real World at AIGC 2023 (08/26).
The theme of this year is Reinforcement Learning for Large Language Models (LLM).
[Workshop site]
- [Call for abstracts] I am organizing a session on Reinforcement Learning Meets Combinatorial Optimization session at INFORMS 2023 this year (in Arizona).
If your work is related, please consider submitting an abstract to me at hchen23@wm.edu. Deadline is 05/02/2023.
- April, 2023 - Our paper "Complex Contagion Influence Maximization: A Reinforcement Learning Approach" is accepted by IJCAI 2023.
- March, 2023 - Session proposal "Reinforcement Learning Meets Combinatorial Optimization"
is accepted by INFORMS 2023 (Phoenix, AZ) AI Cluster.
- February, 2023 - Paper "Predicting Micronutrient Deficiency with Publicly Available Satellite Data"
is accepted by AI Magazine.
- January, 2023 - Two papers accepted as extended abstract by AAMAS 2023.
- October, 2022 - Attending INFORMS. Chairing the session "Reinforcement Learning for Decision Making in Networks and Combinatorial Spaces" on Oct 17.
- October, 2022 - Selected as top 10% of the reviewers for NeurIPS 2022.
- August, 2022 - Officially joined William & Mary!
- April, 2022 - Paper "Sequential Vaccine Allocation with Delayed Feedback" is accepted by IJCAI 2022.
- March, 2022 - Session proposal 'Reinforcement Learning for Decision Making in Networks and Combinatorial Spaces'
is accepted by the AI cluster at INFORMS 2022.
- December, 2021 - Giving a contributed talk at MLPH workshop @NeurIPS on
"Demand prediction of mobile clinics using public data".
- November, 2021 - Two papers, 'Using Public Data to Predict Demand for Mobile Health Clinics'
and 'Micronutrient Deficiency Prediction via Publicly Available Satellite Imagery' are accepted by IAAI 2022!
- November, 2021 - Paper 'M2P2: Multimodal Persuasion Prediction using Adaptive Fusion'
is accepted by IEEE Transactions on Multimedia.
- September, 2021 - Our paper "Learning MDPs from Features: Predict-Then-Optimize for Sequential Decision Problems by Reinforcement Learning"
is accepted by NeurIPS-21 as a spotlight!
- September, 2021 - Our paper "PCAM: Predictive Cyber Alert Management"
is accepted by ACM Transactions on Internet Technology.
- August, 2021 - I am co-organizing the 3rd Workshop
on Artificial Intelligence for Social Good@IJCAI2021.
- May, 2021 - I am co-organizing the Synthetic Data Generation:
Quality, Privacy, Bias workshop @ICLR2021.
- May, 2021 - Two papers are accepted by UAI-21.
- May, 2021 - Our paper, 'Active Screening for Recurrent Diseases: A Reinforcement Learning Approach' is
awarded the best paper nomination by AAMAS-21!
- March, 2021 - Our workshop proposal, 'International Workshop on Artificial Intelligence for Social Good (AI4SG)' is
accepted by IJCAI'2021.
- December, 2020 - Our paper, 'Active Screening for Recurrent Diseases: A Reinforcement Learning Approach' is
accepted by AAMAS'2021.
- December, 2020 - Our workshop proposal, 'Synthetic Data Generation: Quality, Privacy, Bias' is
accepted by ICLR'2021 workshops.
- December, 2020 - Our paper, 'EvaLDA: Efficient Evasion Attacks Towards Latent Dirichlet Allocation' is
accepted by AAAI'2021.
- September, 2020 - Organzing Harvard CRCS workshop on Using AI for Social Good!
- August, 2020 - Our team AMI (Bo An, Haipeng Chen, Xu He, Rundong Wang, and Youzhi Zhang; alphabetically ordered) made
it to the finalist (top 25 out of 1000+ teams) in the KDD'20 reinforcement learning competition track!
- August, 2020 - Our paper, "Using Word Embeddings to Deter Intellectual Property Theft Through Automated Generation of
Fake Documents" is accepted by ACM Transactions on Management Information Systems!
- July, 2020 - Started postdoc at Harvard University!
- May, 2020 - Our paper, "Learning Behaviors with Uncertain Human Feedback" got accepted to UAI'20.
Congrats Xu on his first paper -- well deserved!
- March, 2020 - Invited to serve as a reviewer of Neurips'20.
- Feb, 2020 - Invited talk at CS department, University of Illinois at Chicago.
- December 16, 2019 - Attending Matariki Cybersecurity Workshop.
- December 8-14, 2019 - Attending Neurips'19 in Vancouver, Canada!
- November, 2019 - Our paper, "Disclose or Exploit? A Game Theoretic Approach Towards Strategic Decision Making
in Cyber Warfare" has been accepted to IEEE Systems Journal.
- November, 2019 - Our paper, "PIE: A Data-Driven Payoff Inference Engine for Strategic Security Applications"
has been accepted to IEEE Transactions on Computational Social Systems.
- August, 2019 - Our IJCAI 2019 demo paper, "VEST: A System for Vulnerability Exploit Scoring & Timing"
has been awarded IJCAI'19 Demonstration Innovation Award runner-up!
- August, 2019 - Two papers accepted to ICDM 2019, including one regular paper which integrates
contextual bandit with TD learning to handle the joint pricing and dispatch problem in ride-hailing platform,
a work done when I was an intern at Didi; and a short paper jointly done with George Mason University,
which is a follow-up of our KDD paper .
- August, 2019 - Attending KDD'19 in Anchorage, Alaska!
- May, 2019 - Attending ISTS
VeChain BlockChain Technology Workshop.
- May, 2019 - Three papers accepted to IJCAI 2019, including two papers on
GAN-based tabular data generation with function-preservation and
dynamic ETC control with multi-agent deep reinforcement learning accepted as main conference papers,
and one demo paper demonstrating a system for vulnerability exploit timing and severity scoring prediction!
- April, 2019 - Our paper, Using Twitter to Predict when Vulnerabilities will be Exploited,
is accepted to KDD 2019 as poster presentation!
- April, 2019 - Paper DCL-AIM: Decentralized Coordination Learning of Autonomous Intersection Management for Connected and Automated Vehicles
has been accepted to Transportation Research, Part C, Emerging Methodologies!