Papers

See also my Google scholar page.

  1. 2026
    Benchmarks
    MBABench: Evaluating LLM Agents on End-to-End Spreadsheet Tasks in Finance
    Thomson Yen, Julian Poeltl, Harshith Srinivas Gear, Yilin Meng, Joshua Fan, Adam Shen, Yili Liu, Ali Bauyrzhan, Siri Du, Haoyang Liu, Daniel Guetta, and Hongseok Namkoong
    Site Code Data
  2. 2026
    Continual Learning Benchmarks
    LatentGym: A Testbed for Cross-Task Experiential Learning with Controllable Latent Structure
    Daksh Mittal, Tommaso Castellani, Thomson Yen, Naimeng Ye, Fangyu Wu, Minghui Chen, Tiffany Cai, Emmanouil Koukoumidis, William Zeng, and Hongseok Namkoong
    Code Blog Data
  3. 2026
    Benchmarks
    Empirical Rigor Through Benchmarking in Operations Research
    Jing Dong, Daksh Mittal, and Hongseok Namkoong
    Site Code
  4. 2026
    Trustworthy AI
    Local Sensitivity Under Transport Restrictions
    Hongseok Namkoong
  5. 2026
    Causal Inference
    When Representative Samples Produce Worse Outcomes: Scale-up Decisions and Testing in Small-Budget RCTs
    Hannah Li, Hongseok Namkoong, and Isaac Scheinfeld
  6. 2026
    Causal Inference
    Empirical Likelihood for Nonsmooth Functionals
    Hongseok Namkoong
  7. 2026
    Continual Learning Adaptive Experimentation
    A Broader View of Thompson Sampling
    Yanlin Qu, Hongseok Namkoong, and Assaf Zeevi
    ICML 2026
  8. 2026
    Trustworthy AI Benchmarks
    On the Need for a Language Describing Distribution Shifts: Illustrations on Tabular Datasets
    Jiashuo Liu, Tianyu Wang, Peng Cui, and Hongseok Namkoong
    Management Science. Conference version appeared in NeurIPS 2023.
    Site Slides Video
  9. 2026
    Continual Learning Adaptive Experimentation
    Learning-To-Measure: In-context Active Feature Acquisition
    Yuta Kobayashi, Zilin Jing, Jiayu Yao, Hongseok Namkoong, and Shalmali Joshi
    ICML 2026
  10. 2026
    Benchmarks
    FinSearchComp: Towards a Realistic, Expert-Level Evaluation of Financial Search and Reasoning
    Liang Hu, Jianpeng Jiao, Jiashuo Liu, Yanle Ren, Zhoufutu Wen, Kaiyuan Zhang, Xuanliang Zhang, Xiang Gao, Tianci He, Fei Hu, Yali Liao, Zaiyuan Wang, Chenghao Yang, Qianyu Yang, Mingren Yin, Zhiyuan Zeng, Ge Zhang, Xinyi Zhang, Xiying Zhao, Zhenwei Zhu, Hongseok Namkoong, Wenhao Huang, and Yuwen Tang
    ICLR 2026
    Site
  11. 2026
    Adaptive Experimentation Deployed in Practice
    Distilled Thompson Sampling: Practical and Efficient Thompson Sampling via Imitation Learning
    Hongseok Namkoong, Samuel Daulton, and Eytan Bakshy
    Transactions on Machine Learning Research. Selected for an oral presentation at the NeurIPS 2020 OfflineRL Workshop.
    Code
  12. 2025
    Queueing
    Data-driven Stochastic Modeling using Autoregressive Sequence Models
    Daksh Mittal, Shunri Zheng, Jing Dong, and Hongseok Namkoong
  13. 2025
    Trustworthy AI Optimization
    DRO: A Python Library for Distributionally Robust Optimization in Machine Learning
    Jiashuo Liu, Tianyu Wang, Henry Lam, Hongseok Namkoong, and Jose Blanchet
    Code
  14. 2025
    Continual Learning Benchmarks Adaptive Experimentation
    Benchmarking In-context Experiential Learning Through Repeated Product Recommendations
    Gilbert Yang, Yaqin Chen, Thomson Yen, and Hongseok Namkoong
    Site Code
  15. 2025
    Continual Learning Benchmarks
    SynthTools: A Framework for Scaling Synthetic Tools for Agent Development
    Tommaso Castellani, Naimeng Ye, Daksh Mittal, Thomson Yen, and Hongseok Namkoong
  16. 2025
    Causal Inference
    A Sensitivity Approach to Causal Inference Under Limited Overlap
    Yuanzhe Ma and Hongseok Namkoong
  17. 2025
    Continual Learning Adaptive Experimentation
    Adaptive Elicitation of Latent Information Using Natural Language
    Jimmy Wang, Thomas Zollo, Richard Zemel, and Hongseok Namkoong
    ICML 2025. Best Paper Award at ICLR 2025 Workshop on Quantify Uncertainty and Hallucination in Foundation Models.
    Code
  18. 2025
    Adaptive Experimentation Optimization
    Data Mixture Optimization: A Multi-fidelity Multi-scale Bayesian Framework
    Thomson Yen, Andrew Wei Tung Siah, Haozhe Chen, Tianyi Peng, Daniel Guetta, and Hongseok Namkoong
    NeurIPS 2025
    Code
  19. 2025
    Trustworthy AI
    LLM Generated Persona is a Promise with a Catch
    Ang Li, Haozhe Chen, Hongseok Namkoong, and Tianyi Peng
    NeurIPS 2025
    Data
  20. 2025
    Continual Learning Adaptive Experimentation
    Architectural and Inferential Inductive Biases For Exchangeable Sequence Modeling
    Daksh Mittal, Ang Li, Tzu-Ching Yen, Daniel Guetta, and Hongseok Namkoong
    NeurIPS 2025
  21. 2025
    Continual Learning Adaptive Experimentation
    A Planning Framework for Adaptive Labeling
    Daksh Mittal, Yuanzhe Ma, Shalmali Joshi, and Hongseok Namkoong
    NeurIPS 2024. Journal version under review.
  22. 2025
    Continual Learning Adaptive Experimentation
    Contextual Thompson Sampling via Generation of Missing Data
    Kelly Zhang, Tiffany Cai, Hongseok Namkoong, and Daniel Russo
    NeurIPS 2025
  23. 2025
    Trustworthy AI Causal Inference
    AI as an intervention: improving clinical outcomes relies on a causal approach to AI development and validation
    Shalmali Joshi, Inigo Urteaga, Wouter A C van Amsterdam, George Hripcsak, Pierre Elias, Benjamin Recht, Noemie Elhadad, James Fackler, Mark P Sendak, Jenna Wiens, Kaivalya Deshpande, Yoav Wald, Madalina Fiterau, Zachary Lipton, Daniel Malinsky, Madhur Nayan, Hongseok Namkoong, Soojin Park, Julia E Vogt, and Rajesh Ranganath
    Journal of the American Medical Informatics Association
  24. 2025
    Continual Learning Benchmarks
    PersonalLLM: Tailoring LLMs to Individual Preferences
    Thomas Zollo, Andrew Siah, Naimeng Ye, Ang Li, and Hongseok Namkoong
    ICLR 2025
    Code
  25. 2025
    Continual Learning Adaptive Experimentation
    Active Exploration via Autoregressive Generation of Missing Data
    Tiffany Cai, Hongseok Namkoong, Daniel Russo, and Kelly Zhang
    Selected for presentation at the Econometric Society Interdisciplinary Frontiers: Economics and AI+ML conference.
    Slides
  26. 2025
    Trustworthy AI Deployed in Practice
    Diagnosing Model Performance Under Distribution Shift
    Tiffany Cai, Hongseok Namkoong, and Steve Yadlowsky
    Operations Research. Conference version appeared at FORC 2023.
    Code Slides Video
  27. 2025
    Trustworthy AI
    Minimax Optimal Estimation of Stability Under Distribution Shift
    Hongseok Namkoong, Yuanzhe Ma, and Peter W. Glynn
    Operations Research
    Code
  28. 2024
    Trustworthy AI
    From Models to Systems: A Comprehensive Framework for AI System Fairness in Compositional Recommender Systems
    Brian Hsu, Cyrus DiCiccio, Natesh Sivasubramoniapillai, and Hongseok Namkoong
    PMLR 2024
  29. 2024
    Continual Learning Trustworthy AI
    LLM Embeddings Improve Test-time Adaptation to Tabular Y|X-Shifts
    Yibo Zeng, Jiashuo Liu, Henry Lam, and Hongseok Namkoong
    Code
  30. 2024
    Queueing Benchmarks
    QGym: Scalable Simulation and Benchmarking of Queuing Network Controllers
    Haozhe Chen, Ang Li, Ethan Che, Tianyi Peng, Jing Dong, and Hongseok Namkoong
    NeurIPS 2024 Datasets and Benchmarks
    Code
  31. 2024
    Queueing Optimization
    Differentiable Discrete Event Simulation for Queuing Network Control
    Ethan Che, Jing Dong, and Hongseok Namkoong
    Major revision in Operations Research.
    Code
  32. 2024
    Adaptive Experimentation Optimization
    Optimization-Driven Adaptive Experimentation
    Ethan Che, Daniel Jiang, Hongseok Namkoong, and Jimmy Wang
    Selected for oral presentations at the Econometric Society Interdisciplinary Frontiers: Economics and AI+ML conference and Conference on Digital Experimentation.
    Code Slides
  33. 2024
    Adaptive Experimentation Benchmarks
    AExGym: Benchmarks and Environments for Adaptive Experimentation
    Jimmy Wang, Ethan Che, Daniel Jiang, and Hongseok Namkoong
    Code
  34. 2024
    Continual Learning Adaptive Experimentation
    Exchangeable Sequence Models Quantify Uncertainty Over Latent Concepts
    Naimeng Ye and Hongseok Namkoong
  35. 2024
    Causal Inference Optimization
    Constrained Learning for Causal Inference and Semiparametric Statistics
    Tiffany Cai, Yuri Fonseca, Kaiwen Hou, and Hongseok Namkoong
  36. 2024
    Queueing
    Design and Scheduling of an AI-based Queueing System
    Jiung Lee, Hongseok Namkoong, and Yibo Zeng
    Major revision in Management Science; selected for presentation at SIG day 2025.
  37. 2024
    Trustworthy AI
    Evaluating Model Performance Under Worst-case Subpopulations
    Mike Li, Daksh Mittal, Hongseok Namkoong, and Shangzhou Xia
    NeurIPS 2021. Major revision in Mathematics of Operations Research.
  38. 2023
    Adaptive Experimentation Optimization Deployed in Practice
    Adaptive Experimentation at Scale: A Computational Framework for Flexible Batches
    Ethan Che and Hongseok Namkoong
    Major revision in Operations Research.
    Site Slides Video
  39. 2023
    Causal Inference
    Modeling Interference via Experiment Rollout
    Ari Boyarsky, Hongseok Namkoong, and Jean Pouget-Abadie
    ACM EC 2023
    Slides
  40. 2022
    Causal Inference Trustworthy AI Deployed in Practice
    Assessing External Validity via Worst-case Subpopulation Treatment Effects
    Sookyo Jeong and Hongseok Namkoong
    COLT 2020. Major revision in Management Science.
    Code Slides Video
  41. 2022
    Trustworthy AI Deployed in Practice
    Model Soups: Averaging Weights of Multiple Fine-tuned Models Improves Accuracy Without Increasing Inference Time
    Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, Simon Kornblith, and Ludwig Schmidt
    ICML 2022
    Code Video
  42. 2022
    Trustworthy AI Deployed in Practice
    Robust Fine-tuning of Zero-shot Models
    Mitchell Wortsman, Gabriel Ilharco, Jong Wook Kim, Mike Li, Simon Kornblith, Rebecca Roelofs, Raphael Gontijo-Lopes, Hannaneh Hajishirzi, Ali Farhadi, Hongseok Namkoong, and Ludwig Schmidt
    CVPR 2022. CVPR Best Paper Finalist.
    Code Video
  43. 2022
    Causal Inference Trustworthy AI
    Bounds on the Conditional and Average Treatment Effect with Unobserved Confounding Factors
    Steve Yadlowsky, Hongseok Namkoong, Sanjay Basu, John Duchi, and Lu Tian
    Annals of Statistics
    Slides Video
  44. 2022
    Trustworthy AI Optimization
    Distributionally Robust Losses Against Mixture Covariate Shifts
    John C. Duchi, Tatsunori Hashimoto, and Hongseok Namkoong
    Operations Research
    Code Video
  45. 2021
    Trustworthy AI Optimization
    Learning Models with Uniform Performance via Distributionally Robust Optimization
    John C. Duchi and Hongseok Namkoong
    Annals of Statistics
    Code Slides Video
  46. 2021
    Trustworthy AI Optimization
    Statistics of Robust Optimization: A Generalized Empirical Likelihood Approach
    John C. Duchi, Peter W. Glynn, and Hongseok Namkoong
    Mathematics of Operations Research. APS Best Student Paper Prize, and featured in Mathematics of Operations Research's 50th anniversary selection.
    Video
  47. 2020
    Causal Inference Trustworthy AI
    Off-policy Policy Evaluation For Sequential Decisions Under Unobserved Confounding
    Hongseok Namkoong, Ramtin Keramati, Steve Yadlowsky, and Emma Brunskill
    NeurIPS 2020
    Code
  48. 2019
    Trustworthy AI Optimization
    Variance-based regularization with convex objectives
    John C. Duchi and Hongseok Namkoong
    Journal of Machine Learning Research. Conference version won NeurIPS 2017 Best Paper Award.
    Code Slides Video
  49. 2018
    Trustworthy AI Optimization
    Certifiable Distributional Robustness with Principled Adversarial Training
    Aman Sinha, Hongseok Namkoong, Riccardo Volpi, and John Duchi
    ICLR 2018. Selected for a full oral presentation.
    Code Video
  50. 2018
    Trustworthy AI
    Generalizing to Unseen Domains via Adversarial Data Augmentation
    Riccardo Volpi, Hongseok Namkoong, John Duchi, Vittorio Murino, and Silvio Savarese
    NeurIPS 2018
    Code
  51. 2018
    Trustworthy AI Deployed in Practice
    Scalable End-to-End Autonomous Vehicle Testing via Rare-event Simulation
    Mathew O'Kelly, Aman Sinha, Hongseok Namkoong, John Duchi, and Russ Tedrake
    NeurIPS 2018
  52. 2018
    Trustworthy AI Optimization
    Fairness Without Demographics in Repeated Loss Minimization
    Tatsunori Hashimoto, Megha Srivastava, Hongseok Namkoong, and Percy Liang
    ICML 2018. Best Paper Runner-up Award.
    Code
  53. 2017
    Optimization
    Adaptive sampling probabilities for non-smooth optimization
    Hongseok Namkoong, Aman Sinha, Steve Yadlowsky, and John C. Duchi
    ICML 2017
    Code
  54. 2016
    Trustworthy AI Optimization
    Stochastic Gradient Methods for Distributionally Robust Optimization with f-divergences
    Hongseok Namkoong and John C. Duchi
    NeurIPS 2016
    Slides