A CPIL research theme bringing diffusion/generative models and offline model-based optimization (MBO) to large language models, including an LLM-oriented Design-Bench 2.0.
Project summary
This theme studies the intersection of diffusion and flow-based generative models, offline black-box / model-based optimization (MBO), and LLM pretraining. A current focus is Design-Bench 2.0, an LLM-oriented benchmark that adapts offline MBO algorithms to LLM-related tasks, alongside diffusion- and flow-based methods for black-box and multi-objective optimization.
Lead: Ye Yuan
Members: Can Chen, Dheeraj, Linfeng Du, Zipeng Sun, Weixu Zhang, Xiuyuan Hu, Yonghan (Harry) Yang, Haolun Wu
- Large Language Models
- Diffusion Models
- Offline Model-Based Optimization
- Black-Box Optimization
- LLM Pretraining
- Generative Models