publications

2026

  1. im-mopd.png
    No Pain, More Gain: Iterative Merging for Effective Multi-Teacher On-Policy Distillation
    Seonghyeon Kim*, Chaeyun Jang*, Noah Lee, and 2 more authors
    Preprint, 2026
    arXiv
  2. perpru.jpg
    Persona-Pruner: Sculpting Lightweight Models for Role-Playing
    Jinsu Kim, Jihoon Tack, Noah Lee, and 1 more author
    ICML, 2026
    arXiv
  3. mapo.png
    Margin-aware Preference Optimization for Aligning Diffusion Models without Reference
    Jiwoo Hong*, Sayak Paul*, Noah Lee, and 3 more authors
    AAAI, 2026
    arXiv Code

2025

  1. alphapo.png
    AlphaPO - Reward Shape Matters for LLM Alignment
    Aman Gupta, Shao Tang, Qingquan Song, and 8 more authors
    ICML, 2025
    arXiv
  2. robustrm.png
    On the Robustness of Reward Models for Language Model Alignment
    Jiwoo Hong, Noah Lee, Eunki Kim, and 5 more authors
    ICML, 2025
    arXiv
  3. cross.png
    Cross-lingual Transfer of Reward Models in Multilingual Alignment
    Jiwoo Hong*, Noah Lee*, Rodrigo Martínez-Castaño, and 2 more authors
    NAACL, 2025
    arXiv Code
  4. biggen.png
    The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models
    Seungone Kim, Juyoung Suk, Ji Yong Cho, and 29 more authors
    NAACL (Best Paper), 2025
    arXiv
  5. conseval.png
    Evaluating the Consistency of LLM Evaluators
    Noah Lee*, Jiwoo Hong*, and James Thorne
    COLING, 2025
    arXiv

2024

  1. orpo.png
    ORPO: Monolithic Preference Optimization without Reference Model
    Jiwoo Hong, Noah Lee, and James Thorne
    EMNLP, 2024
    arXiv Code

2023

  1. humllm.png
    Can Large Language Models Capture Dissenting Human Voices?
    Noah Lee*, Na Min An*, and James Thorne
    EMNLP, 2023
    arXiv Code