Noah Lee

MS Student @ KAIST AI

Noah.jpg

I am a Master Student at the Kim Jaechul Graduate School of AI of KAIST, jointly advised by James Thorne and Jinwoo Shin. Before joining KAIST, I was a Research Intern at Naver CLOVA where I conducted research on Recommender Systems. Before that, I received my Bachelor’s degree in Statistics in Korea University.


My current main research interest lies in (but not confined to):

  • Bettering human representation of LLMs
  • Uncertainty-aware systems for reliable and safe AI usage
  • Personalization & customization of LLMs

Feel free to get in touch!


News

Jul 1, 2025 Two papers (Robust RM & AlphaPO) have been accepted to ICML 2025!
Jan 24, 2025 Our RM cross-lingual paper has been accepted to NAACL 2025!
Dec 2, 2024 A paper has been accepted to COLING 2025

Publications

  1. alphapo.png
    AlphaPO - Reward Shape Matters for LLM Alignment
    Aman Gupta, Shao Tang, Qingquan Song, and 8 more authors
    ICML, 2025
    arXiv
  2. robustrm.png
    On the Robustness of Reward Models for Language Model Alignment
    Jiwoo Hong, Noah Lee, Eunki Kim, and 5 more authors
    ICML, 2025
    arXiv
  3. cross.png
    Cross-lingual Transfer of Reward Models in Multilingual Alignment
    Jiwoo Hong*, Noah Lee*, Rodrigo Martínez-Castaño, and 2 more authors
    NAACL, 2025
    arXiv Code
  4. biggen.png
    The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models
    Seungone Kim, Juyoung Suk, Ji Yong Cho, and 29 more authors
    NAACL (Best Paper), 2025
    arXiv
  5. conseval.png
    Evaluating the Consistency of LLM Evaluators
    Noah Lee*, Jiwoo Hong*, and James Thorne
    COLING, 2025
    arXiv
  6. orpo.png
    ORPO: Monolithic Preference Optimization without Reference Model
    Jiwoo Hong, Noah Lee, and James Thorne
    EMNLP, 2024
    arXiv Code
  7. mapo.png
    Margin-aware Preference Optimization for Aligning Diffusion Models without Reference
    Jiwoo Hong*, Sayak Paul*, Noah Lee, and 3 more authors
    Preprint, 2024
    arXiv Code
  8. humllm.png
    Can Large Language Models Capture Dissenting Human Voices?
    Noah Lee*, Na Min An*, and James Thorne
    EMNLP, 2023
    arXiv Code