Noah Lee

I am a Master Student at the Kim Jaechul Graduate School of AI of KAIST, jointly advised by James Thorne and Jinwoo Shin. Before joining KAIST, I was a Research Intern at Naver CLOVA where I conducted research on Recommender Systems. Before that, I received my Bachelor’s degree in Statistics in Korea University.

My current main research interest lies in (but not confined to):

Bettering human representation of LLMs
Uncertainty-aware systems for reliable and safe AI usage
Personalization & customization of LLMs

Feel free to get in touch!

News

Jun 10, 2024	Check out our recent preprint MaPO and its blog post
Apr 15, 2024	Check out our largest ORPO Checkpoint Zephyr 141B-A39B.
Mar 12, 2024	Check out our recent preprint ORPO and its blog post

Publications

Margin-aware Preference Optimization for Aligning Diffusion Models without Reference

Jiwoo Hong*, Sayak Paul*, Noah Lee, and 3 more authors

arXiv e-prints, 2024

ORPO: Monolithic Preference Optimization without Reference Model

Jiwoo Hong, Noah Lee, and James Thorne

Preprint, 2024

arXiv Bib

@article{hong2024orpo,
  title = {ORPO: Monolithic Preference Optimization without Reference Model},
  author = {Hong, Jiwoo and Lee, Noah and Thorne, James},
  journal = {Preprint},
  year = {2024},
}

Can Large Language Models Capture Dissenting Human Voices?

Noah Lee*, Na Min An*, and James Thorne

EMNLP, 2023

arXiv Bib