Noah Lee

I am a Master Student at the Kim Jaechul Graduate School of AI of KAIST, jointly advised by James Thorne and Jinwoo Shin. Before joining KAIST, I was a Research Intern at Naver CLOVA where I conducted research on Recommender Systems. Before that, I received my Bachelor’s degree in Statistics in Korea University.

My current main research interest lies in (but not confined to):

Bettering human representation of LLMs
Uncertainty-aware systems for reliable and safe AI usage
Personalization & customization of LLMs

Feel free to get in touch!

News

Sep 22, 2024	ORPO has been accepted to EMNLP 2024 as a main paper!
Jun 10, 2024	Check out our recent preprint MaPO and its blog post
Apr 15, 2024	Check out our largest ORPO Checkpoint Zephyr 141B-A39B.

Publications

ORPO: Monolithic Preference Optimization without Reference Model

Jiwoo Hong, Noah Lee, and James Thorne

EMNLP, 2024

arXiv Bib Code

@article{hong2024orpo,
  title = {ORPO: Monolithic Preference Optimization without Reference Model},
  author = {Hong, Jiwoo and Lee, Noah and Thorne, James},
  journal = {EMNLP},
  year = {2024},
}

Margin-aware Preference Optimization for Aligning Diffusion Models without Reference

Jiwoo Hong*, Sayak Paul*, Noah Lee, and 3 more authors

Preprint, 2024

Code

Can Large Language Models Capture Dissenting Human Voices?

Noah Lee*, Na Min An*, and James Thorne

EMNLP, 2023

arXiv Bib Code