Curriculum Vitae
Education
M.S. in Computer Science Korea Advanced Institute of Science and Technology (KAIST) Mar. 2025 - Present Advisor: Prof. Seunghoon Hong
B.S. in Computer Science and Chemistry (Double Major) Korea Advanced Institute of Science and Technology (KAIST) Mar. 2019 - Feb. 2025
Gyeonggi Science High School for Gifted Mar. 2016 - Feb. 2019
Research Interests
- Neural network scaling
- Model fusion and parameter alignment
- Efficient approaches to build large models with limited resources
Publications
Conference Papers
AdaRank: Adaptive Rank Pruning for Enhanced Model Merging Chanhyuk Lee, Jiho Choi, Chanryeol Lee, Donggyun Kim, Seunghoon Hong International Conference on Learning Representations (ICLR), 2026 [arXiv] [Code]
Preprints
One-step Language Modeling via Continuous Denoising Chanhyuk Lee, Jaehoon Yoo, Manan Agarawal, Sheel Shah, Jerry Huang, Aditi Raghunathan, Seunghoon Hong, Nicholas M. Boffi, Jinwoo Kim Preprint [arXiv] [Code] [Project]
Infinite Mask Diffusion for Few-Step Distillation Jaehoon Yoo, Wonjung Kim, Chanhyuk Lee, Seunghoon Hong Under Review
Revisiting Weight Averaging for Model Merging Jiho Choi*, Donggyun Kim*, Chanhyuk Lee, Seunghoon Hong Preprint [arXiv] [Code]
Skills
- Programming Languages: Python, C/C++
- Deep Learning Frameworks: PyTorch
- Research Areas: Model merging, diffusion models, language models