Jun-Hyung Park

I am a postdoc researcher in BK21 FOUR R&E Center for Artificial Intelligence at Korea University. I have obtained my Ph.D. in Computer Science and Engineering from Korea University, advised by Prof. SangKeun Lee. I received B.S. in Computer Science and Engineering from Korea University.

My primary research lies in the area of natural language processing and efficient AI:

• Commonsense Reasoning: Improving the commonsense reasoning capabilities of pre-trained models including language models and multi-modal transformers. Interested in augmenting the models with (implicit) commonsense knowledge by incorporating knowledge graphs and retrieving texts.
• Language Models: Improving the various aspects of language models including effectiveness, efficiency, diversity, multilinguality, etc. Addressing any pipeline of language model development, ranging from pre-training to inference.
• Model Compression: Compressing and accelerating pre-trained models for efficient inference, such as network pruning, quantization, and knowledge distillation.