Yu Kong

Department of Computer Science and Engineering, Michigan State University

yukong.jpg

Office: EB 3573

Email: yukong@msu.edu

Dr. Yu Kong is an Assistant Professor of the Department of Computer Science and Engineering, Michigan State University. He is now directing the ACTION Lab. He serves Pattern Recognition and IEEE Transactions on Multimedia as an Associate Editor. He also serves CVPR, ICCV, IJCAI, AAAI, Multimedia, FG, etc., as an Area Chair. He is an IEEE Senior Member. His research has been supported by National Science Foundation, Office of Naval Research, Army Research Office, Google, Meta, Nvidia, Adobe, Josiah Mary Jr Foundation, and Knight Foundation.

Dr. Kong’s research focuses on building AI systems that represent, understand, and generate human behaviors. His research spans human motion and human-object interaction modeling, video understanding (including egocentric videos), and trustworthy generative AI. Together, these research directions lay the foundation for AI systems to learn from human activities and interactions, leverage physical principles and prior knowledge, and ultimately interact with the physical world in a human-like manner to better serve people.

Openings: We have openings for Fall 2026 for Ph.D. students, Visiting Scholars, and Research Assistants. You can either 1) fill in the external contact form (preferred) or 2) send your application package to actionlab@msu.edu. I will review applications periodically. Due to large volume of applications, I am not able to track and respond to every applicant. How to apply?

news

Jun 18, 2026 Our paper on test-time optimization for video generation has been accepted by ECCV 2026. Congratulations to Yujiang!
Apr 30, 2026 We have one paper on continual VQA accepted by ICML 2026.
Apr 02, 2026 One paper about media forenisics has been accepted by FG 2026. This is the Zhongyi’s first paper at ACTION Lab. Congratulations to Zhongyi and collaborators!
Feb 21, 2026 We have two papers accepted by CVPR 2026. Congratulations to Zhanbo and our collaborators!
Jan 26, 2026 One paper about mistake detection has been accepted by ICLR 2026. This is the Wenliang’s first paper at ACTION Lab. Congratulations to Wenliang and Yujiang!
Nov 10, 2025 One paper about Egocentric Video Generation has been accepted by WACV 2026. Congratulations to Yujiang!
Sep 25, 2025 Our project on Neuro-Symbolic Video Understanding ($50K) is selected for funding by Jenison Fund.
Sep 18, 2025 We have one paper accepted by NeurIPS 2025. Congratulations to Yifan!
Aug 16, 2025 I will be serving CVPR 2026 as an Area Chair.
Jun 25, 2025 We have one paper accepted by ICCV 2025. Congratulations to Yifan!

selected publications

  1. CVPR Highlight
    Zhanbo2026a.pdf
    Unlocking Motion from Large Vision Models with a Semantic and Kinematic Duality for Gait Recognition
    Zhanbo Huang, Dingqiang Ye, Xiaoming Liu, and Yu Kong
    In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2026
    Highlight
  2. WACV
    Yujiang2025.pdf
    Show Me: Generating Instructional Videos with Diffusion Models
    Yujiang Pu, Zhanbo Huang, Vishnu Boddeti, and Yu Kong
    In Winter Conference on Applications of Computer Vision (WACV), 2026
  3. NeurIPS
    YifanNeurIPS2025.pdf
    IndustryEQA: Pushing the Frontiers of Embodied Question Answering in Industrial Scenarios
    Yifan Li, Yuhang Chen, Anh Dao, Lichi Li, Zhongyi Cai, Zhen Tan, Tianlong Chen, and 1 more author
    In NeurIPS DB Track, 2025
  4. CVPR Highlight
    Zhanbo2025.pdf
    Learning Human-centric Motion Representation for Action Analysis
    Zhanbo Huang, Xiaoming Liu, and Yu Kong
    In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2025
    Highlight

acknowledgement of support