About

πŸ‘‹πŸ» Hi! I’m an undergraduate student and researcher at the University of Washington (UW). I double major in computer science (with honors) and statistics, with a minor in mathematics. I am also a student collaborator working with the Perceptual Reasoning and Interaction Research (PRIOR) team at the Allen Institute for Artificial Intelligence (Ai2).

At UW, I am fortunate to be co-advised by Prof Ranjay Krishna at the Reasoning, AI, and VisioN (RAIVN) Lab and Prof Dieter Fox at the Robotics and State Estimation (RSE) Lab in UW CSE. Before that, I was advised by Prof Jenq-Neng Hwang at the Information Processing Lab (IPL) in UW ECE. I am also pleased to be mentored by Dr Jiafei Duan and Dr Ying Jin. At Ai2 PRIOR, I am fortunate to be mentored by Prof Ranjay Krishna and Dr Jiafei Duan, and sponsored by Dr Rose Hendrix.

My research interests are broadly in the fields of computer vision, machine learning, and embodied AI. I am especially passionate about robot learning, imitation learning, behavior cloning, and foundation models for robotics.

I am now actively seeking PhD positions for fall 2026 and any other opportunities. Feel free to reach out!

πŸ”₯ News

  • [Aug 2025] We are launching MolmoAct: Action Reasoning Models that can Reason in Space.
  • [Jul 2025] Received the UW CSE Award for Excellence Scholarship 2025.
  • [Jun 2025] Received the UW CSE Best Senior Thesis Award Honorable Mention 2025 (2nd Place).
  • [May 2025] Our paper SAM2Act: Integrating Visual Foundation Model with A Memory Architecture for Robotic Manipulation has been accepted to FMEA @ CVPR 2025 and selected as Oral Presentation (Perfect Scores).
  • [May 2025] Our paper PointArena: Probing Multimodal Grounding Through Language-Guided Pointing has been preprinted to arXiv.
  • [May 2025] Our paper SAM2Act: Integrating Visual Foundation Model with A Memory Architecture for Robotic Manipulation has been accepted to ICML 2025.
  • [Apr 2025] Our paper SAM2Act: Integrating Visual Foundation Model with A Memory Architecture for Robotic Manipulation has been featured by AI Index Report 2025.
  • [Feb 2025] Our paper SAM2Act: Integrating Visual Foundation Model with A Memory Architecture for Robotic Manipulation has been accepted to WRL @ ICLR 2025 and selected as Oral Spotlight (Award Nomination).

πŸ“‘ Selected Publications

* Equal Contribution as First Authors Β Β  † Equal Contribution as Second Authors Β Β  ‑ Equal Contribution as Advisors

MolmoAct: Action Reasoning Models that can Reason in Space
Jason Lee*, Jiafei Duan*, Haoquan Fang*, Yuquan Deng, Shuo Liu, Boyang Li, Bohan Fang, Jieyu Zhang, Yi Ru Wang, Sangho Lee, Winson Han, Wilbert Pumacay, Angelica Wu, Rose Hendrix, Karen Farley, Eli VanderBilt, Ali Farhadi, Dieter Fox, Ranjay Krishna
Technical Report 2025
Blog Technical Report Code Models Datasets Post

SAM2Act: Integrating Visual Foundation Model with A Memory Architecture for Robotic Manipulation
Haoquan Fang, Markus Grotz, Wilbert Pumacay, Yi Ru Wang, Dieter Fox‑, Ranjay Krishna‑, Jiafei Duan‑
International Conference on Machine Learning (ICML) 2025
Workshop on Robot Learning (WRL) at ICLR 2025 Oral Spotlight (Award Nomination)
Workshop on Foundation Models Meet Embodied Agents (FMEA) at CVPR 2025 Oral Presentation (Perfect Scores)
Website Paper Code MemoryBench Post AI Index Report

PointArena: Probing Multimodal Grounding Through Language-Guided Pointing
Long Cheng*, Jiafei Duan*, Yi Ru Wang†, Haoquan Fang†, Boyang Li†, Yushan Huang, Elvis Wang, Ainaz Eftekhar, Jason Lee, Wentao Yuan, Rose Hendrix, Noah A. Smith, Fei Xia, Dieter Fox, Ranjay Krishna
arXiv 2025
Website arXiv Code Dataset Post

πŸ“– Professional Services

  • Conference Reviewer
    • International Conference on Learning Representations (ICLR) 2025 Workshops
    • Conference on Computer Vision and Pattern Recognition (CVPR) 2025 Workshops
  • Workshop Organizer
    • Workshop on 3D Vision Language Models for Robotic Manipulation (Robo-3DVLM) at CVPR 2025
  • Teaching Assistant
    • CSE 493G1/599G1: Deep Learning (Spring 2025, Undergrad/Grad)

πŸŽ“ Education

  • University of Washington, 2022 - 2026 (Expected)
    Bachelor of Science in Computer Science with Honors
    Bachelor of Science in Statistics
    Minor in Mathematics
    • GPA: 3.98/4.00, Dean’s Lists, Best Senior Thesis Award Honorable Mention, CSE Award for Excellence Scholarship

πŸ’Ό Industrial Experience

  • Allen Institute for Artificial Intelligence, Apr 2025 - Present
    Student Collaborator
  • Nokia Shanghai Bell, Jul 2023 - Aug 2023
    Research Engineer Intern
    • Mentored by Dr Quan Wang, Explored on COSMIC Report Generation

πŸ… Awards