About
ππ» Hi! Iβm an undergraduate student and researcher at the University of Washington (UW). I double major in computer science (with honors) and statistics, with a minor in mathematics. I am also a student collaborator working with the Perceptual Reasoning and Interaction Research (PRIOR) team at the Allen Institute for AI (Ai2).
At UW, I am fortunate to be co-advised by Prof Ranjay Krishna at the Reasoning, AI, and VisioN (RAIVN) Lab and Prof Dieter Fox at the Robotics and State Estimation (RSE) Lab in UW CSE. Before that, I was advised by Prof Jenq-Neng Hwang at the Information Processing Lab (IPL) in UW ECE. I am also pleased to be mentored by Dr Jiafei Duan and Dr Ying Jin. At Ai2 PRIOR, I am fortunate to be mentored by Prof Ranjay Krishna and Dr Jiafei Duan, and sponsored by Dr Rose Hendrix.
My research interests lie in robot learning and foundation models for robotics. In particular, I develop generalist robotic manipulation policies with spatial intelligence, enabling them to perceive, remember, and reason in space.
I am now actively seeking PhD positions for fall 2026 and any other opportunities. Feel free to reach out!
π₯ News
- [Oct 2025] Our paper MolmoAct: Action Reasoning Models that can Reason in Space has been featured by State of AI Report 2025.
- [Oct 2025] Our paper FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Models has been preprinted to arXiv.
- [Sep 2025] Our paper SAM2Act: Integrating Visual Foundation Model with A Memory Architecture for Robotic Manipulation has been accepted to RemembeRL @ CoRL 2025 and selected as Best Paper Award.
- [Sep 2025] Our paper MolmoAct: Action Reasoning Models that can Reason in Space has been accepted to Rational Robots @ CoRL 2025 and selected as Best Paper Award Runner-up.
- [Sep 2025] Our paper MolmoAct: Action Reasoning Models that can Reason in Space has been accepted to Data @ CoRL 2025 and selected as Best Paper Award Nominee.
- [Aug 2025] We are launching MolmoAct: Action Reasoning Models that can Reason in Space.
- [Jul 2025] Received the UW CSE Award for Excellence Scholarship 2025.
- [Jun 2025] Received the UW CSE Best Senior Thesis Award Honorable Mention 2025 (2nd Place).
- [May 2025] Our paper PointArena: Probing Multimodal Grounding Through Language-Guided Pointing has been preprinted to arXiv.
- [May 2025] Our paper SAM2Act: Integrating Visual Foundation Model with A Memory Architecture for Robotic Manipulation has been accepted to ICML 2025.
- [Apr 2025] Our paper SAM2Act: Integrating Visual Foundation Model with A Memory Architecture for Robotic Manipulation has been featured by AI Index Report 2025.
π Selected Publications
*
Equal Contribution as First Authors β
Equal Contribution as Second Authors β‘
Equal Contribution as AdvisorsMolmoAct: Action Reasoning Models that can Reason in Space
Jason Lee*, Jiafei Duan*, Haoquan Fang*, Yuquan Deng, Shuo Liu, Boyang Li, Bohan Fang, Jieyu Zhang, Yi Ru Wang, Sangho Lee, Winson Han, Wilbert Pumacay, Angelica Wu, Rose Hendrix, Karen Farley, Eli VanderBilt, Ali Farhadi, Dieter Fox, Ranjay Krishna
Technical Report 2025
Data @ CoRL 2025 Best Paper Award Nominee
Rational Robots @ CoRL 2025 Best Paper Award Runner-up
SAM2Act: Integrating Visual Foundation Model with A Memory Architecture for Robotic Manipulation
Haoquan Fang, Markus Grotz, Wilbert Pumacay, Yi Ru Wang, Dieter Foxβ‘, Ranjay Krishnaβ‘, Jiafei Duanβ‘
International Conference on Machine Learning (ICML) 2025
WRL @ ICLR 2025 Oral Presentation
FMEA @ CVPR 2025 Oral Presentation
RemembeRL @ CoRL 2025 Best Paper Award
π Academic Services
- Conference Reviewer
- International Conference on Learning Representations (ICLR) 2025 Workshops
- Conference on Computer Vision and Pattern Recognition (CVPR) 2025 Workshops
- International Conference on Robotics and Automation (ICRA) 2026
- Workshop Organizer
- Workshop on 3D Vision Language Models for Robotic Manipulation (Robo-3DVLM) at CVPR 2025
- Teaching Assistant
- CSE 493G1/599G1: Deep Learning (Spring 2025, Undergrad/Grad)
- Grader
- STAT 311: Elements of Statistical Methods (Autumn 2025)
π¬ Presentations
All presentations below were delivered in person by me, either solo or with coauthors.
- Genesis AI, Invited Talk on MolmoAct
- Hosted by Johnson Wang, Aug 2025, San Carlos, CA
- Google Deepmind, Invited Talk on MolmoAct
- Hosted by Ted Xiao, Aug 2025, Mountain View, CA
- Allen Institute for AI, Company Demo on MolmoAct
- Hosted by Ali Farhadi, Jun 2025, Seattle, WA
- FMEA @ CVPR 2025, Oral Presentation on SAM2Act
- Hosted by Manling Li, Jun 2025, Nashville, TN
- UW RAIVN Lab, Group Talk on SAM2Act
- Hosted by Ranjay Krishna, Feb 2025, Seattle, WA
- UW RSE Lab, Group Talk on SAM2Act
- Hosted by Dieter Fox, Feb 2025, Seattle, WA
π Education
- University of Washington, 2022 - 2026 (Expected)
Bachelor of Science in Computer Science with Honors
Bachelor of Science in Statistics
Minor in Mathematics- GPA: 3.98/4.00, Deanβs Lists, Best Senior Thesis Award Honorable Mention, CSE Award for Excellence Scholarship
πΌ Industrial Experiences
- Allen Institute for AI, Apr 2025 - Present
Student Collaborator- Worked with the Perceptual Reasoning and Interaction Research (PRIOR) Team
- Mentored by Prof Ranjay Krishna and Dr Jiafei Duan, Sponsored by Dr Rose Hendrix
- Nokia Shanghai Bell, Jul 2023 - Aug 2023
Research Engineer Intern- Mentored by Dr Quan Wang, Explored on COSMIC Report Generation
π Awards
- Best Paper Award at RemembeRL @ CoRL 2025
- Best Paper Award Runner-up at Rational Robots @ CoRL 2025
- Best Paper Award Nominee at Data @ CoRL 2025
- UW CSE Award for Excellence Scholarship 2025
- UW CSE Best Senior Thesis Award Honorable Mention 2025 (2nd Place)
- Kaggle Competitions Expert (Top 0.85% Highest)
- Kaggle - LLM Science Exam, Silver Medal (Top 4%) [Website]
- RSNA Screening Mammography Breast Cancer Detection, Solo Silver Medal (Top 5%)