Shaowei Liu

I’m a CS PhD student at the University of Illinois Urbana-Champaign, being advised by Prof. Saurabh Gupta and Prof. Shenlong Wang.

I received my master's degree in Computer Science from UCSD, advised by Prof. Xiaolong Wang. Before that, I received my bachelor’s degree in Electrical Engineering from Tsinghua University.

My research interests lie in computer vision and robotics. I am interested in 3D vision, generative model and the intersection of vision and robotics.

Google Scholar  /  Github  /  Twitter

profile photo

Email: shaowei3@illinois.edu

Publications
PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generation
Shaowei Liu, Zhongzheng Ren, Saurabh Gupta*, Shenlong Wang*
European Conference on Computer Vision (ECCV), 2024.
[Paper] [Project] [Code]

Image-to-video generation pipeline integrates physical simulation and video diffusion prior.

ContactGen: Generative Contact Modeling for Grasp Generation
Shaowei Liu, Yang Zhou, Jimei Yang, Saurabh Gupta*, Shenlong Wang*
International Conference on Computer Vision (ICCV), 2023.
[Paper] [Project] [Code]

We propose a novel object-centric contact representation for hand-object interaction.

Building Rearticulable Models for Arbitrary 3D Objects from 4D Point Clouds
Shaowei Liu, Saurabh Gupta*, Shenlong Wang*
Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
[Paper] [Project] [Code]

We build animatable 3D models from arbitrary articulated object point cloud sequence.

CASA: Category-agnostic Skeletal Animal Reconstruction
Yuefan Wu*, Zeyuan Chen*, Shaowei Liu, Zhongzheng Ren, Shenlong Wang
Conference on Neural Information Processing Systems (NeurIPS), 2022.
[Paper] [Project] [Code]

we propose category-agnostic 3D animal reconstruction from a monocular video.

DexMV: Imitation Learning for Dexterous Manipulation from Human Videos
Yuzhe Qin*, Yueh-Hua Wu*, Shaowei Liu, Hanwen Jiang, Ruihan Yang, Yang Fu, Xiaolong Wang
European Conference on Computer Vision (ECCV), 2022.
[Paper] [Project] [Code]

we propose a new platform and pipeline for dexterous manipulation from videos.

Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videos
Shaowei Liu, Subarna Tripathi, Somdeb Majumdar, Xiaolong Wang
Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
[Paper] [Project] [Code]

We propose to forecast future hand-object interactions given an egocentric video.

Hand-Object Contact Consistency Reasoning for Human Grasps Generation
Hanwen Jiang* Shaowei Liu*, Jiashun Wang and Xiaolong Wang
International Conference on Computer Vision (ICCV), 2021 (Oral).
[Paper] [Project] [Code]

We propose to generate natural human grasps given a 3D object in the world.

Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Time
Shaowei Liu*, Hanwen Jiang*, Jiarui Xu, Sifei Liu and Xiaolong Wang
Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
[Paper] [Project] [Code]

We build a joint learning framework for estimating the 3D hand and object poses.

Light and Fast Hand Pose Estimation From Spatial-Decomposed Latent Heatmap
Shaowei Liu, Guijin Wang, Pengwei Xie, Cairong Zhang
IEEE Access 2020
[Paper] [Bibtex]

We present a light and efficient approach for depth-based hand pose estimation.

Experiences

Intel AI Lab
Multimodal Learning Intern
Jun. 21 - Aug. 21

Adobe Research
Intern - Research Scientist
June. 22 - Nov. 22

Award
    Outstanding Undergraduate Thesis (Top 5%), Tsinghua University. 2019