Jin Cao

曹晋

My goal is to digitalize the physical world — building virtual worlds that power entertainment and robotics.

Portrait of Jin Cao

relighted by IC-Light

About· 01 ·

I'm Jin Cao, an incoming Computer Science PhD student at UT Austin, advised by Prof. Qixing Huang and Prof. Georgios Pavlakos. I am currently working with Dr. Kaipeng Zhang from Alaya Lab. During my undergraduate, I was fortunate to collaborate with Prof. Jiajun Wu and Koven Yu from Stanford, Prof. Sida Peng and Prof. Xiaowei Zhou from ZJU3DV, Zhejiang University, and Prof. Xiangyong Cao and Prof. Deyu Meng from Xi'an Jiaotong University.

My research interest is to build virtual worlds that digitalize the physical world and enable downstream applications such as entertainment and robotics. Toward this goal, I focus on learning world representations from multi-modal data and building generative models on top of them. Recently, I have been interested in long-context generative world modeling, physically-grounded generation, and controllable generation in support of this goal.

News· 02 ·

Selected Publications· 03 ·

* indicates equal contribution. See the full list on Google Scholar.

Education· 04 ·

The University of Texas at Austin

Incoming · Austin, USA

Incoming Ph.D. in Computer Science, advised by Prof. Qixing Huang and Prof. Georgios Pavlakos

Xi'an Jiaotong University

2022.09 – 2026.06 · Shaanxi, China

Undergraduate in Computer Science

Special Class for the Gifted Young 少年班

2021.09 – 2022.06 · Xi'an Jiaotong University (Suzhou High School)

Admitted through China's elite program for gifted youth — ranked top 13 / 235, with direct admission to undergraduate study.

Experience· 05 ·

Alaya Lab, Shanda AI

2026.04 – Present · Shanghai, China

Research Intern at Alaya Lab with Dr. Kaipeng Zhang · Dynamics Representation Learning & Fully-Controllable Video Generation

Stanford Vision and Learning Lab (SVL)

2025.02 – 2026.06 · California, USA

Research Intern with Koven Yu and Prof. Jiajun Wu · Iterative 3D Scene Generation

ZJU3DV, Zhejiang University

2024.12 – 2025.10 · Zhejiang, China

Research Intern with Prof. Sida Peng and Prof. Xiaowei Zhou · Robust Radiance Field Reconstruction

Xi'an Jiaotong University

2024.03 – 2025.02 · Shaanxi, China

Research with Prof. Xiangyong Cao and Prof. Deyu Meng · Low-Level Image Processing (Super Resolution, Dehazing)