Zifan Shi

Ⓜ️">

Zifan Shi

Hello! I am a research scientist at Adobe Research. I obtained my PhD degree at the Department of Computer Science and Engineering, the Hong Kong University of Science and Technology (HKUST), supervised by Prof. Dit-Yan Yeung and Prof. Qifeng Chen. During my PhD study, I was a visiting student researcher at Stanford University, advised by Prof. Gordon Wetzstein. Before that, I obtained a Bachelor's degree at Nanjing University. My research interests include world model, generative models and 3D&4D vision.

If you're interested in collaborating or doing an internship with me, please don't hesitate to get in touch!

Email1 / Email2 / Github / Google Scholar

News

[04/2025]: One paper is accepted to SIGGRAPH TOG 2025.

[03/2025]: One paper is accepted to CVPR 2025.

[11/2024]: One papers is accepted to 3DV 2025.

[07/2024]: Two papers are accepted to ECCV 2024.

[02/2024]: One paper is accepted to CVPR 2024.

[01/2024]: One paper is accepted to ICLR 2024 (Spotlight).

[09/2023]: One paper is accepted to NeurIPS 2023 Datasets and Benchmarks Track.

[07/2023]: One paper is accepted to ICCV 2023.

[02/2023]: Two papers, with one highlight, are accepted to CVPR 2023.

[10/2022]: Our survey on 3D generative models is available now.

[09/2022]: One paper is accepted to NeurIPS 2022 (Spotlight).

[07/2022]: One paper is accepted to ECCV 2022 (Oral).

[07/2021]: One paper is accepted to IROS 2021.

[03/2021]: One paper is accepted to CVPR 2021.

Publications

(* indicates equal contribution)

	RigAnything: Template-Free Autoregressive Rigging for Diverse 3D Assets Isabella Liu, Zhan Xu, Yifan Wang, Hao Tan, Zexiang Xu, Xiaolong Wang, Hao Su, Zifan Shi SIGGRAPH TOG 2025 Paper / Project Page
	Exploring Sparse MoE in GANs for Text-conditioned Image Synthesis Jiapeng Zhu, Ceyuan Yang, Kecheng Zheng, Yinghao Xu, Zifan Shi, Yifei Zhang, Qifeng Chen, Yujun Shen CVPR 2025 Paper / Code
	Learning Naturally Aggregated Appearance for Efficient 3D Editing Ka Leong Cheng, Qiuyu Wang, Zifan Shi, Kecheng Zheng, Yinghao Xu, Ouyang Hao, Qifeng Chen, Yujun Shen 3DV 2025 Paper / Project Page / Code
	GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generation Yinghao Xu, Zifan Shi, Yifan Wang, Hansheng Chen, Ceyuan Yang, Sida Peng, Yujun Shen, Gordon Wetzstein ECCV 2024 Paper / Project Page / Code / Hugging Face Demo
	Real-time 3D-aware Portrait Editing from a Single Image Qingyan Bai, Zifan Shi, Yinghao Xu, Ouyang Hao, Qiuyu Wang, Ceyuan Yang, Xuan Wang, Gordon Wetzstein, Yujun Shen, Qifeng Chen ECCV 2024 Paper / Project Page / Code / Hugging Face Demo
	Gaussian Shell Maps for Efficient 3D Human Generation Rameen Abdal, Yifan Wang, Zifan Shi, Yinghao Xu, Ryan Po, Zhengfei Kuang, Qifeng Chen, Dit-Yan Yeung, Gordon Wetzstein CVPR* 2024 Paper / Project Page / Code
	DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model Yinghao Xu, Hao Tan, Fujun Luan, Sai Bi, Peng Wang, Jiahao Li, Zifan Shi, Kalyan Sunkavalli, Gordon Wetzstein, Zexiang Xu, Kai Zhang ICLR 2024 (Spotlight Presentation) Paper / Project Page
	GenDeF: Learning Generative Deformation Field for Video Generation Wen Wang, Kecheng Zheng, Qiuyu Wang, Hao Chen, Zifan Shi, Ceyuan Yang, Yujun Shen, Chunhua Shen arXiv 2023 Paper / Project Page / Code
	Benchmarking and Analyzing 3D-aware Image Synthesis with a Modularized Codebase Qiuyu Wang, Zifan Shi, Kecheng Zheng, Yinghao Xu, Sida Peng, Yujun Shen NeurIPS 2023 Datasets and Benchmarks Track Paper / Code
	LinkGAN: Linking GAN Latents to Pixels for Controllable Image Synthesis Jiapeng Zhu, Ceyuan Yang, Yujun Shen, Zifan Shi, Deli Zhao, Qifeng Chen ICCV* 2023 Paper / Project Page / Code
	Learning 3D-aware Image Synthesis with Unknown Pose Distribution Zifan Shi, Yujun Shen, Yinghao Xu, Sida Peng, Yiyi Liao, Sheng Guo, Qifeng Chen, Dit-Yan Yeung CVPR 2023 Paper / Project Page / Code / Demo
	DiscoScene: Spatially Disentangled Generative Radiance Field for Controllable 3D-aware Scene Synthesis Yinghao Xu, Menglei Chai, Zifan Shi, Sida Peng, Ivan Skorokhodov, Aliaksandr Siarohin, Ceyuan Yang, Yujun Shen, Hsin-Ying Lee, Bolei Zhou, Sergey Tulyakov CVPR 2023 (Highlight Presentation) Paper / Project Page / Code / Demo
	3D Generative Models: A Survey Zifan Shi, Sida Peng, Yinghao Xu, Andreas Geiger, Yiyi Liao, Yujun Shen arXiv* 2022 Paper / Github
	Improving 3D-aware Image Synthesis with A Geometry-aware Discriminator Zifan Shi, Yinghao Xu, Yujun Shen, Deli Zhao, Qifeng Chen, Dit-Yan Yeung NeurIPS 2022 (Spotlight Presentation) Paper / Project Page / Code / Demo
	3D-Aware Indoor Scene Synthesis with Depth Priors Zifan Shi, Yujun Shen, Jiapeng Zhu, Dit-Yan Yeung, Qifeng Chen ECCV 2022 (Oral Presentation) Paper / Project Page / Code / Demo
	Stereo Waterdrop Removal with Row-wise Dilated Attention Zifan Shi, Na Fan, Dit-Yan Yeung, Qifeng Chen IROS 2021 Paper / Code
	Neural Camera Simulators Ouyang Hao , Zifan Shi , Chenyang Lei, Ka Lung Law, Qifeng Chen CVPR 2021 Paper / Code

Experiences

	Visiting Researcher, Stanford University Host by Prof. Gordon Wetzstein Oct 2023 - Mar 2024
	Research Scientist Intern, Adobe Host by Dr. Zhixin Shu May 2023 - Aug 2023
	Research Intern, Ant Research Host by Dr. Yujun Shen Jun. 2022 - Apr. 2023
	Research Intern, Bytedance Host by Dr. Yujun Shen Sep. 2021 - May 2022

Selected Awards

NeurIPS Travel Award, 2022
Hong Kong PhD Fellowship, 2019-2023
Dong-Liang Special Scholarship, Nanjing University, 2018
First Prize of the National Elite Program Scholarship, 2017
National Scholarship, 2016

Thank Dr. Jon Barron for sharing the source code of his personal page.