I am a third-year Ph.D. candidate from MMLab, The Chinese University of Hong Kong, and my advisor is Prof. Tianfan Xue.
I received both my Bachelor's and Master's degrees from Beijing Institute of Technology, supervised by Prof. Jianan Li. I spent a wonderful time in Qcraft and SenseTime as a research intern, mentored by Boyin Zhang and Dr. Zhanpeng Huang, respectively. I was a research assistant at Tsinghua University with Prof. Li Yi.
I have been working on Neural Rendering and Diffusion Model for 3D generation. My previous work also included 3D perception on Point Clouds. (*: Equal Contribution †: Corresponding Author)
We propose a hybrid pipeline for inserting 3D objects into videos, combining 3D Gaussian Splatting rendering for temporal consistency and a 2D diffusion-based enhancement for photorealistic lighting.
we propose an alternative to make sample-adaptive transformations based on the structure of the sample to cope with potential corruption via an auto-augmentation framework.
We propose a novel class-aware 3D proposal generation strategy and an efficient fully sparse convolutional 3D refinement module for vote-based Indoor 3D Detection.
We propose a novel multi-modality two-stage approach to effectively and efficiently fuse point clouds and camera images in the Regions of Interest(RoI).
The dynamic graph constructing strategy can well capture the fine-grained geometry ignored by previous aggregation operations.
Education
PhD in Multimedia Lab (MMLab) @ The Chinese University of Hong Kong Sep. 2023 - Now Advisor: Prof.Tianfan Xue
MSc in Opt-Electronics information Science and Engineeering @ Beijing Institute of Technology Sep. 2020 - Jun. 2023 Advisor: Prof.Jianan Li
BSc in Opt-Electronics information Science and Engineeering @ Beijing Institute of Technology Sep. 2016 - Jun. 2020 GPA: 90.2/100
Experience
Metaverse Video R&D at SenseTime Research Intern Text-to-3D Generation using both 2D and 3D priors May, 2023 - Sep, 2023 Mentor: Dr. Zhanpeng Huang 3DAR Group
Institute for Interdisciplinary Information Sciences (IIIS) at Tsinghua University Research Assistant 3D Generation with diffusion model and implicit fuction May, 2022 - Sep, 2022 Advisor: Prof. Li Yi 3D Visual Computing and Machine Intelligence (3DVICI) Lab
Qcraft Research Intern Beijing, China May, 2021 - June, 2022 Mentor: Boyin Zhang Perception & Machine Learning Group