Junyi Zhang 章俊一

Hi! I am a first-year CS PhD student at UC Berkeley, advised by Prof. Trevor Darrell. Currently, I also work with Dr. Deqing Sun, Dr. Varun Jampani, and Prof. Ming-Hsuan Yang. I obtained my B.Eng. (Honors) degree in Computer Science from Shanghai Jiao Tong University (SJTU), where I worked with Prof. Yong-Lu Li as an undergraduate researcher, supervised by Prof. Cewu Lu. Previously, I was a research intern at Microsoft Research Asia (MSRA), mentored by Dr. Shizhao Sun and Dr. Jian-Guang Lou.

My research interests mainly lie in computer vision, deep generative models, and representation learning.

profile photo
News

[2024.12] Our work DenseMatcher is on arXiv!
[2024.10] Very excited to share our latest work, Monst3r, check out the interactive 4D results 🔥!
[2024.06] I graduated from SJTU with Honor Degree, Outstanding Graduates of Shanghai, and Best Bachelor Thesis! 🥳
[2024.03] Code for Telling Left from Right is released on GitHub.
[2024.02] 🎉 Our work Telling Left from Right is accepted by CVPR 2024! 🎉
[2023.11] Our work Telling Left from Right is on arXiv!
[2023.09] 🎉 Our work A Tale of Two Features is accepted to NeurIPS 2023! 🎉
[2023.08] Code for LayoutDiffusion is released on GitHub.
[2023.07] 🎉 Our work LayoutDiffusion is accepted to ICCV 2023! 🎉
[2023.06] Code for A Tale of Two Features is released on GitHub.
[2023.05] Our work A Tale of Two Features is on arXiv!
[2023.04] Our work Pangea is on arXiv!
[2023.03] Our work LayoutDiffusion is on arXiv!

Publications
MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motion
Junyi Zhang, Charles Herrmann+, Junhwa Hur, Varun Jampani, Trevor Darrell, Forrester Cole, Deqing Sun*, Ming-Hsuan Yang*
Under review, 2024
code / project page / arXiv
DenseMatcher: Learning 3D Semantic Correspondence for Category-Level Manipulation from a Single Demo
Junzhe Zhu*, Yuanchen Ju*, Junyi Zhang, Muhan Wang, Zhecheng Yuan, Kaizhe Hu, Huazhe Xu
Under review, 2024
code / project page / arXiv
Telling Left from Right: Identifying Geometry-Aware Semantic Correspondence
Junyi Zhang, Charles Herrmann, Junhwa Hur, Eric Chen, Varun Jampani, Deqing Sun*, Ming-Hsuan Yang*
CVPR, 2024
code / project page / arXiv / poster
From Isolated Islands to Pangea: Unifying Semantic Space for Human Action Understanding
Yong-Lu Li*, Xiaoqian Wu*, Xinpeng Liu, Zehao Wang, Yiming Dou, Yikun Ji, Junyi Zhang, Yixing Li, Xudong Lu, Jingru Tan, Cewu Lu
CVPR, 2024
code / project page / arXiv
A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondence
Junyi Zhang, Charles Herrmann, Junhwa Hur, Luisa F. Polanía, Varun Jampani, Deqing Sun, Ming-Hsuan Yang
NeurIPS, 2023
code / project page / arXiv / poster
LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models
Junyi Zhang, Jiaqi Guo, Shizhao Sun, Jian-Guang Lou, Dongmei Zhang
ICCV, 2023
code & project page / arXiv / poster
Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detection
Xiaoqian Wu*, Yong-Lu Li*, Xinpeng Liu, Junyi Zhang, Yuzhe Wu, Cewu Lu
ECCV, 2022
code / arXiv
Course Projects
InteractFusion: Synthesizing Interactive Motions with Noise-Decoupled Diffusion Models
Junyi Zhang and Hongchi Xia (course report only)
Advisor: Dr. Xinpeng Liu and Prof. Yong-Lu Li
CS3327: Virtual Reality and Augmented Display
SJTU, March 2023
Course Report
DiffStyle: Leverage Diffusion Prior to One-for-All Style Transfer
Junyi Zhang
CS3310: Computer Graphics
SJTU, Dec. 2022
Github / bilibili (in Chinese)
Experience
UCM logo
University of California, Merced

Merced, CA, USA
Visiting student
Supervisor: Prof. Ming-Hsuan Yang
Google logo
Google Research

Cambridge, MA, USA
Remote Collaborator
Supervisor: Dr. Deqing Sun, Dr. Varun Jampani, and Prof. Ming-Hsuan Yang
MSFT logo
Microsoft Research Asia

Beijing, China
Research intern
Supervisor: Dr. Shizhao Sun and Dr. Jian-Guang Lou
SJTU logo
Shanghai Jiao Tong University

Shanghai, China
First year GPA: 3.85 (rank 1/73)
Final GPA: 3.92 (rank 8/108)
B.Eng. in Computer Science and Technology (Honor), Zhiyuan Honors Program
Honors
Best Bachelor Thesis (top 1%, ranked 1/200+ in CS department), SJTU, 2024
Outstanding Graduates of Shanghai (top 3%), SJTU, 2024
Zhiyuan Outstanding Scholarship (top 5% in honors program), SJTU, 2024
SenseTime Scholarship (30 undergraduate AI researchers nationwide), SenseTime, 2023
Chandler-Chi Family Scholarship (top 5%), SJTU, 2023
Microsoft Research "Stars of Tomorrow" Certificate (top 10% interns), MSRA, 2022
Huawei Fellowship (top 1% in honors program), SJTU, 2022
Fujian Young Talent Merit Scholarship (50 winners in the whole province), Communist Youth League Fujian Committee, 2022
National Scholarship (top 0.2% nationwide), Ministry of Education of the People's Republic of China, 2021
Merit Scholarship, A Level (top 1%), SJTU, 2021
Merit Student Award (top 5%), SJTU, 2021
Zhiyuan Honors Scholarship (top 5%), SJTU, 2021, 2022, 2023
Meritorious Winner (top 7%), ICM, 2021
Misc.

I am a cinephile. My favorite directors include Martin Scorsese, Theodoros Angelopoulos, Leos Carax, Jean-Luc Godard, Paul Thomas Anderson, and many more. You can find a list of some of my favorite films here. I was the VP of the student group '800 Movie Theater' and hosted several salons and weekend theater events. I also write reviews on films, books, and games on Douban.