Visual-Information Intelligent Learning LAB
Welcome to VILLA, the research group lead by Prof. Jian Zhang, affiliated to the School of Electronic and Computer Engineering, Peking University. We research on intelligent visual representation, reconstruction, and learning.

Previous Next

Current Team Members

Professor

Avatar

Jian Zhang (张健)

Assistant Professor, Ph. D. Supervisor

AI-based low-level vision and computational imaging, AI-generated content (AIGC) and security

Phd Students

Avatar

Jiechong Song (宋皆充)

Compressive Sensing, Image Restoration

Avatar

Yujie Hu (胡妤婕)

Image Synthesis, Image Translation, Image Animation

Avatar

Yanmin Wu (吴艳敏)

3D Vision-and-Language

Avatar

Youmin Xu (许佑民)

Computer Vision, Image Generation, Image Compression, Generative Adversarial Network

Avatar

Shuzhou Yang (杨树州)

3D Reconstruction, Image Restoration, Image Enhancement

Avatar

Chong Mou (牟冲)

Image Restoration, Object Detection

Avatar

Qiankun Gao (高乾坤)

Continual Learning, Transfer Learning, Multimodal Large Language Models

Avatar

Bin Chen (陈斌)

Image Reconstruction, Compressed Sensing, Inverse Imaging Problems

Master Students

Avatar

Zhenyu Zhang (张振宇)

Image Restoration and Enhancement, Video Processing

Avatar

Xinhua Cheng (程鑫华)

Computer Vision, Deep Learning, Person re-ID

Avatar

Jiwen Yu (余济闻)

AIGC-related Applications, Generation Models

Avatar

Yinhuai Wang (王荫槐)

Deep Learning, Robotics, Computer Vision, Generative Models

Avatar

Qian Wang (王茜)

Image Restoration, Compressive Sensing, Computer Vision

Avatar

Xuanyu Zhang (张轩宇)

Image Restoration and Enhancement

Avatar

Weiqi Li (李玮琦)

AIGC, 360 Image Processing, Compressed Sensing

Avatar

Yu Gu (古雨)

Deep Learning, Computer Vision, Compressive Sensing

Avatar

Runyi Li (李润一)

Computer Vision, Compressed Sensing, Image Restoration

Avatar

Xuhan Sheng (盛栩涵)

Omnidirectional Image Problem, SNN

Avatar

Haijie Li (李海杰)

3D Vision-and-Language

Avatar

Guanhua Zhao (赵灌华)

Computer Vision, Deep Learning, Multimedia Coding

Avatar

Chengxiang Wen (温程翔)

Computer Vision, Deep Learning

Avatar

Yu Wang (汪玉)

Computer Vision, Deep Learning

Alumni

2022

Jianhui Chang (常建慧)

Master 2019-2022, To Ph.D study at Peking University

Mengxi Jia (贾梦溪)

Master 2019-2022, To Ph.D study at Peking University

Zhuoyuan Wu (武卓远)

Master 2019-2022, To work at Mei Tuan

Zihong Huang (黄姿鸿)

Master 2019-2022, To work at Alibaba

Di You (由迪)

Master 2019-2022, To Ph.D study at Imperial College London

2023

Jingfen Xie (谢静芬)

Master 2020-2023, To work at ByteDance

Recent News

  • 2024/04 - 1 paper accepted to TPAMI!
  • 2024/02 - 6 papers accepted to CVPR 2024!
  • 2024/01 - 2 papers accepted to ICLR 2024!
  • 2023/12 - 3 papers accepted to AAAI 2024!
  • 2023/11 - 1 paper accepted to TPAMI!
  • 2023/10 - 1 paper accepted to TMM!
  • 2023/09 - 1 paper accepted to NeurIPS 2023!
  • 2023/08 - 1 paper accepted to TIM!
  • 2023/07 - 3 papers accepted to ICCV 2023!
  • 2023/05 - 1 paper accepted to IJCV!
  • 2023/05 - 1 paper accepted to TIP!
  • 2023/04 - 1 paper accepted to IJCAI!
  • 2023/04 - 1 paper accepted to IJCV!
  • 2023/04 - 1 paper accepted to TRO!
  • 2023/03 - 1 paper accepted to TIP!
  • 2023/02 - 4 papers accepted to CVPR 2023!
  • 2023/02 - 1 paper accepted to TCSVT!
  • 2023/01 - 1 paper accepted to IJCV!
  • 2023/01 - 1 paper accepted to ICLR 2023!
  • 2022/11 - 4 papers accepted to AAAI 2023!
  • 2022/09 - 1 paper accepted to SPM!
  • 2022/08 - 1 paper accepted to TNNLS!
  • 2022/07 - 1 paper accepted to TPAMI!
  • 2022/07 - 1 paper accepted to TIP!
  • 2022/07 - 1 paper accepted to TNNLS!
  • 2022/07 - 2 papers accepted to ECCV 2022!
  • 2022/07 - 2 papers accepted to ACM MM 2022!
  • 2022/06 - 1 paper accepted to MICCAI 2022!
  • 2022/05 - 1 paper accepted to TCSVT!
  • 2022/05 - 1 paper accepted to TMM!

Papers 2024

Chong Mou (牟冲), Xintao Wang, Yanze Wu, Ying Shan, Jian Zhang (张健) (2024). Empowering Real-World Image Super-Resolution with Flexible Interactive Modulation!. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).

Xuanyu Zhang (张轩宇), Runyi Li (李润一), Jiwen Yu (余济闻), Youmin Xu (许佑民), Weiqi Li (李玮琦), Jian Zhang (张健) (2024). EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protection. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

PDF Code Project

Qian Wang (王茜), Weiqi Li (李玮琦), Chong Mou (牟冲), Xinhua Cheng (程鑫华), Jian Zhang (张健) (2024). 360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Model. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

PDF Code Project

Chong Mou (牟冲), Xintao Wang, Jiechong Song (宋皆充), Ying Shan, Jian Zhang (张健) (2024). DiffEditor: Boosting Accuracy and Flexibility on Diffusion-based Image Editing. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

PDF Code Project

Chong Mou (牟冲), Xintao Wang, Jiechong Song (宋皆充), Ying Shan, Jian Zhang (张健) (2024). DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Models. International Conference on Learning Representations (ICLR).

PDF Code Project

See All

Papers 2023

Wenxue Cui, Xiaopeng Fan, Jian Zhang (张健), Debin Zhao (2023). Deep Unfolding Network for Image Compressed Sensing by Content-adaptive Gradient Updating and Deformation-invariant Non-local Modeling. IEEE Transactions on Multimedia (TMM).

PDF

Jiwen Yu (余济闻), Xuanyu Zhang (张轩宇), Youmin Xu (许佑民), Jian Zhang (张健) (2023). CRoSS: Diffusion Model Makes Controllable, Robust and Secure Image Steganography. Advances in Neural Information Processing Systems (NeurIPS).

PDF Code

Jiechong Song (宋皆充), Jian Zhang (张健) (2023). SODAS-Net: Side-Information-Aided Deep Adaptive Shrinkage Network for Compressive Sensing. IEEE Transactions on Instrumentation and Measurement (TIM).

PDF Code

Qiankun Gao (高乾坤), Chen Zhao, Yifan Sun, Teng Xi, Gang Zhang, Bernard Ghanem, Jian Zhang (张健) (2023). A Unified Continual Learning Framework with General Parameter-Efficient Tuning. International Conference on Computer Vision (ICCV).

PDF Code

Jiwen Yu (余济闻), Yinhuai Wang (王荫槐), Chen Zhao, Bernard Ghanem, Jian Zhang (张健) (2023). Freedom: Training-free energy-guided conditional diffusion model. International Conference on Computer Vision (ICCV).

PDF Code

See All

Papers 2022

Zihong Huang (黄姿鸿), Jian Zhang (张健) (2022). Contrastive Unfolding Deraining Network. IEEE Transactions on Neural Networks and Learning Systems (TNNLS).

PDF

Chong Mou (牟冲), Jian Zhang (张健) (2022). TransCL: Transformer Makes Strong and Flexible Compressive Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).

PDF Code

Bin Chen (陈斌), Jian Zhang (张健) (2022). Content-aware Scalable Deep Compressed Sensing. IEEE Transactions on Image Processing (TIP).

PDF Code

Yuqing Liu, Qi Jia, Jian Zhang (张健), Xin Fan, Shanshe Wang, Siwei Ma, Wen Gao (2022). Hierarchical Similarity Learning for Aliasing Suppression Image Super-Resolution. IEEE Transactions on Neural Networks and Learning Systems (TNNLS).

PDF

Qiankun Gao (高乾坤), Chen Zhao, Bernard Ghanem, Jian Zhang (张健) (2022). R-DFCIL: Relation-Guided Representation Learning for Data-Free Class Incremental Learning. European Conference on Computer Vision (ECCV).

PDF Code

See All

Papers Before 2022

Zhuchen Shao, Hao Bian, Yang Chen, Yifeng Wang, Jian Zhang (张健), Xiangyang Ji, Yongbing Zhang (2021). TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classification. Advances in Neural Information Processing Systems (NeurIPS).

PDF

Zhuoyuan Wu (武卓远), Jian Zhang (张健), Chong Mou (牟冲) (2021). Dense Deep Unfolding Network with 3D-CNN Prior for Snapshot Compressive Sensing. International Conference on Computer Vision (ICCV).

PDF Code

Chong Mou (牟冲), Jian Zhang (张健), Zhuoyuan Wu (武卓远) (2021). Dynamic Attentive Graph Learning for Image Restoration. International Conference on Computer Vision (ICCV).

PDF Code

Jing Zhao, Jiyu Xie, Ruiqin Xiong, Jian Zhang (张健), Zhaofei Yu, Tiejun Huang (2021). Super Resolve Dynamic Scene from Continuous Spike Streams. International Conference on Computer Vision (ICCV).

PDF

Jiechong Song (宋皆充), Bin Chen (陈斌), Jian Zhang (张健) (2021). Memory-Augmented Deep Unfolding Network for Compressive Sensing. ACM International Conference on Multimedia (ACM MM).

PDF

See All

Openings

Postdoctoral Fellows

The VILLA group at PKU is looking for a top postdoctoral researcher with expertise in computer vision, computational photography, and deep learning. The researcher for this opening will work at PKU to investigate and develop principled computational methods for highly effective, scalable, and robust visual-information intelligent learning (e.g. person re-identification, tracking, segmentation, compression, reconstruction). Please send a full CV with a complete list of your publications and projects to Prof. Jian Zhang.

Students

The VILLA group at PKU is looking for motivated MS and Ph.D. students in computer vision and signal processing. Please send a full CV with a complete list of your publications and projects, as well as, an unofficial academic transcript to Prof. Jian Zhang.
国内学生请认真阅读【2024招收硕士/博士研究生及访问学生申请须知】。

Contact