Zhaoyang Zhang's Homepage

Circle Image

Zhaoyang Zhang

Computer Vision Researcher

Final-year PhD candidate in The Chinese University of Hong Kong

Under supervision of Prof. Xiaogang Wang and Prof Ping Luo.

I am currently a Senior Research Scientist at Tencent's ARC Lab. We have several open intern positions focused on controllable video and image generation. If you are interested, please feel free to contact me via email.

Email: zhaoyangzhang@link.cuhk.edu.hk


Publications

Musketeer (All for One, and One for All): A Generalist Vision-Language Model with Task Explanation Prompts

Zhaoyang Zhang Yantao Shen, Kunyu Shi, Zhaowei Cai, Jun Fang, Siqi Deng, Hao Yang, Davide Modolo, Zhuowen Tu, Stefano Soatto

Under Review

[PDF]

Real-time Controllable Denoising for Image and Video

Zhaoyang Zhang, Yitong Jiang, Wenqi Shao, Xiaogang Wang, Ping Luo, Kaimo Lin, Jinwei Gu

CVPR 2023

[PDF]

Not all models are equal: predicting model transferability in a self-challenging fisher space

Wenqi Shao, Xun Zhao, Yixiao Ge, Zhaoyang Zhang, Lei Yang, Xiaogang Wang, Ying Shan, Ping Luo

ECCV 2022

[PDF]

Dynamic Token Normalization Improves Vision Transformer

Wenqi Shao, Yixiao Ge, Zhaoyang Zhang, Xuyuan Xu, Xiaogang Wang, Ying Shan, Ping Luo

ICLR 2022

[PDF]

STAR: A Structure-aware Lightweight Transformer for Real-time Image Enhancemen

Zhaoyang Zhang, Yitong Jiang, Jun Jiang, Xiaogang Wang, Ping Luo, Jinwei Gu

ICCV 2021

[PDF]

Differentiable Dynamic Quantization with Mixed Precision and Adaptive Resolution

Zhaoyang Zhang, Wenqi Shao, Jinwei Gu, Xiaogang Wang, Ping Luo

ICML 2021 (Spotlight)

[PDF]

Differentiable learning-to-group channels via groupable convolutional neural networks

Zhaoyang Zhang, Jingyu Li, Wenqi Shao, Zhanglin Peng, Ruimao Zhang, Xiaogang Wang, Ping Luo

ICCV 2019

[PDF]

Temporal Sequence Distillation: Towards Few-Frame Action Recognition in Videos

Zhaoyang Zhang, Zhanghui Kuang, Ping Luo, Litong Feng, Wei Zhang

ACM Multimedia 2018

[PDF]

Boosting up Scene Text Detectors with Guided CNN

Xiaoyu Yue, Zhanghui Kuang, Zhaoyang Zhang, Zhenfang Chen, Pan He, Yu Qiao, Wei Zhang

BMVC 2018 (Oral)

[PDF]

BWCP: Probabilistic Learning-to-Prune Channels for ConvNets via Batch Whitening

Wenqi Shao, Hang Yu, Zhaoyang Zhang, Hang Xu ,Zhenguo Li, Ping Luo

Under Review

[PDF]

FAT: Learning Low-Bitwidth Parametric Representation via Frequency-Aware Transformation

Chaofan Tao, Rui Lin, Quan Chen, Zhaoyang Zhang, Ping Luo, Ngai Wong

IEEE Transactions on Neural Networks and Learning Systems

[PDF]

Adax: Adaptive gradient descent with exponential long term memory

Wenjie Li, Zhaoyang Zhang, Xinjiang Wang, Ping Luo

Under Review

[PDF]

Experience

  • 2018.7 - 2019.7

    Research Assistant, Multimedia Lab, The Chinese University of Hong Kong

    Supervised by Prof. Ping Luo and Prof Hongsheng Li
  • 2022.9 - 2023.3

    Applied Scientist Intern, AWS AI Labs, Bellevue, US

    Mentored by Dr. Yantao Shen and Prof. Zhuowen Tu

Skills

PyTorch
Tensorflow
Flax
Caffe
NumPy
CUDA
C/C++
Python