Zidong Du 杜子东

Associate Professor
Institute of Computing Technology, Chinese Academy of Sciences


About Me

Du, Zidong (杜子东),is an associate professor at Intelligent Processor Research Center, Institute of Computing Technology (ICT), Chinese Academy of Sciences (CAS). His research interests mainly focus on novel architecture for artificial intelligence, including deep learning processors, inexact/approximate computing, neural network architecture, neuromorphic architecture. He has published over 20 top-tier computer architecture research papers, including ASPLOS, MICRO, ISCA, TC, TOCS, TCAD. For his innovative works on deep learning processors, he won the best paper award of ASPLOS’14, Distinguished Doctoral Dissertation Award of CAS (40/10000), Distinguished Doctoral Dissertation Award of China Computer Federation (10 per year).

He obtained his Ph.D degree from ICT, CAS in 2016 with the guidance from Prof. Yunji Chen, Prof. Olivier Temam and Prof. Chengyong Wu. He obtained his bachelor degree of Engineering from Department of Electronic Engineering, Tsinghua University in 2011.


Experience

  • 2018~now: Associate Professor, Institute of Computing Technology, Chinese Academy of Sciences
  • 2016~2018: Assistant Professor, Institute of Computing Technology, Chinese Academy of Sciences
  • 2011~2016: Ph.D. Candidate, Institute of Computing Technology, Chinese Academy of Sciences
  • 2007~2011: Bachelor Eng., Dept. of Electronic Engineering, Tsinghua University

  • Service

  • Program committee member: PMAM'17, APPT'17, PMAM'18, ACA'18, PMAM'19, ASPLOS'19, MICRO'19, MICRO'20, PMAM'20, PMAM'21, HPCA'21
  • External committee member: HPCA'18, ASPLOS'20, ASPLOS'21
  • Submission chair: ASPLOS'17

  • Research Interests

    Including but not limited to:

  • Computer Architecture
  • Inexact/Approximate Computing
  • Neural Networks
  • Machine Learning
  • Neuromorphic Computing

  • Selected Publications

    Conference Papers

    • [CVPR'20] Xishan Zhang, Shaoli Liu, Rui Zhang, Chang Liu, Di Huang, Shiyi Zhou, Jiaming Guo, Yu Kang, Qi Guo, Zidong Du, Yunji Chen, "Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers", in Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR'20), 2020.
    • [AAAI'20] Di Huang, Xishan Zhang, Rui Zhang, Tian Zhi, Deyuan He, Jiaming Guo, Chang Liu, Qi Guo, Zidong Du, Shaoli Liu, Tianshi Chen, Yunji Chen, "DWM: A Decomposable Winograd Method for Convolution Acceleration", in Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI'20), 2020.
    • [ISCA'19] Yongwei Zhao, Zidong Du, Qi Guo, Shaoli Liu, Ling Li, Zhiwei Xu, Tianshi Chen, Yunji Chen, "Cambricon-F: Machine Learning Computers with Fractal von Neumann Architecture", in Pr oceedings of the 46th International Symposium on Computer Architectuer (ISCA'19), 2019.
    • [AAAI'19] Lei Zhang, Shengyuan Zhou, Tian Zhi, Zidong Du, Yunji Chen, "TDSNN: From Deep Neural Networks to Deep Spike Neural Networks with Temporal coding", in Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence (AAAI'19), 2019.
    • [MICRO'18] Xuda Zhou, Zidong Du, Qi Guo, Chengsi Liu, Xuehai Zhou, Ling Li, Tianshi Chen, Yunji Chen, "Cambricon-S: Addressing Irregularity in Sparse Neural Networks through a Cooperative Software/Hardware Approach",in Proceedings of the 51st IEEE/ACM International Symposium on Microarchitecture (MICRO'18), 2018.
    • [MICRO'16] Shijin Zhang, Zidong Du, Lei Zhang, Huiying Lan, Shaoli Liu, Ling Li, Qi Guo, Tianshi Chen, and Yunji Chen, "Cambricon-X: An Accelerator for Sparse Neural Networks," in Proceedings of the 49th IEEE/ACM International Symposium on Microarchitecture (MICRO'16), 2016.
    • [ISCA'16] Shaoli Liu, Zidong Du, Jinhua Tao, Dong Han, Tao Luo, Yuan Xie, Yunji Chen, and Tianshi Chen, "Cambricon: An Instruction Set Architecture for Neural Networks," in Proceedings of the 43rd ACM/IEEE International Symposium on Computer Architecture (ISCA'16), 2016.
    • [MICRO'15] Zidong Du, Daniel D. Ben-Dayan Rubin, Yunji Chen, Liqiang He, Tianshi Chen, Lei Zhang, Chengyong Wu, Olivier Temam, "Neuromorphic accelerators: a comparison between neuroscience and machine-learning approaches," in Proceedings of the 48th IEEE/ACM International Symposium on Microarchitecture (MICRO'15), 2015, pp. 494-507
    • [ISCA'15] Zidong Du, Robert Fasthuber, Tianshi Chen, Paolo Ienne, Ling Li, Tao Luo, Xiaobing Feng, Yunji Chen, Olivier Temam, "ShiDianNao: shifting vision processing closer to the sensor," in Proceedings of the 42nd ACM/IEEE International Symposium on Computer Architecture (ISCA'15), 2015, pp. 92-104
    • [DATE'15] Jiachao Deng, Yuntan Fang, Zidong Du, Ying Wang, Huawei Li, Olivier Temam, Paolo Ienne, David Novo, Xiaowei Li, Yunji Chen, Chengyong Wu,  "Retraining-based timing error mitigation for hardware neural networks," in Proceedings of the 2015 Design, Automation & Test in Europe Conference & Exhibition (DATE'15), 2015, pp. 593-596
    • [ASPLOS'14] Tianshi Chen, Zidong Du, Ninghui SunJia WangChengyong WuYunji ChenOlivier Temam"DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning,"  in Proceedings of the 19th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'14), 2014: 269-284 (Best Paper)
    • [ASP-DAC'14] Zidong Du, Krishna V. Palem, Lingamneni Avinash, Olivier Temam, Yunji Chen, Chengyong Wu, "Leveraging the error resilience of machine-learning applications for designing highly energy efficient accelerators," in Proceedings of the 19th Asia and South Pacific Design Automation Conference (ASP-DAC'14), 2014, pp. 201-206
    • [ISADS'11] Zidong Du, Bingbing Xia, Fei Qiao, Huazhong Yang, "System-Level Evaluation of Video Processing System Using SimpleScalar-Based Multi-core Processor Simulator." in Proceedings of The Tenth International Symposium on Autonomous Decentralized Systems (ISADS'11), 2011, pp. 256-259

    Journal Articles

    • [PIEEE] Zidong Du#, Qi Guo#, Yongwei Zhao, Tian Zhi, Yunji Chen*, Zhiwei Xu, "Self-Aware Neural Network Systems: A Survey and New Perspective", Proceedings of the IEEE (PIEEE), 2020.
    • [TC] Yongwei Zhao, Zhe Fan, Zidong Du*, Tian Zhi, Ling Li, Qi Guo, Shaoli Liu, Zhiwei Xu, Tianshi Chen, Yunji Chen, "Machine Learning Computers with Fractal von Neumann Architecture", IEEE Transactions on Computers (TC), 2020.
    • [TC] Xi Zeng, Tian Zhi, Xuda Zhou, Zidong Du, Qi Guo, Shaoli Liu, Bingrui Wang, Yuanbo Wen, Chao Wang, Xuehai Zhou, Ling Li, Tianshi Chen, Ninghui Sun, Yunji Chen*, "Addressing Irregularity in Sparse Neural Networks through a Cooperative Software/Hardware Approach", IEEE Transactions on Computers (TC), 2020.
    • [TOCS] Yunji Chen, Huiying Lan, Zidong Du*, Shaoli Liu, Jinhua Tao, Dong Han, Tao Luo, Qi Guo, Ling Li, Yuan Xie, Tianshi Chen, "An Instruction Set Architecture for Machine Learning", ACM Transactions on Computer Systems (TOCS), 2019.
    • [TCAD] Shengyuan Zhou, Qi Guo, Zidong Du*, Daofu Liu, Tianshi Chen, Ling Li, Shaoli Liu, Jinhong Zhou, Olivier Teman, Xiaobing Feng, Xuehai Zhou, Yunji Chen, "ParaML: A Polyvalent Multi-core Accelerator for Machine Learning", IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD), 2019.
    • [TCAD] Xuda Zhou, Zidong Du, Shijin Zhang, Lei Zhang, Huiying Lan, Shaoli Liu, Ling Li, Qi Guo, Tianshi Chen, Yunji Chen*, "Addressing Sparsity in Deep Neural Networks", IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD), 2018.
    • [TCAD] Zidong Du, Shaoli Liu, Robert Fasthuber, Tianshi Chen, Paolo Ienne, Ling Li, Tao Luo, Qi Guo, Xiaobing Feng, Yunji Chen and Olivier Temam, "An Accelerator for High Efficient Vision Processing," IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD), 2017.
    • [IEEE Micro] Tianshi Chen, Zidong Du, Ninghui Sun, Jia Wang, Chengyong Wu, Yunji Chen, Olivier Temam, "A High-Throughput Neural Network Accelerator," IEEE Micro 35(3). pp. 24-32, 2015
    • [TC] Tianshi Chen, Shijin Zhang, Shaoli Liu, Zidong Du, Tao Luo, Yuan Gao, Junjie Liu, Dongsheng Wang, Chengyong Wu, Ninghui Sun, Yunji Chen, Olivier Temam, "A Small-Footprint Accelerator for Large-Scale Neural Networks," ACM Transactions on Computer System (TC) 33(2), 2015
    • [TCAD] Zidong Du, Avinash Lingamneni, Yunji Chen, Krishna V. Palem, Olivier Temam, and Chengyong Wu, "Leveraging the Error Resilience of Neural Networks for Designing Highly Energy Efficient Accelerators," IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD), 34(8), 2015.
    • [TACO] Shuangde Fang, Zidong Du, Yuntan Fang, Yuanjie Huang, Yang Chen, Lieven Eeckhout, Olivier Temam, Huawei Li, Yunji Chen, Chengyong Wu, "Performance Portability Across Heterogeneous SoCs Using a Generalized Library-Based Approach," ACM Transactions on Architecture and Code Optimization (TACO) 11(2): 21 (2014)
    • [JCSC] Bingbing XiaFei QiaoZidong DuDi ZhuHuazhong Yang"A 'Near-the-Best' System-Level Design Methodology of Multi-Core H.264 Video Decoder Based on the Parallelized Multi-Core Simulator," Journal of Circuits, Systems, and Computers 21(7), 2012

    Patterns&Books

    TBD


    Awards

  • 2020 DAMO Academy Young Fellow
  • 2019 Beijing Academy of Artificial Intelligence, Young Scientists
  • 2019 Chinese Academy of Sciences, Outstanding Achievement on Science and Technology Award
  • 2019 Beijing Nova Program of Science and Technology
  • 2019 Chinese Academy of Sciences, Youth Innovation Promotion Association
  • 2017 Chinese Academy of Sciences (CAS) Distinguished Doctoral Dissertation Award
  • 2016 China Computer Federation (CCF) Distinguished Doctoral Dissertation Award
  • 2016 Presidential Scholarship for Postgraduate Students of CAS, Special Prize
  • 2015 National scholarship for Ph.D. students
  • 2014 Sugon Doctoral Award
  • 2014 "Three Good" student, Chinese Academy of Sciences
  • 2014 Best Paper Award of ASPLOS