Embed Size (px)
Citation preview
北京市海淀区中关村大街 59 号,100872,010-62510977
59 Zhongguancun Street, Haidian District, Beijing, 100872, P. R. China,86-10-62510977
统计与大数据研究院
Institute of Statistics and Big Data
Dr. Yu Cheng Courses and Lectures
Lecturer: Dr. Yu Cheng
Senior Researcher
Microsoft AI and Research
Topic： Introduction to deep learning
Time 2：00pm-5：30pm Classroom
June
25th，
Monday
Introduction, the basis of machine
learning and neural networks
Chinese Classical
Building 226 Room
June
26th，
Tuesday
Convolutional neural networks,
recurrent neural networks
Chinese Classical
Building 226 Room
June
27th，
Wednesday
Training neural networks, deep learning
software
Chinese Classical
Building 226 Room
June
28th，
Thursday
Optimization in deep learning, deep
reinforcement learning
Chinese Classical
Building 226 Room
June
29th，
Friday
Advanced topics in deep learning,
course project (optional)
Chinese Classical
Building 226 Room
北京市海淀区中关村大街 59 号,100872,010-62510977
59 Zhongguancun Street, Haidian District, Beijing, 100872, P. R. China,86-10-62510977
统计与大数据研究院
Institute of Statistics and Big Data
PhD course: Introduction to Deep Learning
Lectured by Dr. Yu Cheng
Dates: June 25, 2018 -- June 29, 2018 2：00pm-5：30pm
Location:Chinese Classical Building 226 Room（国学馆 226），Renmin
University of China
Structure:
The course consists of five days of approximately 3.5 hours of lectures per day.
Content:
Course description: deep neural network (aka “deep learning”) approaches have
achieved great success in many applications over the past few years. This course
provides an in-depth understanding of deep neural network and its applications in
computer vision, natural language processing, and health informatics. I will focus
on deep neural network architectures, optimization, learning algorithms and
practical engineering tricks for training neural networks. Besides that, I will also
cover some advanced topics in this area.
Basic requirements:
basic knowledge of linear algebra, probability, and statistics
References:
1. Deep Learning, Ian Goodfellow and Yoshua Bengio and Aaron Courville, 2016.
http://www.deeplearningbook.org/
2. Machine Learning, Pattern Recognition and Machine Learning, Christopher M.
Bishop, 2006.
3. Linear Algebra and Matrix Computation:
https://www.math.uwaterloo.ca/~hwolkowi/matrixcookbook.pdf
北京市海淀区中关村大街 59 号,100872,010-62510977
59 Zhongguancun Street, Haidian District, Beijing, 100872, P. R. China,86-10-62510977
统计与大数据研究院
Institute of Statistics and Big Data
4. Basic Probability Theory: http://ai.stanford.edu/~paskin/gm-short-
course/lec1.pdf
5. Basic Optimization: http://cs229.stanford.edu/notes/cs229-notes1.pdf
Yu Cheng
Senior Researcher
Microsoft AI and Research
Phone: (847)331-7231
Email: [email protected]
Homepage: https://sites.google.com/site/chengyu05/
Education
Sep. 2010 – April 2015 Ph.D., Department of Computer
Science Northwestern University,
Evanston IL, USA
Sep. 2006 – July 2010 B.S., Department of Automation
北京市海淀区中关村大街 59 号,100872,010-62510977
59 Zhongguancun Street, Haidian District, Beijing, 100872, P. R. China,86-10-62510977
统计与大数据研究院
Institute of Statistics and Big Data
Tsinghua University, Beijing, China
Research Interests
Machine Learning/Deep Learning
·Deep Generative Model, Model Compression, Zero-shot/Few-shot Learning
Computer Vision
·Video Event Detection, Egocentric Vision, Face Detection/Recognition
Natural Language Processing
·Natural Language Classification, Visual Dialogue
Working Experience
Microsoft AI and Research April 2018 – Now
Senior Researcher
IBM T.J. Watson Research Center May 2015 – April 2018
Research Staff Member
Northwestern University Sep. 2010 – Mar. 2015
Research Assistant, Computer Science. Supervised by Alok Choudhary
LinkedIn, Inc. July 2014 – Sep. 2014
Consultant, Business Analytics Group. Collaborate with Yongzheng Zhang, Songtao Guo
IBM T.J. Watson Research Center July 2013 – July 2014
Research Intern Managed by Rogerio Feris, Sharath Pankanti
National University of Singapore Aug. 2009 – Oct. 2009
Research Intern, School of Computing, Supervised by Roger Zimmermann
北京市海淀区中关村大街 59 号,100872,010-62510977
59 Zhongguancun Street, Haidian District, Beijing, 100872, P. R. China,86-10-62510977
统计与大数据研究院
Institute of Statistics and Big Data
Tsinghua University Aug. 2008 – June 2010
Undergraduate Research Assistant, Department of Automation, Supervised by Tao Zhang
北京市海淀区中关村大街 59 号,100872,010-62510977
59 Zhongguancun Street, Haidian District, Beijing, 100872, P. R. China,86-10-62510977
统计与大数据研究院
Institute of Statistics and Big Data
Services
Conference Program Committee: 1) ICML 2018; 2) IJCAI 2018; 3) ICLR 2018; 4)
CVPR 2018; 5) AAAI 2018; 6) NIPS 2017; 7) CVPR 2017; 8) SDM 2017; 9) KDD
2016; 10) IJCAI 2016; 11) CVPR 2016; 12) NIPS 2016; 13) SDM 2016; 14) IJCAI
2015; 15) ICHI 2015
Journal Reviewer: 1) IEEE Transactions on Knowledge and Data Engineering Data
(TKDE); 2) ACM Transactions on Knowledge Discovery from Data (TKDD); 3) ACM
Transactions on Intelligent Systems and Technology (TIST); 4) Computer Vision and
Image Understanding (CVIU); 5) Neurocomputing; 6) IEEE Intelligent Systems; 7)
IEEE/ACM Transactions on Computational Biology and Bioinformatics; 8) IEEE
Transactions on Network Science and Engineering; 9) Journal of Visual
Communication and Image Representation
Awards and Honors
1. International Conference on Computer Vision 2017 Young Researcher Support Grant
Award
2. IBM Selective Rewards for AI Research 2017
3. Winner of Data analytics Challenge, IEEE International Conference on Healthcare
Informatics 2016
4. IBM Invention Plateau Award, IBM Research. 2016
5. Invention 1st File Patent Award, IBM Research. 2015
6. Best Paper Finalist, SIAM Data Mining Conference (SDM). 2015
7. Amazon Scholarship for Amazon’s Graduate Research Symposium. 2014
8. 1st Place, NIST TRECVID 2014 Surveillance Event Detection, Retrospective &
Interactive Task. Aug. 2014
北京市海淀区中关村大街 59 号,100872,010-62510977
59 Zhongguancun Street, Haidian District, Beijing, 100872, P. R. China,86-10-62510977
统计与大数据研究院
Institute of Statistics and Big Data
9. 2st Place, NIST TRECVID 2013 Surveillance Event Detection, Retrospective Task,
Oct. 2013
10. Best Paper Runner Up, the 13th International Conference on Electronic Commerce
(ICEC), 2011
11. Best Paper Award, the 15th International Symposium on Artificial Life and
Robotics 2010.
Selected Publications
Conference Papers
1. Xiaoxiao Guo*, Yu Cheng*, Hui Wu, Rogerio Feris, Kristen Grauman (*equal
contribution). Dialog-based Interactive Image Retrieval, Submitted to In IEEE
Conference on Computer Vision and Pattern Recognition (CVPR 2018)
2. Yu Cheng, Xi Ouyang and Yifan Jiang. Pedestrian-Synthesis-GAN: Generating
Pedestrian Data in Real Scene and Beyond, Submitted to In IEEE Conference on
Computer Vision and Pattern Recognition (CVPR 2018)
3. Shuangjie Xu, Yu Cheng, and Pan Zhou. Crowd Density Estimation via Multi-scale
Fully Convolutional Neural Network, Submitted to In IEEE Conference on Computer
Vision and Pattern Recognition (CVPR 2018)
4. Youssef Mroueh, Chun-Liang Li, Tom Sercu, Anant Raj and Yu Cheng. Sobolev
GAN, Submitted to International Conference on Learning Representations (ICLR 2018)
5. Chun-Liang Li, Wei-Chen Chang, Yu Cheng, Yiming Yang and Barnabás Póczos.
MMD GAN: Towards Deeper Understanding of Moment Matching Network, In the
Thirtieth-first Annual Conference on Neural Information Processing System (NIPS
2017)
6. Yu Cheng*, Shuangjie Xu*, Kang Gu, Shiyu Chang, Pan Zhou (*equal contribution).
Jointly Attentive Spatial-Temporal Pooling Networks for Video-based Person Re-
Identification, In International Conference on Computer Vision 2017 (ICCV 2017)
7. Zhengping Che*, Yu Cheng*, Shuangfei Zhai, Zhaonan Sun, Yan Liu (*equal
contribution). Boosting Risk Prediction with Generative Adversarial Networks for
Electronic Health Records. In 2017 IEEE International Conference on Data Mining
北京市海淀区中关村大街 59 号,100872,010-62510977
59 Zhongguancun Street, Haidian District, Beijing, 100872, P. R. China,86-10-62510977
统计与大数据研究院
Institute of Statistics and Big Data
(ICDM 2017)
8. Yongxi Lu, Abhishek Kumar, Shuangfei Zhai, Yu Cheng, Tara Javidi, Rogerio Feris.
Fully-adaptive Feature Sharing in Multi-Task Networks with Applications in Person
Attribute Classification, In IEEE Conference on Computer Vision and Pattern
Recognition (CVPR 2017)
9. Shuangfei Zhai, Hui Wu, Abhishek Kumar, Yu Cheng, Zhongfei (Mark) Zhang,
Rogerio Feris. S3Pool: Pooling with Stochastic Spatial Sampling, In IEEE Conference
on Computer Vision and Pattern Recognition (CVPR 2017)
10. Shuangfei Zhai, Yu Cheng, Rogerio Feris, Zhongfei (Mark) Zhang. Generative
Adversarial Networks as Variational Training of Energy Based Models. In 5th
International Conference on Learning Representations (ICLR 2017)
11. Shuangfei Zhai, Yu Cheng, Zhongfei Zhang. Doubly Convolutional Neural
Networks. In the Thirtieth Annual Conference on Neural Information Processing
Systems (NIPS 2016)
12. Zihao Zhu, Changchang Yin, Buyue Qian, Yu Cheng, Jishang Wei. Measuring
Patient Similarities via A Deep Architecture with Medical Concept Embedding. In 2016
IEEE International Conference on Data Mining (ICDM 2016)
13. Yu Cheng*, Shuangfei Zhai*, Weining Lu, Zhongfei Zhang (* equal contribution).
Deep Structured Energy Based Models for Anomaly Detection. In the 33rd
International Learning Conference on Machine (ICML 2016)
14. Jing Wang, Rogerio Feris, Yu Cheng. Walk and Learn: Facial Attribute
Representation Learning from Egocentric Video and Contextual Data. In the 27th IEEE
Conference on Computer Vision and Pattern Recognition (CVPR 2016)
15. Yu Cheng, Ping Zhang, Jianying Hu. Risk Prediction with Electronic Health
Records: A Deep Learning Approach. In 2016 SIAM International Conference on Data
Mining (SDM 2016)
16. Yu Cheng, Nalini Ratha, Sharat Pankanti. Outlier Faces Detector via Efficient
Cohesive Subgraph Identification. In the 23rd IEEE International Conference on Image
Processing (ICIP 2016)
17. Yusheng Xie, Pranjal Daga, Yu Cheng, Kunpeng Zhang, Ankit Agrawal, Alok
北京市海淀区中关村大街 59 号,100872,010-62510977
59 Zhongguancun Street, Haidian District, Beijing, 100872, P. R. China,86-10-62510977
统计与大数据研究院
Institute of Statistics and Big Data
Choudhary: Reducing Infrequent-token Perplexity via Variational Corpora. The annual
meeting of the Association for Computational Linguistics (ACL 2015)
18. Yu Cheng, Felix X. Yu, Rogerio Feris, Sanjiv Kumar, Shih-Fu Chang: Fast Neural
Networks with Circulant Projections. In 2015 International Conference on Computer
Vision (ICCV 2015)
19. Yu Cheng, Alok Choudhary, Ankit Agrawal, Huan Liu: Legislative Prediction with
Dual Uncertainty Minimization from Heterogeneous Information. In 2015 SIAM
International Conference on Data Mining (SDM 2015)
20. Yu Cheng, Ankit Agrawal, Alok Choudhary, Huan Liu, Tao Zhang: Social Role
Identification via Dual Uncertainty Minimization Regularization. In the 15th IEEE
International Conference on Data Mining (ICDM 2014)
21. Yu Cheng, Quanfu Fan, Sharath Pankanti and Alok Choudhary: Temporal
Sequence Modeling for Video Event Detection. In the 27th IEEE Conference on
Computer Vision and Pattern Recognition (CVPR 2014)
22. Yu Cheng, Lisa Brown, Quanfu Fan, Rogerio Feris, Sharath Pankanti and Tao
Zhang. RiskWheel: Interactive Visual Analytics for Surveillance Event Detection.
IEEE 2014 International Conference on Multimedia & Expo (ICME 2014)
23. Yu Cheng, Hongliang Fei, Fei Wang, Zhengzhang Chen, and Alok Choudhary.
Batch Mode Active Learning with Hierarchical-Structured Embedded Variance. In
2014 SIAM International Conference on Data Mining (SDM 2014)
24. Xiaohan Li, Yu Cheng, Song Chen, Tao Zhang. A Robot-in-the-Loop Face
Detection and Recognition System with Coordinative Control Platform. In the 10th
IEEE International Conference on Robotics and Biomimetics (ROBIO 2013)
25. Yu Cheng, Zhengzhang Chen, Lu Liu, Jiang Wang, Alok Choudhary. Feedback-
Driven Multiclass Active Learning for Data Streams. In the 22th ACM International
Conference on Information and Knowledge Management (CIKM 2013)
26. Yu Cheng, Zhengzhang Chen, Jiang Wang, Alok Choudhary. Bootstrapping Active
Name Disambiguation with Crowdsourcing. In the 22th ACM International Conference
on Information and Knowledge Management (CIKM 2013)
27. Lu Liu, Jie Tang, Yu Cheng, Ankit Agrawal, Wei-keng Liao, Alok Choudhary.
北京市海淀区中关村大街 59 号,100872,010-62510977
59 Zhongguancun Street, Haidian District, Beijing, 100872, P. R. China,86-10-62510977
统计与大数据研究院
Institute of Statistics and Big Data
Mining Diabetes Complication and Treatment Patterns for Clinical Decision Support.
In the 22th ACM International Conference on Information and Knowledge
Management (CIKM 2013)
28. Yusheng Xie, Zhengzhang Chen, Kunpeng Zhang, Yu Cheng, Chen Jin, Ankit
Agrawal, and Alok Choudhary. Elver: Recommending Facebook Pages in Cold Start
Situation Without Content Features. In IEEE International Conference on Big Data
(BIGDATA 2013)
29. Kunpeng Zhang, Doug Downey, Zhengzhang Chen, Yusheng Xie, Yu Cheng, Ankit
Agrawal, Wei-keng Liao, Alok Choudhary. A Probabilistic Graphical Model for Brand
Reputation Assessment in Social Networks. In the proceedings of the 2013 IEEE/ACM
International Conference on Advances in Social Networks Analysis and Mining
(ASONAM 2013)
30. Yu Cheng, Yusheng Xie, Zhengzhang Chen, Ankit Agrawal, Alok Choudhary,
Songtao Guo. JobMiner: A Real-time System for Mining Job-related Patterns from
Social Media. In the 19th ACM SIGKDD International Conference on Knowledge
Discovery and Data Mining (KDD 2013)
31. Zhengzhang Chen, Yusheng Xie, Yu Cheng, Kunpeng Zhang, Ankit Agrawal, Wei-
keng Liao, Nagiza F. Samatova, and Alok Choudhary. Forecast Oriented Classification
of Spatio-Temporal Extreme Events. In the 23rd International Joint Conference on
Artificial Intelligence (IJCAI 2013)
32. Yusheng Xie, Zhengzhang Chen, Kunpeng Zhang, Yu Cheng, Ankit Agrawal, Wei-
keng Liao, and Alok Choudhary. Detecting and Tracking Disease Outbreaks in Real-
time through Social Media. In the 23rd International Joint Conference on Artificial
Intelligence (IJCAI 2013)
33. Yusheng Xie, Zhengzhang Chen, Kunpeng Zhang, Md. Mostofa Ali Patwary, Yu
Cheng, Ankit Agrawal, Alok Choudhary. Data-Driven Graphical Modeling of Macro
Behavioral Targeting in Social Networks. In SIAM International Conference on Data
Mining (SDM 2013)
34. Yu Cheng, Kunpeng Zhang, Yusheng Xie, Ankit Agrawal, Alok Choudhary. On
Active Learning in Hierarchical Classification. In the 21th ACM International
Conference on Information and Knowledge Management (CIKM 2012)
北京市海淀区中关村大街 59 号,100872,010-62510977
59 Zhongguancun Street, Haidian District, Beijing, 100872, P. R. China,86-10-62510977
统计与大数据研究院
Institute of Statistics and Big Data
35. Kunpeng Zhang, Yu Cheng, Yusheng Xie, Daniel Honbo, Doug Downey, Ankit
Agrawal, Wei-keng Liao, and Alok Choudhary. Sentiment Identification by
Incorporating Syntax, Semantics and Context Information. In the 35th International
ACM SIGIR Conference on Research and Development in Information Retrieval
(SIGIR 2012)
36. Yusheng Xie, Daniel Honbo, Kunpeng Zhang, Yu Cheng, Ankit Agrawal, and Alok
Choudhary. VOXSUP: A Social Engagement Framework. In the 18th ACM SIGKDD
International Conference on Knowledge Discovery and Data Mining (KDD 2012)
Journal Papers
1. Yu Cheng, Duo Wang, Pan Zhou, Tao Zhang. A Survey of Model Compression and
Acceleration for Deep Neural Networks. IEEE Signal Processing Magazine, 2018
2. Yu Cheng, Weining Lu, Cao Xiao, Shiyu Chang, Shuai Huang, Thomas S. Huang.
Unsupervised Sequential Outlier Detection with Deep Architectures. IEEE
Transactions on Image Processing, 2017.
3. Yu Cheng, Ankit Agrawal, Alok Choudhary, Huan Liu. Legislative Prediction with
Dual Uncertainty Minimization from Heterogeneous Information. Journal of Statistical
Analysis and Data Mining 2015.
4. Weining Lu, Bin Liang, Yu Cheng, Deshan Meng, Jun Yang, Tao Zhang. Deep
Model based Domain Adaptation for Fault Diagnosis. IEEE Transactions on Industrial
Electronics, 2017.
5. Yusheng Xie, Zhengzhang Chen, Yu Cheng, Kunpeng Zhang, Daniel K. Honbo,
Ankit Agrawal, Wei-keng Liao, and Alok Choudhary. MuSES: a Multilingual
Sentiment Elicitation System for Social Media Data. IEEE Intelligent Systems, vol. 99,
2013.
6. Weining Lu, Bin Liang, Yu Cheng, Deshan Meng, Jun Yang, Tao Zhang. Deep
Model based Domain Adaptation for Fault Diagnosis. IEEE Transactions on Industrial
2016.
7. Yuan Luo, Yu Cheng, Ozlem Uzuner, Peter Szolovits, Justin Starren. Segment
Convolutional Neural Networks (Seg-CNN) for Classifying Relations in Clinical Notes.
Journal of the American Medical Informatics Association 2017.
北京市海淀区中关村大街 59 号,100872,010-62510977
59 Zhongguancun Street, Haidian District, Beijing, 100872, P. R. China,86-10-62510977
统计与大数据研究院
Institute of Statistics and Big Data
8. Yijun Huang, Qiang Meng, Heather Evans, Bill Lober, Yu Cheng, Xiaoning Qian, Ji
Liu, Shuai Huang. CHI: A Contemporaneous Health Index for Degenerative Disease
Monitoring using Longitudinal Measurements. Journal of Biomedical Informatics 2017.
Advising Experiences
Chun-Liang Li, Carnegie Mellon University, Research Intern, 05/2017 – now
Shuangfei Zhai, Binghamton Univeristy, SUNY, Research Intern, 05/2016 – 02/2017
Zhengping Che, University of Southern California, Summer Intern, 05/2016 – 08/2016
Yongxi Lu, University of California San Diego, Summer Intern, 06/2016 – 09/2016
Jing Wang, Northwestern University, Research Intern, 06/2015 - 12/2015
Jigarkumar Doshi, Georgia Institute of Technology, Research Intern, 06/2015 -
06/2016
Elizabeth Webster, Icahn School at Mount Sinai, Research Intern, 06/2015 - 09/2015
Patents
1. Zhaonan Sun, Soumya Ghosh, Yu Cheng, Jianying Hu: A method for identifying and
indexing discriminative features for disease progression, YOR820170234 filed on
09/2017.
2. Zhaonan Sun, Soumya Ghosh, Yu Cheng, Jianying Hu: A data-driven method for
generating robust disease progression indicators, YOR820170320 filed on 09/2017.
3. Rogerio Feris, Jing Wang, Yu Cheng: Finding missing persons by learning features
for person attribute classification based on deep learning, YOR820160027 filed on
03/2016.
4. Yu Cheng, Yajuan Wang, Jianying Hu: Time-varying Risk Profiling from Health
Sensor Data, YOR920150984US1, filed on 10/2015.
北京市海淀区中关村大街 59 号,100872,010-62510977
59 Zhongguancun Street, Haidian District, Beijing, 100872, P. R. China,86-10-62510977
统计与大数据研究院
Institute of Statistics and Big Data
5. Yu Cheng, Nalini Ratha, Sharath Pankanti: Video Clustering with Inherent and Weak
Supervision, YOR920150222US1, filed on 09/2015.
6. Yu Cheng, Nalini Ratha, Sharath Pankanti: Efficient Cohesive Sub-graph
Identification for Outlier Detection, YOR920150223US1, filed on 09/2015.
7. Alok Choudhary, Kunpeng Zhang, Yu Cheng, Yusheng Xie: MuSES: Multilingual
Sentiment Elicitation System for Social Media Data, application US61/795401, filed
on 08/2013.
8. Alok Choudhary, Yusheng Xie, Yu Cheng, Daniel K. Honbo: Probabilistic Macro
Behavioral Targeting, application US 61/795402, filed on 08//2013.
9. Tao Zhang, Xiaohan Li, Yu Cheng, Song Chen, Xuedong Chen, Hao Sun, Heyi Li.
Active Vision Heterogeneous Networks ased on Facial Image Optimization Method
Sample Collection, CN 201210152291, filed on 09/16/2013.
10. Tao Zhang, Yu Cheng, Mengbin Zhu, Jianfeng Zhang, Yifeng Li. 3D Hepatectomy
Simulation and Evaluation System, filed on 12/22/2011.
