Deep Learning

Course ID
CSIS1-5
Direction
1st, 2nd
Semester
Spring
Type
1rd direction elective, 2nd direction mandatory

Learning Outcomes

Upon successful completiion of this course, students will have a grasp of the fundamentals around the theory and practical application of modern deep learning models. These will allow students to apply machine / deep learning techniques in a production environment, as well as to carry out research in relevant fields.

Course Content

 - Representation learning for signals - convolutional neural networks (CNN)
- Capacity control: Regularization, dropout and data augmentation
- Popular CNN architectures
- Word embeddings
- Data loading, preprocessing and training workflows in pytorch
- Recurrent neural networks (RNN) with emphasis on LSTM and GRU
- Attention mechanisms
- Transformer networks
- Generative models: GAN, VAE and Normalizing Flows
- Introduction to Reinforcement Learning
- DQN, A2C and PPO algorithms

General Skills

Search, analysis and synthesis of data and information with the use of the assorted technologies

Adaptation in new conditions

Decision Making

Independent work

Promoting reasoning and self improvement

Promoting free, creative and deductive reasoning

Learning and Teaching Methods - Evaluation

Teaching methods: On site 

Use of Information and Communication Technologies: Software development in Python language using Numpy, Pandas, and Pytorch. Use of pre-trained models. Data preparation and model development.

Activity Work load
Semester
Lectures 36
Lab exercises 0
Thesis 50
Independent Study 64
Total 150

Assessment

Individual student projects

Literature

– Aston Zhang et al. (2022), “Dive into Deep Learning”, https://d2l.ai/
– Ian Goodfellow, Yoshua Bengio and Aaron Courville (2016), “Deep Learning” (2016), MIT
Press https://www.deeplearningbook.org/
– Sutton, R. S., Barto, A. G. (2018). Reinforcement learning: An introduction. MIT press.
Journals (indicative):
IEEE Transactions on Pattern Analysis and Machine Intelligence
IEEE Transactions on Neural Networks and Learning Systems
Expert Systems with Applications
Journal of Machine Learning Research
Machine Learning
Journal of Artificial Intelligence Research
Neural Computing and Applications
International Journal of Computer Vision
Engineering Applications of Artificial Intelligence
Conferences (indicative):
Neural Information Processing Systems (NeurIPS)
International Conference on Machine Learning (ICML)
International Conference on Learning Representations (ICLR)
AAAI Conference on Artificial Intelligence (AAAI)
Computer Vision and Pattern Recognition (CVPR)
International Conference on Computer Vision (ICCV)
International Joint Conference on Artificial Intelligence (IJCAI)
European Conference on Machine Learning (ECML)
Asian Conference on Machine Learning (ACML)