Natural Language Processing and Information Retrieval

Course ID
CSIS-E10
Direction
2nd
Semester
Spring
Type
2rd direction elective

Learning Outcomes

- Proficiency in various text representation models used in Natural Language Processing (NLP) and Information Retrieval (IR).

- Ability to apply and utilize Bag of Words and tf-idf techniques for text representation and feature extraction.

- Understanding the fundamentals of information retrieval and its various methods.

- Mastery in using vector-space methods for information retrieval tasks.

- Familiarity with evaluation metrics used in assessing the performance of information retrieval systems.

- Understanding different language models used specifically in information retrieval.

- Proficiency in various word representation models used in NLP tasks.

- Ability to work with word embeddings like word2vec for semantic representation of words.

- Understanding and practical knowledge of Transformer-based models such as BERT and GPT for language understanding and generation tasks.

- Ability to apply NLP techniques in various application-specific contexts, such as sentiment analysis, text classification, or named entity recognition.

- Understanding techniques used in content-based retrieval systems for multimedia data.

Course Content

Text representation models

Bag of words, tf-idf

Information retrieval

Vector-space methods for IR

Information retrieval evaluation metrics

IR and language models

Word representation models

RNN-LSTM

Transformers – BERT, GPT

Application-specific NLP

Content-based multimedia retrieval

General Skills

Search, analysis and synthesis of data and information with the use of the
assorted technologies

Decision Making

Independent work

Team work

Work at an interdisciplinary framework

Promoting free, creative and deductive reasoning

Learning and Teaching Methods - Evaluation

Teaching methods: On site
Use of ICT: e-class Presentations Code examples

Activity Work load
Semester
Lectures 18
Lab exercises 8
Thesis 60
Independent Study 64
Total 150

Assessment

Group and/or individual project with presentations

Literature

Schütze, H., Manning, C. D., Raghavan, P. (2008). Introduction to information retrieval (Vol. 39,
pp. 234-265). Cambridge: Cambridge University Press.
Jurafsky, D., Martin, J. H. (2000). Speech language processing. Pearson Education.
Li, H. (2022). Learning to rank for information retrieval and natural language processing.
Springer Nature.
Manning, C., Schutze, H. (1999). Foundations of statistical natural language processing. MIT
press.
Information Retrieval Journal
International Journal of Information Retrieval Research
International Journal of Multimedia Information Retrieval
Transactions of the Association for Computational Linguistics, ACL
IEEE/ACM Transactions on Audio, Speech, and Language Processing