Master in Artificial Intelligence (MAI)

Advanced Human Language Technology - Spring 2023

Instructors

Lluís Padró (coordinator) - contact - webpage
Salvador Medina - contact

Sessions

Date	Content	Lecturer
February 16th	Introduction Statistical Language Models MLE practical example	Lluís
February 16th	Lab Session 1 : Group 11 Task data & other stuff Guidelines and code for task 1 (rule-based NERC)
February 23th	Statistical Language Models (continued) MEM practical example Exercises about estimation and smoothing	Lluís
February 23th	Lab Session 1 : Group 12 Task data & other stuff Guidelines and code for task 1 (rule-based NERC)
March 2th	Lexical similarity. Distributional Semantics. Exercises about similarities	Lluís
March 2th	Lab Session 2 : Group 11 Guidelines and code for task 2 (ML-based NERC)
March 9th	Sequence Prediction Exercises about features	Lluís
March 9th	Lab Session 2 : Group 12 Guidelines and code for task 2 (ML-based NERC)
March 16th	Constituency Parsing Exercises about constituent parsing	Lluís
March 16th	Lab Session 3 : Group 11 Guidelines and code for task 3 (rule based DDI)
March 23th	Dependency Parsing Exercises about dependency parsing	Lluís
March 23th	Lab Session 3 : Group 12 Guidelines and code for task 3 (rule based DDI)
March 30th	Recap exercises on all previous topics	Lluís
March 30th	Lab Session 4 : Group 11 Guidelines and code for task 4 (machine-learning DDI)
April 6th	No class (spring break)
April 13th	Overview Word Embeddings Exercises about Word Embeddings	Salva
April 13th	Lab Session 4 : Group 12 Guidelines and code for task 4 (machine-learning DDI)
April 20th	No class - FIB midterm exam week (No AHLT midterm, though)
April 27th	Word Classification Exercises about Word Classification	Salva
April 27th	Lab Session 5 : Group 11 Guidelines and code for task 5 (NN-based NER)
May 4th	Recurrent NN Language Models Exercises about RNNs	Salva
May 4th	Lab Session 5 : Group 12 Guidelines and code for task 5 (NN-based NER)
May 11th	Transformers Advanced Transformers Sequence-to-sequence	Salva
May 11th	Lab Session 6 : Group 11 Guidelines and code for task 6 (NN-based DDI)
May 18th	Large Language Models Ethics	Salva
May 18th	Lab Session 6 : Group 12 Guidelines and code for task 6 (NN-based DDI)
May 25th	Discussion/Review	Salva
May 25th	Lab Session 7 : Groups 11&12 Consulting

Important dates

March 26th: Deadline for delivery of NER report (lab tasks 1 and 2)

May 7th: Dadline for delivery of DDI report (lab tasks 3 and 4)

June 15th, 15:00-18:00h: Final exam

June 20th: Deadline for delivery of NN report (lab tasks 5 and 6)

Solved exercises

Exercises about estimation and smoothing

Exercises about similarities

Exercises about features

Exercises about constituent parsing

Exercises about dependency parsing

Exercises about word embeddings

Exercises about word classification

Exercises about RNNs

Resources

Books

Alexander Clark, Chris Fox, Shalom Lappin (eds.)
The Handbook of Computational Linguistics and Natural Language Processing
Blackwell Handbooks in Linguistics, John Wiley & Sons, 2012.
R. Dale, H. Moisl, H.Somers (eds.)
Handbook of Natural Language Processing
Marcel Dekker, New York, 2000.
Nitin Indurkhya, Fred J. Damerau
Handbook of Natural Language Processing, Second Edition
Chapman & Hall/CRC Machine Learning & Pattern Recognition, 2010.
D. Jurafsky, James H. Martin
Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition
Prentice Hall, Upper Saddle River, N.J., 2017
C. Manning, H. Schütze
Foundations of Statistical Natural Language Processing
MIT Press, Cambridge, Mass., 1999.
R. Mitkov (ed.)
The Oxford Handbook of Computational Linguistics
Oxford University Press, 2004.

Similar Courses

Christopher Manning & Abigail See
Natural Language Processing with Deep Learning
Stanford University
Michael Collins
Natural Language Processing
Columbia University
Ivan Titov
Foundations of Natural Language Processing
University of Edinburgh
Sara Stymne
Syntactic Analysis / Syntactic parsing
Uppsala Universitet

Software

Language Processing

Machine Learning / Deep Learning

External Knowledge

Word Embeddings

Utilities

XML.dom