Pre-requisites for the Computational Linguistics program

Due to its multi-disciplinary character, candidates for this Master’s degree can have different profiles: we welcome either students with a main training in linguistics but with knowledge and interest in computer science and mathematics, or students trained in computer science but interested in linguistics and the formal organisation of languages.

Note that it is possible to enter the Master’s programme with little to no knowledge of linguistics (such students will receive accelerated introductory courses in linguistics in the first semester of the M1 level) but some knowledge in computer science and in mathematics is required:

In computer science: students are expected to know the basics of practical computer programming, ideally in Python (namely an understanding of variables, control statements, data structures). To give you an idea of the expected level, you will find here the subject of the very first lab session of the Machine Learning for NLP class (the lab session is done over two 2-hour sessions, then completed at home; some indications are given in class). To (self-)assess your ability to follow the lectures, check whether you are able to write a program that, given a directory containing several text files, prints the 5 most frequent words in all of these files.
In mathematics: it is desirable to have followed an introductory course in statistics and probability and to know the basics of linear algebra (vector space, dot product, matrix-vector multiplication)

In linguistics: the M1 is open both to students with previous knowledge in linguistics and to beginners. Tests occur during the first week of the semester to identify beginners, who will attend specific accelerated linguistics courses.

These prerequisites are not “hard constraints”, but should be interpreted as advice to avoid unfortunate academic orientations. A very good academic record and strong motivation can compensate for certain shortcomings in the pre-requisites.

Depending on your academic record, you will be invited to an online interview in order to evaluate your skills in computer science and discuss your application.

If you think you do not fully meet the pre-requisites, and if you speak French, consider joining at the L3 level (third year of “Licence”). The L3 year, taught in French, provides the required training to enter the master.

Contact the head of M1 year (see below) if you wish to discuss your application.

A few references in NLP / mathematics / computer science

Here are a few references to help students directly entering in M2:

NLP and computational linguistics
- The Jurafsky and Martin’s notebook provides introduction to major tasks in NLP, and the current methods to achieve these tasks
- the Natural Language Processing with Python book and package is a good way to exemplify NLP methods
- machine/deep learning for NLP: Y. Goldberg “Neural Network Methods in Natural Language Processing”, Morgan & Claypool, 2017
Algorithmics: a student entering the M2 is expected to have knowledge of complexity (O), sorting, linear structures (stacks), trees, hash-tables
Programming:
- most lab sessions in M2 use python. Being able to easily handle corpora, data structures in python is required.
Maths:
- basic probability theory
- formal language theory (automata)
- see e.g. Partee, B. et alii [1993] Mathematical methods in Linguistics, Kluwer.

A few references in linguistics

Syntax
- Abeillé, A. [2007] Les grammaires d’unification, Hermès (chap 1 et chap 2).
- Bresnan, J. [2001] Lexical Functional Syntax, Basic Blackwell.
- Delaveau, A. [2001] Syntaxe, la phrase et la subordination. Armand Colin.
- Haegeman L. [1993]. Introduction to Government & Binding Theory. Blackwell, Oxford.
- Kerleroux F. et Delaveau, A. [1985] Problèmes et exercices de syntaxe française. Armand Colin.
- Sag, I et Wasow, T., et Bender, E. [2003] Syntactic theory: a formal introduction, CSLI Publications.
- Radford, A. [1988]. Transformational Grammar: A First Course. Cambridge University Press.
- Radford, A. [1997] Syntax: a minimalist Introduction.
Phonetics
- Ladefoged, P., [1975] A Course in phonetics, Harcourt, Brace & Jovanovich.
- Landercy A., & Renard R. [1977] Eléments de phonétique, Didier-Bruxelles.
- Léon, P. [2000] Phonétisme et prononciation du français, Nathan, 2000.
Semantics
- John Lyons, Eléments de sémantique (Larousse, 1978, ISBN 2030703443).
- Saeed, John I. [1997] Semantics. Blackwell.

Contacts

for questions concerning the M1 year, contact Guillaume Wisniewski
for general questions about the master, or questions concerning the M2 year, contact Benoît Crabbé