Natural Language Processing course resources
This github contains practical assignments for Natural Language Processing course by Higher School of Economics: https://www.coursera.org/learn/language-processing. In this course you will learn how to solve common NLP problems using classical and deep learning approaches.
From a practical side, we expect your familiarity with Python, since we will use it for all assignments in the course. Two of the assignments will also involve TensorFlow. You will work with many other libraries, including NLTK, Scikit-learn, and Gensim. You have several options on how to set it up.
1. Running on Google Colab
Google has released its own flavour of Jupyter called Colab, which has free GPUs!
Here's how you can use it:
- Open https://colab.research.google.com, click Sign in in the upper right corner, use your Google credentials to sign in.
- Click GITHUB tab, paste https://github.com/hse-aml/natural-language-processing and press Enter
- Choose the notebook you want to open, e.g. week1/week1-MultilabelClassification.ipynb
- Click File -> Save a copy in Drive... to save your progress in Google Drive
- If you need a GPU, click Runtime -> Change runtime type and select GPU in Hardware accelerator box
- Execute the following code in the first cell that downloads dependencies (change for your week number):
! wget https://raw.githubusercontent.com/hse-aml/natural-language-processing/master/setup_google_colab.py -O setup_google_colab.py
import setup_google_colab
# please, uncomment the week you're working on
# setup_google_colab.setup_week1()
# setup_google_colab.setup_week2()
# setup_google_colab.setup_week3()
# setup_google_colab.setup_week4()
# setup_google_colab.setup_project()
# setup_google_colab.setup_honor()
- If you run many notebooks on Colab, they can continue to eat up memory, you can kill them with
! pkill -9 python3and check with! nvidia-smithat GPU memory is freed.
Known issues:
- No support for
ipywidgets, so we cannot use fancytqdmprogress bars. For now, we use a simplified version of a progress bar suitable for Colab. - Blinking animation with
IPython.display.clear_output(). It's usable, but still looking for a workaround. - If you see an error "No module named 'common'", make sure you've uncommented the assignment-specific line in step 6, restart your kernel and execute all cells again
2. Running locally
Two options here:
-
Use the Docker container of our course. It already has all libraries, that you will need. The setup for you is very simple: install Docker application depending on your OS, download our container image, run everything within the container. Please, see this detailed Docker tutorial.
-
Manually install all the libraries depending on your OS (each task contains a list of needed libraries in the very beginning). If you use Windows/MacOS you might find useful Anaconda distribution which allows to install easily most of the needed libraries. However, some tools, like StarSpace for week 2, are not compatible with Windows, so it's likely that you will have to use Docker anyways, if you go for these tasks.
It might take a significant amount of time and resources to run the assignments code, but we expect that an average laptop is enough to accomplish the tasks. All assignments were tested in the Docker on Mac with 8GB RAM. If you have memory errors, that could be caused by not tested configurations or inefficient code. Consider reporting these cases or double-checking your code.
If you want to run the code of the course on the AWS machine, we've prepared the AWS tutorial here.
5 Sep 15, 2022
49 Dec 26, 2022
207 Nov 22, 2022
315 Jan 01, 2023
16 Feb 24, 2022
8.5k Jan 03, 2023
1.1k Jan 07, 2023
1 Jan 17, 2022
1 Jan 27, 2022
75 Jan 04, 2023
1 Dec 22, 2021
3 Dec 20, 2022
2 Mar 04, 2022
111 Dec 22, 2022
30 Dec 12, 2022
1 Dec 31, 2021
2.3k Jan 01, 2023
1 Mar 11, 2022
216 Nov 27, 2022
2 Aug 16, 2022