Text Mining 2022/23

Amsterdam University College -- Text Mining -- Winter/Spring 2023.

Contents

You can use the Hello World notebooks to check that everything is working.

Week	Topic	Materials
1	Introduction and Python refresher	slides + notebooks 1, 2, 3, 4, 5
2	Introduction to NLP and NLP pipelines	slides + notebook
3	Language modelling	slides + notebooks 1, 2
4	Vector space semantics	slides + notebook
5	Word embeddings	slides + notebook
6	Machine learning fundamentals	slides + notebook
7	Text classification	slides + notebook (Scikit-learn), notebook (PyTorch)
8	RNNs and NER	slides + notebook
9	Recommender systems	slides + notebook
10	Creating annotated corpora, Web scraping and APIs	slides, notebook
11	Sentiment analysis	slides + notebook
12	Clustering and topic modelling	slides + notebook
13	XAI and Bias in Word Embeddings	Selected contents from this course - slides
14	Fairness and Text Mining for Humanities	slides

External materials

Neural networks

• Introduction (Stanford's CS231N).
• Optimization 1 (Stanford's CS231N).
• Yes you should understand backprop by Andrej Karpathy.
• Optimization 2 (Stanford's CS231N).

Tutorials

• SpaCy 101.
• scikit-learn tutorials.
• PyTorch 60m blitz.
• PyTorch text classification with torchtext.

Group projects

See the projects folder for info.

Ongoing projects

• Biological terminology visualization: https://github.com/aidanlowrie/text-mining-project
• Board game recommender: https://github.com/iasonmat/BoardGame-Recommender
• Weather and restaurant reviews: https://github.com/jago-h/TM_project
• The Office script analysis: https://github.com/shantanu-555/Text-Mining-Project

Project outcomes

Set-up

Running in the cloud (Google Colab)

1. Fork the repository to your Github account: go to https://github.com/bloemj/AUC_TM_2023 and click Fork
2. Get updates (from time to time): In your fork on the Github website, click "Fetch upstream"
3. Launch notebooks by going to your Google Colab: https://colab.research.google.com/ and loading them using the "Open Notebook" window. Enter the GitHub URL of the fork of the course materials in your own GitHub account to be able to save your changes. Click "Open notebook in new tab" to run the notebook.
4. To save your changes, choose "Save a copy in GitHub" and accept the suggested location. Note that just using "Save" will not work, and changes will not automatically save. This will also not work if you did not perform step 1 and are loading my version of the repository directly.

Running on your own system

1. Clone the repository locally: git clone https://github.com/bloemj/AUC_TM_2023.git
2. Get updates (from time to time): git pull
3. Create a conda environment: conda create -n myenv python=3.7 anaconda (where myenv is the envirnoment name)
4. Activate it: conda activate myenv
5. Install packages (see the requirements.txt file), e.g. conda install pandas
6. Launch a Jupyter notebook: jupyter notebook

• More on conda enviroments
• Conda cheatsheet
• Getting started with Jupyter notebooks
• On using git and GitHub for version control

Alternatively, use Binder (link above).

A more detailed guide to setup your environment, with multiple options.

Credits

• Giovanni Colavizza, who ran the 2021 edition of this course.
• Michael Repplinger, who ran the 2018/19 edition and Gianluca Lebani, who ran the 2017/18 edition.
• Giovanni Colavizza and Matteo Romanello, Applied Data Analysis course for the Oxford Digitial Humanities Summer School
• James Hetherington and Giovanni Colavizza, Research Software Engineering with Python

License

Everything in this repository which is not already attributed to someone else is released under CC BY 4.0.