The lab component of the course will cover mathematical concepts used in computational linguistics. The purpose of the lab is to familiarize you with not-so-basic probability theory, information theory, Bayesian inference, linear algebra, and descriptive and inferential statistics. These concepts are crucial in understanding computational linguistics and natural language processing algorithms covered in lecture. If you are shaky about these topics, you are recommended to attend the lab and do the exercise. If you are going to take CS134 next year (Statistical Natural Language Processing), the lab is highly recommended.

Lab instructors: Kenneth Lai, Tuan Do

Place and Time: 2 p.m-3 p.m Friday weekly in Volen 101 depending on the progress of the class.

Lab notes and exercises

You are encouraged but not required to complete and turn in the exercises. But to make the encouragement more tangible, we will offer extra credit for every exercise you turn in.

Notes and exercises from the lab will be posted here as the semester progresses.

  • 1/19: Intro to Python | NLTK book
  • 1/26: Morphology, Finite State Machines, and Regular Expressions | slides
  • 2/2: Probability Theory I: (Tabular) Probability Distribution Function: Joint, Conditional, and Marginal Probabilities | notes, exercises
  • 2/8 (Thurs 12-1pm in Volen 106): Probability Theory II: Naive Bayes classifiers, Maximum Likelihood Estimation | slidesmore slidesexercises
  • 2/16: Frequentist and Bayesian Statistics | Notebook
  • 2/23: no lab (Winter Break)
  • 3/2: Information Theory I: Entropy and Mutual Information | slides, exercises
  • 3/9: Probability Theory III: Markov Chains and Hidden Markov Models | slidesexercises
  • 3/16: no lab (extra office hours)
  • 3/23: Context-Free Grammars and Pushdown Automata | slides
  • 3/28 (Wed 12-1pm in Volen 201): Linear Algebra I: Vector/Matrix operations in Numpy | tutorial
  • 4/6: no lab (Spring Break)
  • 4/13: Word2vec tutorial
  • 4/20: no lab

Past labs:

  • Probability Theory IV: Bayesian Inference and Conjugate Priors
  • Basic Maths of Neural Network