CS571: Natural Language Processing
Fall 2007

Time and Place: Tue-Thu, 10am-11:15am, Math & Science Center W408

 

Class Lectures and Schedule

 

Date

Topic

Assigned Readings

Tue Sep 4

Logistics, introduction: [slides]
Brief introduction to Language Models: [slides]

Handout #1: Questionnaire

M&S 1.1-1.3, 2.1.1-2.1.7, M&S 3.1

Thu Sep 6

Language Models [slides]

M&S 1.4, M&S 2.2, M&S 6.1-6.3.1, 6.4

Tue Sep 11

Text Categorization 1 [slides]
Project 1, part 1 (entity classification and tagging) assigned

 

Thu Sept 13

NO LECTURE

Advances in Word Sense Disambiguation by Rada Mihalcea and Ted Pedersen [ PDF ] [ original PPT ]

Tue Sep 18

Text Categorization 2 [slides]

 

Thu Sep 20

Part of Speech (POS) tagging [ slides ]

M&S 9.1-3, M&S 10.1-3

Tue Sep 25

Training HMMs: Forward-Backword algorithm [ slides ]
Project 1.1 due

M&S Chapter 9 (or Martin & Jurafsky, Speech and Language Processing, Chapter 6)

Wed Sep 26

Make-up lecture at 2pm Finish up BW, EM, and applications
Phrase chunking [ slides ]

M&S 10.4-10.7 (or Martin & Jurafsky, Speech and Language Processing, Chapter 6)

Thu Sep 27

NO LECTURE

 

Mon Oct 1

Make-up lecture 5pm: Entity tagging. [ slides ]

Martin & Jurafsky, Speech and Language Processing, Section 22.1

Tue Oct 2

Context-Free Grammars (CFGs), Chunking, NER [ slides ]

Martin & Jurafsky, Speech and Language Processing, Chapter 12

Thu Oct 4

NO LECTURE

 

Tue Oct 9

Fall Break

 

Thu Oct 11

Parsing [ slides ]

Martin & Jurafsky, Speech and Language Processing, Chapter 13

Tue Oct 16

Parsing 2 [ slides ]

Martin & Jurafsky, Speech and Language Processing, Chapter 13

Thu Oct 18

Statistical Parsing [ slides ]

Martin & Jurafsky, Speech and Language Processing, Chapter 14  OR M&S Chapter 12

Tue Oct 23

Human sentence processing, Semantics 1: representation [ slides ]

Martin & Jurafsky, Speech and Language Processing, Chapter 17

Thu Oct 25

Semantics 2: parsing/role labeling [ slides ]

Martin & Jurafsky, Speech and Language Processing, Chapter 18

Mon Oct 29

Project 2 due by Monday night (feel free to submit early!)
[ accuracy script available: /home/eugene/cs571/project2/accuracy.pl ]

 

Tue Oct 30

Midterm Review [ slides ]

 

Thu Nov 1

Midterm
Final project assigned. 

 

Tue Nov 6

Guest lecture: Prof Roberto Franzosi (Sociology): Content Analysis

 

Thu Nov 8

Guest lecture: Prof Phillip Wolff  (Psychology): Causality in Language

 

Tue Nov 13

Midterm postmortem, overview of Information Retrieval [ slides ]

 

Thu Nov 15

Tolerant Information Retrieval: spelling, concepts [ slides ]

 

Tue Nov 20

Collocations, word similarity [ slides ]

M&S Chapter 5

Thu Nov 22

Thanksgiving break

 

Tue Nov 27

Text clustering [ slides ]

M&S Chapter 14

Thu Nov 29

Machine translation and cross-language retrieval [ slides ]

M&S Chapter 13

Tue Dec 4

Information Extraction II: Event extraction [ slides ]

Martin & Jurafsky, Speech and Language Processing, Chapter 22

Thu Dec 6

Last class: Question Answering and Summarization [ slides ]

Martin & Jurafsky, Speech and Language Processing, Chapter 23

Tue Dec 11

No class - reading week.

 

Thu Dec 13

Final exam: project presentations. NOTE: 4:30pm-7pm

 

Tue Dec 18

Final Project reports due