CS 397: AI Planning and Decision Making


Spring 2002 12:30-1:45 TuTh 203 Transportation
Registration: 3 hours, or 3/4 unit or 1 unit, 01666 LECT SML

Instructor: Prof. Steve LaValle, 2107 DCL, lavalle@cs.uiuc.edu


Index
A. General Information and Motivation
B. Topics
C. Lectures
D. Assignments
E. Related Web Pages


A. General Information and Motivation


B. Topics (tentative)
C. Lectures

Date Topics Materials
Jan 15 course overview, single-stage decision making, loss, deterministic vs. randomized decisions Handout: course syllabus
Jan 17 continuous choice sets, uncertainty, games against nature, observation spaces, Bayes and minimax decision rules .
Jan 22 classification, OCR example .
Jan 24 parameter estimation, utility theory .
Jan 29 criticisms of decision theory, frequentist vs. Bayesian, obtaining priors .
Jan 31 multiobjective decision making .
Feb 5 multi-stage decision making, state spaces, additive loss, termination actions .
Feb 7 representations (STRIPS, decision-theoretic, graph), cost-to-come, cost-to-go .
Feb 12 forward and backwards dynamic programming, relation to Dijkstra .
Feb 14 multiple-stage games against nature, Markovian models Handout: Dynamic programming notes: [pdf] [ps]
Feb 19 feedback strategies, forward projections .
Feb 21 dynamic programming .
Feb 26 infinite horizon problems .
Feb 28 policy iteration, reinforcement learning Surveys: [Dean] [Kaebling et al.] [Harmon et al.]
Mar 5 reinforcement learning, imperfect information .
Mar 7 observations, information states .
Mar 12 MIDTERM EXAM .
Mar 26 information space representations .
Mar 28 information space representations .
Apr 2 examples of informations spaces .
Apr 4 Class was cancelled .
Apr 9 Solving imperfect state information problems .
Apr 11 Two-person zero-sum games .
Apr 16 Two-person zero-sum games .
Apr 18 Two-person zero-sum games .
Apr 23 N-person nonzero-sum games .
Apr 25 N-person nonzero-sum games .
Apr 30 Perspective .


D. Assignments
E. Related Web Pages

General:

Single-Stage Decision Making: Sequential Decision Making: Game Theory: