Instructor: Prof. Steve LaValle, 2107 DCL, lavalle@cs.uiuc.edu
|
Date | Topics | Materials |
Jan 15 | course overview, single-stage decision making, loss, deterministic vs. randomized decisions | Handout: course syllabus |
Jan 17 | continuous choice sets, uncertainty, games against nature, observation spaces, Bayes and minimax decision rules | . |
Jan 22 | classification, OCR example | . |
Jan 24 | parameter estimation, utility theory | . |
Jan 29 | criticisms of decision theory, frequentist vs. Bayesian, obtaining priors | . |
Jan 31 | multiobjective decision making | . |
Feb 5 | multi-stage decision making, state spaces, additive loss, termination actions | . |
Feb 7 | representations (STRIPS, decision-theoretic, graph), cost-to-come, cost-to-go | . |
Feb 12 | forward and backwards dynamic programming, relation to Dijkstra | . |
Feb 14 | multiple-stage games against nature, Markovian models | Handout: Dynamic programming notes: [pdf] [ps] |
Feb 19 | feedback strategies, forward projections | . |
Feb 21 | dynamic programming | . |
Feb 26 | infinite horizon problems | . |
Feb 28 | policy iteration, reinforcement learning | Surveys: [Dean] [Kaebling et al.] [Harmon et al.] |
Mar 5 | reinforcement learning, imperfect information | . |
Mar 7 | observations, information states | . |
Mar 12 | MIDTERM EXAM | . |
Mar 26 | information space representations | . |
Mar 28 | information space representations | . |
Apr 2 | examples of informations spaces | . |
Apr 4 | Class was cancelled | . |
Apr 9 | Solving imperfect state information problems | . |
Apr 11 | Two-person zero-sum games | . |
Apr 16 | Two-person zero-sum games | . |
Apr 18 | Two-person zero-sum games | . |
Apr 23 | N-person nonzero-sum games | . |
Apr 25 | N-person nonzero-sum games | . |
Apr 30 | Perspective | . |
General: