Policy iteration

The policy iteration method of Section 10.2.2 can be applied in principle, but it is unlikely to solve challenging problems. For example, if $ \vert X\vert = 10$, then each iteration will require solving matrices that have $ 1$ million entries! At least they are likely to be sparse in many applications.

Steven M LaValle 2012-04-20