The policy iteration method of Section 10.2.2 can be applied in principle, but it is unlikely to solve challenging problems. For example, if , then each iteration will require solving matrices that have million entries! At least they are likely to be sparse in many applications.

Steven M LaValle 2012-04-20