Coarse Coding is another useful approach for generating features especially when the observation of the environment is not informative enough [1]}. For example, assume a task with two dimensional state space where each region of the space has its own characteristics. In order to capture pertinent information about the environment, coarse coding introduces some overlapping circles whose status shows the corresponding state of observation. Each observation lies in one or more circles and circles are called present/absent or active/inactive based on the location of the observation. If the observation lies in \(i^{th}\)  circle, its corresponding value in state \(s\)  is 1, otherwise it is 0. Using this method, the feature vector of states extends to \(n\)  binary values. Figure REF  shows an example of coarse coding with \(n=6\) .
<FIGURE>