Such an empirical approach to network training is not practical for camera design. The cost of designing and building a camera, acquiring training data, labeling the training data, and assessing the network performance is simply too expensive. Simulation of image data from the novel camera design is the only option. For this reason we are developing software tools (ISETAuto) [1]}, [2]}, [3]}) for simulating physically accurate, complex and realistic driving scenes, modeling camera optics and sensors, and controlling the neural networks that detect and localize objects.
