Designing and Prototyping from the Perspective of AI in the Wild
This paper describes ObjectResponder a tool that allows designers to use Artificial Intelligence (AI) to rapidly prototype concepts for context aware intelligent interaction in the wild. To our knowledge, there are currently no available tools for designing and prototyping with AI within the actual context of use. Our application uses Google Cloud Vision to allow designers assigning chat bot like responses to objects recognized by the smart phone camera. This enables designers to use object recognition labels as a means to diverge on possible interpretations of the context and start generating ideas that can then be immediately tested and iterated. Initial results suggest that looking at the world from the perspective of the AI may enable designers to balance human and nonhuman biases, enrich a designer's understanding of the context, and open up unexpected directions for idea generation.
Conference on Designing Interactive Systems