Collaborative intelligence (CI) [1]}, [2]} is a “hybrid" AI deployment strategy. To complete an AI task, CI typically involves splitting the Deep Neural Network (DNN) computations between an edge device and a cloud service. The resource-constrained edge device runs the initial few layers of the DNN on the input signal (image, video, ...) and produces a deep feature tensor. The latter is transmitted over a communication channel to the cloud, where the remaining layers of the DNN complete the inference task. CI has shown potential for improved inference latency and energy use as compared to purely cloud-based or edge-based AI deployment approaches in certain scenarios [1]}, [4]}.
