Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> This work presents a performance comparison of the two latest video coding standards H.264/MPEG-AVC and H.265/MPEG-HEVC (High-Efficiency Video Coding) as well as the recently published proprietary video coding scheme VP9. According to the experimental results, which were obtained for a whole test set of video sequences by using similar encoding configurations for all three examined representative encoders, H.265/MPEG-HEVC provides significant average bit-rate savings of 43.3% and 39.3% relative to VP9 and H.264/MPEG-AVC, respectively. As a particular aspect of the conducted experiments, it turned out that the VP9 encoder produces an average bit-rate overhead of 8.4% at the same objective quality, when compared to an open H.264/MPEG-AVC encoder implementation - the x264 encoder. On the other hand, the typical encoding times of the VP9 encoder are more than 100 times higher than those measured for the x264 encoder. When compared to the full-fledged H.265/MPEG-HEVC reference software encoder implementation, the VP9 encoding times are lower by a factor of 7.35, on average. <s> BIB001 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> Energy conservation in battery powered mobile devices that perform wireless multimedia streaming has been a significant research problem since last decade. This is because these mobile devices consume a lot of power while receiving, decoding and ultimately, presenting the multimedia content. What makes things worse is the fact that battery technologies have not evolved enough to keep up with the rapid advancement of mobile devices. This survey examines solutions that have been proposed during the last few years, to improve the energy efficiency of wireless multimedia streaming in mobile hand-held devices. We categorize the research work according to different layers of the Internet protocol stack they utilize. Then, we again regroup these studies based on different traffic scheduling and multimedia content adaptation mechanisms. The traffic scheduling category contains those solutions that optimize the wireless receiving energy without changing the actual multimedia content. The second category on the other hand, specifically modifies the content, in order to reduce the energy consumed by the wireless receiver and to decode and view the content. We compare them and provide evidence of the fact that some of these tactics already exist in modern smaprtphones and provide energy savings with real measurements. In addition, we discuss some relevant literature on the complementary problem of energy-aware multimedia delivery from mobile devices and contrast with our target approaches for multimedia transmission to mobile devices. <s> BIB002 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> This paper provides an overview of the Internet of Things (IoT) with emphasis on enabling technologies, protocols, and application issues. The IoT is enabled by the latest developments in RFID, smart sensors, communication technologies, and Internet protocols. The basic premise is to have smart sensors collaborate directly without human involvement to deliver a new class of applications. The current revolution in Internet, mobile, and machine-to-machine (M2M) technologies can be seen as the first phase of the IoT. In the coming years, the IoT is expected to bridge diverse technologies to enable new applications by connecting physical objects together in support of intelligent decision making. This paper starts by providing a horizontal overview of the IoT. Then, we give an overview of some technical details that pertain to the IoT enabling technologies, protocols, and applications. Compared to other survey papers in the field, our objective is to provide a more thorough summary of the most relevant protocols and application issues to enable researchers and application developers to get up to speed quickly on how the different protocols fit together to deliver desired functionalities without having to go through RFCs and the standards specifications. We also provide an overview of some of the key IoT challenges presented in the recent literature and provide a summary of related research work. Moreover, we explore the relation between the IoT and other emerging technologies including big data analytics and cloud and fog computing. We also present the need for better horizontal integration among IoT services. Finally, we present detailed service use-cases to illustrate how the different protocols presented in the paper fit together to deliver desired IoT services. <s> BIB003 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> Abstract Bluetooth Low Energy (Bluetooth LE) is a key technology in the envisioned Internet of Things (IoT) scenario. In fact, its extremely low-power characteristics make it one of the most suitable solutions to enable wireless communications among battery powered IoT objects ubiquitously deployed in the field with the aim of building smart environments. Although Bluetooth LE specification targets a specific set of applications mainly devoted to monitoring purposes, innovative solutions can lead to the adoption of such technology in different applications, such as multimedia streaming, allowing IoT objects to exploit new functionalities. In this direction this article presents BlueVoice, an application targeted to Bluetooth LE devices to enable speech streaming services. In the article BlueVoice is presented by first detailing the services set extension needed to support the new envisioned multimedia service, then a description of application choices is given, followed by an evaluation of its performance in real IoT objects. Thanks to the selected speech encoding technique, connection design choices and packetization strategies, BlueVoice application requires a communication bandwidth of 64.3 kbps to transmit audio at 16 kHz in ADPCM format. BlueVoice performance has been evaluated in terms of power consumption, memory and processing requirements, showing feasibility of the developed solution in resource constrained devices, thus confirming the correct choices in the application design. The set of performance information obtained show that BlueVoice is a viable solution to enable speech communications in ubiquitous wireless IoT nodes based on the Bluetooth LE technology. <s> BIB004 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> The Internet of Things (IoT) opens a new horizon for network applications by virtue of wireless sensor network technologies and advancement of data analytics. Since various applications are possible in the IoT compared to conventional multimedia applications, quality of experience (QoE), which is a user's subjective satisfaction with the application, becomes more complicated for network operators to perceive. In this paper, we propose a framework of scalable QoE modeling for explosively increasing applications. In the framework, the massive amount of quality metrics in the IoT architecture are defined as physical metrics and organized into four layers; device, network, computing, and user interface. We also introduce metaphysical metrics, which are the summarized quality metrics that users of IoT applications demand. By aggregating the massive amount of physical metrics into certain metaphysical metrics and qualitatively modeling the QoE by the metaphysical metrics according to the characteristics of the applications, scalable modeling of the QoE for continuously emerging applications in the IoT becomes possible. <s> BIB005 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> Multicast routing that meets multiple quality of service constraints is important for supporting multimedia communications in the Internet of Things (IoT). Existing multicast routing technologies for IoT mainly focus on ad hoc sensor networking scenarios; thus, are not responsive and robust enough for supporting multimedia applications in an IoT environment. In order to tackle the challenging problem of multicast routing for multimedia communications in IoT, in this paper, we propose two algorithms for the establishing multicast routing tree for multimedia data transmissions. The proposed algorithms leverage an entropy-based process to aggregate all weights into a comprehensive metric, and then uses it to search a multicast tree on the basis of the spanning tree and shortest path tree algorithms. We conduct theoretical analysis and extensive simulations for evaluating the proposed algorithms. Both analytical and experimental results demonstrate that one of the proposed algorithms is more efficient than a representative multiconstrained multicast routing algorithm in terms of both speed and accuracy; thus, is able to support multimedia communications in an IoT environment. We believe that our results are able to provide in-depth insight into the multicast routing algorithm design for multimedia communications in IoT. <s> BIB006 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> RPL is the IPv6 routing protocol for low-power and lossy networks, standardized by IETF in 2012 as RFC6550. Specifically, RPL is designed to be a simple and inter-operable networking protocol for resource-constrained devices in industrial, home, and urban environments, intended to support the vision of the Internet of Things with thousands of devices interconnected through multihop mesh networks. More than four-years have passed since the standardization of RPL, and we believe that it is time to examine and understand its current state. In this paper, we review the history of research efforts in RPL; what aspects have been (and have not been) investigated and evaluated, how they have been studied, what was (and was not) implemented, and what remains for future investigation. We reviewed over 97 RPL-related academic research papers published by major academic publishers and present a topic-oriented survey for these research efforts. Our survey shows that only 40.2% of the papers evaluate RPL through experiments using implementations on real embedded devices, ContikiOS and TinyOS are the two most popular implementations (92.3%), and TelosB was the most frequently used hardware platform (69%) on testbeds that have average and median size of 49.4 and 30.5 nodes, respectively. Furthermore, unfortunately, despite it being approximately four years since its initial standardization, we are yet to see wide adoption of RPL as part of real-world systems and applications. We present our observations on the reasons behind this and suggest directions on which RPL should evolve. <s> BIB007 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> The vision of wireless multimedia sensor networks (WMSNs) is to provide real-time multimedia applications using wireless sensors deployed for long-term usage. Quality of service assurances for both best effort data and real-time multimedia applications introduced new challenges in prioritizing multipath routing protocols in WMSNs. Multipath routing approaches with multiple constraints have received considerable research interest. In this paper, a comprehensive survey of both best effort data and real-time multipath routing protocols for WMSNs is presented. Results of a preliminary investigation into design issues affecting the development of strategic multipath routing protocols that support multimedia data in WMSNs are also presented and discussed from the network application perspective. <s> BIB008 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> We propose a joint routing and medium access control (MAC) protocol, named as JRAM, for reducing transmission delays in a many-to-one communication paradigm for wireless sensor networks (WSNs). Due to the wide variety of WSN applications, there is a need for protocol solutions optimized for specific application classes. JRAM is proposed for WSNs deployed for monitoring multiple events in the same geographic region which require prompt detection and response. In existing contention-based synchronous MAC protocols designed for this, a node gets only one chance to succeed in data transmission scheduling per cycle, and a sink can also only receive data packets from at most one node in a cycle. Therefore, end-to-end transmission delay (E2ETD) and packet delivery ratio (PDR) of these protocols drastically degrade with the increase in event occurrence rate (EOR). In contrast, JRAM proposes a novel approach to provide $ {k}~ {(k >1)}$ chances to a node to succeed in data transmission scheduling in a cycle, and also allows a sink to receive data packets from ${k}$ nodes in the same cycle. This is done, in JRAM, by partitioning the network nodes into $ {k}$ disjoint sets and then using a novel cycle structure. We evaluate JRAM through extensive NS-2.35 simulations and compare its performance with existing pipelined data collection (PDC), adaptive data collection (ADC), and CROPMAC protocols, for different types of traffic loads and traffic patterns. Results suggest that in case of high EOR, JRAM outperforms PDC, ADC and CROPMAC both in terms of the E2ETD and the PDR. <s> BIB009 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> In this paper, the problem of distributed resource allocation is studied for an Internet of Things (IoT) system, composed of a heterogeneous group of nodes compromising both machine-type devices (MTDs) and human-type devices (HTDs). The problem is formulated as a noncooperative game between the heterogeneous IoT devices that seek to find the optimal time allocation so as to meet their quality-of-service (QoS) requirements in terms of energy, rate and latency. Since the strategy space of each device is dependent on the actions of the other devices, the generalized Nash equilibrium (GNE) solution is first characterized, and the conditions for uniqueness of the GNE are derived. Then, to explicitly capture the heterogeneity of the devices, in terms of resource constraints and QoS needs, a novel and more realistic game-theoretic approach, based on the behavioral framework of cognitive hierarchy (CH) theory, is proposed. This approach is then shown to enable the IoT devices to reach a CH equilibrium (CHE) concept that takes into account the various levels of rationality corresponding to the heterogeneous computational capabilities and the information accessible for each one of the MTDs and HTDs. Simulation results show that the proposed CHE solution keeps the percentage of devices with satisfied QoS constraints above 96% for IoT networks containing up to 10,000 devices without considerably degrading the overall system performance. <s> BIB010 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> Deadline constrained packet scheduling and transmission are important in real-time multimedia applications. This is because packets missing their deadlines would become useless and are frequently dropped, which seriously degrade the quality of service (QoS). As the utilization of Internet of Things has become mature, multimedia data transmission is a key component to promote the QoS of citizens. To fulfill the QoS requirement in wireless sensor networks (WSNs) with multimedia content, the combination of multiple transmission methods is encouraged for packet forwarding, including conventional network coding, analog network coding, plain routing, and direct transmission (i.e., no-relaying, NR). The diversity of transmission method is helpful to lower packet dropping probability, while complicating the packet transmitting and scheduling process instead. Therefore, we first introduce an exhaustive search method to obtain the optimal scheduling sequence and corresponding transmission method for deadline constrained multimedia transmissions in WSNs. With the objective of promoting computing efficiency for the formulated problem, we then propose two heuristic methods based on the Markov chain approximation and the dynamic graph, respectively. Simulation results illustrate that our methods can effectively reduce packet dropping probability and simulation time, so that QoS of individuals can be promoted. <s> BIB011 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> Internet of Things (IoT) and Cloud computing paradigm is a new research area. On the other hand, it has been identified as one of the emerging technologies in the field of computer science and Information Technology. The complementarity of these two technologies plays a major role in accessing any services and applications anywhere, anytime in the many smart environments. It is obvious that the integration of IoT and cloud computing is in its infantile phase and it has not been extended to all application domains due to its inadequate quality of service. In this research, we consider the combination and corporation of IoT and cloud computing as a point of assurance of QoS view. <s> BIB012 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> Multimedia communications play a major role in Internet of Things (IoT) applications such as traffic control and management, environmental monitoring, healthcare, surveillance, event recognition and home monitoring and automation. To ensure the quality of multimedia content to be collected, processed and delivered appropriately in such applications, it is necessary to design and develop a quality aware IoT architecture for multimedia IoT applications. Research on Quality of Experience (QoE) in multimedia communications in IoT has gained attention in recent years. However, the concept of IoT is to connect everything in a smart way without human interaction. Therefore, this paper introduces a new concept of Quality of Things (QoT) for multimedia communications in IoT, a new architecture based on the QoT for multimedia communications in IoTs is also proposed together with its challenges and future research directions. <s> BIB013 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> The futuristic trend is toward the merging of cyber world with physical world leading to the development of Internet of Things (IoT) framework. Current research is focused on the scalar data-based IoT applications thus leaving the gap between services and benefits of IoT objects and multimedia objects. Multimedia IoT (IoMT) applications require new protocols to be developed to cope up with heterogeneity among the various communicating objects. In this paper, we have presented a cross-layer protocol for IoMT. In proposed methodology, we have considered the cross communication of physical, data link, and routing layers for multimedia applications. Response time should be less, and communication among the devices must be energy efficient in multimedia applications. IoMT has considered both the issues and the comparative simulations in MATLAB have shown that it outperforms over the traditional protocols and presents the optimized solution for IoMT. <s> BIB014 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> In this paper, we present a compressed sensing-based approach, which combines the dictionary learning (DL) method and the approximate message passing (AMP) approach. The approach can be used for efficient communication in the multimedia Internet of Things (IoT). AMP is a signal reconstruction algorithm framework, which can be explained as an iterative denoising process. On the other hand, the DL method seeks an adaptive dictionary for realizing sparse signal representations, and provides good performance in signal denoising. We apply the DL-based denoising method within the AMP algorithm framework and propose a novel DL-AMP framework. We demonstrate our framework’s effectiveness for multimedia IoT devices by showing its capability in reducing required communication bandwidth for multimedia communication while improving reconstruction quality (by over 2 dB). <s> BIB015 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> The limited capabilities of Internet of Things (IoT) devices make real-time video streaming a major challenge. Video encoding and transmission are computationally intensive processes. Applications; like urban surveillance and health care monitoring, require real-time high definition video streams. Current video encoders are not designed to meet these requirements, thus alternative architectures, algorithms and compression techniques are needed to meet these goals. In this paper, real-time video streaming challenges for IoT applications are presented. <s> BIB016 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> Heterogeneous Internet of Things (HetIoT) is an emerging research field that has strong potential to transform both our understanding of fundamental computer science principles and our future living. HetIoT is being employed in increasing number of areas, such as smart home, smart city, intelligent transportation, environmental monitoring, security systems, and advanced manufacturing. Therefore, relaying on strong application fields, HetIoT will be filled in our life and provide a variety of convenient services for our future. The network architectures of IoT are intrinsically heterogeneous, including wireless sensor network, wireless fidelity network, wireless mesh network, mobile communication network, and vehicular network. In each network unit, smart devices utilize appropriate communication methods to integrate digital information and physical objects, which provide users with new exciting applications and services. However, the complexity of application requirements, the heterogeneity of network architectures and communication technologies impose many challenges in developing robust HetIoT applications. This paper proposes a four-layer HetIoT architecture consisting of sensing, networking, cloud computing, and applications. Then, the state of the art in HetIoT research and applications have been discussed. This paper also suggests several potential solutions to address the challenges facing future HetIoT, including self-organizing, big data transmission, privacy protection, data integration and processing in large-scale HetIoT. <s> BIB017 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> The Internet of Things (IoT) enables environmental monitoring by collecting data from sensing devices, including cameras and microphones. The popularity of smartphones enables mobile users to communicate and collect data from their surrounding sensing devices. The mobile devices can obtain useful environmental data from nearby sensors through short-range communication such as Bluetooth. Nevertheless, the limited contact time and the wireless capacity constrain the amount of data to be collected. With the increasing amount of multimedia big data such as videos and pictures from cameras, it is crucial for mobile users to collect prioritized data that can maximize their data utility. In this paper, we propose a distributed algorithm to provide information-centric ubiquitous data collection of multimedia big data by mobile users in the IoT. The algorithm can handle transmissions of multimedia big data recorded by the surrounding cameras and sensors, and prioritize the transmissions of the most important and relevant data. The mobile users construct data collection trees adaptively according to their dynamic moving speeds and the value of information carried by the multimedia and sensor data. The distributed algorithm can support smooth data collection and coordination of multiple mobile users. We provide both numerical analysis and extensive simulations to evaluate the information value, energy efficiency and scalability of our solution. The results showed that our distributed algorithm can improve the value of information up to 50% and reduce energy consumption to half compared with existing approach. Our algorithm also scales perfectly well with increasing number of mobile users and dynamic moving speeds. <s> BIB018 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> Abstract Nowadays, multimedia contents are widely used for various applications to ensure personal and public services. These contents are transferred through different kind of networks, from classical Adhoc networks to the recent Internet of Things (IoT). However, regardless the deployed network, the main goal remains the same: ensuring a better QoE and lower latency especially for emergency traffic. This domain attracts many research activities. In this paper, we tackle this challenging issue and we propose a cross-layer scheme to handle video streaming over wireless sensor networks. Our starting point is to provide a carrier sense aware disjoint multi-path routing protocol able to transmit efficiently video and regular data from many sources to a unique base station (BS). This protocol will cooperate with the application layer in order to provide a frame-aware solution to assign high priority to the most important frames and low priority for the least important ones. This priority concerns mainly the path that will be used by the frames and the queuing policy that will be applied. Our queuing policy involves enqueuing, dequeuing and congestion solving function in order to reduce video latency and enhance the reliability. Our scheme is explained through a theoretical study with illustrative examples. Many simulations have been conducted, they demonstrate improvements of some performance indicators such as packet data rate, delay, loss packet rate and user experience. <s> BIB019 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> The Internet of Things is a networking framework which allows the physical objects to connect with existing networking infrastructure. Due to high heterogeneity of hardware and communication protocols present among the things, poses many areas of the layered architecture to be re-engineered. Existing cross layered architectures for Sensor/Ad hoc networks cannot be applied directly, as the network characteristics are different. Internet uses hierarchical architectures whereas the Sensor/Ad hoc networks use flat architectures. In our work, we propose a cross-layer architecture of data-link and network layers for delay sensitive applications, such that response time should be less. An agent-based architecture was looked in, to optimize the inter-relation among the things, to find an optimal path i.e., optimize the end-to-end delay. IoT network mainly follows star type of topology but sensor network is multihop. The results show that the methodology we started with will yield good results for delay sensitive applications. <s> BIB020 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> Abstract With an exponential increase in the provisioning of multimedia devices over the Internet of Things (IoT), a significant amount of multimedia data (also referred to as multimedia big data – MMBD) is being generated. Current research and development activities focus on scalar sensor data based IoT or general MMBD and overlook the complexity of facilitating MMBD over IoT. This paper examines the unique nature and complexity of MMBD computing for IoT applications and develops a comprehensive taxonomy for MMBD abstracted into a novel process model reflecting MMBD over IoT. This process model addresses a number of research challenges associated with MMBD, such as scalability, accessibility, reliability, heterogeneity, and Quality of Service (QoS) requirements. A case study is presented to demonstrate the process model. <s> BIB021 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> Abstract Recently, there has been an increasing interest in the Internet of Things (IoT). While some analysts disvalue the IoT hype, several technology leaders, governments, and researchers are putting serious efforts to develop solutions enabling wide IoT deployment. Thus, the huge amount of generated data, the high network scale, the security and privacy concerns, the new requirements in terms of QoS, and the heterogeneity in this ubiquitous network of networks make its implementation a very challenging task. SDN, a new networking paradigm, has revealed its usefulness in reducing the management complexities in today's networks. Additionally, SDN, having a global view of the network, has presented effective security solutions. On the other hand, fog computing, a new data service platform, consists of pushing the data to the network edge reducing the cost (in terms of bandwidth consumption and high latency) of “big data” transportation through the core network. In this paper, we critically review the SDN and fog computing-based solutions to overcome the IoT main challenges, highlighting their advantages, and exposing their weaknesses. Thus, we make recommendations at the end of this paper for the upcoming research work. <s> BIB022 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> High Efficiency Video Coding (HEVC) encryption, which has been proposed to encrypt intra prediction modes (structural information), transform coefficients (texture information), and motion related codewords (motion information), has received considerable attention recently. However, there is still the issue of efficiency when HEVC encryption is applied in the Internet of Multimedia Things (IoMT). Aiming at this challenge, in this paper, we propose a new low-overhead HEVC encryption scheme for energy-constrained IoMT. Concretely, the proposed scheme adjusts the selection of the aforementioned syntax elements to be encrypted according to the structure, texture, and motion energy present in each frame. It works as follows. The energy levels of quantized coefficients and motion vectors are calculated and compared with adaptive threshold values to classify the energy level in each video frame. When there is a high energy frame in the video, all the syntax elements are encrypted. When there is a low energy frame, alternate syntax elements are encrypted for achieving low encryption overhead. Moreover, in the case of transform coefficients, to withstand the interpolation attack, alternate coefficients are encrypted after correlating the frame with its neighboring coefficients. Extensive experiments were conducted, and the results demonstrate that the proposed scheme efficiently reduces the encryption overhead with low impact on the security level, making it suitable for IoMT. <s> BIB023 </s> Multimedia Internet of Things: A Comprehensive Survey <s> A. CONTRIBUTIONS OF THIS SURVEY ARTICLE <s> The Internet of Things (IoT) connects more and more devices and supports an ever-growing diversity of applications. The heterogeneity of the cross-industry and cross-platform device resources is one of the main challenges to realize the unified management and information sharing, ultimately the large-scale uptake of the IoT. Inspired by software-defined networking, we propose the concept of software-defined device (SDD) and further elaborate its definition and operational mechanism from the perspective of cyber-physical mapping. Based on the device-as-a-software concept, we develop an open IoT system architecture which decouples upper-level applications from the underlying physical devices (Physical-D) through the SDD mechanism. A logically centralized controller is designed to conveniently manage Physical-D and flexibly provide the device discovery service and the device control interfaces for various application requests. We also describe an application use scenario which illustrates that the SDD-based system architecture can implement the unified management, sharing, reusing, recombining, and modular customization of device resources in multiple applications, and the ubiquitous IoT applications can be interconnected and intercommunicated on the shared Physical-D. <s> BIB024
In summary, this work aims to make the following contributions: To provide a detailed survey of various M-IoT network architectures. To survey the various M-IoT applications i.e., traffic monitoring, habitat monitoring, surveillance for public safety, industrial monitoring, and health monitoring. Requirements and open issues in each layer are also discussed in this section. Moreover, IoT has been analyzed in-depth in the context of multimedia data. The authors have also discussed several video encoding and compressing techniques. The second section outlines the various multimedia applications and uses cases concerning M-IoT. However, this article does not cover a detailed survey on M-IoT specifically. An indepth discussion on various enabling technologies, i.e., MAC protocols and network layer protocols, is missing. Discussion on future machine-type-communication and integration with 5 th generation (5G) cellular communication is not found. Furthermore, various QoS and QoE depending factors and Information-Centric Network (ICN) approach regarding M-IoT are not discussed. Multimedia computation technologies are not found in this article. The discussion on M-IoT in the context of architecture, enabling technologies, MAC and routing protocols is not found in the recent survey articles on IoT  , BIB003 , BIB017 . The existing survey on energy-efficient M-IoT is presented in BIB002 . This study explains the working of each layer of the traditional IoT architecture; however, the intrinsic nature of multimedia data is not considered in any aspect. Different routing protocols are discussed in BIB006 - BIB007 . A detailed survey on multimedia routing in wireless sensor networks is presented in  , BIB008 . However, these articles present a brief overview of multimedia routing and the comparison of various routing standards. It merely discusses the issues and challenges of current multimedia data requirements. Current M-IoT takes not only QoS but QoE into consideration that is dependent not only on network parameters but user's hardware capabilities itself. MAC protocols and efficient resource allocation standards are presented in BIB009 - BIB010 . BlueVoice has been evaluated for multimedia services in real-time IoT devices in BIB004 . QoS is analysed in BIB011 - BIB012 , while QoE is studied in BIB013 - BIB005 . The concept of Quality of Information (QoI) and ICN using a distributed algorithm for multimedia data collection is proposed in BIB018 . Kaaradi et al. BIB013 have presented the concept of Quality of Things (QoT) for M-IoT. However, it lacks QoS objectives. The rest of this article discusses the introduction of the virtual layer for virtual object representation and crosslayer communication. Cross-layer design related to M-IoT is presented in BIB019 , BIB014 , BIB020 . Thiyagarajan et al. BIB023 have proposed a secure video transmission energy-aware encryption scheme for M-IoT. Using Dictionary Learning (DL) and Approximate Message Passing (AMP). A compressed sensing technique is proposed for M-IoT in BIB015 . Various video encoding schemes and multimedia sensing are outlined in  , BIB016 . Performance comparison of Advance Video Codings (AVC) H.  and H.264 is presented in BIB001 . A detailed survey on multimedia big data computation is presented in BIB021 . Salman et al. in BIB022 present a survey on IoT from the perspective of Fog and SDN technologies. Articles  -  , present review on multimedia in road traffic management and biometric security. However, all these studies do not include a survey on multimedia communication in any form. Existing challenges, issues, and proposed work from the perspective of M-IoT are not presented in any of the articles. Comparison: From the word comprehensive, this article provides an in-depth overview of M-IoT. This article specifies the limitations of IoT architecture and user requirements of multimedia data in order to revise IoT architecture. This enables us to cover a review of various IoT architectures supporting wireless multimedia communication. Computation is the key feature required for M-IoT. Limitations of cloud computing in exhausting the bandwidth and energy-constrained networks are identified. Advantages of Fog/Edge computation to assist cloud computing are pre- sensors, and actuators, depending upon the services required by the application. Sensing devices have uplink data transmission mode while actuators have downlink data functionality. Access devices have the competency to operate in both uplink and downlink data transmission mode BIB024 . The main objective of this layer is to interconnect things in the IoT network. These devices sense, acquire and preprocess data from the physical world either locally or send the data to the centralized servers through gateways using Local Area Network or Wireless Personal Area Network (LAN/WPAN) via short-range low power enabling technologies like Zigbee, Bluetooth Low Energy (BLE), Ethernet, IEEE 802.15.4, etc.