ViPR HDFS provides an HDFS-compatible file system. A ViPR client (a .jar file) installs on the data nodes of an existing Hadoop cluster and registers the ViPR File system (ViPRFS) as a file system that is available for MapReduce jobs as well as Pig, Hive queries etc. Existing storage arrays managed by ViPR can now be made accessible via ViPR HDFS. ViPR Services create a unified pool (bucket) of data. Similar to ViPR Object, users create buckets which can span file shares that can grow and shrink on demand. The data is distributed across the arrays according to how the virtual storage pool is configured. The bucket provides an HDFS interface or, optionally, an Object (S3) and HDFS interface. In this way, the compute portion of an existing Hadoop cluster communicates with ViPR HDFS, which uses existing data (added to the HDFS bucket) as the target for Big Data applications and queries.
How does ViPR HDFS work?
ViPR HDFS