CROSS-REFERENCE TO RELATED APPLICATIONSApplicationNo.Date FiledTitleCurrentHerewithSYSTEM AND METHODS FORapplicationBANDWIDTH-EFFICIENTCRYPTOGRAPHIC DATA TRANSFERClaims priority to, and benefit of:63/027,166May 19, 2020ENHANCED CRYPTOGRAPHY USINGCODEBOOK SHUFFLINGand also claims priority to, and benefit of:62/926,723Oct. 28, 2019SYSTEM AND METHOD FOR SECURE,FAST COMMUNICATIONS BETWEENPROCESSORS ON COMPLEX CHIPSand is also a continuation-in-part of:16/716,098Dec. 16, 2019BANDWIDTH-EFFICIENT INSTALLATIONOF SOFTWARE ON TARGET DEVICESUSING REFERENCE CODE LIBRARIESwhich is a continuation of:16/455,655Jun. 27, 2019SYSTEM AND METHOD FOR DATAPatentIssue DateSTORAGE, TRANSFER,10,509,771Dec. 17, 2019SYNCHRONICATION, AND SECURITYUSING RECURSIVE ENCODINGwhich is a continuation-in-part of:16/200,466Nov. 26, 2018SYSTEM AND METHOD FOR HIGH-SPEEDPatentIssue DateTRANSFER OF SMALL DATA SETS10,476,519Nov. 12, 2019which is a continuation-in-part of:15/975,741May 9, 2018SYSTEM AND METHOD FOR DATAPatentIssue DateSTORAGE, TRANSFER,10,303,391May 28, 2019SYNCHRONIZATION, AND SECURITYwhich claims benefit of, and priority to:62/578,824Oct. 30, 2017MASSIVE DATA STORAGE, TRANSFER,SYNCHRONIZATION, AND SECURITYSYSTEMthe entire specification of each of which is incorporated herein by reference.

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention is in the field of computer data storage and transmission, and in particular to the use of block cipher encryption using novel systems and techniques.

Discussion of the State of the Art

As computers become an ever-greater part of our lives, and especially in the past few years, data storage has become a limiting factor worldwide. Prior to about 2010, the growth of data storage far exceeded the growth in storage demand. In fact, it was commonly considered at that time that storage was not an issue, and perhaps never would be, again. In 2010, however, with the growth of social media, cloud data centers, high tech and biotech industries, global digital data storage accelerated exponentially, and demand hit the zettabyte (1 trillion gigabytes) level. Current estimates are that data storage demand will reach 50 zettabytes by 2020. By contrast, digital storage device manufacturers produced roughly 1 zettabyte of physical storage capacity globally in 2016. We are producing data at a much faster rate than we are producing the capacity to store it. In short, we are running out of room to store data, and need a breakthrough in data storage technology to keep up with demand.

The primary solutions available at the moment are the addition of additional physical storage capacity and data compression. As noted above, the addition of physical storage will not solve the problem, as storage demand has already outstripped global manufacturing capacity. Data compression is also not a solution. A rough average compression ratio for mixed data types is 2:1, representing a doubling of storage capacity. However, as the mix of global data storage trends toward multi-media data (audio, video, and images), the space savings yielded by compression either decreases substantially, as is the case with lossless compression which allows for retention of all original data in the set, or results in degradation of data, as is the case with lossy compression which selectively discards data in order to increase compression. Even assuming a doubling of storage capacity, data compression cannot solve the global data storage problem. The method disclosed herein, on the other hand, works the same way with any type of data.

Transmission bandwidth is also increasingly becoming a bottleneck. Large data sets require tremendous bandwidth, and we are transmitting more and more data every year between large data centers. On the small end of the scale, we are adding billions of low bandwidth devices to the global network, and data transmission limitations impose constraints on the development of networked computing applications, such as the “Internet of Things”.

Furthermore, as quantum computing becomes more and more imminent, the security of data, both stored data and data streaming from one point to another via networks, becomes a critical concern as existing encryption technologies are placed at risk.

What is needed is a fundamentally new approach to data storage and transmission, that allows for dramatically more storage versus existing methods on the same physical storage device, and that supports very high security implementations and transfer rates.

SUMMARY OF THE INVENTION

The inventor has developed, and reduced to practice, a system and methods for bandwidth-efficient cryptographic data transfer, utilizing an encoding endpoint device, a decoding endpoint device, a reference codebook, and a plurality of data to encode and decode, which may use specific algorithms on top of block cipher encryption to achieve higher data security and ease the burden on users with regards to computational power, complexity, and bandwidth for communication.

According to one aspect, a system for bandwidth-efficient cryptographic data transfer is disclosed, comprising: at least one reference codebook comprising key-value pairs of data to ingest, and data to output as an enciphered codeword or codeblock; a plurality of data to be enciphered with a reference codebook; an encoding endpoint device comprising a first processor, a first memory, and a first plurality of programming instructions stored in the memory and operable on the processor of a computing device, wherein the first plurality of programming instructions, when operating on the processor, cause the update receiving server to: use a reference codebook to encipher the plurality of data based on source data length and reference code length; run at least one algorithm using a reference codebook to re-encipher the initially enciphered data; and send the enciphered data to a decoding endpoint device; and a decoding endpoint device comprising a first processor, a first memory, and a first plurality of programming instructions stored in the memory and operable on the processor of a computing device, wherein the first plurality of programming instructions, when operating on the processor, cause the update receiving server to: receive enciphered data from an encoding endpoint device; use at least one algorithm using a reference codebook to decipher the data until only a basic block cipher encryption remains; and use a reference codebook to decipher the data into the original source data.

In another aspect, a method for bandwidth-efficient cryptographic data transfer is disclosed, comprising the steps of: using a reference codebook to encipher the plurality of data based on source data length and reference code length, using an encoding endpoint device, a reference codebook, and a plurality of data; running at least one algorithm using a reference codebook to re-encipher the initially enciphered data, using an encoding endpoint device, a reference codebook, and a plurality of data; sending the enciphered data to a decoding endpoint device, using an encoding endpoint device, a reference codebook, and a plurality of data; receiving enciphered data from an encoding endpoint device, using an decoding endpoint device, a reference codebook, and a plurality of data; using at least one algorithm using a reference codebook to decipher the data until only a basic block cipher encryption remains, using an decoding endpoint device, a reference codebook, and a plurality of data; and using a reference codebook to decipher the data into the original source data, using an decoding endpoint device, a reference codebook, and a plurality of data.

