TECHNICAL FIELD

The present disclosure relates to data platforms and, more particularly, to systems and methods for supporting unstructured, semi-structured, and structured files.

BACKGROUND

Data platforms are widely used for data storage and data access in computing and communication contexts. With respect to architecture, a data platform could be an on-premises data platform, a network-based data platform (e.g., a cloud-based data platform), a combination of the two, and/or include another type of architecture. With respect to type of data processing, a data platform could implement online transactional processing (OLTP), online analytical processing (OLAP), a combination of the two, and/or another type of data processing. Moreover, a data platform could be or include a relational database management system (RDBMS) and/or one or more other types of database management systems.

In a typical implementation, a data platform includes one or more databases that are maintained on behalf of a customer account. Indeed, a data platform may include one or more databases that are respectively maintained in association with any number of customer accounts, as well as one or more databases associated with one or more system (e.g., administrative) accounts of the data platform, one or more other databases used for administrative purposes, and/or one or more other databases that are maintained in association with one or more other organizations and/or for any other purposes. A data platform may store metadata in association with the data platform in general and in association with particular databases and/or particular customer accounts as well. Metadata that is maintained by a data platform with respect to stored data (e.g., stored customer data) may be referred to herein at times as “expression properties.”

Users and/or executing processes—that may be associated with, e.g., a given customer account—may, via one or more types of clients, be able to cause data to be ingested into one or more databases in the data platform, and may also be able to manipulate the data, run queries against the data, create customized views (which are also known as secure views) of the data, modify the data, insert additional data, remove data, and/or the like. Some example types of clients include web interfaces, Java Database Connectivity (JDBC) drivers, Open Database Connectivity (ODBC) drivers, one or more other types of drivers, desktop applications, mobile apps, and the like.

In an example implementation of a data platform, a given database is represented as an account-level object within a customer account, and the customer account may also include one or more other account-level objects such as users, roles, and/or the like. Furthermore, a given account-level database object may itself contain one or more objects such as tables, schemas, views, streams, tasks, and/or the like. A given table may be organized as records (e.g., rows) that each include one or more attributes (e.g., columns). A data platform may physically store database data in multiple storage units, which may be referred to as blocks, micro-partitions, and/or by one or more other names.

