Announcing Partiql: One Query Language For All Your Data

The root of the problem is that data is typically spread across a combination of relational databases, non-relational data stores, and data lakes. Some data may be highly structured and stored in SQL databases or data warehouses. Other data may be stored in NoSQL engines, including key-value stores, graph databases, ledger databases, or time-series databases. Data may also reside in the data lake, stored in formats that may lack schema, or may involve nesting or multiple values (e.g., Parquet, JSON). Every different type and flavor of data store may suit a particular use case, but each also comes with its own query language. The result is tight coupling between the query language and the format in which data is stored. Hence, if you want to change your data to another format, or change the database engine you use to access/process that data (which is not uncommon in a data lake world), or change the location of your data, you may also need to change your application and queries. This is a very large obstacle to the agility and flexibility needed to effectively use data lakes.


Comments

Be the first to comment !



Related Posts


2 months, 3 weeks ago

Yugabyte/Yugabyte-db

The high-performance distributed SQL database for global, internet-scale apps.

..

2 months ago

Blazingdb/Pyblazing

Blazingsql is a Lightweight, GPU Accelerated, SQL Engine Built on RAPIDS.

..

-->