Google Launches BigQuery Omni

BigQuery Omni brings multi-cloud analytics to your data.

Google introduced BigQuery Omni, which is a multi-cloud analytics solution that allows users to cost-effectively access and securely analyze data across Google Cloud, AWS, and Azure (coming soon), without leaving the familiar BigQuery user interface (UI).
 
The solution allows you to use standard SQL and the BigQuery APIs to break down data silos and gain critical business insights from a single pane of glass. BigQuery Omni is powered by Anthos, so developers will be able to query data without having to manage the underlying infrastructure.
 
"BigQuery Omni is an extension of our continued innovation and commitment to multi-cloud, bringing you the best analytics and data warehouse technology, no matter where your data is stored." wrote Google.
 
Google said that BigQuery Omni brings a new way of analyzing data stored in multiple public clouds, which is made possible by BigQuery's separation of compute and storage.
 
The same BigQuery interface on Google Cloud enables you to query the data that you have stored in Google Cloud, AWS and Azure without any cross-cloud movement or copies of data. Omni’s query engine runs the required compute on clusters in the same region where your data resides.
 
 
Source: Google
 
As the BigQuery Omni runs on Anthos clusters that are fully managed by Google Cloud, it allows you to securely execute queries on other public clouds.
 
To Get started with the BigQuery Omni, you can start in the BigQuery UI on Google Cloud then choose the public cloud region where your data is located, and run your query.
 
You will not need to format or transform your data, the solution supports Avro, CSV, JSON, ORC, and Parquet. You are not required to move or copy your raw data out of the other public cloud, manage clusters, or provision resources. Computation happens within BigQuery’s multi-tenant service that runs on the AWS region where the data is currently located.
 
To learn more you can visit the official announcement here. 


Next Recommended Reading Kaggle Integrates Into BigQuery