skip to Main Content
Welcome to Gimasys!
Hotline: +84 974 417 099 (HCM) | +84 987 682 505 (HN)

Introducing Datastream for Google BigQuery

Datastream cho Google BigQuery
Datastream cho Google BigQuery

In today’s competitive environment, organizations need to quickly and easily make decisions based on real-time data. That’s why we’re announcing Datastream cho BigQuery, hiện đã có trong bản xem trước, có tính năng sao chép liền mạch từ các nguồn cơ sở dữ liệu hoạt động như AlloyDB cho PostgreSQL, PostgreSQL, MySQL và Oracle, trực tiếp vào BigQuery –  kho dữ liệu không máy chủ của Google Cloud. Datastream cho BigQuery là bước tiến lớn tiếp theo của Google nhằm hiện thực hóa tầm nhìn của chúng tôi về đám mây dữ liệu thống nhất, kết hợp cơ sở dữ liệu, phân tích và học máy vào một nền tảng duy nhất cung cấp quy mô, tốc độ, bảo mật và sự đơn giản mà các doanh nghiệp hiện đại cần. Với kiến ​​trúc tự động mở rộng quy mô không máy chủ, Datastream cho phép bạn dễ dàng thiết lập pipeline ELT (Trích xuất, Tải, Chuyển đổi) để sao chép dữ liệu với độ trễ thấp cho phép thông tin chi tiết theo thời gian thực. 

Consider the case of a large supermarket chain, with 100’s of stores spread out across the region. Each individual store runs its own local point-of-sale and stock management systems, collecting data throughout the day about transactions and stock-levels in the store. To provide visibility and help streamline the chain’s daily operations, the IT department set up a nightly batch process to collect and consolidate all of the data from the stores into a central data warehouse, so that reports on the stores’ performance could be ready for review in the morning. Maintaining this process took time and resources from the data engineering team, and as the chain grows and more data needs to be processed, this process ended up taking so long that reports would only be ready late into the day. Organizations like this are looking for a modern solution that allows effortless replication of operational data to their data warehouse, enabling real-time decision making; Datastream for BigQuery is that solution.

> Tham khảo: 

Datastream accelerates data-driven decision making in BigQuery

Được phát triển với sự hợp tác chặt chẽ với nhóm BigQuery của Google Cloud, Datastream dành cho BigQuery mang đến trải nghiệm độc đáo, thực sự liền mạch và dễ sử dụng, cho phép hiểu rõ thời gian thực trong BigQuery chỉ với một vài bước.

Using BigQuery’s newly developed Change Data Capture (CDC) and Storage Write API’s UPSERT functionality, Datastream efficiently replicates updates directly from source systems into BigQuery tables in real-time. You no longer have to waste valuable resources building and managing complex data pipelines, self-managed staging tables, tricky DML merge logic, or manual conversion from database-specific data types into BigQuery data types. Just configure your source database, connection type, and destination in BigQuery and you’re all set. Datastream for BigQuery will backfill historical data and continuously replicate new changes as they happen. And as database schemas shift, Datastream seamlessly handles schema changes and automatically adds new tables and columns to BigQuery. 

New volume-based tiered pricing

We are also excited to announce the launch of volume-based tiered pricing that makes it more affordable for customers moving larger volumes of data. Volume-based tiered pricing will be applied automatically based on actual usage to unlock the power of Datastream. 

Klooka leading travel and leisure e-commerce platform for experiences and services, processes vast amounts of data across a range of applications and databases. Using BigQuery, Klook’s data team produces daily reports and analysis for their management team to help drive better business decisions. “Dealing with complex data environments and ingesting data from different sources into our data warehouse is very challenging”, says Stacy Zhu, Senior Manager for Data at Klook. “Prior to adopting Datastream, we had a team of data engineers dedicated to the task of ingesting data into BigQuery, and we spent a lot of time and effort making sure that the data was accurate. With Datastream, our data analysts can have accurate data readily available to them in BigQuery with a simple click. We enjoy Datastream's ease-of-use, and its performance helps us achieve large scale ELT data processing.”

Volume based tiered pricing
Volume based tiered pricing

Achievers, an award-winning employee engagement software and platform, is another customer who recently adopted Datastream. “Achievers had been heavily using Google Cloud VMs (GCE), and Google Kubernetes Engine (GKE)” says Daljeet Saini, Lead Data Architect at Achievers. “With the help of Datastream, Achievers will be streaming our data into BigQuery and enabling our analysts and data scientists to start using BigQuery for smart analytics, helping us take the data warehouse to the next level.”

Start using Datastream today

Bạn có thể bắt đầu ngay hôm nay với Datastream, dành cho tất cả khách hàng ở tất cả các khu vực của Google Cloud. Để biết thêm thông tin về Datastream cho BigQuery, vui lòng xem product page..

If your business is interested in the Cloud Platform Google Platform then you can connect to Gimasys - Google Premier Partner - for consulting solutions according to the unique needs of your business. Contact now:

  • Gimasys – Google Cloud Premier Partner
  • Hotline: Ha Noi: 0987 682 505 – Ho Chi Minh: 0974 417 099
  • Email:

The source:

Back To Top
0974 417 099