{"id":8367,"date":"2021-12-22T15:31:39","date_gmt":"2021-12-22T08:31:39","guid":{"rendered":"https:\/\/gcloudvn.com\/?p=8367"},"modified":"2023-12-11T17:05:25","modified_gmt":"2023-12-11T10:05:25","slug":"datastream-la-gi","status":"publish","type":"post","link":"https:\/\/gcloudvn.com\/en\/kienthuc\/datastream-la-gi\/","title":{"rendered":"What is Datastream? Information to know about Datastream"},"content":{"rendered":"<p style=\"text-align: justify;\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-8368 aligncenter\" src=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2021\/12\/Datastream_v07-20-21.max-1600x1600-1-300x169.png\" alt=\"What is Datastream?\" width=\"600\" height=\"338\" srcset=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2021\/12\/Datastream_v07-20-21.max-1600x1600-1-300x169.png 300w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2021\/12\/Datastream_v07-20-21.max-1600x1600-1-1024x576.png 1024w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2021\/12\/Datastream_v07-20-21.max-1600x1600-1-768x432.png 768w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2021\/12\/Datastream_v07-20-21.max-1600x1600-1-1536x864.png 1536w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2021\/12\/Datastream_v07-20-21.max-1600x1600-1-18x10.png 18w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2021\/12\/Datastream_v07-20-21.max-1600x1600-1.png 1600w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_80 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewbox=\"0 0 24 24\" version=\"1.2\" baseprofile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/gcloudvn.com\/en\/kienthuc\/datastream-la-gi\/#Datastream_la_gi\" >What is Datastream?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/gcloudvn.com\/en\/kienthuc\/datastream-la-gi\/#Cac_truong_hop_su_dung\" >Use cases<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/gcloudvn.com\/en\/kienthuc\/datastream-la-gi\/#Ban_thiet_lap_Datastream_nhu_the_nao\" >How do you set up the Datastream?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/gcloudvn.com\/en\/kienthuc\/datastream-la-gi\/#Tuy_chon_ket_noi\" >Connection options<\/a><\/li><\/ul><\/nav><\/div>\n<h2 style=\"text-align: justify;\"><span class=\"ez-toc-section\" id=\"Datastream_la_gi\"><\/span><strong>What is Datastream?<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">With the volume of data constantly increasing, many companies find it difficult to use data effectively and derive insights from it. Often these organizations are burdened with cumbersome and difficult-to-maintain data architectures.\u00a0<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">One way companies are addressing this challenge is change streaming: the movement of changing data as they happen from source (usually a database) to destination. Powered by change data capture \u2013 CDC (change data capture), change streaming has become an important data architecture building block. We recently announced Datastream, a serverless data collection change and copy service. Key capabilities of Datastream include:<\/span><\/p>\n<ul style=\"text-align: justify;\">\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Duplicate and synchronize data across your organization with minimal latency. You can reliably synchronize data across heterogeneous databases and applications, with low latency and minimal impact on your power performance. Harness the power of data flows for analytics, database replication, cloud migration, and event-driven architectures across hybrid environments.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Scale up or down with a serverless architecture seamlessly. Get up and running quickly with an easy-to-use and serverless service that scales seamlessly as your data volumes change. Focus on gleaning up-to-date insights from your data and responding to high-priority issues, instead of infrastructure management, performance tuning, or resource provisioning.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Integration with data integrators <a href=\"https:\/\/gcloudvn.com\/en\/google-cloud-platform\/\">Google Cloud Platform<\/a>. K\u1ebft n\u1ed1i d\u1eef li\u1ec7u trong t\u1ed5 ch\u1ee9c c\u1ee7a b\u1ea1n v\u1edbi c\u00e1c s\u1ea3n ph\u1ea9m t\u00edch h\u1ee3p d\u1eef li\u1ec7u \u0110\u00e1m m\u00e2y c\u1ee7a Google. Datastream t\u1eadn d\u1ee5ng c\u00e1c m\u1eabu Dataflow \u0111\u1ec3 t\u1ea3i d\u1eef li\u1ec7u v\u00e0o BigQuery, Cloud Spanner v\u00e0 Cloud SQL; n\u00f3 c\u0169ng h\u1ed7 tr\u1ee3 c\u00e1c \u0111\u1ea7u n\u1ed1i CDC Replicator c\u1ee7a Cloud Data Fusion \u0111\u1ec3 t\u1ed5ng h\u1ee3p d\u1eef li\u1ec7u d\u1ec5 d\u00e0ng h\u01a1n bao gi\u1edd h\u1ebft.<\/span><\/li>\n<\/ul>\n<p style=\"text-align: justify;\"><strong><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-8369\" src=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2021\/12\/Datastream_Final.max-2800x2800-1-300x113.png\" alt=\"What is Datastream? Information about Datastream 1\" width=\"600\" height=\"225\" srcset=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2021\/12\/Datastream_Final.max-2800x2800-1-300x113.png 300w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2021\/12\/Datastream_Final.max-2800x2800-1-1024x384.png 1024w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2021\/12\/Datastream_Final.max-2800x2800-1-768x288.png 768w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2021\/12\/Datastream_Final.max-2800x2800-1-1536x577.png 1536w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2021\/12\/Datastream_Final.max-2800x2800-1-2048x769.png 2048w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2021\/12\/Datastream_Final.max-2800x2800-1-18x7.png 18w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/strong><\/p>\n<h2 style=\"text-align: justify;\"><span class=\"ez-toc-section\" id=\"Cac_truong_hop_su_dung\"><\/span><strong>Use cases<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Datastream captures change streams from Oracle, MySQL, and other sources for destinations such as <a href=\"https:\/\/gcloudvn.com\/en\/cloud-storage\/\">Cloud Storage<\/a>, Pub\/Sub, BigQuery, Spanner, etc. Some use cases of Datastream:\u00a0\u00a0<\/span><\/p>\n<ul style=\"text-align: justify;\">\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">For analytics use Datastream with pre-built template <\/span><span style=\"font-weight: 400;\">.<\/span> <span style=\"font-weight: 400;\">to create up-to-date replication tables in <\/span><a href=\"https:\/\/gcloudvn.com\/en\/bigquery\/\"><span style=\"font-weight: 400;\">BigQuery<\/span><\/a> <span style=\"font-weight: 400;\">in a fully managed manner.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">For database replication, use Datastream with pre-built Dataflow templates to continuously copy and synchronize database data into <\/span><a href=\"https:\/\/gcloudvn.com\/en\/cloud-sql\/\"><span style=\"font-weight: 400;\">Cloud SQL<\/span><\/a><span style=\"font-weight: 400;\"> for PostgreSQL or <\/span><span style=\"font-weight: 400;\">Spanner<\/span> <span style=\"font-weight: 400;\">to support low downtime database migrations or hybrid cloud configurations.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">To build an event-driven architecture, use Datastream to ingest changes from multiple sources into object stores like <\/span><span style=\"font-weight: 400;\">Google Cloud Storage<\/span> <span style=\"font-weight: 400;\">or in the future, messaging services like <\/span><span style=\"font-weight: 400;\">Pub \/ Sub<\/span><span style=\"font-weight: 400;\"> or <\/span><span style=\"font-weight: 400;\">Kafka\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Streamline real-time data pipelines that seamlessly transfer data from legacy relational data warehouses (like Oracle and MySQL) <\/span><a href=\"https:\/\/cloud.google.com\/blog\/products\/databases\/get-real-time-analytics-data-with-datastream-and-mongodb\" rel=\"nofollow noopener\" target=\"_blank\"><span style=\"font-weight: 400;\">using Datastream into MongoDB<\/span><\/a><span style=\"font-weight: 400;\">.\u00a0<\/span><\/li>\n<\/ul>\n<h2 style=\"text-align: justify;\"><span class=\"ez-toc-section\" id=\"Ban_thiet_lap_Datastream_nhu_the_nao\"><\/span><strong>How do you set up the Datastream?<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ol style=\"text-align: justify;\">\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Create a power connection profile.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Create a destination connection profile.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Create a stream using source and destination connection profiles, and define objects to get from the source.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Authenticate and start the stream.<\/span><\/li>\n<\/ol>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Once started, a stream continuously transmits data from source to destination. You can pause and then resume the live stream.\u00a0<\/span><\/p>\n<h2 style=\"text-align: justify;\"><span class=\"ez-toc-section\" id=\"Tuy_chon_ket_noi\"><\/span><strong>Connection options<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">To use Datastream to create a stream from the source database to the destination, you must establish a connection to the source database. Datastream supports IP whitelist, SSH tunnel forwarding, and VPC peer-to-peer networking methods.<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Private connection configuration allows Datastream to communicate with the data source over a private network (internally within Google Cloud or with external sources connected via VPN or Interconnect). This communication occurs through a Virtual Private Cloud (VPC) peer-to-peer connection.\u00a0<\/span><\/p>\n<p style=\"text-align: right;\"><strong>Source: <a href=\"https:\/\/gcloudvn.com\/en\/\">Gimasys<\/a><\/strong><\/p>","protected":false},"excerpt":{"rendered":"<p>What is Datastream? With the volume of data constantly increasing, many companies struggle to use data effectively and gain insights from it. Normally\u2026<\/p>","protected":false},"author":2,"featured_media":8368,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[1,135],"tags":[],"class_list":["post-8367","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-kienthuc","category-google-cloud-platform","entry","has-media"],"_links":{"self":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/posts\/8367","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/comments?post=8367"}],"version-history":[{"count":0,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/posts\/8367\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/media\/8368"}],"wp:attachment":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/media?parent=8367"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/categories?post=8367"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/tags?post=8367"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}