{"id":6234,"date":"2020-01-16T11:44:30","date_gmt":"2020-01-16T04:44:30","guid":{"rendered":"http:\/\/gcloudvn.wam.vn\/hoi-nhap-don-nhan-su-thay-doi-voi-kho-du-lieu-dam-may\/"},"modified":"2023-04-27T10:50:19","modified_gmt":"2023-04-27T03:50:19","slug":"hoi-nhap-don-nhan-su-thay-doi-voi-kho-du-lieu-dam-may","status":"publish","type":"post","link":"https:\/\/gcloudvn.com\/en\/kienthuc\/hoi-nhap-don-nhan-su-thay-doi-voi-kho-du-lieu-dam-may\/","title":{"rendered":"Integrating, embracing change with cloud data warehouse"},"content":{"rendered":"<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">The move from a traditional on-premises data warehouse platform to a cloud data warehouse like <\/span><span style=\"font-weight: 400;\">Google Cloud <a href=\"https:\/\/gcloudvn.com\/en\/bigquery\/\">BigQuery<\/a><\/span><span style=\"font-weight: 400;\">, not merely adopting new technology. It also provides an opportunity to review existing practices and adopt new ways of working. We&#039;ve noted some typical changes that teams go through to support data warehouse migration to the cloud.<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">For a change management framework and best practices for migrating to the cloud, you can find more details in the documentation <\/span><a href=\"https:\/\/services.google.com\/fh\/files\/misc\/managing_change_in_the_cloud.pdf\" target=\"_blank\" rel=\"nofollow noopener\"><span style=\"font-weight: 400;\">Qu\u1ea3n l\u00fd thay \u0111\u1ed5i trong \u0111\u00e1m m\u00e2y.<\/span><\/a><span style=\"font-weight: 400;\">\u00a0<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">People are at the core of any change management initiative. For a data warehouse migration initiative, Google will focus on three key stakeholders involved in day-to-day use and management (although other ancillary roles may be involved):<\/span><\/p>\n<ul style=\"text-align: justify;\">\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">data consumers (<\/span><b>Data consumers)<\/b><span style=\"font-weight: 400;\"> \u2013 usually a data analyst, data scientist or business user<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Data Activator (<\/span><b>Data enabler)<\/b><span style=\"font-weight: 400;\"> \u2013 usually a data engineer or tool developer <\/span><a href=\"https:\/\/en.wikipedia.org\/wiki\/Extract,_transform,_load\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">ETL<\/span><\/a><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">data administrator (<\/span><b>Data administrator)<\/b><span style=\"font-weight: 400;\"> \u2013 typically a database\/datastore administrator<\/span><\/li>\n<\/ul>\n<p style=\"text-align: justify;\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-15348 size-full\" src=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2020\/01\/GCP8.png\" alt=\"H\u1ed9i nh\u1eadp, \u0111\u00f3n nh\u1eadn s\u1ef1 thay \u0111\u1ed5i v\u1edbi kho d\u1eef li\u1ec7u \u0111\u00e1m m\u00e2y 1\" width=\"1000\" height=\"519\" \/><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Let&#039;s look at each stakeholder and see how their responsibilities change as their organization moves from on-premises to the cloud.<\/span><\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_80 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewbox=\"0 0 24 24\" version=\"1.2\" baseprofile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/gcloudvn.com\/en\/kienthuc\/hoi-nhap-don-nhan-su-thay-doi-voi-kho-du-lieu-dam-may\/#Nguoi_tieu_dung_du_lieu_Data_consumer\" >Ng\u01b0\u1eddi ti\u00eau d\u00f9ng d\u1eef li\u1ec7u (Data consumer)\u00a0<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/gcloudvn.com\/en\/kienthuc\/hoi-nhap-don-nhan-su-thay-doi-voi-kho-du-lieu-dam-may\/#Nguoi_kich_hoat_du_lieu_Data_enabler\" >Ng\u01b0\u1eddi k\u00edch ho\u1ea1t d\u1eef li\u1ec7u (Data enabler)<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/gcloudvn.com\/en\/kienthuc\/hoi-nhap-don-nhan-su-thay-doi-voi-kho-du-lieu-dam-may\/#Nguoi_quan_tri_du_lieu_Data_administrator\" >Ng\u01b0\u1eddi qu\u1ea3n tr\u1ecb d\u1eef li\u1ec7u (Data administrator)\u00a0<\/a><\/li><\/ul><\/nav><\/div>\n<h2 style=\"padding-left: 40px; text-align: justify;\"><span class=\"ez-toc-section\" id=\"Nguoi_tieu_dung_du_lieu_Data_consumer\"><\/span><span style=\"font-size: 14pt;\"><span style=\"font-weight: 400;\">data consumers (<\/span><b>Data consumers)\u00a0<\/b><\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Data analysts and data scientists have many benefits from migrating to the cloud data warehouse. New datasets available, new algorithms to play with, and lower latency access options in the cloud. Typically, during a migration, existing reporting applications and BI tools are left in place to ensure minimal business disruption causing data consumers to accept relative changes. easy. However, data consumers may want to ensure that their existing reports and use cases are tested on the new platform. Therefore, it is advisable to ask them to participate in any data validation efforts. You can create a data validation group, for example.<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Once migrated, data consumers can find new ways of working as they gain access to new datasets, like converting bulk reports into real-time dashboards and finding ways to turn machine learning reality for the organization. New platform capabilities eventually become the most important catalyst for change in this role. The more ambitious a data consumer is, the greater the shift will be to other roles within the organization.<\/span><\/p>\n<h2 style=\"padding-left: 40px; text-align: justify;\"><span class=\"ez-toc-section\" id=\"Nguoi_kich_hoat_du_lieu_Data_enabler\"><\/span><span style=\"font-size: 14pt;\"><span style=\"font-weight: 400;\">Data Activator (<\/span><b>Data enabler)<\/b><\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">The technical capabilities of a data enabler are critical to how the cloud is successfully adopted in an organization. These individuals own the data pipelines and are deeply involved in any refactoring efforts needed to move workloads to the cloud. The roadmap may be phased depending on the technology stack that Google adopts; Proper resource planning will be important for those enabling this data. Migrating to the cloud can be a lengthy undertaking, so it&#039;s worth considering taking the time to plan, re-tool, and automate the migration.<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">As data enablers are restructuring and redesigning data pipelines and working alongside data consumers, they have plenty of opportunities to rethink how business processes should change. change to take advantage of real-time data ingestion, new data modeling techniques, or the permanent storage that new cloud technology offers. Data enablers can also review legacy requests that can&#039;t be accommodated due to size, data format complexity, or ETL complexity. Cloud technologies may be better suited to overcome such challenges through capabilities such as storage and resource elasticity, support for multiple data formats and storage options, and multiple storage options. tools and libraries for data processing. Additionally, adopting DevOps, container apps, or serverless compute are ways data enablers (along with data administrators) can explore to improve change rates. Changes are applied and new insights are provided to users.<\/span><\/p>\n<h2 style=\"padding-left: 40px; text-align: justify;\"><span class=\"ez-toc-section\" id=\"Nguoi_quan_tri_du_lieu_Data_administrator\"><\/span><span style=\"font-size: 14pt;\"><span style=\"font-weight: 400;\">data administrator (<\/span><b>Data administrator)\u00a0<\/b><\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Database administrators continue to play an important role even when enterprise data warehouses are hosted in the cloud. As platform owners, administrators must familiarize themselves with the cloud technology capabilities early on and drive business transformation with key stakeholders. As database administrators move data workloads to the cloud, there are next important areas to focus; an overview of governance during and after the migration, data integrity, and SLAs such as <\/span><span style=\"font-weight: 400;\">RPO<\/span><span style=\"font-weight: 400;\"> and <\/span><span style=\"font-weight: 400;\">RTO<\/span><span style=\"font-weight: 400;\">. If the organization adopts a vendor-managed cloud data warehouse, the database administrator will have fewer tasks to procure and tune the underlying database. But cost versus performance optimization remains an important area for administrators to fully engage with. (<\/span><a href=\"https:\/\/www.esg-global.com\/the-economic-advantages-of-migrating-enterprise-data-warehouse-workloads-to-google-bigquery\" target=\"_blank\" rel=\"nofollow noopener\"><span style=\"font-weight: 400;\">See the ESG report on how to migrate to BigQuery<\/span><\/a><span style=\"font-weight: 400;\"> can lower your three-year TCO by up to 52%.)<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Database administrators are also freed up to deepen their understanding of the storage, networking, and compute options the cloud offers, and find ways to optimize enterprise workloads in the cloud. Admins can adopt new ways to work with machine learning notebook environments, new query engines, containerization engines, hybrid clouds, and more \u2013 there&#039;s so much to learn and optimize. optimization!<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Organizations that adopt these new skills and processes have a better chance of succeeding in delivering business results in the cloud. For more information on how to streamline your business migration path, see <\/span><a href=\"https:\/\/cloud.google.com\/solutions\/migration\/dw2bq\/dw-bq-migration-overview\" target=\"_blank\" rel=\"nofollow noopener\"><span style=\"font-weight: 400;\">documentation and data warehouse migration framework<\/span><\/a><span style=\"font-weight: 400;\">. You can also apply <\/span><a href=\"https:\/\/www.esg-global.com\/the-economic-advantages-of-migrating-enterprise-data-warehouse-workloads-to-google-bigquery\" target=\"_blank\" rel=\"nofollow noopener\"><span style=\"font-weight: 400;\">data warehouse migration incentives<\/span><\/a><span style=\"font-weight: 400;\"> for help with the full migration process.<\/span><\/p>\n<p style=\"text-align: right;\"><strong>Source: Gimasys<\/strong><\/p>","protected":false},"excerpt":{"rendered":"<p>Moving from a traditional on-premises data warehouse platform to a cloud data warehouse like Google Cloud BigQuery is more than just adopting new technology. It also provides an opportunity to\u2026<\/p>","protected":false},"author":1,"featured_media":6235,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-6234","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-kienthuc","entry","has-media"],"_links":{"self":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/posts\/6234","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/comments?post=6234"}],"version-history":[{"count":0,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/posts\/6234\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/media\/6235"}],"wp:attachment":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/media?parent=6234"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/categories?post=6234"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/tags?post=6234"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}