{"id":14272,"date":"2023-06-07T16:12:11","date_gmt":"2023-06-07T09:12:11","guid":{"rendered":"https:\/\/gcloudvn.com\/?p=14272"},"modified":"2023-08-16T13:25:15","modified_gmt":"2023-08-16T06:25:15","slug":"how-a-green-energy-provider-used-dataplex-for-its-data-governance-and-quality","status":"publish","type":"post","link":"https:\/\/gcloudvn.com\/en\/kienthuc\/how-a-green-energy-provider-used-dataplex-for-its-data-governance-and-quality\/","title":{"rendered":"How a green energy provider used Dataplex for its data governance and quality"},"content":{"rendered":"<p style=\"text-align: justify;\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-14279 size-full\" src=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex1.png\" alt=\"Case Study: C\u00e1ch Google Dataplex gi\u00fap Casa Dos Ventos qu\u1ea3n tr\u1ecb v\u00e0 \u0111\u1ea3m b\u1ea3o ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u\" width=\"600\" height=\"337\" srcset=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex1.png 600w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex1-18x10.png 18w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Brazil l\u00e0 m\u1ed9t trong nh\u1eefng th\u1ecb tr\u01b0\u1eddng n\u0103ng l\u01b0\u1ee3ng t\u00e1i t\u1ea1o h\u1ee9a h\u1eb9n nh\u1ea5t th\u1ebf gi\u1edbi, trong \u0111\u00f3 Casa Dos Ventos l\u00e0 nh\u00e0 \u0111\u1ea7u t\u01b0 v\u00e0 ti\u00ean phong h\u00e0ng \u0111\u1ea7u. V\u1edbi s\u1ef1 \u0111\u1ed5i m\u1edbi v\u00e0 \u0111\u1ea7u t\u01b0 c\u1ee7a m\u00ecnh, h\u1ecd \u0111ang d\u1eabn \u0111\u1ea7u qu\u00e1 tr\u00ecnh chuy\u1ec3n \u0111\u1ed5i sang m\u1ed9t t\u01b0\u01a1ng lai b\u1ec1n v\u1eefng v\u00e0 c\u1ea1nh tranh h\u01a1n.<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">D\u1ef1a v\u00e0o \u201cBig Data\u201d \u0111\u1ec3 h\u1ed7 tr\u1ee3 c\u00e1c quy\u1ebft \u0111\u1ecbnh l\u1edbn v\u00e0 quan tr\u1ecdng trong doanh nghi\u1ec7p. H\u1ea7u h\u1ebft d\u1eef li\u1ec7u \u0111\u01b0\u1ee3c l\u01b0u tr\u1eef trong BigQuery serverless enterprise data warehouse. Google li\u00ean t\u1ee5c s\u1eed d\u1ee5ng nh\u1eefng d\u1ecbch v\u1ee5 v\u00e0 c\u00f4ng c\u1ee5 c\u1ea3i ti\u1ebfn c\u1ee7a <a href=\"https:\/\/gcloudvn.com\/google-cloud-platform\/\">Google Cloud GCP<\/a> \u0111\u1ec3 t\u0103ng t\u1ed1c c\u00e1c ho\u1ea1t \u0111\u1ed9ng kinh doanh hi\u1ec7u qu\u1ea3 h\u01a1n.<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">V\u00ed d\u1ee5 trong c\u00e1c ho\u1ea1t \u0111\u1ed9ng c\u1ee7a trang tr\u1ea1i gi\u00f3, d\u1eef li\u1ec7u \u0111\u01b0\u1ee3c s\u1eed d\u1ee5ng \u0111\u1ec3 \u0111\u1ecbnh l\u01b0\u1ee3ng s\u1ea3n l\u01b0\u1ee3ng, t\u1ed5n th\u1ea5t v\u00e0 hi\u1ec7u qu\u1ea3 n\u0103ng l\u01b0\u1ee3ng. \u0110\u1ed1i v\u1edbi c\u00e1c c\u1ed9t kh\u00ed t\u01b0\u1ee3ng d\u1eef li\u1ec7u v\u00e0 c\u1ea5u h\u00ecnh c\u1ea3m bi\u1ebfn li\u00ean t\u1ee5c \u0111\u01b0\u1ee3c nh\u1eadp v\u00e0 ph\u00e2n t\u00edch v\u1ec1 t\u00ecnh tr\u1ea1ng c\u1ee7a ch\u00fang. Ho\u1eb7c trong c\u00e1c d\u1ef1 \u00e1n xanh m\u1edbi h\u1ecd \u0111\u00e3 s\u1eed d\u1ee5ng d\u1eef li\u1ec7u \u0111\u1ec3 \u0111\u01b0a ra quy\u1ebft \u0111\u1ecbnh v\u1ec1 c\u00e1c kho\u1ea3n \u0111\u1ea7u t\u01b0 c\u1ee7a m\u00ecnh.<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Google c\u1ea7n d\u1eef li\u1ec7u \u0111\u00e1ng tin c\u1eady \u0111\u1ec3 \u0111\u01b0a ra nh\u1eefng quy\u1ebft \u0111\u1ecbnh n\u00e0y nh\u1eb1m tr\u00e1nh sai m\u1ee5c ti\u00eau c\u1ee7a h\u1ecd v\u1ec1 th\u1eddi gian ho\u1ea1t \u0111\u1ed9ng, hi\u1ec7u qu\u1ea3 v\u00e0 l\u1ee3i t\u1ee9c \u0111\u1ea7u t\u01b0. Tuy nhi\u00ean, vi\u1ec7c ki\u1ec3m so\u00e1t ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u l\u00e0 m\u1ed9t th\u00e1ch th\u1ee9c \u0111\u1ed1i v\u1edbi Google, th\u01b0\u1eddng khi\u1ebfn h\u1ecd ph\u1ea3i ch\u1eefa ch\u00e1y d\u1eef li\u1ec7u.<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Tr\u01b0\u1edbc \u0111\u00e2y \u0111\u00e3 t\u1eebng s\u1eed d\u1ee5ng c\u00e1c gi\u1ea3i ph\u00e1p t\u1ef1 ngh\u0129 ra \u0111\u1ec3 c\u00f3 th\u1ec3 gi\u1ea3i quy\u1ebft v\u00e0 khi\u1ebfn cho d\u1eef li\u1ec7u t\u1ed1t h\u01a1n nh\u01b0 \u0111\u1eb7t quy t\u1eafc v\u00e0 c\u1ea3nh b\u00e1o trong c\u00f4ng c\u1ee5 BI tool ho\u1eb7c vi\u1ebft t\u1eadp l\u1ec7nh python t\u00f9y ch\u1ec9nh. Nh\u1eefng gi\u1ea3i ph\u00e1p n\u00e0y th\u01b0\u1eddng r\u1ea5t kh\u00f3 m\u1edf r\u1ed9ng quy m\u00f4 ti\u00eau chu\u1ea9n h\u00f3a v\u00e0 th\u01b0\u1eddng r\u1ea5t t\u1ed1n k\u00e9m.<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">\u0110\u1ec3 gi\u1ea3i quy\u1ebft v\u1ea5n \u0111\u1ec1 \u0111\u00f3, Google \u0111\u00e3 chuy\u1ec3n sang DataPlex, m\u1ed9t k\u1ebft c\u1ea5u d\u1eef li\u1ec7u th\u00f4ng minh h\u1ee3p nh\u1ea5t d\u1eef li\u1ec7u ph\u00e2n t\u00e1n, \u0111\u1ec3 \u0111\u1ea1t \u0111\u01b0\u1ee3c kh\u1ea3 n\u0103ng quan tr\u1ecb d\u1eef li\u1ec7u t\u1ed1t h\u01a1n trong t\u1ed5 ch\u1ee9c c\u1ee7a google v\u00e0 t\u1ea1o ni\u1ec1m tin v\u00e0o d\u1eef li\u1ec7u. V\u1edbi DataPlex cung c\u1ea5p m\u1ed9t c\u00e1ch h\u1ee3p l\u00fd \u0111\u1ec3 t\u1ed5 ch\u1ee9c d\u1eef li\u1ec7u, b\u1ea3o m\u1eadt v\u00e0 gi\u00e1m s\u00e1t d\u1eef li\u1ec7u v\u1ec1 ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u.<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Google b\u1eaft \u0111\u1ea7u tri\u1ec3n khai DataPlex v\u1edbi 3 m\u1ee5c ti\u00eau ch\u00ednh :\u00a0<\/span><\/p>\n<ul style=\"text-align: justify;\">\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">X\u00e1c \u0111\u1ecbnh khung qu\u1ea3n tr\u1ecb d\u1eef li\u1ec7u cho t\u1ed5 ch\u1ee9c\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">T\u1ea1o b\u00e1o c\u00e1o th\u01b0\u1eddng xuy\u00ean \u0111o l\u01b0\u1eddng vi\u1ec7c tu\u00e2n th\u1ee7 khu\u00f4n kh\u1ed5<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">T\u1ea1o b\u00e1o c\u00e1o th\u01b0\u1eddng xuy\u00ean \u0111o l\u01b0\u1eddng ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u<\/span><\/li>\n<\/ul>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_83 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">M\u1ee5c L\u1ee5c<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/gcloudvn.com\/en\/kienthuc\/how-a-green-energy-provider-used-dataplex-for-its-data-governance-and-quality\/#Xac_dinh_khung_quan_tri_du_lieu_cho_to_chuc\" >X\u00e1c \u0111\u1ecbnh khung qu\u1ea3n tr\u1ecb d\u1eef li\u1ec7u cho t\u1ed5 ch\u1ee9c\u00a0<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/gcloudvn.com\/en\/kienthuc\/how-a-green-energy-provider-used-dataplex-for-its-data-governance-and-quality\/#Tao_bao_cao_cho_noi_dung_du_lieu_va_quan_ly_noi_dung_du_lieu\" >T\u1ea1o b\u00e1o c\u00e1o cho n\u1ed9i dung d\u1eef li\u1ec7u v\u00e0 qu\u1ea3n l\u00fd n\u1ed9i dung d\u1eef li\u1ec7u\u00a0<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/gcloudvn.com\/en\/kienthuc\/how-a-green-energy-provider-used-dataplex-for-its-data-governance-and-quality\/#Quet_chat_luong_du_lieu_va_tao_cac_report_ve_chat_luong_du_lieu\" >Qu\u00e9t ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u v\u00e0 t\u1ea1o c\u00e1c report v\u1ec1 ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u\u00a0<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/gcloudvn.com\/en\/kienthuc\/how-a-green-energy-provider-used-dataplex-for-its-data-governance-and-quality\/#Y_dinh_tuong_lai\" >\u00dd \u0111\u1ecbnh t\u01b0\u01a1ng lai<\/a><\/li><\/ul><\/nav><\/div>\n<h2 style=\"text-align: justify;\"><span class=\"ez-toc-section\" id=\"Xac_dinh_khung_quan_tri_du_lieu_cho_to_chuc\"><\/span><b>X\u00e1c \u0111\u1ecbnh khung qu\u1ea3n tr\u1ecb d\u1eef li\u1ec7u cho t\u1ed5 ch\u1ee9c\u00a0<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Google b\u1eaft \u0111\u1ea7u b\u1eb1ng c\u00e1ch t\u1ed5 ch\u1ee9c d\u1eef li\u1ec7u ph\u00f9 h\u1ee3p v\u1edbi doanh nghi\u1ec7p, sau \u0111\u00f3 s\u1eed d\u1ee5ng DataPlex \u0111\u1ec3 \u0111\u1eb7t ch\u00ednh s\u00e1ch cho c\u00e1c t\u1ed5 ch\u1ee9c d\u1eef li\u1ec7u \u0111\u00f3.<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">DataPlex tr\u1eebu t\u01b0\u1ee3ng h\u00f3a c\u00e1c h\u1ec7 th\u1ed1ng l\u01b0u tr\u1eef d\u1eef li\u1ec7u c\u01a1 b\u1ea3n b\u1eb1ng c\u00e1ch s\u1eed d\u1ee5ng c\u00e1c c\u1ea5u tr\u00fac Lake, Data zone, assets. Ch\u00fang t\u00f4i quy\u1ebft \u0111\u1ecbnh l\u1eadp b\u1ea3n \u0111\u1ed3 c\u00e1c c\u1ea5u tr\u00fac n\u00e0y cho doanh nghi\u1ec7p c\u1ee7a m\u00ecnh v\u1edbi khu\u00f4n kh\u1ed5 nh\u01b0 sau :\u00a0<\/span><\/p>\n<ul style=\"text-align: justify;\">\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Lake : M\u1ed7i b\u1ed9 ph\u1eadn m\u1ed9t h\u1ed3 trong c\u00f4ng ty<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Data zone : Ph\u00e2n t\u00e1ch d\u1eef li\u1ec7u trong c\u00e1c khu v\u1ef1c con b\u1eb1ng c\u00e1ch s\u1eed d\u1ee5ng v\u00f9ng\u00a0<\/span>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"2\"><span style=\"font-weight: 400;\">Raw zone : Ch\u1ee9a b\u1ed9 d\u1eef li\u1ec7u \u0111\u01b0\u1ee3c d\u00f9ng cho b\u1ea3ng th\u00f4 ho\u1eb7c c\u00e1c b\u1ea3ng c\u00f3 \u00edt s\u1eeda \u0111\u1ed5i ho\u1eb7c t\u1ed5ng h\u1ee3p<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"2\"><span style=\"font-weight: 400;\">Curated zone : Ch\u1ee9a b\u1ed9 d\u1eef li\u1ec7u c\u00f3 b\u1ea3ng t\u1ed5ng h\u1ee3p ho\u1eb7c b\u1ea3ng d\u1ef1 \u0111o\u00e1n (\u0110\u01b0\u1edbc s\u1eed d\u1ee5ng cho c\u00e1c m\u00f4 h\u00ecnh ML)<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p style=\"text-align: justify;\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-14278 size-full\" src=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex2.png\" alt=\"Case Study: C\u00e1ch Google Dataplex gi\u00fap Casa Dos Ventos qu\u1ea3n tr\u1ecb v\u00e0 \u0111\u1ea3m b\u1ea3o ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u 2\" width=\"600\" height=\"178\" srcset=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex2.png 600w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex2-18x5.png 18w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/p>\n<h2 style=\"text-align: justify;\"><span class=\"ez-toc-section\" id=\"Tao_bao_cao_cho_noi_dung_du_lieu_va_quan_ly_noi_dung_du_lieu\"><\/span><b>T\u1ea1o b\u00e1o c\u00e1o cho n\u1ed9i dung d\u1eef li\u1ec7u v\u00e0 qu\u1ea3n l\u00fd n\u1ed9i dung d\u1eef li\u1ec7u\u00a0<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">\u0110\u1ec3 qu\u1ea3n l\u00fd d\u1eef li\u1ec7u, ch\u00fang ta c\u00f3 hai d\u1ea1ng b\u00e1o c\u00e1o n\u1eafm b\u1eaft tr\u1ea1ng th\u00e1i hi\u1ec7n t\u1ea1i<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">&#8211; B\u00e1o c\u00e1o \u0111\u1ea7u ti\u00ean theo d\u00f5i to\u00e0n b\u1ed9 data. Google s\u1eed d\u1ee5ng API BigQuery v\u00e0 ph\u00e1t tri\u1ec3n t\u1eadp l\u1ec7nh Python (do Composer l\u00ean l\u1ecbch) \u0111\u1ec3 tr\u00edch xu\u1ea5t si\u00eau d\u1eef li\u1ec7u c\u1ee7a t\u1ea5t c\u1ea3 c\u00e1c b\u1ea3ng <a href=\"https:\/\/gcloudvn.com\/bigquery\/\">BigQuery<\/a> trong t\u1ed5 ch\u1ee9c. N\u00f3 c\u0169ng \u0111o l\u01b0\u1eddng c\u00e1c kh\u00eda c\u1ea1nh quan tr\u1ecdng nh\u01b0 s\u1ed1 l\u01b0\u1ee3ng b\u1ea3ng v\u00e0 view.<\/span><\/p>\n<p style=\"text-align: justify;\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-14277 size-full\" src=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex3.png\" alt=\"Case Study: C\u00e1ch Google Dataplex gi\u00fap Casa Dos Ventos qu\u1ea3n tr\u1ecb v\u00e0 \u0111\u1ea3m b\u1ea3o ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u 3\" width=\"600\" height=\"351\" srcset=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex3.png 600w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex3-18x12.png 18w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">&#8211; B\u00e1o c\u00e1o th\u1ee9 hai Google c\u0169ng theo d\u00f5i ti\u1ebfn tr\u00ecnh c\u1ee7a m\u00ecnh trong vi\u1ec7c li\u00ean t\u1ee5c \u0111\u01b0a kho d\u1eef li\u1ec7u c\u1ee7a m\u00ecnh v\u00e0o DataPlex governance. Ch\u00fang t\u00f4i \u0111\u00e3 l\u00e0m theo quy tr\u00ecnh t\u01b0\u01a1ng t\u1ef1 (API + m\u00e3 Python) \u0111\u1ec3 t\u1ea1o trang t\u1ed5ng quan sau. Hi\u1ec7n t\u1ea1i, c\u00e1c b\u1ed9 d\u1eef li\u1ec7u trong DataPlex \u0111\u1ee9ng \u1edf m\u1ee9c 71.6% tr\u00ean dashboard n\u00e0y. M\u1ee5c ti\u00eau c\u1ee7a Google l\u00e0 \u0111\u1ea1t 100% v\u00e0 sau \u0111\u00f3 duy tr\u00ec \u0111i\u1ec1u \u0111\u00f3.<\/span><\/p>\n<p style=\"text-align: justify;\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-14276 size-full\" src=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex4.png\" alt=\"Case Study: C\u00e1ch Google Dataplex gi\u00fap Casa Dos Ventos qu\u1ea3n tr\u1ecb v\u00e0 \u0111\u1ea3m b\u1ea3o ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u 4\" width=\"600\" height=\"455\" srcset=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex4.png 600w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex4-16x12.png 16w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/p>\n<h2 style=\"text-align: justify;\"><span class=\"ez-toc-section\" id=\"Quet_chat_luong_du_lieu_va_tao_cac_report_ve_chat_luong_du_lieu\"><\/span><b>Qu\u00e9t ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u v\u00e0 t\u1ea1o c\u00e1c report v\u1ec1 ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u\u00a0<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Sau khi d\u1eef li\u1ec7u \u0111\u01b0\u1ee3c qu\u1ea3n l\u00fd trong DataPlex ch\u00fang t\u00f4i t\u1ea1o b\u00e1o c\u00e1o ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u v\u00e0 dashboard trong DataPlex ch\u1ec9 v\u1edbi v\u00e0i click \u0111\u01a1n gi\u1ea3n.<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Ch\u1ea1y nhi\u1ec1u data quality scans v\u1edbi DataPlex cho c\u00e1c b\u1ea3ng quan tr\u1ecdng\u00a0<\/span><\/p>\n<p style=\"text-align: justify;\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-14275 size-full\" src=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex5.png\" alt=\"Case Study: C\u00e1ch Google Dataplex gi\u00fap Casa Dos Ventos qu\u1ea3n tr\u1ecb v\u00e0 \u0111\u1ea3m b\u1ea3o ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u 5\" width=\"600\" height=\"131\" srcset=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex5.png 600w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex5-18x4.png 18w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">\u0110\u1ec3 t\u1ea1o c\u00e1c quy t\u1eafc, Google \u0111\u00e3 s\u1eed d\u1ee5ng c\u00e1c quy t\u1eafc c\u00f3 s\u1eb5n nh\u01b0ng c\u0169ng t\u1ea1o th\u00eam c\u00e1c quy t\u1eafc c\u1ee7a ri\u00eang m\u00ecnh b\u1eb1ng c\u00e1ch s\u1eed d\u1ee5ng c\u00e1c c\u00e2u l\u1ec7nh SQL t\u00f9y ch\u1ec9nh. VD: \u0111\u1ec3 \u0111\u1ea3m b\u1ea3o r\u1eb1ng Google kh\u00f4ng bao gi\u1edd c\u00f3 b\u1ea5t k\u1ef3 h\u00e0ng n\u00e0o kh\u1edbp v\u1edbi m\u1ed9t \u0111i\u1ec1u ki\u1ec7n c\u1ee5 th\u1ec3, Google \u0111\u00e3 t\u1ea1o quy t\u1eafc SQL tr\u1ea3 v\u1ec1 FALSE khi th\u1eadm ch\u1ec9 ch\u1ec9 c\u00f3 1 h\u00e0ng kh\u1edbp v\u1edbi \u0111i\u1ec1u ki\u1ec7n.<\/span><\/p>\n<p style=\"text-align: justify;\">(SELECT COUNT(&lt;columnX&gt;) as count_values<br \/>\nFROM `metmastDB.TableX`<br \/>\nWHERE `columnX` IS NULL and columnY&lt;&gt;&#8221;some string&#8221;<br \/>\n) =0<\/p>\n<p style=\"text-align: justify;\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-14274 size-full\" src=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex6.png\" alt=\"Case Study: C\u00e1ch Google Dataplex gi\u00fap Casa Dos Ventos qu\u1ea3n tr\u1ecb v\u00e0 \u0111\u1ea3m b\u1ea3o ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u 6\" width=\"600\" height=\"149\" srcset=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex6.png 600w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex6-18x4.png 18w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Khi c\u00e1c l\u1ea7n ki\u1ec3m tra n\u00e0y kh\u00f4ng th\u00e0nh c\u00f4ng, Google d\u1ef1a v\u00e0o truy v\u1ea5n do Dataplex AutoDQ hi\u1ec3n th\u1ecb \u0111\u1ec3 t\u00ecm c\u00e1c h\u00e0ng kh\u00f4ng th\u00e0nh c\u00f4ng.<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">\u0110\u1ec3 x\u00e2y d\u1ef1ng trang t\u1ed5ng quan v\u1ec1 ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u, Google s\u1eed d\u1ee5ng nh\u1eadt k\u00fd (logs) trong Cloud Logging v\u00e0 thi\u1ebft l\u1eadp \u0111i\u1ec3m \u0111\u1ebfn cho BigQuery. Sau khi d\u1eef li\u1ec7u \u0111\u1ebfn BigQuery, Google t\u1ea1o view v\u1edbi truy v\u1ea5n sau:<\/span><\/p>\n<p style=\"text-align: justify;\">SELECT<br \/>\ntimestamp,<br \/>\nresource.type,<br \/>\nresource.labels.datascan_id,<br \/>\nresource.labels.location,<br \/>\njsonpayload_v1_datascanevent.scope,<br \/>\njsonpayload_v1_datascanevent.type as type_scan_event,<br \/>\njsonpayload_v1_datascanevent.trigger,<br \/>\nSPLIT(jsonpayload_v1_datascanevent.datasource, &#8216;\/&#8217;)[offset(1)] datasource_project,<br \/>\nSPLIT(jsonpayload_v1_datascanevent.datasource, &#8216;\/&#8217;)[offset(3)] datasource_location,<br \/>\nSPLIT(jsonpayload_v1_datascanevent.datasource, &#8216;\/&#8217;)[offset(5)] datasource_lake,<br \/>\nSPLIT(jsonpayload_v1_datascanevent.datasource, &#8216;\/&#8217;)[offset(7)] datasource_zone,<br \/>\njsonpayload_v1_datascanevent.dataquality.dimensionpassed.uniqueness,<br \/>\njsonpayload_v1_datascanevent.dataquality.dimensionpassed.completeness,<br \/>\njsonpayload_v1_datascanevent.dataquality.dimensionpassed.validity,<br \/>\njsonpayload_v1_datascanevent.dataquality.rowcount,<br \/>\njsonpayload_v1_datascanevent.dataquality.passed<br \/>\nFROM `datalake-cver.Analytics_Data_Quality_cdv.dataplex_googleapis_com_data_scan` DATA_SCAN<\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">T\u1ea1o view cho ph\u00e9p t\u00e1ch k\u1ebft qu\u1ea3 ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u theo Lake v\u00e0 zones.<\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Sau \u0111\u00f3 c\u00f3 th\u1ec3 s\u1eed d\u1ee5ng Tableau :\u00a0<\/span><\/p>\n<ul style=\"text-align: justify;\">\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">T\u1ea1o dashboard\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">G\u1eedi th\u00f4ng b\u00e1o qua email cho ng\u01b0\u1eddi d\u00f9ng c\u00f3 c\u00f3 tr\u00e1ch nhi\u1ec7m x\u1eed l\u00fd b\u1eb1ng alerts trong Tableau<\/span><\/li>\n<\/ul>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">D\u01b0\u1edbi \u0111\u00e2y l\u00e0 v\u00ed d\u1ee5 v\u1ec1 Tableau dashboard<\/span><\/p>\n<p style=\"text-align: justify;\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-14273 size-full\" src=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex7.png\" alt=\"Case Study: C\u00e1ch Google Dataplex gi\u00fap Casa Dos Ventos qu\u1ea3n tr\u1ecb v\u00e0 \u0111\u1ea3m b\u1ea3o ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u 7\" width=\"600\" height=\"212\" srcset=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex7.png 600w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2023\/06\/dataplex7-18x6.png 18w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/p>\n<h2 style=\"text-align: justify;\"><span class=\"ez-toc-section\" id=\"Y_dinh_tuong_lai\"><\/span><b>\u00dd \u0111\u1ecbnh t\u01b0\u01a1ng lai<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">M\u1eb7c d\u00f9 Google \u0111\u00e3 \u0111\u1ea1t \u0111\u01b0\u1ee3c v\u1ecb th\u1ebf qu\u1ea3n tr\u1ecb t\u1ed1t h\u01a1n nhi\u1ec1u, nh\u01b0ng h\u1ecd c\u0169ng mong mu\u1ed1n m\u1edf r\u1ed9ng vi\u1ec7c s\u1eed d\u1ee5ng Dataplex h\u01a1n n\u1eefa. Google \u0111ang b\u1eaft \u0111\u1ea7u s\u1eed d\u1ee5ng t\u00ednh n\u0103ng Lineage cho c\u00e1c b\u1ea3ng BigQuery v\u00e0 t\u00ecm hi\u1ec3u c\u00e1ch t\u00edch h\u1ee3p Ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u v\u1edbi Lineage. \u0110i\u1ec1u n\u00e0y s\u1ebd cho ph\u00e9p h\u1ecd ki\u1ec3m tra trang t\u1ed5ng quan v\u00e0 ch\u1ebf \u0111\u1ed9 xem b\u1ecb \u1ea3nh h\u01b0\u1edfng b\u1edfi c\u00e1c v\u1ea5n \u0111\u1ec1 v\u1ec1 ch\u1ea5t l\u01b0\u1ee3ng d\u1eef li\u1ec7u m\u1ed9t c\u00e1ch d\u1ec5 d\u00e0ng. Google c\u0169ng \u0111ang l\u00ean k\u1ebf ho\u1ea1ch qu\u1ea3n l\u00fd c\u00e1c t\u1eadp l\u1ec7nh SQL trong t\u00e0i kho\u1ea3n Github c\u1ee7a m\u00ecnh.<\/span><\/p>\n<p style=\"text-align: justify;\">Cloud \u0111\u00e3 v\u00e0 \u0111ang l\u00e0 xu h\u01b0\u1edbng t\u1ea5t y\u1ebfu trong h\u1ec7 th\u1ed1ng ph\u00e1t tri\u1ec3n , t\u1ed1i \u01b0u c\u00f4ng ngh\u1ec7 c\u1ee7a c\u00e1c doanh nghi\u1ec7p. Gimasys \u2013 Premier Partner c\u1ee7a Google t\u1ea1i Vi\u1ec7t Nam l\u00e0 \u0111\u01a1n v\u1ecb cung c\u1ea5p, t\u01b0 v\u1ea5n c\u00e1c c\u1ea5u tr\u00fac, thi\u1ebft k\u1ebf gi\u1ea3i ph\u00e1p Cloud t\u1ed1i \u01b0u cho b\u1ea1n. \u0110\u1ec3 bi\u1ebft \u0111\u01b0\u1ee3c h\u1ed7 tr\u1ee3 v\u1ec1 m\u1eb7t chuy\u00ean m\u00f4n k\u1ef9 thu\u1eadt, b\u1ea1n c\u00f3 th\u1ec3 li\u00ean h\u1ec7 Gimasys \u2013 Premier Partner c\u1ee7a Google t\u1ea1i Vi\u1ec7t Nam theo th\u00f4ng tin:<\/p>\n<ul style=\"text-align: justify;\">\n<li aria-level=\"1\"><b>Hotline:\u00a0<\/b>0974 417 099 (HCM) | 0987 682 505 (HN)<\/li>\n<li aria-level=\"1\"><b>Email:\u00a0<\/b><a href=\"mailto:gcp@gimasys.com\" target=\"_blank\" rel=\"nofollow noopener\">gcp@gimasys.com<\/a><\/li>\n<\/ul>\n<p style=\"text-align: right;\"><b>Ngu\u1ed3n:\u00a0<a href=\"https:\/\/gcloudvn.com\/\">Gimasys<\/a><\/b><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Brazil l\u00e0 m\u1ed9t trong nh\u1eefng th\u1ecb tr\u01b0\u1eddng n\u0103ng l\u01b0\u1ee3ng t\u00e1i t\u1ea1o h\u1ee9a h\u1eb9n nh\u1ea5t th\u1ebf gi\u1edbi, trong \u0111\u00f3 Casa Dos Ventos l\u00e0 nh\u00e0 \u0111\u1ea7u t\u01b0 v\u00e0 ti\u00ean phong h\u00e0ng \u0111\u1ea7u. V\u1edbi s\u1ef1 \u0111\u1ed5i m\u1edbi v\u00e0 \u0111\u1ea7u t\u01b0 c\u1ee7a m\u00ecnh, h\u1ecd&hellip;<\/p>","protected":false},"author":2,"featured_media":14279,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[1,135],"tags":[],"class_list":["post-14272","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-kienthuc","category-google-cloud-platform","entry","has-media"],"_links":{"self":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/posts\/14272","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/comments?post=14272"}],"version-history":[{"count":0,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/posts\/14272\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/media\/14279"}],"wp:attachment":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/media?parent=14272"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/categories?post=14272"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/tags?post=14272"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}