{"id":26513,"date":"2026-09-15T15:17:48","date_gmt":"2026-09-15T08:17:48","guid":{"rendered":"https:\/\/gcloudvn.com\/?p=26513"},"modified":"2026-09-18T10:16:07","modified_gmt":"2026-09-18T03:16:07","slug":"introducing-agentic-video-understanding-with-gemini","status":"publish","type":"post","link":"https:\/\/gcloudvn.com\/en\/xu-ly-video-theo-co-che-agentic-nho-suc-manh-gemini\/","title":{"rendered":"Introducing agentic video understanding with Gemini"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">Today, we\u2019re launching<\/span><b> (agentic video understanding)<\/b><span style=\"font-weight: 400;\"> across our latest models: Gemini 3.7 Flash, 3.6 Flash and 3.5 Flash-Lite. This new capability improves accuracy while dramatically reducing token usage and costs for video analysis. Similar to agentic vision, which combines code execution with Gemini models\u2019 native image understanding, agentic video understanding uses Gemini\u2019s native video tools to improve performance and unlock new capabilities for video processing like sub-second moment retrieval, more accurate anomaly detection, precise counting and more.<\/span><\/p>\n<p><a href=\"https:\/\/gcloudvn.com\/en\/?attachment_id=26441\" rel=\"attachment wp-att-26441\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-26441\" src=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video___keyword__blog-he.width-2200.format-webp.webp\" alt=\"\" width=\"2200\" height=\"1237\" srcset=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video___keyword__blog-he.width-2200.format-webp.webp 2200w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video___keyword__blog-he.width-2200.format-webp-768x432.webp 768w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video___keyword__blog-he.width-2200.format-webp-1536x864.webp 1536w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video___keyword__blog-he.width-2200.format-webp-2048x1152.webp 2048w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video___keyword__blog-he.width-2200.format-webp-18x10.webp 18w\" sizes=\"auto, (max-width: 2200px) 100vw, 2200px\" \/><\/a><\/p>\n<p><span style=\"font-weight: 400;\">The feature is available today for video uploads and YouTube videos via the Gemini API in Google AI Studio and the Gemini Enterprise Agent Platform.<\/span><\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_88 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewbox=\"0 0 24 24\" version=\"1.2\" baseprofile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/gcloudvn.com\/en\/xu-ly-video-theo-co-che-agentic-nho-suc-manh-gemini\/#Cac_tieu_chuan_danh_gia\" >Benchmarks<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/gcloudvn.com\/en\/xu-ly-video-theo-co-che-agentic-nho-suc-manh-gemini\/#Cach_thuc_hoat_dong\" >How it works<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/gcloudvn.com\/en\/xu-ly-video-theo-co-che-agentic-nho-suc-manh-gemini\/#Cac_kha_nang_va_truong_hop_su_dung\" >Capabilities and use cases<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/gcloudvn.com\/en\/xu-ly-video-theo-co-che-agentic-nho-suc-manh-gemini\/#Ket_qua_thuc_te\" >Real-world results<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/gcloudvn.com\/en\/xu-ly-video-theo-co-che-agentic-nho-suc-manh-gemini\/#Bat_dau\" >Getting started<\/a><\/li><\/ul><\/nav><\/div>\n<h2><span class=\"ez-toc-section\" id=\"Cac_tieu_chuan_danh_gia\"><\/span><b>Benchmarks<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Unlike current \u2018static\u2019 processing, where the model ingests the video at a fixed frames-per-second rate (default 1 FPS, adjustable via API), agentic video understanding pairs the model\u2019s core reasoning with native video tools to dynamically search, scan, and inspect target video segments across visual frames, audio, and transcripts. Across standard video analysis benchmarks, Gemini models with agentic video understanding reduce analysis costs by up to 66% and token consumption by up to 88%, while improving accuracy by up to 7%.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">These efficiency gains are especially pronounced on long-form video (from 10-minute how-to guides to 90-minute lectures and multi-hour recordings), where static processing forces developers to choose between high token costs or techniques that drop critical details.<\/span><\/p>\n<p><a href=\"https:\/\/gcloudvn.com\/en\/?attachment_id=26440\" rel=\"attachment wp-att-26440\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-26440\" src=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video__evals.width-2000.format-webp.webp\" alt=\"\" width=\"1920\" height=\"1080\" srcset=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video__evals.width-2000.format-webp.webp 1920w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video__evals.width-2000.format-webp-768x432.webp 768w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video__evals.width-2000.format-webp-1536x864.webp 1536w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video__evals.width-2000.format-webp-18x10.webp 18w\" sizes=\"auto, (max-width: 1920px) 100vw, 1920px\" \/><\/a><\/p>\n<p><span style=\"font-weight: 400;\">Activating agentic video understanding drops token consumption by up to 88% and boosts accuracy by up to 7% with Gemini 3.7 Flash.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">While these gains span all three supported models, Gemini 3.7 Flash with agentic understanding offers the best possible quality overall and the best combination of quality and cost efficiency, putting it at the accuracy-to-cost pareto frontier among tested models for video understanding.<\/span><\/p>\n<p><a href=\"https:\/\/gcloudvn.com\/en\/?attachment_id=26439\" rel=\"attachment wp-att-26439\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-26439\" src=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video__evals_table2.width-2000.format-webp.webp\" alt=\"\" width=\"1920\" height=\"1080\" srcset=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video__evals_table2.width-2000.format-webp.webp 1920w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video__evals_table2.width-2000.format-webp-768x432.webp 768w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video__evals_table2.width-2000.format-webp-1536x864.webp 1536w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video__evals_table2.width-2000.format-webp-18x10.webp 18w\" sizes=\"auto, (max-width: 1920px) 100vw, 1920px\" \/><\/a><\/p>\n<p><span style=\"font-weight: 400;\">Using agentic video understanding places Gemini 3.7 Flash at the accuracy-to-cost pareto frontier for video analysis.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Cach_thuc_hoat_dong\"><\/span><b>How it works<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Instead of static processing where the model ingests media streams at a fixed frame rate, agentic video understanding enables Gemini to take an active, goal-directed role in determining what to watch, at what speed, and through which modality (frames, audio, or transcript), fetching only the moments and signals needed. While developers could previously do this manually, with agentic video understanding, Gemini can accomplish it through an agentic loop, invoking an internal tool to load the relevant part of the video file, significantly reducing development overheads.<\/span><\/p>\n<p><a href=\"https:\/\/gcloudvn.com\/en\/?attachment_id=26438\" rel=\"attachment wp-att-26438\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-26438\" src=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video__diagram.width-2000.format-webp.webp\" alt=\"\" width=\"2000\" height=\"1125\" srcset=\"https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video__diagram.width-2000.format-webp.webp 2000w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video__diagram.width-2000.format-webp-768x432.webp 768w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video__diagram.width-2000.format-webp-1536x864.webp 1536w, https:\/\/gcloudvn.com\/wp-content\/uploads\/2026\/09\/agentic-video__diagram.width-2000.format-webp-18x10.webp 18w\" sizes=\"auto, (max-width: 2000px) 100vw, 2000px\" \/><\/a><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Cac_kha_nang_va_truong_hop_su_dung\"><\/span><b>Capabilities and use cases<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Agentic video understanding transforms how developers can process long-form video content across a variety of demanding applications.<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Sub-second moment retrieval: Pinpoint split-second state changes and tight cut boundaries that are easily missed at 1 FPS, making precise automated video editing possible.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Long-form needle-in-a-haystack search: Answer complex queries across multi-hour videos without consuming millions of tokens.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Anomaly detection: Resample interesting time windows at higher FPS to inspect rapid motion and subtle visual artifacts.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Counting action &amp; object: Accurately track repeated physical movements and distinct objects over time.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"Ket_qua_thuc_te\"><\/span><b>Real-world results<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Many of our early access partners saw strong performance while testing with<\/span><b> (agentic video understanding)<\/b><span style=\"font-weight: 400;\">Here\u2019s what they have to say:<\/span><\/p>\n<p>Revyl enables teams to automate the development and testing of iOS and Android applications using our cloud-based devices. While Revyl\u2019s proprietary vision system can navigate apps like a real user, screenshot-based verification methods often miss fast-moving elements. By overcoming this limitation, our Agentic Video Understanding technology allows us to efficiently develop and test even those applications featuring complex visual effects.<\/p>\n<p><strong>Ethan Zhou,<\/strong> Growth Engineer, Revyl<\/p>\n<p>\u201cOur team put the Agentic Video Understanding model to the test alongside the existing Gemini system, using thousands of labeled videos and a real-time deepfake detection pipeline. While our models distinguish between authentic content and AI-generated material, Gemini translates those findings into easy-to-understand explanations. The new model delivered more accurate descriptions and context for long-form videos while reducing input tokens by 57%, enabling us to provide higher-quality results at a lower cost.\u201d<\/p>\n<p><strong><span data-markdown-start-index=\"1435\">Zohaib Ahmed<\/span><\/strong><span data-markdown-start-index=\"1449\">, Co-founder &amp; CEO, Resemble AI<\/span><\/p>\n<p>Agentic Video Understanding made the most significant difference when handling long, complex raw footage\u2014a critical factor for video-focused AI agents. In Mosaic\u2019s real-world simulation benchmarks, this technology reduced average input tokens by 97%, nearly doubled the rate of adherence to constraints, and was the only mode capable of completing our 4.5-hour podcast processing case study.<\/p>\n<p><strong>Adish Jain,<\/strong> CEO, Mosaic<\/p>\n<p>At Ponder, we built our own automated video understanding pipeline based on Gemini to identify valuable moments from raw footage. Google\u2019s Agentic Video Understanding technology condensed that entire workflow into a single call, achieving performance comparable to our system while using approximately 3.5 times fewer input tokens.<\/p>\n<p><strong><span data-markdown-start-index=\"2427\">Ibrahim Syed<\/span><\/strong><span data-markdown-start-index=\"2441\">, Founding Engineer, Ponder<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Bat_dau\"><\/span><b>Getting started<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Agent video understanding capabilities are available via the Gemini API in Google AI Studio and the Gemini Enterprise Agent Platform, deployed on Gemini 3.7 Flash, 3.6 Flash, and 3.5 Flash-Lite versions. This service utilizes the standard Gemini API token-based pricing model and incurs no additional feature fees.<\/p>\n<p><span style=\"font-weight: 400;\">Google is also bringing performance and quality improvements in agentic video understanding technology to billions of users across its products. This feature will soon be rolled out to all Gemini app users, supporting both the Flash and Flash-Lite models. Additionally, in the coming months, this technology will also support the feature... <\/span><b>&#8220;Ask YouTube&#8221;<\/b><span style=\"font-weight: 400;\"> On YouTube video pages, leveraging the power of Gemini to provide higher-quality answers that closely align with the visual content of the video.<\/span><\/p>","protected":false},"excerpt":{"rendered":"<p>H\u00f4m nay, Google ra m\u1eaft t\u00ednh n\u0103ng hi\u1ec3u video theo c\u01a1 ch\u1ebf t\u00e1c nh\u00e2n (agentic video understanding) tr\u00ean c\u00e1c m\u00f4 h\u00ecnh m\u1edbi nh\u1ea5t c\u1ee7a m\u00ecnh: Gemini 3.7 Flash, 3.6 Flash v\u00e0 3.5 Flash-Lite. Kh\u1ea3 n\u0103ng m\u1edbi n\u00e0y gi\u00fap c\u1ea3i thi\u1ec7n&hellip;<\/p>","protected":false},"author":2,"featured_media":26433,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[1,135],"tags":[],"class_list":["post-26513","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-kienthuc","category-google-cloud-platform","entry","has-media"],"_links":{"self":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/posts\/26513","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/comments?post=26513"}],"version-history":[{"count":3,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/posts\/26513\/revisions"}],"predecessor-version":[{"id":26572,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/posts\/26513\/revisions\/26572"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/media\/26433"}],"wp:attachment":[{"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/media?parent=26513"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/categories?post=26513"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/gcloudvn.com\/en\/wp-json\/wp\/v2\/tags?post=26513"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}