Introducing the next evolution of container platforms

13/09/2023

Google Cloud is on a mission to create the best place to run containerized workloads. This started in 2014, when inspired by Google's internal cluster management system,Borg, Google invented and introduced Kubernetes Google Kubernetes Engine (GKE) (GKE), the world's first managed Kubernetes service. GKE is the most scalable leading Kubernetes service available today. In 2019, Google launched Cloud Run, the first serverless platform that combines the benefits of containers and serverless. Today, Cloud Run offers one of the leading developer experiences among all cloud providers. Google has also expanded GKE to hybrid and multi-cloud environments with Anthos's reach in 2019, and introduced Autopilot in GKE in 2021. Finally, this year, Google expanded the reach of Anthos with Google Distributed Cloud. Continuing its mission, this year at Next, Google will announce three enhancements to its container management products:

First, we are launching GKE Enterprise, a new premium edition of GKE. With GKE Enterprise, companies can increase velocity across multiple teams, easily and securely run their most important business-critical workloads, and reduce total cost of ownership with a fully integrated and managed solution from Google Cloud.
Second, for organizations developing the next generation of AI applications, GKE now supports the AI-optimized Cloud TPU v5e. Additionally, there is support for A3 virtual machines with NVIDIA H100 GPUs as well Cloud Storage FUSE is now available for GKE.
Third, for teams that want to leverage the power of generative AI To increase productivity, Duet AI in GKE and Cloud Run provides AI gen specially trained on Google materials to reduce launch time of containerized applications.

Agenda

GKE Enterprise: the next evolution of Kubernetes

GKE Enterprise builds on its leadership Google Cloud về containers và Kubernetes, kết hợp những ưu điểm tốt nhất của GKE và Anthos's reach vào một container platform được tích hợp và trực quan, với trải nghiệm trên một giao diện console hợp nhất.

GKE Enterprise edition includes a new multi-cluster (“fleets”) feature that allows platform engineers to easily group similar workloads into dedicated clusters, applying custom configurations and policy barriers to each fleet, separately. sensitive workloads and even delegate cluster management to other teams. GKE Enterprise comes with managed security features, including advanced workload vulnerability insights, policy and administration controls, and managed service mesh — all based on the best of the best. open source Kubernetes ecosystem. And because GKE Enterprise is a fully integrated and fully managed platform, with simple, intuitive dashboards with in-context visibility, customers spend less time and effort more to manage the platform and more time to create great apps and experiences for your customers. Additionally, GKE Enterprise includes hybrid and multi-cloud support so you can run container workloads anywhere – on GKE, in other public clouds, or on-premises with Google Distributed Cloud.

In short, GKE Enterprise helps distributed teams run faster and more securely even with business-critical workloads at scale without increasing costs or headcount. In fact, GKE Enterprise is delivering incredible results with customers, improving their productivity by 45%, while reducing software deployment time by more than 70%.

Credit reporting provider Equifax has 14,000 employees around the world and uses GKE to run data and analytics applications critical to its operations. As an early adopter of the new multi-cluster and multi-team capabilities in GKE Enterprise, Equifax is excited about the security and efficiency improvements it brings to them.

“Google Kubernetes Engine is Equifax's global data architecture platform and helps Equifax customers around the world get the best financing possible. With GKE Enterprise edition, we can effectively manage hundreds of clusters using fleets to ensure operational consistency everywhere. GKE Enterprise instances have enabled us to scale rapidly with strong security and administrative controls, and meet customer service level requirements while reducing costs .” -Vipul Mapara, Equifax Fellow and SRE Leader, Equifax

GKE Enterprise will be available in preview in early September. To enable its capabilities, please contact your account manager. Additionally, you can work with partners Accenture, CDW, Deloitte, DoiT International, SADA, Searce, and 66 degrees to get started.

TPU support in GKE: a catalyst for AI success

Almost every organization has used or plans to use AI to accelerate their business. Outstanding development in the field machine learning is reflected in how customers use our product: Today, 15 of the largest GKE customers use it to power their AI workloads. In fact, over the past year, GPU usage with GKE has doubled.

As organizations develop and deploy larger AI models, they need more compute power and more cost-effective AI accelerators. The new Cloud TPU v5e can scale to tens of thousands of chips, making it ideal for developing more complex AI models. Cloud TPU v5e achieves up to 2x higher training performance and up to 2.5x higher inference performance per dollar for Large Language Models (LLMs) and gen AI models compared to Cloud TPU v4. Running Cloud TPU workloads on GKE allows you to take advantage of the powerful features that many of our most successful customers rely on, such as auto-scaling, workload orchestration, and support for up to 15,000 clusters. knot.

Grammarly offers free AI writing assistance powered by Google Cloud and has begun testing TPU with GKE.

“In our research on large language model alignment, Grammarly used the power of Google Cloud, TPU and JAX. We were impressed by the outstanding performance, robustness and reliability of the platform, which outperformed many similar offerings we evaluated.” -Max Gubin Engineering Director, Intelligence, Grammarly

Running your workloads in GKE helps save on valuable compute cycles by scaling up when demand increases and scaling down when demand decreases. You only pay for the TPU resources you provisioned, so GKE makes it easy to delay having to use provisioned TPUs until needed and turn them off easily.

In addition to TPU support, GKE also added GA support for A3 virtual machines with NVIDIA H100 GPUs, which can be perfect if you are training large models.

Finally, Google Cloud Storage FUSE available on GKE. So if your workloads fetch unstructured data – be it TensorFlow, PyTorch, Ray or Spark workloads – you can now move those workloads to GKE without changing how you access your data.

Duet AI in GKE and Cloud Run: work more productively and efficiently

The demand for cloud skills far exceeds the available talent. At Google Cloud, we want to help operations and platform engineering teams achieve productivity gains and execute on the most impactful ideas. Earlier this year, we introduced Duet AI in Google Cloud – your always-on AI collaborator powered by Google's next-generation AI platform models – to help Google Cloud users complete tasks more efficiently and effectively. And today, we are very happy to be introduce Duet AI in our runtimes, including GKE and Cloud Run. Duet AI helps platform teams running their containers on Google Cloud reduce much of the manual, repetitive work they encounter every day. Duet AI in GKE and Cloud Run is now available in preview.

Enabling a container-first world

We are committed to providing the best place to operate containers. These new additions build on recent enhancements that make it easier for customers to scale workloads with containers, whether using Cloud Run or GKE or both. For example, with recent innovations such as Cloud Run-Eventarc integration, news media such as BBC uses Cloud Run to handle traffic spikes, scaling from 150 – 200 container instances to over 1,000 in under a minute and serving over 498 million adults per week. We also focus on providing customers with choices. Some organizations move workloads between GKE and Cloud Run. Other organizations like Carrefour leverage both GKE and Cloud Run together to Run new e-commerce applications. Finally, for telecommunications companies such as Orange With regulatory and sovereignty requirements in mind, we extended GKE to hybrid environments with Google Distributed Cloud.

Google has come a long way since 2014, from supporting web applications to enabling customers to leverage cloud and containers to run business-critical, AI-driven applications for transformation. their business activities. Today, more than ever, your workloads have endless possibilities, and we look forward to partnering with you on your digital transformation journey.

For more detailed product information or to need technical support, you can contact Gimasys - Premier Partner of Google in Vietnam at the following information: