aws-graviton5

3 posts

aws

Amazon EC2 C9g and C9gd instances powered by AWS Graviton5 processors are now available | Amazon Web Services (opens in new tab)

Amazon EC2 C9g and C9gd instances, powered by AWS Graviton5, are now generally available for compute-intensive workloads. They provide up to 25% better performance per vCPU than C8g, faster DDR5 memory, larger caches, and improved networking and EBS bandwidth. C9gd adds local NVMe SSD storage, making it suitable for workloads requiring both high CPU performance and low-latency temporary storage. ## Graviton5 Performance Improvements - Up to 25% higher performance per vCPU than previous-generation C8g instances. - DDR5 memory running at 8800 MT/s, described as the fastest memory available in a cloud processor instance. - Five times more L3 cache than Graviton4-based instances. - Up to three times higher packet-processing performance than Graviton4. - Benefits include faster in-memory analytics, higher throughput, and more responsive real-time applications. ## C9g and C9gd Workloads - C9g is designed for compute-heavy applications using Amazon EBS, including: - Batch processing - Video encoding - Distributed analytics - CPU-based machine learning inference - Agentic AI workloads - C9gd adds local NVMe SSD storage for: - HPC simulation scratch space - Machine learning inference caches - Ad-serving buffers - Other low-latency temporary-storage use cases - C9gd delivers up to 30% higher local storage performance than the previous generation. ## Networking, Storage, and Configuration - Available in 11 sizes from medium through 48xlarge, plus bare metal. - Up to 15% higher network bandwidth and 20% higher EBS bandwidth on average compared with the prior generation. - The largest instances provide up to 100 Gbps networking and 72 Gbps EBS bandwidth. - Instance Bandwidth Configuration allows up to 25% of bandwidth to be shifted between EBS and VPC networking. - Support includes ENA Express, up to 128 EBS volumes, and On-Demand, Spot, Savings Plans, Dedicated Instances, and Dedicated Hosts. - NVMe-equipped instances expose detailed I/O statistics, including latency histograms by I/O size at one-second granularity through CloudWatch or `nvme-cli`. ## Nitro Isolation Engine - C9g and C9gd are the first compute-optimized EC2 instances to use the AWS Nitro Isolation Engine. - The Rust-based Nitro System component isolates virtual machines by mediating access to memory, CPU register state, and I/O devices through a minimal API set. - AWS provides additional technical documentation covering the engine and its formal verification results. ## Availability - The instances are available in US East (Ohio and Northern Virginia), US West (Oregon), and Europe (Frankfurt). - They can be launched through the AWS Management Console, CLI, or SDKs, with more regions planned. For compute-intensive workloads, C9g is the general-purpose choice, while C9gd is preferable when fast local NVMe storage is also required.

aws

AWS Weekly Roundup: AWS FinOps Agent in preview, Gemma 4 on Bedrock, Kiro Pro Max, and more (June 15, 2026) | Amazon Web Services (opens in new tab)

AWS’s June 15, 2026 roundup highlights rapid adoption of AI-native development, a preview of the AWS FinOps Agent, and major infrastructure and model releases. AWS reports significant productivity gains from agent-assisted engineering, while new services target cost optimization, observability, security, and developer workflows. The overall direction is toward more autonomous, context-aware tools integrated throughout the AWS ecosystem. ## AI-Native Development at AWS - Amazon engineering teams are restructuring development around AI agents. - A six-engineer team rebuilt the Amazon Bedrock inference engine in 76 days, compared with an original estimate of 30 developers over 12–18 months. - Structured Amazon Stores pilots achieved a median 4.5× improvement in normalized deployment velocity, with some teams exceeding 10×. - Recommended practices for “frontier teams” include: - Building steering files, coding standards, and structured repositories to provide agent context. - Expecting an initial productivity slowdown while workflows change. - Maintaining a backlog of well-scoped tasks that agents can execute in parallel. - Writing structured specifications before generating code. - Moving testing earlier so agents can detect and correct issues. - AWS cautions that commit velocity is only one measure; future work will address release management, operations, security, and end-of-life upgrades. ## AWS FinOps Agent Preview - AWS FinOps Agent helps finance and engineering teams: - Answer AWS cost questions and generate reports. - Identify rightsizing, idle-resource, and Savings Plans opportunities. - Investigate cost anomalies automatically. - Schedule recurring FinOps workflows. - Recommendations come from AWS Cost Optimization Hub and AWS Compute Optimizer. - The agent can open Jira tickets and post anomaly-investigation findings to Slack. ## New EC2 M9g and M9gd Instances - M9g and M9gd instances use AWS Graviton5 processors and the sixth-generation Nitro System. - They provide: - Up to 25% better compute performance than Graviton4. - Up to 35% faster web applications and ML inference. - Up to 30% faster database performance. - Up to 15% more network bandwidth and 20% more EBS bandwidth than M8g. - Graviton5 adds PCIe Gen6, DDR5-8800 memory, and a 5× larger L3 cache. - The Nitro Isolation Engine uses formal verification to provide mathematically proven VM isolation. - M9gd adds up to 11.4 TB of local NVMe SSD storage and 30% higher IOPS than M8gd. - Instance Bandwidth Configuration can shift bandwidth between EBS and VPC networking by up to 25%. ## Bedrock Model Updates - Anthropic Claude Fable 5 launched on Bedrock with: - Extended asynchronous task execution. - Advanced vision for diagrams, charts, and PDFs. - Proactive self-verification. - Access required Data Retention API opt-in and 30-day retention for inputs and outputs. - Anthropic later asked AWS to revoke access to Claude Fable 5 and Claude Mythos 5 in response to a U.S. government export-control directive. - Google DeepMind’s Gemma 4 models are available in three versions: - Gemma 4 31B for reasoning and coding, with a 256K-token context window. - Gemma 4 26B-A4B, a mixture-of-experts model for cost- and latency-sensitive use. - Gemma 4 E2B for low-latency interactive applications. - All variants support function calling, structured output, reasoning, streaming, multimodal inputs, and more than 35 languages. ## OpenSearch MCP Apps for Agentic Observability - OpenSearch MCP Apps bring logs, traces, metrics, and alerts into compatible agentic environments such as Claude Desktop and VS Code. - Agents can investigate incidents across OpenSearch and Amazon Managed Service for Prometheus. - Each tool call produces both: - A text summary for the agent. - An interactive visualization displayed in the conversation. - Available tools cover log, metric, and trace analysis; service performance; topology; agent health; cluster health; dynamic visualizations; and instrumentation scoring. ## Additional AWS Updates - AWS CLI v1 is entering maintenance mode: - Dependencies such as `botocore` and `s3transfer` will be vendored into the CLI. - Future releases will focus on critical bugs and security fixes. - AWS recommends migrating to CLI v2. - AWS Workload Credentials Provider provides short-term credentials for applications running outside AWS, including on-premises and third-party environments, without requiring long-term access keys. - Kiro Pro Max adds higher usage limits, access to newer frontier models, and additional agentic development capabilities for professional teams. AWS’s latest releases suggest that teams should prepare for AI agents to handle not only code generation, but also cost management, observability, testing, and operational workflows. Migrating to AWS CLI v2, evaluating Bedrock’s newest models, and establishing strong repository context and specifications are practical next steps.

aws

Now available: Amazon EC2 M9g and M9gd instances powered by new AWS Graviton5 processors | Amazon Web Services (opens in new tab)

AWS has generally released Amazon EC2 M9g and M9gd instances, powered by its Graviton5 processors. They deliver higher compute, memory, networking, and storage performance while improving energy efficiency and security. M9g targets general-purpose workloads, while M9gd adds up to 11.4 TB of local NVMe SSD storage for low-latency applications. ## Graviton5’s Performance Improvements - Graviton5 provides up to: - 25% better compute performance than Graviton4 - 35% faster web applications and ML inference - 30% faster database workloads - It includes: - 192 CPU cores - Five times more L3 cache - Up to 33% lower inter-core latency - DDR5-8800 memory - PCIe Gen6 support - These features improve concurrency, memory bandwidth, and CPU-heavy workloads such as agentic AI, code generation, real-time reasoning, and multi-step orchestration. - Customer results include: - ClickHouse: 36% better performance than M8g without code changes - Honeycomb: 36% higher throughput per core - HubSpot: up to 60% shorter MySQL query duration ## Networking and Storage Enhancements - M9g and M9gd provide: - Up to 15% higher network bandwidth - Up to 20% higher EBS bandwidth on average - Up to twice the network bandwidth on the largest instance - Instance Bandwidth Configuration lets customers shift bandwidth between EBS and VPC networking by up to 25%. - This is useful for databases, query processing, logging, and other workloads with demanding I/O requirements. ## Nitro Isolation Engine - M9g and M9gd introduce the Nitro Isolation Engine, an enhancement to the AWS Nitro System. - It isolates virtual machines by controlling access to: - Memory - CPU register state - I/O devices - The component uses formal verification to mathematically prove isolation behavior rather than relying solely on testing. - AWS describes Nitro as the first formally verified cloud hypervisor. ## M9g General-Purpose Instances - M9g instances provide one vCPU per 4 GiB of memory. - Suitable workloads include: - Application servers and microservices - Web applications and containerized applications - Midsize data stores and caching fleets - Gaming servers - Large-scale Java applications - Code repositories - Agentic AI workloads ## M9gd Instances with Local NVMe Storage - M9gd adds up to 11.4 TB of local NVMe SSD storage. - It offers up to 30% higher IOPS and storage performance than Graviton4-based M8gd instances. - Recommended for: - Low-latency caches and scratch files - Data and log processing - Media processing - Batch workloads - Key-value stores - Gaming and application servers ## Availability and Migration Resources - M9g and M9gd are available in: - US East (N. Virginia) - US East (Ohio) - US West (Oregon) - Europe (Frankfurt) - Purchasing options include Savings Plans, On-Demand, Spot Instances, Dedicated Instances, and Dedicated Hosts. - AWS provides a Graviton Getting Started Guide, Graviton Savings Dashboard, and AWS Transform for migrating Java applications from x86 to Graviton. Organizations seeking better compute efficiency, higher I/O throughput, or lower-cost Arm infrastructure should evaluate M9g for general-purpose workloads and M9gd when local NVMe storage is required.