nvme-ssd

3 posts

aws

Amazon EC2 C9g and C9gd instances powered by AWS Graviton5 processors are now available | Amazon Web Services (opens in new tab)

Amazon EC2 C9g and C9gd instances, powered by AWS Graviton5, are now generally available for compute-intensive workloads. They provide up to 25% better performance per vCPU than C8g, faster DDR5 memory, larger caches, and improved networking and EBS bandwidth. C9gd adds local NVMe SSD storage, making it suitable for workloads requiring both high CPU performance and low-latency temporary storage. ## Graviton5 Performance Improvements - Up to 25% higher performance per vCPU than previous-generation C8g instances. - DDR5 memory running at 8800 MT/s, described as the fastest memory available in a cloud processor instance. - Five times more L3 cache than Graviton4-based instances. - Up to three times higher packet-processing performance than Graviton4. - Benefits include faster in-memory analytics, higher throughput, and more responsive real-time applications. ## C9g and C9gd Workloads - C9g is designed for compute-heavy applications using Amazon EBS, including: - Batch processing - Video encoding - Distributed analytics - CPU-based machine learning inference - Agentic AI workloads - C9gd adds local NVMe SSD storage for: - HPC simulation scratch space - Machine learning inference caches - Ad-serving buffers - Other low-latency temporary-storage use cases - C9gd delivers up to 30% higher local storage performance than the previous generation. ## Networking, Storage, and Configuration - Available in 11 sizes from medium through 48xlarge, plus bare metal. - Up to 15% higher network bandwidth and 20% higher EBS bandwidth on average compared with the prior generation. - The largest instances provide up to 100 Gbps networking and 72 Gbps EBS bandwidth. - Instance Bandwidth Configuration allows up to 25% of bandwidth to be shifted between EBS and VPC networking. - Support includes ENA Express, up to 128 EBS volumes, and On-Demand, Spot, Savings Plans, Dedicated Instances, and Dedicated Hosts. - NVMe-equipped instances expose detailed I/O statistics, including latency histograms by I/O size at one-second granularity through CloudWatch or `nvme-cli`. ## Nitro Isolation Engine - C9g and C9gd are the first compute-optimized EC2 instances to use the AWS Nitro Isolation Engine. - The Rust-based Nitro System component isolates virtual machines by mediating access to memory, CPU register state, and I/O devices through a minimal API set. - AWS provides additional technical documentation covering the engine and its formal verification results. ## Availability - The instances are available in US East (Ohio and Northern Virginia), US West (Oregon), and Europe (Frankfurt). - They can be launched through the AWS Management Console, CLI, or SDKs, with more regions planned. For compute-intensive workloads, C9g is the general-purpose choice, while C9gd is preferable when fast local NVMe storage is also required.

aws

Announcing Amazon EC2 G7 instances accelerated by NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs | Amazon Web Services (opens in new tab)

Amazon EC2 G7 instances are now generally available with NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs and custom sixth-generation Intel Xeon processors. Compared with G6 instances, they provide up to 4.6× higher AI inference performance and 2.1× better graphics performance. AWS positions them for AI inference, rendering, video, virtual desktops, spatial computing, and GPU-accelerated analytics. ## GPU and Performance Improvements - Each GPU provides 32 GB of memory, with up to 256 GB across eight GPUs. - GPU memory capacity is 1.33× higher and bandwidth is 2.45× higher than G6. - GPUs include fifth-generation Tensor Cores and fourth-generation RT Cores. - G7 instances accelerate analytics workloads running on Amazon EMR with Amazon EKS. ## Networking and Storage - Up to 700 Gbps of EFA-enabled networking—seven times the G6 throughput. - Up to 7.6 TB of local NVMe SSD storage keeps large models and datasets close to the GPUs. - Support for NVIDIA GPUDirect P2P and GPUDirect RDMA with EFA enables low-latency GPU communication across GPUs, nodes, and FSx for Lustre. ## Video Processing - Ninth-generation NVENC and sixth-generation NVDEC engines support 4:2:2 encoding and decoding. - They deliver up to 1.5× more concurrent video streams than G6 instances. ## Instance Configurations - Seven instance sizes are available. - Configurations offer up to: - 8 NVIDIA RTX PRO 4500 GPUs - 192 vCPUs - 768 GiB of system memory - 700 Gbps network bandwidth - 7.6 TB local NVMe storage - Detailed instance specifications were listed as “coming soon” in the announcement. ## Software and Availability - AWS provides Deep Learning AMIs and NVIDIA Workstation AMIs with preinstalled drivers. - Amazon EKS users should build AMIs with NVIDIA driver version R595. - Supported operating systems include Amazon Linux, Ubuntu, RHEL, and Windows Server. - NVIDIA integration supports DirectX, Vulkan, and OpenGL. - G7 instances are initially available in US East (Ohio) and US West (Oregon). - Purchasing options include On-Demand, Savings Plans, Spot Instances, and Dedicated Instances for selected sizes. G7 instances are a strong option for GPU-intensive workloads requiring higher inference, graphics, networking, and video performance. Organizations can launch them through the EC2 console and evaluate pricing across the available purchasing models.

aws

Now available: Amazon EC2 M9g and M9gd instances powered by new AWS Graviton5 processors | Amazon Web Services (opens in new tab)

AWS has generally released Amazon EC2 M9g and M9gd instances, powered by its Graviton5 processors. They deliver higher compute, memory, networking, and storage performance while improving energy efficiency and security. M9g targets general-purpose workloads, while M9gd adds up to 11.4 TB of local NVMe SSD storage for low-latency applications. ## Graviton5’s Performance Improvements - Graviton5 provides up to: - 25% better compute performance than Graviton4 - 35% faster web applications and ML inference - 30% faster database workloads - It includes: - 192 CPU cores - Five times more L3 cache - Up to 33% lower inter-core latency - DDR5-8800 memory - PCIe Gen6 support - These features improve concurrency, memory bandwidth, and CPU-heavy workloads such as agentic AI, code generation, real-time reasoning, and multi-step orchestration. - Customer results include: - ClickHouse: 36% better performance than M8g without code changes - Honeycomb: 36% higher throughput per core - HubSpot: up to 60% shorter MySQL query duration ## Networking and Storage Enhancements - M9g and M9gd provide: - Up to 15% higher network bandwidth - Up to 20% higher EBS bandwidth on average - Up to twice the network bandwidth on the largest instance - Instance Bandwidth Configuration lets customers shift bandwidth between EBS and VPC networking by up to 25%. - This is useful for databases, query processing, logging, and other workloads with demanding I/O requirements. ## Nitro Isolation Engine - M9g and M9gd introduce the Nitro Isolation Engine, an enhancement to the AWS Nitro System. - It isolates virtual machines by controlling access to: - Memory - CPU register state - I/O devices - The component uses formal verification to mathematically prove isolation behavior rather than relying solely on testing. - AWS describes Nitro as the first formally verified cloud hypervisor. ## M9g General-Purpose Instances - M9g instances provide one vCPU per 4 GiB of memory. - Suitable workloads include: - Application servers and microservices - Web applications and containerized applications - Midsize data stores and caching fleets - Gaming servers - Large-scale Java applications - Code repositories - Agentic AI workloads ## M9gd Instances with Local NVMe Storage - M9gd adds up to 11.4 TB of local NVMe SSD storage. - It offers up to 30% higher IOPS and storage performance than Graviton4-based M8gd instances. - Recommended for: - Low-latency caches and scratch files - Data and log processing - Media processing - Batch workloads - Key-value stores - Gaming and application servers ## Availability and Migration Resources - M9g and M9gd are available in: - US East (N. Virginia) - US East (Ohio) - US West (Oregon) - Europe (Frankfurt) - Purchasing options include Savings Plans, On-Demand, Spot Instances, Dedicated Instances, and Dedicated Hosts. - AWS provides a Graviton Getting Started Guide, Graviton Savings Dashboard, and AWS Transform for migrating Java applications from x86 to Graviton. Organizations seeking better compute efficiency, higher I/O throughput, or lower-cost Arm infrastructure should evaluate M9g for general-purpose workloads and M9gd when local NVMe storage is required.