Amazon Fsx For Lustre

2 posts

aws2 min readCurated summary

Amazon EC2 Hpc8a Instances powered by 5th Gen AMD EPYC processors are now available | Amazon Web Services

Amazon EC2 Hpc8a instances are now generally available for tightly coupled, compute-intensive HPC workloads. Powered by 5th Gen AMD EPYC processors reaching 4.5 GHz, they provide up to 40% more performance, 42% higher memory bandwidth, and 25% better price-performance than Hpc7a instances. AWS targets applications such as fluid dynamics, weather modeling, design simulations, and crash analysis. ## Instance Specifications - Available in a single `96xlarge` configuration: - 192 CPU cores - 768 GiB memory - 300 Gbps Elastic Fabric Adapter (EFA) networking - Uses a 1:4 core-to-memory ratio. - Customers can customize the number of cores at launch to better match workload requirements. - Simultaneous Multithreading (SMT) is disabled to maximize HPC performance. - Sixth-generation AWS Nitro cards handle virtualization, storage, and networking tasks separately from the CPUs. ## Supported HPC Services - Integrates with AWS ParallelCluster and AWS Parallel Computing Service (AWS PCS) for cluster creation and job submission. - Supports Amazon FSx for Lustre, offering sub-millisecond latency and throughput of up to hundreds of gigabytes per second. - High-bandwidth, low-latency networking is designed for workloads requiring extensive communication between compute nodes. ## Availability and Purchasing - Initially available in: - US East (Ohio) - Europe (Stockholm) - Offered through On-Demand Instances and Savings Plans. - Regional availability and future expansion can be checked through AWS Capabilities by Region. Hpc8a instances are best suited for organizations needing faster simulation results and efficient scaling across tightly coupled HPC workloads. Teams can launch them through the Amazon EC2 console and combine them with AWS cluster and storage services for a complete HPC environment.

Read original(opens in new tab)
awsOriginal article

Announcing Amazon EC2 G7e instances accelerated by NVIDIA RTX PRO 6000 Blackwell Server Edition GPUs (opens in new tab)

Amazon has announced the general availability of EC2 G7e instances, a new hardware tier powered by NVIDIA RTX PRO 6000 Blackwell Server Edition GPUs designed for generative AI and high-end graphics. These instances deliver up to 2.3 times the inference performance of their G6e predecessors while providing significant upgrades to memory and bandwidth. This launch aims to provide a cost-effective solution for running medium-sized AI models and complex spatial computing workloads at scale. **Blackwell GPU and Memory Advancements** * The G7e instances feature NVIDIA RTX PRO 6000 Blackwell GPUs, which provide twice the memory and 1.85 times the memory bandwidth of the G6e generation. * Each GPU provides 96 GB of memory, allowing users to run medium-sized models—such as those with up to 70 billion parameters—on a single GPU using FP8 precision. * The architecture is optimized for both spatial computing and scientific workloads, offering the highest graphics performance currently available in the EC2 portfolio. **High-Speed Connectivity and Multi-GPU Scaling** * To support large-scale models, G7e instances utilize NVIDIA GPUDirect P2P, enabling direct communication between GPUs over PCIe interconnects with minimal latency. * These instances offer four times the inter-GPU bandwidth compared to the L40s GPUs found in G6e instances, facilitating more efficient data transfer in multi-GPU configurations. * Total GPU memory can scale up to 768 GB within a single node, supporting massive inference tasks across eight interconnected GPUs. **Networking and Storage Performance** * G7e instances provide up to 1,600 Gbps of network bandwidth, a four-fold increase over previous generations, making them suitable for small-scale multi-node clusters. * Support for NVIDIA GPUDirect Remote Direct Memory Access (RDMA) via Elastic Fabric Adapter (EFA) reduces latency for remote GPU-to-GPU communication. * The instances support GPUDirect Storage with Amazon FSx for Lustre, achieving throughput speeds up to 1.2 Tbps to ensure rapid model loading and data processing. **System Specifications and Configurations** * Under the hood, G7e instances are powered by Intel Emerald Rapids processors and support up to 192 vCPUs and 2,048 GiB of system memory. * Local storage options include up to 15.2 TB of NVMe SSD capacity to handle high-speed data caching and local processing. * The instance family ranges from the g7e.2xlarge (1 GPU, 8 vCPUs) to the g7e.48xlarge (8 GPUs, 192 vCPUs). For developers ready to transition to Blackwell-based architecture, these instances are accessible through AWS Deep Learning AMIs (DLAMI). They represent a major step forward for organizations needing to balance the high memory requirements of modern LLMs with the cost efficiencies of the G-series instance family.