Amazon Sagemaker | Techlist.io

awsJul 27, 20263 min readCurated summary

AWS Weekly Roundup: Local Zone in Athens, Claude Opus 5 on AWS, Lambda durable execution for .NET, and more (July 27, 2026) | Amazon Web Services

The week’s AWS updates focus on bringing infrastructure closer to users, expanding AI capabilities, and improving reliability and observability. Highlights include a new Athens Local Zone, Claude Opus 5 availability, durable Lambda workflows for .NET, and unified Amazon Bedrock AgentCore telemetry. The post also points to new data, contact-center, developer-productivity, and community resources. ## AWS Local Zone in Athens - AWS launched its second EMEA Local Zone in Athens, Greece. - It supports: - Amazon EC2 C7i, M7i, and R7i instances - Amazon S3 One Zone-Infrequent Access - Amazon EBS and EBS Local Snapshots - Amazon ECS - Greek organizations can process and store data locally to help satisfy data-residency requirements. - The zone enables single-digit-millisecond latency for workloads such as gaming, media production, and financial services while still connecting to the nearest AWS Region. ## New AI and Serverless Capabilities - **Claude Opus 5 on AWS** is available through Amazon Bedrock and Claude Platform on AWS. - It provides top-tier Opus-level intelligence. - Bedrock enables zero data retention by default, supporting stricter governance requirements. - **Lambda durable execution for .NET** is now generally available. - C# developers can create long-running, multi-step workflows without custom checkpointing or external orchestration. - Workflows can pause for up to one year. - Use cases include payment pipelines, AI agents, and human approvals. ## Improved Agent Observability - Amazon Bedrock AgentCore now stores traces, prompts, inputs, outputs, and application logs in a single CloudWatch log group. - Engineers can investigate individual agent invocations without searching multiple destinations. - Agent-level access controls and customer-managed key encryption are also supported. ## Contact Center, Data, and Developer Updates - Amazon Connect added more natural agentic voice experiences across more than 50 languages. - The service now includes over 100 new voice options and improved handling of tone and sentiment. - SageMaker Unified Studio can query Amazon OpenSearch data alongside Redshift, S3, and relational database assets. - CloudWatch coding agent insights measures the organizational impact of tools such as Claude Code, Codex, and GitHub Copilot using OpenTelemetry telemetry without custom instrumentation. ## Additional Resources and Events - AWS published guidance for evaluating AI agents with Strands Agents and Bedrock AgentCore. - A new guide covers multi-region resiliency for CloudFormation custom resources. - Amazon SES introduced pricing plans intended to make large-scale email costs more predictable. - Upcoming opportunities include AWS Summits and AWS Community Day Belo Horizonte on August 22. Together, these releases suggest AWS is prioritizing lower-latency regional infrastructure, production-ready AI workflows, and better operational visibility. Builders should assess the Athens Local Zone for residency-sensitive workloads, consider durable Lambda execution for complex .NET processes, and adopt the new observability tools as agent deployments grow.

Read original

Amazon Sagemaker AWS Amazon Bedrock Aws Lambda+4

awsJul 13, 20264 min readCurated summary

AWS Weekly Roundup: AWS Builder Center at 1 year, Network Scanning in Security Hub, Loom for AWS, and more (July 13, 2026) | Amazon Web Services

AWS’s weekly roundup highlights the first anniversary of AWS Builder Center and its expansion into a broader learning and experimentation ecosystem. It also introduces major security, AI, container, database, and developer-tool updates, including internet reachability scanning, Azure support in Security Hub, Hugging Face integration with SageMaker, lower GPU management fees, and Aurora DSQL change data capture. The overall direction is toward more integrated, governed, and accessible cloud development workflows. ## AWS Builder Center Turns One - Launched on July 9, 2025, Builder Center has expanded from a community hub into an ecosystem with: - Sandbox environments - Workshops and the Builders’ Library - Community Spaces, profiles, badges, and streaks - AWS regional capability listings - Saved items, article series, availability notifications, and GitHub/Amazon sign-in - In its first year: - 5,548 authors published 6,448 articles. - Articles received more than 10.4 million page views. - Builders earned 99,226 badges. - The community submitted 565 feature wishes, with 10 already delivered. - The most popular articles covered MCP and Strands Agents, Linux migration with Kiro, and multimodal AI for neurological screening. ## Free AWS Sandbox Environments - Builder Center now offers free, pre-provisioned AWS accounts for workshop exercises. - Each sandbox: - Remains active for eight hours. - Automatically removes the account and resources afterward. - Requires no personal AWS account, credit card, or manual cleanup. - Users can have one active sandbox and request one sandbox per week. ## Security Hub Adds Network and Azure Coverage - Security Hub Network Scanning probes AWS and Azure environments from the public internet. - It identifies: - Public IP addresses, virtual machines, and load balancers. - Reachable ports. - Services operating behind those ports. - Each reachable port produces a finding, which Security Hub Exposures correlates with other configuration and security findings. - Existing customers can enable the feature by account, Region, or organization policy; it is enabled by default for new customers. - Network Scanning is included with Security Hub Essentials at no extra cost. - Security Hub also now evaluates Azure VMs, container images, Function Apps, and identities for vulnerabilities, misconfigurations, and internet exposure. ## SageMaker Studio and Hugging Face Integration - Users can deploy or customize supported Hugging Face models in SageMaker Studio with one click. - New customers receive automatically configured Studio environments for: - Fine-tuning and reinforcement learning with custom reward functions. - Model evaluation. - Deployment to SageMaker or Bedrock endpoints. - Verified customers receive default GPU access to G5, G6, and G4dn instances, while quota usage is visible in Studio. ## Lower GPU Management Fees - Starting July 1, 2026, EKS Auto Mode and ECS Managed Instances reduced accelerated-instance management fees: - G-series: 35% reduction. - P-series and Trainium: 60% reduction. - Existing customers receive the reductions automatically. - EKS adds accelerator-aware node repair and parallel image pulling. - ECS provides GPU metrics through CloudWatch Container Insights and monitors GPU hardware health. ## Aurora DSQL Change Data Capture - Aurora DSQL CDC is generally available and streams insert, update, and delete events to Kinesis Data Streams. - The events can synchronize microservices, invoke Lambda functions, or feed S3, Redshift, and OpenSearch through Firehose. - CDC is designed to avoid database performance impact and requires no infrastructure management. ## Tools for Governed AI Agents - Loom for AWS is an open-source platform for deploying and managing Strands Agents on Bedrock AgentCore Runtime. - It includes: - Identity-provider integration and RBAC/ABAC. - Lifecycle management for agents, memory, MCP servers, and agent-to-agent connections. - Automated tagging for cost attribution. - Agent Registry integration and human approval for sensitive actions. - The Claude apps gateway provides centralized access, policy, and spending controls for Claude Code and Claude Desktop. - It supports OIDC identity providers, per-user and per-group spending caps, managed request settings, and routing through Amazon Bedrock or Claude Platform on AWS. - AWS MCP Server now supports browser-based OAuth using AWS Console or CLI credentials, including IAM federation and IAM Identity Center, with short-lived tokens and automatic refresh. AWS’s updates favor managed services that reduce operational work while strengthening security and governance. Teams should evaluate Builder Center sandboxes for training, enable Security Hub’s broader scanning where appropriate, and consider the new AI-agent controls and managed GPU options for production workloads.

Read original

Amazon Sagemaker Kubernetes Model Context Protocol PostgreSQL+4

awsJul 6, 20263 min readCurated summary

AWS Weekly Roundup: Claude Sonnet 5 on AWS, Amazon WorkSpaces for AI agents, AWS service availability updates, and more (July 6, 2026) | Amazon Web Services

The July 6, 2026 AWS roundup highlights new infrastructure, AI, observability, and developer productivity capabilities. Major announcements include Claude Sonnet 5 on AWS, generally available WorkSpaces for AI agents, faster SageMaker inference scaling, and log-query alarms in CloudWatch. It also details AWS service lifecycle changes and upcoming community events. ## Featured AWS Launches - **Claude Sonnet 5 on AWS** - Anthropic’s latest Sonnet model is available for coding, agentic workflows, and professional tasks. - It can navigate large codebases, use tools accurately, and preserve state across long-running tasks. - **Amazon WorkSpaces for AI agents** - AI agents can securely operate desktop applications in managed WorkSpaces environments. - Organizations can use existing applications without modernization or custom integrations. - **OpenSearch log analytics optimization** - A new engine provides up to four times better price-performance in internal benchmarks. - It combines log aggregation with OpenSearch’s full-text search capabilities. - **Faster SageMaker AI inference scaling** - Container image caching can reduce generative AI scale-out time by up to half. - SageMaker supports up to two times faster end-to-end scaling during demand increases. - **CloudWatch alarms from log queries** - Users can create alarms directly from log query results and define thresholds in one workflow. - This removes the need to create metric filters or custom metrics first. ## Additional Infrastructure and Developer Updates - **EC2 C9g and C9gd instances** - Powered by AWS Graviton5 processors. - Offer up to 25% more compute performance than Graviton4 instances, five times more cache, faster memory, and optional local NVMe storage. - **CloudFormation Express mode** - Provides deployment confirmation within seconds. - Helps developers and AI agents iterate more quickly, at no additional cost in commercial Regions. - **Amazon EKS version rollbacks** - Kubernetes upgrades can be reversed within seven days. - Rollbacks avoid rebuilding clusters and reduce the risk of failed upgrades. - **ACME support in AWS Certificate Manager** - Automates issuance and renewal of public TLS certificates using the standard ACME protocol. ## AWS Service Availability Changes AWS updated its lifecycle guidance on June 30, 2026, including alternatives and migration support. - **Moving to maintenance for new customers from July 30** - Amazon Bedrock Agents becomes Bedrock Agents Classic. - Amazon Cognito Sync, Amazon Kendra, Amazon Q Business, Simple AD, and several other services and features will no longer accept new customers. - A number of SageMaker AI features are affected, including Clarify, Debugger, Ground Truth, Model Monitor, and Studio Lab. - AWS IoT Device Defender Detect changes on August 31, 2026. - **Entering sunset** - Amazon WorkSpaces PCoIP and Pool. - AWS Managed Services Advanced. - AWS re:Post Private. - SageMaker AI Profiler. - **End of support** - Amazon Chime SDK Carrier Voice Focus. - SageMaker AI Ground Truth Plus. ## Upcoming AWS Events - AWS Summits will take place throughout the second half of 2026. - AWS Community Day Belo Horizonte is scheduled for August 22. - The AWS Builder Center offers community discussions, technical content, and information about upcoming virtual and in-person events. Organizations using affected AWS services should review the relevant lifecycle documentation and contact AWS Support to plan migrations before availability or support deadlines.

Read original

Amazon Sagemaker Kubernetes AWS Amazon Eks+4

awsMay 25, 20263 min readCurated summary

AWS Weekly Roundup: AWS Local Zones in Istanbul, open-source ExtendDB, Kiro Web, and more (May 25, 2026) | Amazon Web Services

AWS’s latest updates focus on expanding regional infrastructure, improving developer workflows, and making cloud and AI services more portable. The Istanbul Local Zone strengthens data residency and low-latency capabilities in Türkiye, while tools such as ExtendDB, OpenAI-compatible SageMaker APIs, and Kiro Web reduce migration and development friction. Together, these releases emphasize flexibility, operational resilience, and easier local testing. ## AWS Local Zone in Istanbul - AWS opened a new Local Zone in Istanbul, Türkiye. - It provides nearby compute, storage, and networking with single-digit millisecond latency. - Organizations can keep and process data within Turkish borders to support residency and compliance requirements. - The zone supports latency-sensitive workloads in sectors such as finance, government, telecommunications, and healthcare. - Applications can combine Istanbul infrastructure with the broader AWS Region, enabling hybrid architectures without operating a private data center. ## Security and AI Service Updates - **Security Hub Extended** now integrates with 21 curated partner solutions across nine security categories, including endpoint protection, threat intelligence, and cloud security posture management. - **Amazon SageMaker AI** supports OpenAI-compatible inference APIs, allowing existing OpenAI-based applications to use SageMaker with minimal or no SDK changes. - **Secrets Manager Agent** can pre-fetch secrets at startup, reducing cold-start delays, and can assume IAM roles for workloads with different permission boundaries. - **Amazon Bedrock** introduced tools for advanced prompt optimization and migration across foundation models. ## Open-Source and Local Development Tools - AWS open-sourced **ExtendDB**, a DynamoDB-compatible adapter for alternative storage backends. - It supports local development and testing without a live AWS connection. - It can help teams retain DynamoDB API semantics while controlling the underlying storage layer. - **AWS SAM CLI** now supports CloudFormation Language Extensions locally, improving consistency between local testing and production deployments. ## Developer Experience and Reliability - **Kiro Web** brings AWS’s AI-assisted, spec-driven development environment to browsers, providing access to chat and agent capabilities without installing the desktop IDE. - AWS updated default retry behavior across SDKs and CLI tools. - Improvements include smarter backoff and better throttling handling. - Production applications should become more resilient to transient failures without additional configuration. ## Container Image Changes - Bitnami images are being removed from Amazon ECR Public. - Teams currently using those images should review the migration timeline and update image references to Bitnami’s own registry to avoid interruptions. ## Upcoming AWS Events - AWS Summit Amsterdam: May 27 - AWS Summit Bangkok: May 28 - AWS Summit Milan: May 28 Builders should evaluate the Istanbul Local Zone for residency- or latency-sensitive systems, consider ExtendDB and SAM improvements for local workflows, and review the Bitnami registry change before images are removed from ECR Public.

Read original

Amazon Sagemaker AI AWS Amazon Bedrock+4

awsFeb 23, 20263 min readCurated summary

AWS Weekly Roundup: Claude Sonnet 4.6 in Amazon Bedrock, Kiro in GovCloud Regions, new Agent Plugins, and more (February 23, 2026) | Amazon Web Services

AWS’s February 23, 2026 roundup highlights continued investment in AI-assisted development, cloud infrastructure, and production-grade agents. Major launches include Claude Sonnet 4.6 in Amazon Bedrock, Kiro for GovCloud, customizable SageMaker deployments for Nova models, and new EC2 and Aurora capabilities. The post also points developers toward agent tooling, operational best practices, community resources, and upcoming events. ## Developer Conferences and AI Collaboration - AWS teams discussed “renascent software,” where humans and AI work together as co-developers through Kiro. - Developer Week sessions focused on: - Agent memory - Multi-agent architectures - Meta-tooling - Hooks - Production deployment of AI agents - At dev/nexus in Atlanta, AWS speakers will cover AI agents with Spring and MCP, along with AI-assisted Java modernization. ## Major AWS Launches - **Claude Sonnet 4.6 in Amazon Bedrock** - Provides near-Opus 4.6 intelligence at lower cost. - Targets coding, agent workloads, and professional knowledge work. - Designed for fast, high-quality task completion at scale. - **Amazon EC2 Hpc8a instances** - Powered by 5th Gen AMD EPYC processors. - Deliver up to 40% higher performance, increased memory bandwidth, and 300 Gbps Elastic Fabric Adapter networking. - Intended for simulations, engineering, and tightly coupled HPC workloads. - **Custom Amazon Nova models with SageMaker Inference** - Supports configuration of instance types, auto-scaling policies, and concurrency. - Enables deployments to be tuned for specific performance and cost requirements. - **Nested virtualization on EC2** - Allows KVM or Hyper-V virtual machines to run inside virtual EC2 instances. - Supports mobile emulators, automotive hardware simulation, and Windows Subsystem for Linux environments. - **Aurora encryption by default** - New database clusters automatically use server-side encryption with AWS-owned keys. - Encryption is transparent, fully managed, and has no additional cost or performance impact. - **Kiro in AWS GovCloud** - Brings Kiro’s agentic development capabilities to teams working on government missions. - Supports regulated environments requiring stringent security controls. ## Agent Tools and Operational Reliability - AWS introduced open-source **Agent Plugins for AWS** that add AWS-specific skills to coding agents. - The `deploy-on-aws` plugin can generate: - Architecture recommendations - Cost estimates - Infrastructure-as-code - AWS also highlighted automated reasoning research led by Byron Cook, applying formal verification techniques to AI-generated code and critical agent decisions. - Recommended practices for AWS DevOps Agent focus on configuring Agent Spaces to balance broad investigation capabilities with operational efficiency. - AWS reports that DevOps Agent has handled thousands of escalations and achieved an estimated root-cause identification rate above 86% within Amazon. ## Community Projects and Resources - Community content includes: - A practical guide to AWS for developers entering their first job. - An AI agent that automates job searching. - A Kiro Power integrating 25 MCP tools, 10 steering guides, and structured development guidance. - AWS encourages developers to use the AWS Builder Center to exchange knowledge and discover community content. ## Upcoming Events and Hackathons - 2026 AWS Summits are scheduled for Paris, London, and Bengaluru. - The six-week Amazon Nova AI Hackathon runs through March 16, with $40,000 in prizes across areas such as agentic AI, multimodal applications, UI automation, and voice. - Upcoming AWS Community Days include events in Ahmedabad, Tokyo, Chennai, Slovakia, and Pune. Developers interested in AI-assisted coding, agent operations, or high-performance cloud workloads should explore the new Bedrock, Kiro, SageMaker, and Agent Plugin capabilities, while using AWS events and community forums for practical guidance.

Read original

Amazon Sagemaker AI Agents Generative AI Amazon Bedrock+4

awsFeb 16, 20263 min readCurated summary

Announcing Amazon SageMaker Inference for custom Amazon Nova models | Amazon Web Services

Amazon SageMaker Inference now generally supports deploying and scaling full-rank customized Amazon Nova models. The feature gives production workloads more control over instance types, autoscaling, context length, concurrency, and batch settings while improving cost efficiency through optimized GPU utilization. Customers can train Nova Micro, Nova Lite, and Nova 2 Lite models with SageMaker Training Jobs or HyperPod, then deploy them as managed real-time or asynchronous endpoints. ## Custom Nova Model Support - Supports customized Nova Micro, Nova Lite, and Nova 2 Lite models. - Models can use: - Continued pre-training - Supervised fine-tuning - Reinforcement fine-tuning - Custom models can be trained through Amazon SageMaker Training Jobs or Amazon HyperPod. - SageMaker Inference provides managed deployment, scaling, and HTTPS access for production workloads. - GPU utilization and inference costs can be optimized with Amazon EC2 G5 and G6 instances instead of relying exclusively on P5 instances. - Autoscaling can respond to five-minute usage patterns. - Configurable context length, concurrency, and batch size help balance latency, cost, and accuracy. ## Deploying Through SageMaker Studio - In SageMaker Studio, users select a trained Nova model from the Models menu. - Choosing **Deploy**, **SageMaker AI**, and **Create new endpoint** starts deployment. - Deployment settings include: - Endpoint name - Instance type - Initial and maximum instance counts - Permissions - Networking configuration - Supported launch instance types vary by model: - Nova Micro: G5, G6, and P5 options, including `g5.12xlarge` through `g6.48xlarge` and `p5.48xlarge` - Nova Lite: `g5.48xlarge`, `g6.48xlarge`, and `p5.48xlarge` - Nova 2 Lite: `p5.48xlarge` - Provisioning takes time because SageMaker must create infrastructure, download model artifacts, and initialize the inference container. - Once the endpoint is `InService`, users can test it in the Studio Playground using chat prompts. ## Deploying with the SageMaker SDK - Deployment requires two SageMaker resources: - A model object referencing the Nova artifacts and inference container - An endpoint configuration specifying the instance type and count - Model artifacts can be stored in Amazon S3 and referenced with an S3 prefix. - Environment variables configure inference behavior, including: - `CONTEXT_LENGTH` - `MAX_CONCURRENCY` - `DEFAULT_TEMPERATURE` - `DEFAULT_TOP_P` - The endpoint configuration creates a real-time endpoint, such as one using an `ml.g5.12xlarge` instance. - SageMaker supports network isolation and execution roles for secure deployment. ## Inference and Request Configuration - Endpoints support synchronous real-time inference in streaming or non-streaming modes. - Asynchronous endpoints are available for batch-style processing. - Requests can configure: - Maximum output tokens - Temperature - Top-p and top-k sampling - Log probabilities - Streaming usage statistics - Reasoning effort, with `low` and `high` options - The example request asks the model to compare quarterly spending against budget and identify variances above 10 percent. SageMaker Inference provides a complete path from Nova customization to production deployment. Teams should select instance types and tune context length, concurrency, batching, and sampling parameters based on their workload’s latency, cost, and accuracy requirements.

Read original

Amazon Sagemaker Machine Learning AWS Amazon Ec2+3

awsFeb 2, 20263 min readCurated summary

AWS Weekly Roundup: Amazon Bedrock agent workflows, Amazon SageMaker private connectivity, and more (February 2, 2026) | Amazon Web Services

The AWS Weekly Roundup highlights new capabilities for AI agents, private connectivity, encryption management, and resilience testing. Major launches include Bedrock server-side tools and longer prompt caching, SageMaker Unified Studio support for PrivateLink, and S3 encryption changes without data movement. Additional updates strengthen event-driven architectures, observability, zero-trust access, and AI-assisted AWS deployments. ## AI Agents and Developer Workflows - Amazon Bedrock’s Responses API now supports server-side tools such as web search, code execution, and database updates within AWS security boundaries. - Bedrock also offers a one-hour prompt-cache TTL for select Anthropic Claude models, improving performance and reducing costs for long-running, multi-turn agents. - AWS MCP Server deployment SOPs, currently in preview, let agents deploy applications from natural-language prompts using CDK, CloudFormation, and CI/CD workflows. - The deployment preview supports React, Vue.js, Angular, and Next.js through tools such as Kiro, Cursor, and Claude Code. - CloudWatch Application Signals integration with Kiro provides AI-assisted investigation of service health, SLO compliance, and observability issues. ## Private Connectivity and Zero-Trust Security - SageMaker Unified Studio now supports AWS PrivateLink, allowing VPC traffic to remain within the AWS network instead of traversing the public internet. - IAM policies can govern private SageMaker connectivity for stricter security and compliance requirements. - AWS Verified Access guidance demonstrates centralized zero-trust application access across multi-account environments using IAM Identity Center and AWS RAM. - AWS Network Firewall adds predefined web categories for identifying and controlling generative AI application traffic, with full-URL filtering available alongside TLS inspection. ## Storage, Encryption, and Database Performance - Amazon S3’s `UpdateObjectEncryption` API changes encryption for existing objects without moving or re-uploading data. - Supported operations include switching from SSE-S3 to SSE-KMS, rotating customer-managed KMS keys, and standardizing encryption with S3 Batch Operations. - Amazon Keyspaces table pre-warming prepares tables for predictable high-throughput workloads, reducing throttling and cold-start delays during traffic spikes. - Pre-warming works with on-demand and provisioned capacity, including multi-Region tables. - DynamoDB MRSC global tables now integrate with AWS Fault Injection Service, enabling simulated Regional failures and validation of replication and application resilience. ## Event-Driven Systems and Observability - EventBridge’s event payload limit increased from 256 KB to 1 MB, allowing events to carry richer JSON, telemetry, ML, and generative AI data without external storage or fragmentation. - Lambda’s enhanced observability for Kafka event source mappings adds CloudWatch logs and metrics for polling, scaling, processing state, permissions, and failures. - The feature supports both Amazon MSK and self-managed Apache Kafka sources. ## CloudFormation and Community - AWS’s 2025 CloudFormation review covers improved troubleshooting, drift-aware change sets, stack refactoring, StackSets, the CloudFormation language server, and IaC MCP tooling. - AWS Community Day Romania will take place April 23–24, 2026, featuring technical sessions, AWS experts, and networking opportunities. Together, these updates point toward more private, observable, resilient, and AI-assisted AWS operations. Teams should evaluate the new capabilities against their security, scalability, and automation needs, particularly Bedrock agent tooling, S3 encryption updates, PrivateLink connectivity, and resilience testing.

Read original

Amazon Sagemaker AI Agents Generative AI Observability+4

awsDec 3, 2025Original article

New serverless customization in Amazon SageMaker AI accelerates model fine-tuning (opens in new tab)

Amazon SageMaker AI has introduced a new serverless customization capability designed to accelerate the fine-tuning of popular models like Llama, DeepSeek, and Amazon Nova. By automating resource provisioning and providing an intuitive interface for advanced reinforcement learning techniques, this feature reduces the model customization lifecycle from months to days. This end-to-end workflow allows developers to focus on model performance rather than infrastructure management, from initial training through to final deployment. **Automated Infrastructure and Model Support** * The service provides a serverless environment where SageMaker AI automatically selects and provisions compute resources based on the specific model architecture and dataset size. * Supported models include a broad range of high-performance options such as Amazon Nova, DeepSeek, GPT-OSS, Meta Llama, and Qwen. * The feature is accessible directly through the Amazon SageMaker Studio interface, allowing users to manage their entire model catalog in one location. **Advanced Customization and Reinforcement Learning** * Users can choose from several fine-tuning techniques, including traditional Supervised Fine-Tuning (SFT) and more advanced methods. * The platform supports modern optimization techniques such as Direct Preference Optimization (DPO), Reinforcement Learning from Verifiable Rewards (RLVR), and Reinforcement Learning from AI Feedback (RLAIF). * To simplify the process, SageMaker AI provides recommended defaults for hyperparameters like batch size, learning rate, and epochs based on the selected tuning technique. **Experiment Tracking and Security** * The workflow introduces a serverless MLflow application, enabling seamless experiment tracking and performance monitoring without additional setup. * Advanced configuration options allow for fine-grained control over network encryption and storage volume encryption to ensure data security. * The "Continue customization" feature allows for iterative tuning, where users can adjust hyperparameters or apply different techniques to an existing customized model. **Evaluation and Deployment Flexibility** * Built-in evaluation tools allow developers to compare the performance of their customized models against the original base models to verify improvements. * Once a model is finalized, it can be deployed with a few clicks to either Amazon SageMaker or Amazon Bedrock. * A centralized "My Models" dashboard tracks all custom iterations, providing detailed logs and status updates for every training and evaluation job. This serverless approach is highly recommended for teams that need to adapt large language models to specific domains quickly without the operational overhead of managing GPU clusters. By utilizing the integrated evaluation and multi-platform deployment options, organizations can transition from experimentation to production-ready AI more efficiently.

Amazon Sagemaker AI Large Language Models Machine Learning+5