AI

331 posts

figma3 min readCurated summary

Dylan Field and Garry Tan on design, AI, and the power of “locking in” | Figma Blog

AI is expanding what designers and product builders can explore, but it has not eliminated the need for human judgment, context, or craft. Dylan Field argues that design will become even more important as teams use AI to generate ideas and prototypes faster, while still needing expertise to turn them into thoughtful, polished products. The central challenge is closing the gap between making something work and making it work well. ## AI Expands the Design “Idea Maze” - Current AI systems primarily function as tools that augment people in specific tasks, rather than as general intelligence. - They lower the barrier to participating in design while also raising the ceiling on what experienced creators can accomplish. - AI allows teams to explore more branches of an “idea maze,” generating greater breadth during ideation. - However, meaningful progress still requires depth: teams must investigate, refine, and evaluate promising directions. ## The Value of Rapid Feedback and “Vibe Coding” - Terms such as “getting locked in,” “I’m cooking,” and “vibe coding” describe the flow state created by rapid experimentation. - Faster feedback loops help people move ideas from their heads onto the screen more fluidly. - Figma’s emphasis on play reflects the goal of making creative expression accessible and enjoyable, even for non-experts. - AI tools are increasingly effective at helping users start and prototype quickly. - The unresolved problem is helping users move from an exciting prototype to a finished, reliable product—an issue shared by both design and code-generation tools. ## Design Is More Than Functionality - Founders and teams increasingly recognize design as a source of product value. - The important question is no longer only whether software works, but how it works. - User experience, clarity, quality, and the overall interaction determine whether a product feels successful. ## Why Human Designers Still Matter - AI has developed along partly separate tracks: diffusion models address visual creation, while language models focus on reasoning and code generation. - It remains unclear how effectively these approaches can be combined into systems capable of true design. - Field describes design as “art as it applies to problem solving,” requiring more than producing an image or implementing a short specification. - Designers contribute context involving culture, brand, product experience, and the broader problem being addressed. - As software creation becomes more automated, the ability to supply judgment and context may make design an even more critical role. AI is best understood as a force multiplier for exploration and iteration, not a replacement for design expertise. Teams should use it to accelerate experimentation while preserving the human work required to select, shape, and finish products well.

Read original(opens in new tab)
microsoft2 min readCurated summary

How Microsoft Engineers Build AI: Learn about scalable RAG-enabled AI Apps

Microsoft’s new *How Microsoft Engineers Build AI* video series explains how its teams develop AI applications at scale. The first episode focuses on retrieval-augmented generation (RAG), using Copilot for Azure’s Ask Learn plugin as a practical example. It shows how RAG can combine proprietary data with large language models to deliver accurate, contextually relevant answers. ## Building AI Applications with RAG - RAG is presented as a practical way to improve AI applications without relying solely on model fine-tuning. - It retrieves relevant information from a knowledge base and provides that context to an LLM when generating responses. - The approach is useful for applications that need current, domain-specific, or proprietary information. ## The Ask Learn Plugin - Microsoft engineers explain how they built the Ask Learn RAG plugin for Copilot for Azure. - The plugin helps Azure developers find answers quickly within their existing workflow. - The project involved product managers and engineering leaders sharing development challenges, design decisions, and best practices. ## Challenges in Developing Reliable RAG - Selecting the right source content is essential for producing useful answers. - Data must be preprocessed effectively before it can be retrieved. - RAG systems require careful performance evaluation to measure accuracy and relevance. - Keeping responses accurate and up to date requires ongoing improvements to content and retrieval methods. ## Broader Microsoft Applications - The episode discusses RAG implementations across: - Copilot in Azure - Microsoft Security Copilot - Dynamics 365 Business Central - These examples demonstrate how RAG can support different products and business scenarios. The episode is intended as a practical introduction for developers building RAG-based applications, covering prototyping, data management, evaluation, and common pitfalls. Developers can explore the series alongside Microsoft Learn resources and Azure AI development tools such as Visual Studio and GitHub Copilot.

Read original(opens in new tab)
figma3 min readCurated summary

Meet the Makers Defining Tech’s Next Chapter | Figma Blog

The post previews Config 2025 and introduces speakers exploring how technology can become more human-centered. Their work spans AI-native devices, creator tools, AI interfaces, and expressive robotics. Together, they suggest that technology’s next chapter will depend not only on technical capability, but also on accessibility, empathy, and thoughtful design. ## Config 2025 and Its Vision - Figma’s Config conference will take place in San Francisco from May 6–8 and in London on May 14. - The event will examine how AI and automation are changing the way people create and experience technology. - Figma emphasizes tools and experiences that respond to evolving human needs. - In-person London tickets are sold out, while San Francisco tickets and free virtual attendance remain available. ## Building the Next Computing Platform - Andrew “Boz” Bosworth, Meta’s CTO and Head of Reality Labs, began coding through a 4-H club and later taught Mark Zuckerberg’s AI class at Harvard. - As Facebook’s 10th engineer, he helped create the News Feed. - He now leads Meta’s work on AR glasses, mixed-reality headsets, and the metaverse. - Bosworth envisions AI-native devices and proactive, personalized assistants becoming part of everyday computing. - At Config, he will discuss Meta’s efforts to develop a new computing platform. ## Making Creator Tools More Inclusive - Ebi Atawodi, Director of Product Management for YouTube Studio, combines experience in literature, technology, and product leadership. - Her work focuses on helping creators develop ideas and reach new audiences, including through AI-powered features. - Atawodi stresses that technology must be accessible and designed for people who have historically felt excluded by products. - Her approach centers on creating tools that serve a broad range of creators rather than assuming a single user experience. ## Designing Interfaces for Advanced AI - Joel Lewenstein, Head of Product Design at Anthropic, works on the interface for Claude. - He compares designing AI systems to watching a child discover new abilities, highlighting the uncertainty and possibility of emerging technology. - AI’s growing sophistication challenges traditional assumptions about how software interfaces should work. - Lewenstein argues that strong designers are defined more by how they think than by experience in a particular industry. ## Giving Robots Personality - Dr. Madeline Gannon uses her research studio, Atonaton, to transform industrial robots into expressive, lifelike mechanical creatures. - Supported by a Knight Foundation grant, she investigates how art and empathy can influence relationships with autonomous machines. - Her work explores how easily people attribute life and intention to nonliving objects. - Rather than reproducing the complexity of the human mind, Gannon demonstrates how movement, appearance, and context can make robots feel animated. Config’s featured makers represent a broad view of technological progress: more capable devices and systems must also be accessible, intuitive, expressive, and emotionally resonant. The conference aims to explore that balance through the experiences of people actively shaping AI, design, and robotics.

Read original(opens in new tab)
figma3 min readCurated summary

The Rise of the Generalist | Figma Blog

Generalist and hybrid roles are becoming more valuable as complex product problems increasingly cross traditional disciplinary boundaries. The article argues that AI will handle more specialized tasks, making human strengths such as connecting perspectives, asking valuable questions, and exercising judgment increasingly important. This does not eliminate specialization; instead, the strongest professionals combine deep expertise with complementary skills. ## Generalists Move Beyond Startups - Startups have long depended on employees who can switch between responsibilities, such as growth, UX writing, onboarding, and marketing. - Larger companies are increasingly recognizing that complex problems rarely fit within one job category. - Emerging hybrid roles include: - Full-stack marketers combining brand and performance marketing - Product managers fluent in design systems - Sales professionals experienced with multiple customer segments ## Breadth Versus Deep Expertise - Generalist careers offer: - More opportunities to change direction over a long career - Exposure to ideas and methods from different fields - Greater adaptability as technology and job requirements change - Specialists may worry that the push toward generalization devalues years of focused expertise. - The article’s position is not that specialization should disappear, but that deep expertise becomes more valuable when paired with complementary capabilities. ## The Rise of the Multi-Specialist - The “design engineer” illustrates how combined skills can create new, highly sought-after roles. - Design engineers can: - Turn ideas into working prototypes with less communication loss - Recognize technical constraints and opportunities early - Bridge design and engineering teams - Similar combinations apply elsewhere: - Designers who understand engineering can propose more feasible solutions. - Writers familiar with implementation can produce more cohesive documentation. - These professionals are not shallow dabblers; they develop meaningful expertise in multiple connected areas. ## Hybrid Roles Are Spreading - Companies are hiring for roles such as: - Operations Generalist at Linear - People Generalist at Datadog - Software and 3D Generalists at IBM - Multifaceted brand storytellers at Anthropic - The article notes that thousands of generalist positions appear in job listings. - These roles often emerge organically as people follow curiosity and build skills to fill gaps in their existing abilities. ## Generalists in an AI-Driven Economy - As AI becomes better at specialized tasks within defined boundaries, human value shifts toward: - Connecting insights across domains - Asking questions that bridge different perspectives - Identifying what is worth building, not merely what can be built - Applying taste and judgment to limited resources and attention - Specialists provide deep domain knowledge, while generalists help translate and combine that knowledge. - The most productive intersections often occur when one field is viewed through the lens of another. The practical recommendation is to retain deep expertise while deliberately developing adjacent skills. Curiosity-driven, cross-disciplinary learning can create rare capabilities and prepare professionals for roles that may not yet formally exist.

Read original(opens in new tab)
figma2 min readCurated summary

When To Off-Road the Product Roadmap | Figma Blog

Product roadmaps provide direction, but they should not become rigid commitments. Figma’s experience building Dev Mode shows that rapidly changing technology and user feedback often require teams to abandon planned work, pivot, or restart entirely. The best products are shaped by these course corrections rather than harmed by them. ## Why Traditional Roadmaps Need Flexibility - AI tools, agents, and coding assistants are accelerating product development and raising user expectations. - Six-to-twelve-month plans can become outdated before execution is complete. - Prescriptive roadmaps risk keeping teams committed to assumptions that are no longer valid. - Modern product development requires more experimentation, iteration, and willingness to change direction. ## Dev Mode’s Pivot from Code Generation - Figma initially envisioned Dev Mode as a way to automate the conversion of designs into code. - User feedback revealed that many developers already had reusable code for their design systems. - Developers often needed help assembling existing components rather than generating new CSS or code. - Figma shifted its focus to **Code Connect**, which lets teams customize the code snippets shown in Dev Mode using their existing design-system code. - The change delayed launches and frustrated people who had invested months in the original plan, but it better addressed user needs. ## Course Correction as a Product Strength - Figma argues that great products are often defined by twists and pivots. - Loom and Slack are cited as examples of companies that began with very different product concepts before finding their current direction. - Figma avoids letting sunk costs dictate future decisions. - Teams may abandon or restart projects when research, internal testing, or beta feedback shows that the product is not working. ## Learning Through Real-World Feedback - After Dev Mode’s 2023 beta, user feedback became more important than following the original roadmap. - Figma released more than 200 fixes and new features in a single month. - Rapid iteration can be frustrating, but it helps teams move toward outcomes that genuinely work for users. - Valuable information can come from user research, internal dogfooding, rapid prototypes, and beta programs. Teams should treat roadmaps as adaptable guides rather than fixed contracts. When evidence challenges the plan, experiment quickly, revisit assumptions, and be willing to go “off-road” to build the product users actually need.

Read original(opens in new tab)
figma2 min readCurated summary

The Best Advice to Bring to Work in 2025 | Figma Blog

The article gathers practical workplace advice from leaders at Ableton, Snapchat, Coda, and other companies. Their principles emphasize finding inspiration beyond familiar sources, automating low-value work, shortening users’ path to meaningful results, designing meetings around clear purposes, and maintaining momentum through difficult work. Together, they argue that effective work depends less on rigid formulas than on experience-based judgment. ## Look Beyond Design for Inspiration - Pablo Sánchez of Ableton recommends drawing ideas from emotions, memories, science, nature, and other fields—not just existing design conventions. - Designing for yourself first can produce work with genuine personal energy that resonates with users. - Ableton’s Note app borrowed from Brutalist architecture rather than traditional music software, creating a stripped-down experience focused on immediacy. ## Automate Work That Gets in the Way - Product managers should focus primarily on understanding customers, delivering value, and enabling sound decisions—not perfecting internal artifacts. - When documentation, reviews, or OKRs consume as much time as product development, teams should delegate or automate them. - Peter Yang uses AI to synthesize brainstorms, summarize customer feedback, and improve product requirement documents. ## Accelerate Users’ Time to “Magic” - Products should help new users reach their first meaningful “aha moment” quickly instead of overwhelming them with tutorials. - The goal is to move people from following instructions to confidently creating and sharing something of their own. - Snapchat’s Lens Studio team mapped the user journey and reduced the path from download to first submitted project from 19 steps to four milestones. ## Cultivate Different Types of Meetings - Coda’s Shishir Mehrotra distinguishes three meeting categories: - **Cadence meetings:** Regular staff meetings, standups, and syncs that track progress against goals. - **Catalyst meetings:** Decision-making forums, product reviews, and design critiques that resolve questions and drive change. - **Context meetings:** All-hands meetings, off-sites, and orientations that share information, establish context, and build connections. - Teams need a healthy balance, since too many catalyst meetings can cause burnout. ## Keep Moving Through Difficult Work - Dan Mall compares difficult progress to the tedious parts of training that are usually omitted from an exciting montage. - His advice is to build momentum to counteract the discouragement and monotony that can accompany worthwhile goals. The broader recommendation is to focus attention on meaningful outcomes: use unconventional sources of inspiration, remove unnecessary effort, guide users quickly toward value, give meetings a clear purpose, and keep building momentum when progress feels slow.

Read original(opens in new tab)
figma4 min readCurated summary

Figma 2024: We shipped it, you shaped it | Figma Blog

Figma’s 2024 product work was driven by community feedback, spanning 180 releases, UI3, AI tools, performance improvements, and new workflows for moving from concept to delivery. The company’s central conclusion is that meaningful progress comes from reducing friction while preserving designers’ existing habits. Community input shaped both major launches and small refinements across Figma, FigJam, and Figma Slides. ## UI3: Putting the Work Front and Center - Figma redesigned its interface for the first time substantially since 2019, updating typography, layout, colors, icons, labeling, and panel behavior. - Early UI3 testing revealed that floating panels disrupted users’ speed and daily workflows. - Based on feedback, panels became docked and resizable, while users could hide panels to maximize canvas space. - The eyedropper was upgraded to reuse styles and variables, switch between color formats, and create new styles or variables. ## Improving Core Design Workflows - Multi-edit simplified making changes across multiple designs. - Typography improvements added support for italic, bold, underline, underline styling, mixed paragraph spacing, and better local-font detection. - File organization improved through pinning, enhanced search filters, page dividers, and split tabs. - Drafts, content transfers, and file-moving workflows became easier for teams working across organizations. - “Suggest Auto Layout” helped users make designs more responsive. - Figma also introduced playful retro cursors inspired by DOS, Y2K, skeuomorphism, and Windows Vista. ## Performance, Collaboration, and Administration - Dynamic page loading made large design files more manageable. - Memory optimization and a revamped memory-management system improved performance in large files. - Multiplayer collaboration became smoother and more reliable. - Admin tools received new sidebar navigation and a dedicated content-management tab. - Infrastructure improvements included EU-localized file hosting, better support for large asset libraries, and stronger Enterprise security controls. ## AI Features That Reduce Friction - Visual search lets users find designs by uploading an image or selecting part of the canvas. - Asset search understands context instead of relying only on exact component names. - AI-assisted layer renaming improves file organization. - Replace Text Content generates realistic copy, while Rewrite, Translate, and Shorten help revise text. - Make an Image enables image creation and editing directly on the canvas, and Remove Background isolates subjects without requiring another tool. - FigJam’s AI mindmaps became a popular way to explore ideas and visualize connections. - Figma AI can turn a FigJam board into a Figma Slides outline and generate presenter notes. - First Draft, formerly Make Designs, was redesigned to help users move from an idea to an initial design. It was in limited beta, with planned support for custom libraries and deeper integration with existing design systems. ## Moving from Work in Progress to Shipping - Figma continued expanding tools intended to connect design work with development and presentation. - Dev Mode and Code Connect aimed to reduce developer context switching by translating design components into code. - Figma Slides supported creating high-fidelity presentations, extending Figma’s workflow beyond interface design. - The broader goal was to help teams move more smoothly from early concepts to implementation and delivery. ## Community-Led Product Development - Figma reported 10,000 Config attendees and more than 220 Friends of Figma groups worldwide. - Product decisions were shaped through beta testing, user conversations, and feedback from individual designers and organizations. - The company emphasized thoughtful AI development: AI should help express ideas and remove tedious work without replacing designers’ judgment. - Community members influenced both flagship features such as UI3 and First Draft and smaller quality-of-life improvements. Figma’s 2024 updates show a strategy focused on practical acceleration rather than novelty alone: improve the fundamentals, apply AI where it removes real friction, and build stronger bridges between design, development, and presentation. For teams, the most valuable improvements are likely the cumulative ones—better organization, faster search, stronger performance, and workflows shaped directly by how people already work.

Read original(opens in new tab)
coupangOriginal article

Optimizing Logistics Receiving Processes Using Machine (opens in new tab)

Coupang has implemented a machine learning-based prediction system to optimize its logistics inbound process by accurately forecasting the number of trucks required for product deliveries. By analyzing historical logistics data and vendor characteristics, the system minimizes resource waste at fulfillment center docks and prevents operational delays caused by slot shortages. This data-driven approach ensures that limited dock slots are allocated efficiently, improving overall supply chain speed and reliability. ### Challenges in Inbound Logistics * Fulfillment centers operate with a fixed number of "docks" for unloading and specific time "slots" assigned to each truck. * Inaccurate predictions create a resource dilemma: under-estimating slots causes unloading delays and backlogs, while over-estimating leads to idle docks and wasted capacity. * The goal was to move beyond manual estimation to an automated system that balances vendor requirements with actual facility throughput. ### Feature Engineering and Data Collection * The team performed Exploratory Data Analysis (EDA) on approximately 800,000 instances of inbound data collected over two years. * In-depth interviews with domain experts and logistics managers were conducted to identify hidden patterns and qualitative factors that influence truck requirements. * Final feature sets were refined through feature engineering, focusing on vendor-specific behaviors and the physical characteristics of the products being delivered. ### LightGBM Implementation and Optimization * The LightGBM algorithm was selected due to its high performance with large datasets and its efficiency in handling categorical features. * The model utilizes a leaf-wise tree growth strategy, which allows for faster training speeds and lower loss compared to traditional level-wise growth algorithms. * Hyperparameters were optimized using Bayesian Optimization, a method that finds the most effective model configurations more efficiently than traditional grid search methods. * The trained model is integrated directly into the booking system, providing real-time truck quantity recommendations to vendors during the application process. ### Operational Trade-offs and Results * The system must navigate the trade-off between under-prediction (which risks logistical bottlenecks) and over-prediction (which risks resource waste). * By automating the prediction of necessary slots, Coupang has reduced the manual workload for vendors and improved the accuracy of fulfillment center scheduling. * This optimization allows for more products to be processed in a shorter time frame, directly contributing to faster delivery times for the end customer. By replacing manual estimates with a LightGBM-based predictive model, Coupang has successfully synchronized vendor deliveries with fulfillment center capacity. This technical shift not only maximizes dock utilization but also builds a more resilient and scalable inbound supply chain.

coupangOriginal article

Accelerating ML development through Cou (opens in new tab)

Coupang’s internal Machine Learning (ML) platform serves as a standardized ecosystem designed to accelerate the transition from experimental research to stable production services. By centralizing core functions like automated pipelines, feature engineering, and scalable inference, the platform addresses the operational complexities of managing ML at an enterprise scale. This infrastructure allows engineers to focus on model innovation rather than manual resource management, ultimately driving efficiency across Coupang’s diverse service offerings. ### Addressing Scalability and Development Bottlenecks * The platform aims to drastically reduce "Time to Market" by providing "ready-to-use" services that eliminate the need for engineers to build custom infrastructure for every model. * Integrating Continuous Integration and Continuous Deployment (CI/CD) into the ML lifecycle ensures that updates to data, code, and models are handled with the same rigor as traditional software engineering. * By optimizing ML computing resources, the platform allows for the efficient scaling of training and inference workloads, preventing infrastructure costs from spiraling as the number of models grows. ### Core Services of the ML Platform * **Notebooks and Pipelines:** Integrated Jupyter environments allow for ad-hoc exploration, while workflow orchestration tools enable the construction of reproducible ML pipelines. * **Feature Engineering:** A dedicated feature store facilitates the reuse of data components and ensures consistency between the features used during model training and those used in real-time inference. * **Scalable Training and Inference:** The platform provides dedicated clusters for high-performance model training and robust hosting services for real-time and batch model predictions. * **Monitoring and Observability:** Automated tools track model performance and data drift in production, alerting engineers when a model’s accuracy begins to degrade due to changing real-world data. ### Real-World Success in Search and Pricing * **Search Query Understanding:** The platform enabled the training of Ko-BERT (Korean Bidirectional Encoder Representations from Transformers), significantly improving the accuracy of search results by better understanding customer intent. * **Real-time Dynamic Pricing:** Using the platform’s low-latency inference services, Coupang can predict and adjust product prices in real-time based on fluctuating market conditions and inventory levels. To maintain a competitive edge in e-commerce, organizations should transition away from fragmented, ad-hoc ML workflows toward a unified platform that treats ML as a first-class citizen of the software development lifecycle. Investing in such a platform not only speeds up deployment but also ensures the long-term reliability and observability of production models.

coupangOriginal article

Optimizing the inbound process with a machine learning model (opens in new tab)

Coupang optimized its fulfillment center inbound process by implementing a machine learning model to predict the exact number of delivery trucks and dock slots required for vendor shipments. By moving away from manual estimates, the system minimizes resource waste from over-allocation while preventing processing delays caused by under-prediction. This automated approach ensures that the limited capacity of fulfillment center docks is utilized with maximum efficiency. ### The Challenges of Dock Slot Allocation * Fulfillment centers operate with a fixed number of hourly "slots," representing the time and space a single truck occupies at a dock to unload goods. * Inaccurate slot forecasting creates a binary risk: under-prediction leads to logistical bottlenecks and delivery delays, while over-prediction results in idle docks and wasted operational overhead. * The diversity of vendor behaviors and product types makes manual estimation of truck requirements highly inconsistent across the supply chain. ### Predictive Modeling and Feature Engineering * Coupang utilized years of historical logistics data to extract features influencing truck counts, including product dimensions, categories, and vendor-specific shipment patterns. * The system employs the LightGBM algorithm, a gradient-boosting framework selected for its high performance and ability to handle large-scale tabular logistics data. * Hyperparameter tuning is managed via Bayesian optimization, which efficiently searches the parameter space to minimize prediction error. * The model accounts for the inherent trade-off between under-prediction and over-prediction, prioritizing a balance that maintains high throughput without straining labor resources. ### System Integration and Real-time Processing * The trained ML model is integrated directly into the inbound reservation system, providing vendors with an immediate prediction of required slots during the request process. * By automating the truck-count calculation, the system removes the burden of estimation from vendors and ensures consistency across different fulfillment centers. * This integration allows Coupang to dynamically adjust its dock capacity planning based on real-time data rather than static, historical averages. To maximize logistics efficiency, organizations should leverage granular product data and historical vendor behavior to automate capacity planning. Integrating predictive models directly into the reservation workflow ensures that data-driven insights are applied at the point of action, reducing human error and resource waste.

coupangOriginal article

Accelerating Coupang’s AI Journey with LLMs (opens in new tab)

Coupang is strategically evolving its machine learning infrastructure to integrate Large Language Models (LLMs) and foundation models across its e-commerce ecosystem. By transitioning from task-specific deep learning models to multi-modal transformers, the company aims to enhance customer experiences in search, recommendations, and logistics. This shift necessitates a robust ML platform capable of handling the massive compute, networking, and latency demands inherent in generative AI. ### Core Machine Learning Domains Coupang’s existing ML ecosystem is built upon three primary pillars that drive business logic: * **Recommendation Systems:** These models leverage vast datasets of user interactions—including clicks, purchases, and relevance judgments—to power home feeds, search results, and advertising. * **Content Understanding:** Utilizing deep learning to process product catalogs, user reviews, and merchant data to create unified representations of customers and products. * **Forecasting Models:** Predictive algorithms manage over 100 fulfillment centers, optimizing pricing and logistics for millions of products through a mix of statistical methods and deep learning. ### Enhancing Multimodal and Language Understanding The adoption of Foundation Models (FM) has unified previously fragmented ML tasks, particularly in multilingual environments: * **Joint Modeling:** Instead of separate embeddings, vision and language transformer models jointly model product images and metadata (titles/descriptions) to improve ad retrieval and similarity searches. * **Cross-Border Localization:** LLMs facilitate the translation of product titles from Korean to Mandarin and improve the quality of shopping feeds for global sellers. * **Weak Label Generation:** To overcome the high cost of human labeling in multiple languages, Coupang uses LLMs to generate high-quality "weak labels" for training downstream models, addressing label scarcity in under-resourced segments. ### Infrastructure for Large-Scale Training Scaling LLM training requires a shift in hardware architecture and distributed computing strategies: * **High-Performance Clusters:** The platform utilizes H100 and A100 GPU clusters interconnected with high-speed InfiniBand or RoCE (RDMA over Converged Ethernet) networking to minimize communication bottlenecks. * **Distributed Frameworks:** To fit massive models into GPU memory, Coupang employs various parallelism techniques, including Fully Sharded Data Parallelism (FSDP), Tensor Parallelism (TP), and Pipeline Parallelism (PP). * **Efficient Categorization:** Traditional architectures that required a separate model for every product category are being replaced by a single, massive multi-modal transformer capable of handling categorization and attribute extraction across the entire catalog. ### Optimizing LLM Serving and Inference The transition to real-time generative AI features requires significant optimizations to manage the high computational cost of inference: * **Quantization Strategies:** To reduce memory footprint and increase throughput, models are compressed using FP8, INT8, or INT4 precision without significant loss in accuracy. * **Advanced Serving Techniques:** The platform implements Key-Value (KV) caching to avoid redundant computations during text generation and utilizes continuous batching (via engines like vLLM or TGI) to maximize GPU utilization. * **Lifecycle Management:** A unified platform vision ensures that the entire end-to-end lifecycle—from data preparation and fine-tuning to deployment—is streamlined for ML engineers. To stay competitive, Coupang is moving toward an integrated AI lifecycle where foundation models serve as the backbone for both content generation and predictive analytics. This infrastructure-first approach allows for the rapid deployment of generative features while maintaining the resource efficiency required for massive e-commerce scales.

coupangOriginal article

Meet Coupang’s Machine Learning Platform (opens in new tab)

Coupang’s internal Machine Learning Platform (MLP) is a comprehensive "batteries-included" ecosystem designed to streamline the end-to-end lifecycle of ML development across its diverse business units, including e-commerce, logistics, and streaming. By providing standardized tools for feature engineering, pipeline authoring, and model serving, the platform significantly reduces the time-to-production while enabling scalable, efficient compute management. Ultimately, this infrastructure allows Coupang to leverage advanced models like Ko-BERT for search and real-time forecasting to enhance the customer experience at scale. **Motivation for a Centralized Platform** * **Reduced Time to Production:** The platform aims to accelerate the transition from ad-hoc exploration to production-ready services by eliminating repetitive infrastructure setup. * **CI/CD Integration:** By incorporating continuous integration and delivery into ML workflows, the platform ensures that experiments are reproducible and deployments are reliable. * **Compute Efficiency:** Managed clusters allow for the optimization of expensive hardware resources, such as GPUs, across multiple teams and diverse workloads like NLP and Computer Vision. **Notebooks and Pipeline Authoring** * **Managed Jupyter Notebooks:** Provides data scientists with a standardized environment for initial data exploration and prototyping. * **Pipeline SDK:** Developers can use a dedicated SDK to define complex ML workflows as code, facilitating the transition from research to automated pipelines. * **Framework Agnostic:** The platform supports a wide range of ML frameworks and programming languages to accommodate different model architectures. **Feature Engineering and Data Management** * **Centralized Feature Store:** Enables teams to share and reuse features, reducing redundant data processing and ensuring consistency across the organization. * **Consistent Data Pipelines:** Bridges the gap between offline training and online real-time inference by providing a unified interface for data transformations. * **Large-scale Preparation:** Streamlines the creation of training datasets from Coupang’s massive logs, including product catalogs and user behavior data. **Training and Inference Services** * **Scalable Model Training:** Handles distributed training jobs and resource orchestration, allowing for the development of high-parameter models. * **Robust Model Inference:** Supports low-latency model serving for real-time applications such as ad ranking, video recommendations in Coupang Play, and pricing. * **Dedicated Infrastructure:** Training and inference clusters abstract the underlying hardware complexity, allowing engineers to focus on model logic rather than server maintenance. **Monitoring and Observability** * **Performance Tracking:** Integrated tools monitor model health and performance metrics in live production environments. * **Drift Detection:** Provides visibility into data and model drift, ensuring that models remain accurate as consumer behavior and market conditions change. For organizations looking to scale their AI capabilities, investing in an integrated platform that bridges the gap between experimentation and production is essential. By standardizing the "plumbing" of machine learning—such as feature stores and automated pipelines—companies can drastically increase the velocity of their data science teams and ensure the long-term reliability of their production models.

figma2 min readCurated summary

The Long and Short of It: Issue no.6 | Figma Blog

Figma’s sixth issue of *The Prompt* examines how AI is changing design, engineering, product development, and human curiosity. Its central argument is that adopting AI requires more than learning new tools: it requires understanding which human skills—judgment, creativity, problem selection, and curiosity—remain essential. The issue presents AI as a collaborator that can expand creative and technical work without replacing the craft behind it. ## AI and the Future of Design - Figma’s design leaders ask what “good design” means as AI makes product development more accessible. - As execution becomes easier to automate, design judgment and strong craft principles become more important differentiators. - The focus is on building practical, thoughtful products with AI rather than pursuing novelty for its own sake. ## What Engineers Contribute Beyond Code - Figma CTO Kris Rasmussen argues that engineering is not merely the production of code. - Engineers provide value by identifying which problems matter and determining effective ways to solve them. - AI may commoditize portions of coding, but it also creates space for engineers to focus on architecture, judgment, problem framing, and higher-level innovation. ## Curiosity and Judgment-Free Questions - Perplexity CEO Aravind Srinivas describes AI-powered search as a continuation of encyclopedias and wikis. - The goal is to give people a source of answers without the social pressure or embarrassment that can inhibit curiosity. - AI can act as a “copilot” for exploration, though improving the reliability and usefulness of its answers remains an ongoing challenge. ## Humanoid Robots and Embodied AI - The issue considers whether humanoid robots are finally moving from science fiction into everyday reality. - Androids reflect humanity’s longstanding fascination with reproducing intelligence and ourselves in technological form. - Conversations with robotics builders explore both the promise and the risks of giving AI a physical body. ## The Role of Print and Material Experience - *The Prompt* is also an 80-page print magazine produced with Figma’s Brand Studio and designer Chloe Scheffe. - Vellum paper, illustration, color, layout, and physical materiality interpret the issue’s themes. - The print edition emphasizes experiences that digital tools and AI cannot fully reproduce, reinforcing the value of tangible, intentional creative work. AI’s greatest potential lies in extending human abilities rather than eliminating them. Designers and engineers should use it to increase experimentation and efficiency while preserving the judgment, creativity, and curiosity that give their work meaning.

Read original(opens in new tab)
figma2 min readCurated summary

An Update on our Make Designs Feature | Figma Blog

Figma temporarily disabled its Make Designs AI feature after discovering that some generated mockups closely resembled real applications, including Apple’s weather app. The issue came not from model training, but from insufficiently reviewed components and example screens in Figma’s custom design systems. Figma removed the problematic assets and planned stronger quality assurance before relaunching the feature, later bringing it back under the name First Draft with updates. ## How Make Designs Works - Combines an AI model, contextual design-system data, and a user prompt. - Uses generally available models such as OpenAI’s GPT-4o and Amazon Titan, without additional fine-tuning. - Relies on separate mobile and desktop design systems containing hundreds of components and example compositions. - The language model selects, arranges, parameterizes, and themes components based on the prompt. - Amazon Titan generates the images used in the resulting designs. ## What Went Wrong - Figma reviewed the design systems during development and private beta testing. - Shortly before Config 2024, new components and example screens were added without sufficient vetting. - Some assets resembled patterns from real-world applications. - A prompt for a weather app produced results that appeared notably similar to Apple’s first-party design. - The incident was identified after designer Andy Allen raised the concern, prompting an immediate investigation. ## Figma’s Response - The team traced the similarities to assets in the underlying design systems. - Problematic components and examples were removed. - Make Designs was rolled back and disabled. - Figma postponed relaunching the feature while developing a more robust QA process. ## Future Direction - Make Designs was originally called “First Draft” to emphasize that AI output is only a starting point. - Figma wants users eventually to connect the feature to their own company design systems. - This could reduce the time spent locating, assembling, and configuring components. - Figma maintains that designers remain essential for refining drafts into meaningful user experiences. - The feature was later re-enabled with updates and renamed First Draft. Figma’s experience highlights the need to carefully audit not only AI models but also the data, components, and examples supplied to them. AI-generated designs should be treated as starting points that require professional review and creative refinement.

Read original(opens in new tab)
figma2 min readCurated summary

What is Good Design in the Age of AI? | Figma Blog

AI is making product creation faster and more accessible, increasing the importance of design as a differentiator. Figma argues that designers should not chase automation or trends, but apply enduring principles such as empathy, creativity, and solving real user needs. The future of good design will depend on experimentation, stronger design-to-code connections, pragmatism, and new forms of human–AI collaboration. ## AI Creates a New Design Inflection Point - Like the iPhone’s launch in 2007, AI is introducing a new medium that requires experimentation and the development of new interaction patterns. - Early mobile products often forced desktop experiences onto smaller screens; today, many AI products similarly rely on basic chatbots and templates. - Designers can unlock AI’s potential through: - Richer interactions - Intuitive gestures - Patterns designed specifically for AI - AI can generate code, designs, and complete applications from prompts, allowing teams to move rapidly from concept to creation. - As more people participate in product development, thoughtful design becomes increasingly important for products to stand out. ## Codifying the Fundamentals of Good Design - Figma’s AI feature for generating initial UI drafts needed to understand the mechanics of good design. - Because large language models are text-oriented, generating high-quality visual interfaces is more difficult than generating text or code. - A complete rulebook for design is impractical: - Good design contains too many contextual details to define exhaustively. - Extremely large prompts exceed technical token limits. - Figma instead focused on reducing design expertise to a small set of broadly applicable principles. - Teaching AI requires designers to make their intuitive knowledge explicit by creating rules that are: - Clear - Concrete - Practical - General enough to apply across many interfaces - The process resembles teaching design: instructors must break complex judgment into principles that others can understand and use. ## Design’s Continuing Role - AI should elevate design rather than simply automate it. - The most valuable design foundations remain relatively constant despite technological change. - Designers’ roles may evolve, but their understanding of users, creativity, and ability to solve meaningful problems remain essential. ## Practical Direction Teams should treat AI as a new design medium, not merely an automation tool. They should experiment with AI-native interaction patterns while grounding products in concise, teachable design principles and genuine user needs.

Read original(opens in new tab)