Generative AI

125 posts

googleOriginal article

Google Research at Google I/O 2025 (opens in new tab)

Google Research at I/O 2025 showcases the "research to reality" transition, highlighting how years of foundational breakthroughs are now being integrated into Gemini models and specialized products. By focusing on multimodal capabilities, pedagogy, and extreme model efficiency, Google aims to democratize access to advanced AI while ensuring it remains grounded and useful across global contexts. ## Specialized Healthcare Models: MedGemma and AMIE * **MedGemma:** This new open model, based on Gemma 3, is optimized for multimodal medical tasks such as radiology image analysis and clinical data summarization. It is available in 4B and 27B sizes, performing similarly to much larger models on the MedQA benchmark while remaining small enough for efficient local fine-tuning. * **AMIE (Articulate Medical Intelligence Explorer):** A research AI agent designed for diagnostic medical reasoning. Its latest multimodal version can now interpret and reason about visual medical information, such as skin lesions or medical imaging, to assist clinicians in diagnostic accuracy. ## Educational Optimization through LearnLM * **Gemini 2.5 Pro Integration:** The LearnLM family of models, developed with educational experts, is now integrated into Gemini 2.5 Pro. This fine-tuning enhances STEM reasoning, multimodal understanding, and pedagogical feedback. * **Interactive Learning Tools:** A new research-optimized quiz experience allows students to generate custom assessments from their own notes, providing specific feedback on right and wrong answers rather than just providing solutions. * **Global Assessment Pilots:** Through partnerships like the one with Kayma, Google is testing the automatic assessment of short and long-form content in regions like Ghana to scale quality educational tools. ## Multilingual Expansion and On-Device Gemma Models * **Gemma 3 and 3n:** Research breakthroughs have expanded Gemma 3’s support to over 140 languages. The introduction of **Gemma 3n** targets extreme efficiency, capable of running on devices with as little as 2GB of RAM while maintaining low latency and low energy consumption. * **ECLeKTic Benchmark:** To assist the developer community, Google introduced this novel benchmark specifically for evaluating how well large language models transfer knowledge across different languages. ## Model Efficiency and Factuality in Search * **Inference Techniques:** Google Research continues to set industry standards for model speed and accessibility through technical innovations like **speculative decoding** and **cascades**, which reduce the computational cost of generating high-quality responses. * **Grounded Outputs:** Significant focus remains on factual consistency, ensuring that the AI models powering features like AI Overviews in Search provide reliable and grounded information to users. As Google continues to shrink the gap between laboratory breakthroughs and consumer products, the emphasis remains on making high-performance AI accessible on low-cost hardware and across diverse linguistic landscapes. Developers and researchers can now leverage these specialized tools via platforms like HuggingFace and Vertex AI to build more targeted, efficient applications.

lineOriginal article

How to evaluate AI-generated images? (opens in new tab)

To optimize the Background Person Removal (BPR) feature in image editing services, the LY Corporation AMD team evaluated various generative AI inpainting models to determine which automated metrics best align with human judgment. While traditional research benchmarks often fail to reflect performance in high-resolution, real-world scenarios, this study identifies a framework for selecting models that produce the most natural results. The research highlights that as the complexity and size of the masked area increase, the gap between model performance becomes more pronounced, requiring more sophisticated evaluation strategies. ### Background Person Removal Workflow * **Instance Segmentation:** The process begins by identifying individual pixels to classify objects such as people, buildings, or trees within the input image. * **Salient Object Detection:** This step distinguishes the main subjects of the photo from background elements to ensure only unwanted figures are targeted for removal. * **Inpainting Execution:** Once the background figures are removed, inpainting technology is used to reconstruct the empty space so it blends seamlessly with the surrounding environment. ### Comparison of Inpainting Technologies * **Diffusion-based Models:** These models, such as FLUX.1-Fill-dev, restore damaged areas by gradually removing noise. While they excel at restoring complex details, they are generally slower than GANs and can occasionally generate artifacts. * **GAN-based Models:** Using a generator-discriminator architecture, models like LaMa and HINT offer faster generation speeds and competitive performance for lower-resolution or smaller inpainting tasks. * **Performance Discrepancy:** Experiments showed that while most models perform well on small areas, high-resolution images with large missing sections reveal significant quality differences that are not always captured in standard academic benchmarks. ### Evaluation Methodology and Metrics * **BPR Evaluation Dataset:** The team curated a specific dataset of 10 images with high quality-variance to test 11 different inpainting models released between 2022 and 2024. * **Single Image Quality Metrics:** Evaluated models using LAION Aesthetics score-v2, CLIP-IQA, and Q-Align to measure the aesthetic quality of individual generated frames. * **Preference and Reward Models:** Utilized PickScore, ImageReward, and HPS v2 to determine which generated images would be most preferred by human users. * **Objective:** The goal of these tests was to find an automated evaluation method that minimizes the need for expensive and time-consuming human reviews while maintaining high reliability. Selecting an inpainting model based solely on paper-presented metrics is insufficient for production-level services. For features like BPR, it is critical to implement an evaluation pipeline that combines both aesthetic scoring and human preference models to ensure consistent quality across diverse, high-resolution user photos.

lineOriginal article

How to evaluate AI-generated images? (opens in new tab)

LY Corporation is developing a text-to-image pipeline to automate the creation of branded character illustrations, aiming to reduce the manual workload for designers. The project focuses on utilizing Stable Diffusion and Flow Matching models to generate high-quality images that strictly adhere to specific corporate style guidelines. By systematically evaluating model architectures and hyperparameters, the team seeks to transform subjective image quality into a quantifiable and reproducible technical process. ### Evolution of Image Generation Models * **Diffusion Models:** These models generate images through a gradual denoising process. They use a forward process to add Gaussian noise via a Markov chain and a reverse process to restore the original image based on learned probability distributions. * **Stable Diffusion (SD):** Unlike standard diffusion that operates in pixel space, SD works within a "latent space" using a Variational Autoencoder (VAE). This significantly reduces computational load by denoising latent vectors rather than raw pixels. * **SDXL and SD3.5:** SDXL improves prompt comprehension by adding a second text encoder (CLIP-G/14). SD3.5 introduces a major architectural shift by moving from diffusion to "Flow Matching," utilizing a Multimodal Diffusion Transformer (MMDiT) that handles text and image modalities in a single block for better parameter efficiency. * **Flow Matching:** This approach treats image generation as a deterministic movement through a vector field. Instead of removing stochastic noise, it learns the velocity required to transform a simple probability distribution into a complex data distribution. ### Core Hyperparameters for Output Control * **Seeds and Latent Vectors:** The seed is the integer value that determines the initial random noise. Since Stable Diffusion operates in latent space, this noise is essentially the starting latent vector that dictates the basic structure of the final image. * **Prompts:** Textual inputs serve as the primary guide for the denoiser. Models are trained on image-caption pairs, allowing the U-Net or Transformer blocks to align the visual output with the user’s descriptive intent. * **Classifier-Free Guidance (CFG):** This parameter adjusts the weight of the prompt's influence. It calculates the difference between noise predicted with a prompt and noise predicted without one (or with a negative prompt), allowing users to control how strictly the model follows the text instructions. ### Practical Recommendation To achieve consistent results that match a specific brand identity, it is insufficient to rely on prompts alone; developers should implement automated hyperparameter search and black-box optimization. Transitioning to Flow Matching models like SD3.5 can provide a more deterministic generation path, which is critical when attempting to scale the production of high-quality, branded assets.

googleOriginal article

Bringing 3D shoppable products online with generative AI (opens in new tab)

Google has developed a series of generative AI techniques to transform standard 2D product images into immersive, interactive 3D visualizations for online shopping. By evolving from early neural reconstruction methods to state-of-the-art video generation models like Veo, Google can now produce high-quality 360-degree spins from as few as three images. This progression significantly reduces the cost and complexity for businesses to create shoppable 3D experiences at scale across diverse product categories. ## First Generation: Neural Radiance Fields (NeRFs) * Launched in 2022, this initial approach utilized NeRF technology to synthesize novel views and 360° spins, specifically for footwear on Google Search. * The system required five or more images and relied on complex sub-processes, including background removal, XYZ prediction (NOCS), and camera position estimation. * While a breakthrough, the technology struggled with "noisy" signals and complex geometries, such as the thin structures found in sandals or high heels. ## Second Generation: View-Conditioned Diffusion * Introduced in 2023, this version addressed previous limitations by using a diffusion-based architecture to predict unseen viewpoints from limited data. * The model utilized Score Distillation Sampling (SDS), which compares rendered 3D models against generated targets to iteratively refine parameters for better realism. * This approach allowed Google to scale 3D visualizations to the majority of shoes viewed on Google Shopping, handling more diverse and difficult footwear styles. ## Third Generation: Generalizing with Veo * The current advancement leverages Google’s Veo video generation model to transform product images into consistent, high-fidelity 360° videos. * By training on millions of synthetic 3D assets, Veo captures complex interactions between light, texture, and geometry, making it effective for shiny surfaces and diverse categories like electronics and furniture. * This method removes the need for precise camera pose estimation, increasing reliability across different environments. * While the model can generate a 3D representation from a single image by "hallucinating" missing details, using three images significantly reduces errors and ensures high-fidelity accuracy. These technological milestones mark a shift from specialized 3D reconstruction toward generalized AI models that make digital products feel tangible and interactive for consumers.

figma2 min readCurated summary

Config 2025 Launches Deepen Figma's Design Capabilities As Its Platform Expands | Figma Blog

Figma’s Config 2025 announcements expand the platform from collaborative design into a broader product-development environment. New tools combine AI, code, visual design, websites, and marketing workflows, enabling teams to move from ideas to production within Figma. The company’s conclusion is that design and AI can help more people contribute throughout the development lifecycle. ## New Products - **Figma Make** turns written prompts or existing designs into working prototypes and applications. - **Figma Sites** lets designers build and publish dynamic websites with customizable interactions, code, and AI. - **Figma Draw** adds advanced vector editing and illustration tools to Figma Design. - **Figma Buzz** helps brand and marketing teams produce visual assets at scale while preserving brand consistency, with integrated AI features. ## Expanded AI Capabilities - New image-generation and image-editing tools support faster visual exploration. - Contextual auto-suggestions provide workflow guidance and help users work more efficiently. - FigJam receives additional AI features for brainstorming and collaboration. - Together with Figma Make, these tools are intended to make ideas easier to visualize and turn into functional outputs. ## Responsive Design and Developer Handoff - **Grid** introduces responsive layouts that adapt across screen sizes. - Grid can generate CSS code in Dev Mode, improving communication between designers and developers. - The feature supports Figma’s broader effort to connect design work more directly with implementation. ## Figma’s Expanding Platform - The new offerings join Figma Design, FigJam, Dev Mode, and Figma Slides. - About two-thirds of monthly active users in Q4 2024 worked outside traditional design roles, including roughly 30% who identified as developers. - The announcements reflect Figma’s shift from a design tool toward an integrated platform for ideation, design, development, publishing, and marketing. ## Global Growth - Figma announced full localization for Brazil, including Portuguese translation, culturally adapted interfaces, and dedicated language support. - Brazilian support joins existing Japanese, Spanish, and Korean localization. - Approximately 85% of Figma’s monthly active users were outside the United States in Q4 2024, while more than half of its 2024 revenue came from non-U.S. markets. - The company now employs more than 1,600 people worldwide. The new products and features will roll out over the following weeks. Overall, Figma is positioning itself as a unified environment where designers, developers, marketers, and other collaborators can take products from early concepts through launch.

Read original(opens in new tab)
figma2 min readCurated summary

Introducing Figma Make: A New Way to Test, Edit, and Prompt Designs | Figma Blog

Figma Make is Figma’s new prompt-to-app tool for turning designs into interactive, testable experiences. It allows designers and product teams to start with existing Figma frames, add behavior through natural-language prompts, and iterate collaboratively without rebuilding everything in code. Figma’s goal is to make exploration faster while preserving design intent, structure, and craft. ## Start with Existing Designs - Users can copy frames from Figma Design into Figma Make, including their structure and metadata. - Natural-language prompts transform static designs into interactive prototypes. - The tool is designed to support the entire design process, from early sketches to developed prototypes. - Figma Make currently uses Claude 3.7 Sonnet, with additional models planned. ## Turn Static Designs into Interactive Experiences - Add animations, interactive buttons, and real-time feedback without complex coding. - Test features using dynamic data, including file uploads and data visualizations. - Adapt designs across platforms and form factors, such as converting a mobile app design into a desktop version. - Future capabilities are expected to include third-party database integrations and design-system support. ## Real-Time Collaborative Exploration - Figma Make is built into the Figma platform and supports multiplayer collaboration. - Designers, product managers, and other team members can add features, test interactions, and incorporate data in the same file. - By reducing the need for coding expertise, it enables broader participation in product exploration. ## Point-and-Prompt Editing - Users can select a specific element and describe the desired behavior, such as animating a button or responding to scrolling. - This approach connects design intent directly to functional implementation. - Figma Make preserves component hierarchies and design-system structure while adding interactive behavior. ## From Canvas to Code and Publication - Figma Make connects with existing Figma workflows, including Figma Design and Figma Sites. - Teams can move from concept to prototype to published site without switching tools or recreating work. - The workflow is intended to provide a continuous path from visual design through implementation. Figma Make is positioned as a complement to—not a replacement for—traditional design work. Its practical value is in helping teams validate ideas sooner, explore more alternatives, and communicate functionality while retaining the original design’s structure and intent.

Read original(opens in new tab)
figma3 min readCurated summary

Figma Launches Brazilian Portuguese Localization | Figma Blog

Figma is launching a full Brazilian Portuguese localization on May 7, expanding its global reach and reducing language barriers for Brazilian users. The release includes translated interfaces, cultural adaptations, and Portuguese-language support. It follows Figma’s growing adoption in Brazil, where millions of files are created annually, with Latin American Spanish planned for later this year. ## Brazilian Market Expansion - Brazilian Portuguese is Figma’s fourth localized product language, after Japanese, Spanish, and Korean. - Brazil has a substantial Figma user base, including enterprises such as iFood, Itaú Unibanco, Nubank, Mercado Libre, TOTVS, and BTG Pactual. - More than one-third of Brazil’s Ibovespa-listed companies use Figma. - Nearly 5.5 million Figma files were created in Brazil over the past year, with more than 85,000 edited daily. - The São Paulo Friends of Figma community has nearly 1,000 active members. ## Localization and Accessibility - The localization provides: - A complete Brazilian Portuguese product translation - Culturally adapted interfaces - Dedicated support for Portuguese-speaking users - Figma says the goal is to make its tools feel more native and intuitive while encouraging broader collaboration among designers, developers, and other contributors. - Customers such as Itaú Unibanco and Mercado Libre expect the change to reduce friction and make Figma more accessible to Brazilian teams. ## Figma’s Global User Base - Approximately 85% of Figma’s monthly active users were outside the United States in Q4 2024. - More than half of the company’s 2024 revenue came from non-U.S. markets. - About two-thirds of monthly active users work outside traditional design roles, including roughly 30% who identify as developers. ## Expanding Product Ecosystem Figma’s localization arrives as the company expands its tools across the full product development lifecycle: - **Figma Design:** Digital product exploration, iteration, and prototyping. - **FigJam:** Collaborative whiteboarding, brainstorming, and meetings. - **Dev Mode:** Design-to-code handoff and developer workflows. - **Figma Slides:** Collaborative creation of interactive presentations. ## New Products and Features Announced updates at the Config conference include: - **Figma Make:** An AI prompt-to-code tool for creating prototypes and applications from descriptions or existing designs. - **Figma Sites:** Tools for designing and publishing dynamic, highly customizable websites. - **Figma Draw:** Enhanced vector editing and illustration capabilities. - **Figma Buzz:** Brand and marketing asset creation at scale, with AI support and brand-consistency controls. - **Enhanced AI features:** Image generation and editing, contextual workflow suggestions, and new FigJam capabilities. - **Grid:** Responsive layouts that can generate CSS code in Dev Mode. These products and features are scheduled to begin rolling out in the weeks following the announcement. Figma also plans to launch Latin American Spanish localization later in the year. Figma’s Brazilian Portuguese release is both a response to strong local demand and part of its broader strategy to make collaborative design and development accessible to a global audience.

Read original(opens in new tab)
figma2 min readCurated summary

Figma Buzz Is Where Design and Marketing Teams Co-create | Figma Blog

Figma Buzz is a new open-beta workspace designed to help brand designers and marketers create on-brand assets together. It addresses fragmented tools and workflows by combining Figma’s design precision with approachable editing and reusable templates. The product aims to speed up production while letting marketing teams create independently within brand guidelines. ## A Shared Space for Design and Marketing - Product launches require extensive marketing materials beyond the original design work. - Designers often need control and precision, while marketers need simple tools for adapting content quickly. - Figma Buzz brings both groups into one collaborative environment. - Designers can copy existing Figma designs into Buzz, build templates, or create assets directly with Figma Design functionality. - Marketers can customize materials without worrying about departing from brand standards. ## Types of Assets Figma Buzz supports a broad range of branded content, including: - Social media posts in multiple platform-specific sizes - Digital display and social advertisements - Flyers, email headers, and promotional announcements - Event invitations, schedules, and badges - Internal communications such as signage, infographics, and one-pagers - Personalized cards and other celebration materials ## Flexible Ways to Start Users can begin creating assets in several ways: - Choose from pre-made templates. - Start with a blank design. - Create images using OpenAI’s `gpt-image-1` or Gemini. - Copy and paste designs from Figma Design. - Use an intuitive inline toolbar for editing. The examples highlighted include Instagram feed and story ads, Pinterest and Twitter/X promotional posts, event invitations, and thank-you cards. Figma Buzz is intended to reduce repetitive executional work, allowing creative teams to focus more on brand strategy and larger ideas while giving marketers the tools to produce high-quality content quickly and consistently.

Read original(opens in new tab)
googleOriginal article

Amplify Initiative: Localized data for globalized AI (opens in new tab)

The Amplify Initiative by Google Research addresses the critical lack of linguistic and cultural diversity in generative AI training data by establishing an open, community-based platform for localized data collection. By partnering with regional experts to co-create structured, high-quality datasets, the initiative aims to ensure AI models are both representative and effective in solving local challenges across health, finance, and education. This approach shifts data collection from a top-down model to a participatory framework that prioritizes responsible, locally respectful practices in the Global South. ## The Amplify Platform Framework The initiative is designed to bridge the gap between global AI capabilities and local needs through three core pillars: * **Participatory Co-creation:** Researchers and local communities collaborate to define specific data needs, ensuring the resulting datasets address region-specific problems like financial literacy or localized health misinformation. * **Open Access for Innovation:** The platform provides high-quality, multilingual datasets suitable for fine-tuning and evaluating models, specifically empowering developers in the Global South to build tools for their own communities. * **Author Recognition:** Contributors receive tangible rewards, including professional certificates, research acknowledgments, and data authorship attribution, creating a sustainable ecosystem for expert participation. ## Pilot Implementation in Sub-Saharan Africa To test the methodology, Google Research partnered with Makerere University’s AI Lab in Uganda to conduct an on-the-ground pilot program. * **Expert Onboarding:** The program trained 259 experts across Ghana, Kenya, Malawi, Nigeria, and Uganda through a combination of in-person workshops and app-based modules. * **Dataset Composition:** The pilot resulted in 8,091 annotated adversarial queries across seven languages, covering salient domains such as education and finance. * **Adversarial Focus:** By focusing on adversarial queries, the team captured localized nuances of potential AI harms, including regional stereotypes and specialized advice that generic models often miss. ## Technical Workflow and App-Based Methodology The initiative utilizes a structured technical pipeline to scale data collection while maintaining high quality and privacy. * **Privacy-Preserving Android App:** A dedicated app serves as the primary interface for training, data creation, and annotation, allowing experts to contribute from their own environments. * **Automated Validation:** The app includes built-in feedback loops that use automated checks to ensure queries are relevant and to prevent the submission of semantically similar or duplicate entries. * **Domain-Specific Annotation:** Experts are provided with specialized annotation topics tailored to their professional backgrounds, ensuring that the metadata for each query is technically accurate and contextually relevant. The Amplify Initiative provides a scalable blueprint for building inclusive AI by empowering experts in the Global South to define their own data needs. As the project expands to India and Brazil, it offers a vital resource for developers seeking to fine-tune models for local contexts and improve the safety and relevance of AI on a global scale.

figma3 min readCurated summary

Figma's 2025 AI report: Perspectives From Designers and Developers | Figma Blog

Figma’s 2025 AI report, based on a survey of 2,500 users, shows that AI adoption is accelerating across product development. Agentic AI is growing especially quickly, while established practices such as prototyping, iteration, and collaboration remain essential. However, developers generally see greater quality benefits from AI than designers, and widespread adoption is still limited by concerns about reliability. ## Agentic AI Is Growing Fast - Text generation remains the most common AI product category. - Agentic AI is the fastest-growing category, with 51% of AI builders developing agents, up from 21% the previous year. - Agents perform multi-step tasks by interpreting inputs, reasoning, and taking action. - Building them requires decisions about: - When users should be asked for confirmation - How much information the system should reveal - Whether conversational interfaces or direct controls are more effective - Designers and developers need extensive testing and prototyping to make agent behavior intuitive and trustworthy. ## Human-Centered Best Practices Still Matter - 52% of AI builders say design is more important for AI products than for traditional products, while 95% consider it at least equally important. - Successful teams continue to rely on: - Rapid iteration - Prototyping - Exploring multiple technical and design approaches - Close collaboration between disciplines - 60% of successful AI teams explored multiple approaches, compared with 39% of unsuccessful teams. - AI product development differs from conventional software work because outputs and interactions can change unpredictably. - Human judgment remains critical for explaining AI behavior and keeping people involved in AI-assisted actions. ## Smaller Companies Are Investing More Aggressively - 61% of users at companies with 1–10 employees say AI is very or critically important to their market-share goals. - The number of small-company respondents calling AI essential to their products doubled from the previous year. - Smaller businesses may be moving faster because they have fewer organizational constraints and can experiment more easily. - They may also view AI as a way to accelerate growth and compete with larger companies. ## Developers and Designers Perceive AI Differently - Developers report higher satisfaction with AI tools: - 82% are satisfied with AI tools. - 68% say AI improves their work quality. - Designers report lower—but still substantial—levels: - 69% satisfaction. - 54% saying AI improves quality. - Developers use AI more directly in core responsibilities such as code generation; 59% do so, compared with 31% of designers using AI for core design work such as asset generation. - 68% of developers use prompts to generate code, and 82% are satisfied with the results. - The gap suggests that AI currently fits more naturally into developers’ daily workflows, while designers are still evaluating where it provides meaningful value. ## Efficiency Has Outpaced Trust - 78% of respondents agree that AI significantly improves work efficiency. - Only 32% say they can rely on AI output in their work. - This contrast highlights the difference between AI’s potential to speed up tasks and its ability to produce consistently dependable results. - Teams must therefore focus not only on adoption, but also on quality control, human oversight, and designing workflows that account for AI’s limitations. Figma’s findings point toward an AI-driven future, but successful adoption will depend on disciplined experimentation, thoughtful product design, and systems that keep humans informed and involved.

Read original(opens in new tab)
googleOriginal article

Geospatial Reasoning: Unlocking insights with generative AI and multiple foundation models (opens in new tab)

Google Research is introducing Geospatial Reasoning, a new framework that integrates generative AI with specialized foundation models to streamline complex geographical problem-solving. By combining large language models like Gemini with domain-specific data, the initiative seeks to make large-scale spatial analysis accessible to sectors like public health, urban development, and climate resilience. This research effort moves beyond traditional data silos, enabling agentic workflows that can interpret diverse data types—from satellite imagery to population dynamics—through natural language. ### Specialized Foundation Models for Human Activity * The Population Dynamics Foundation Model (PDFM) captures the complex interplay between human behaviors and their local environments. * A dedicated trajectory-based mobility foundation model has been developed to process and analyze movement patterns. * While initially tested in the US, experimental datasets are expanding to include the UK, Australia, Japan, Canada, and Malawi for selected partners. ### Remote Sensing and Vision Architectures * New models utilize advanced architectures including masked autoencoders, SigLIP, MaMMUT, and OWL-ViT, specifically adapted for the remote sensing domain. * Training involves high-resolution satellite and aerial imagery paired with text descriptions and bounding box annotations to enable precise object detection. * The models support zero-shot classification and retrieval, allowing users to locate specific features—such as "residential buildings with solar panels"—using flexible natural language queries. * Internal evaluations show state-of-the-art performance across multiple benchmarks, including image segmentation and post-disaster damage assessment. ### Agentic Workflows and Industry Collaboration * The Geospatial Reasoning framework utilizes LLMs like Gemini to manage complex datasets and orchestrate "agentic" workflows. * These workflows are grounded in geospatial data to ensure that the insights generated are both useful and contextually accurate. * Google is collaborating with inaugural industry partners, including Airbus, Maxar, Planet Labs, and WPP, to test these capabilities in real-world scenarios. Organizations interested in accelerating their geospatial analysis should consider applying for the trusted tester program to explore how these foundation models can be fine-tuned for specific proprietary data and use cases.

figma2 min readCurated summary

Double Click: You Can Just Do Things—But Should You Always? | Figma Blog

AI tools are creating a renewed sense of possibility, making it easier for people—even nontechnical users—to build, write, design, and research. Figma’s article celebrates the excitement behind the “you can just do things” mantra while questioning whether constant creation may also become exhausting. Its central tension is whether AI is ushering in a creative golden age or overwhelming people with too many possibilities. ## The “You Can Just Do Things” Mantra - The phrase has become a tech-world rallying cry alongside: - “Move fast and break things” - “Don’t ask for permission” - “It’s time to build” - “Founder mode” - “Fuck around and find out” - AI-powered tools make the idea feel more attainable than ever by lowering the barriers to execution. - Writing assistants, design generators, and research platforms allow more people to create without specialized technical skills. - The article connects this mindset to earlier advocates such as Steve Jobs and contemporary online creators. ## The Thrill of Discovery - The current AI boom is compared to the early 2010s, when discovering apps such as Instagram and Uber felt especially exciting after the App Store’s emergence. - Michael Mignano of Lightspeed Venture Partners observes that people are once again hearing about impressive new products every day. - Crucially, these recommendations increasingly come from ordinary friends—not only people working in technology. - This suggests AI products are becoming broadly accessible and relevant beyond the traditional tech community. ## Possibility Versus Overload - The proliferation of AI tools creates a powerful sense that almost anything can be attempted. - At the same time, the sheer number of available tools and projects may become mentally exhausting. - The article asks whether high agency and constant experimentation empower people or pressure them to stay perpetually productive. - It frames the issue as a balance: embracing AI’s creative potential without feeling obligated to act on every possible idea. People should take advantage of AI’s expanded creative possibilities while resisting the expectation to “do everything.” The most sustainable approach is selective experimentation—use tools that meaningfully support a goal rather than treating constant activity as the goal itself.

Read original(opens in new tab)
discord3 min readCurated summary

Come Build Where the World Plays

Discord is opening its Activities platform to all developers, enabling them to build, distribute, and monetize games and interactive experiences directly within Discord. The company argues that Discord’s social communities, voice channels, and existing gaming audience create a powerful environment for discovery and rapid product feedback. Early examples suggest Activities can achieve substantial engagement by combining gameplay with native social interaction. ## Discord as a Platform for Social Gameplay - More than 90% of Discord’s 200 million monthly users play games, generating over 1.5 billion hours of gameplay each month. - The Embedded App SDK lets developers create games, music experiences, and other interactive Activities that run inside Discord. - Discord’s servers and voice calls allow friends to launch lightweight games together without leaving conversations. - The platform supports both playing with existing friends and forming new social connections. - Developers are exploring ideas such as: - Games that support collaboration across different schedules and time zones - Bots and memes integrated directly into conversations - Generative AI combined with built-in social communication ## Faster Feedback and Product Development - Tens of thousands of developers adopted the Embedded App SDK during its developer preview. - Building on Discord gives developers access to an active, game-oriented audience and immediate user feedback. - Developers can observe how people interact with their products and quickly adjust features, languages, content, and monetization. - Playroom’s *Death by AI* used Discord feedback to: - Add features and fixes - Expand support to more than 10 languages - Introduce AI voices and new prompt packs - Implement in-app purchases - The game reached nearly 7 million players and more than 1 million hours of gameplay within weeks. ## Easier Discovery and Engagement - Developers can now submit Activities for verification through the Discord Developer Portal and opt into discovery. - Discoverable Activities can appear in: - Discord’s App Launcher - Text and voice channels - Rich embeds shared with friends - Users can launch an Activity from a conversation and invite others to join. - Native rich presence allows Activities to appear in server member lists and user profiles. - Recommendations and visible friend activity help games spread organically. - Discord reports that these improvements have contributed to approximately 1 million additional game launch days per month. Discord’s recommendation to developers is clear: build social, easily accessible experiences that take advantage of Discord’s existing communities and communication features. By opening Activities broadly, the company aims to make Discord a complete platform for discovering, playing, and growing interactive games.

Read original(opens in new tab)
coupangOriginal article

Accelerating Coupang’s AI Journey with LLMs (opens in new tab)

Coupang is strategically evolving its machine learning infrastructure to integrate Large Language Models (LLMs) and foundation models across its e-commerce ecosystem. By transitioning from task-specific deep learning models to multi-modal transformers, the company aims to enhance customer experiences in search, recommendations, and logistics. This shift necessitates a robust ML platform capable of handling the massive compute, networking, and latency demands inherent in generative AI. ### Core Machine Learning Domains Coupang’s existing ML ecosystem is built upon three primary pillars that drive business logic: * **Recommendation Systems:** These models leverage vast datasets of user interactions—including clicks, purchases, and relevance judgments—to power home feeds, search results, and advertising. * **Content Understanding:** Utilizing deep learning to process product catalogs, user reviews, and merchant data to create unified representations of customers and products. * **Forecasting Models:** Predictive algorithms manage over 100 fulfillment centers, optimizing pricing and logistics for millions of products through a mix of statistical methods and deep learning. ### Enhancing Multimodal and Language Understanding The adoption of Foundation Models (FM) has unified previously fragmented ML tasks, particularly in multilingual environments: * **Joint Modeling:** Instead of separate embeddings, vision and language transformer models jointly model product images and metadata (titles/descriptions) to improve ad retrieval and similarity searches. * **Cross-Border Localization:** LLMs facilitate the translation of product titles from Korean to Mandarin and improve the quality of shopping feeds for global sellers. * **Weak Label Generation:** To overcome the high cost of human labeling in multiple languages, Coupang uses LLMs to generate high-quality "weak labels" for training downstream models, addressing label scarcity in under-resourced segments. ### Infrastructure for Large-Scale Training Scaling LLM training requires a shift in hardware architecture and distributed computing strategies: * **High-Performance Clusters:** The platform utilizes H100 and A100 GPU clusters interconnected with high-speed InfiniBand or RoCE (RDMA over Converged Ethernet) networking to minimize communication bottlenecks. * **Distributed Frameworks:** To fit massive models into GPU memory, Coupang employs various parallelism techniques, including Fully Sharded Data Parallelism (FSDP), Tensor Parallelism (TP), and Pipeline Parallelism (PP). * **Efficient Categorization:** Traditional architectures that required a separate model for every product category are being replaced by a single, massive multi-modal transformer capable of handling categorization and attribute extraction across the entire catalog. ### Optimizing LLM Serving and Inference The transition to real-time generative AI features requires significant optimizations to manage the high computational cost of inference: * **Quantization Strategies:** To reduce memory footprint and increase throughput, models are compressed using FP8, INT8, or INT4 precision without significant loss in accuracy. * **Advanced Serving Techniques:** The platform implements Key-Value (KV) caching to avoid redundant computations during text generation and utilizes continuous batching (via engines like vLLM or TGI) to maximize GPU utilization. * **Lifecycle Management:** A unified platform vision ensures that the entire end-to-end lifecycle—from data preparation and fine-tuning to deployment—is streamlined for ML engineers. To stay competitive, Coupang is moving toward an integrated AI lifecycle where foundation models serve as the backbone for both content generation and predictive analytics. This infrastructure-first approach allows for the rapid deployment of generative features while maintaining the resource efficiency required for massive e-commerce scales.

figma3 min readCurated summary

Building a better First Draft for designers | Figma Blog

Figma reintroduced its AI design-generation feature as **First Draft**, repositioning it as a starting point rather than a finished product. After disabling the original Make Designs feature because its outputs too closely resembled existing apps, Figma rebuilt the system with improved design libraries and safeguards. First Draft was later folded into Figma’s more powerful design agent, which adds iterative prompting, bulk edits, and live feedback. ## The Purpose of First Draft - First Draft is designed to reduce the tedious work required to turn an idea into an initial design. - It helps designers: - Express an idea through a simple prompt - Start productive discussions - Explore multiple design directions - Move more quickly from concept to prototype - Figma presents it as an additional way to explore possibilities, not a replacement for design judgment or craft. ## How the AI Generates Designs - First Draft uses off-the-shelf AI models, including OpenAI’s GPT-4 and Amazon Titan. - It combines three elements: - **Model:** The underlying AI system - **Context:** Figma’s proprietary mobile and desktop design systems, components, and assembly examples - **Prompt:** The user’s description of their design goal - The AI selects, arranges, and customizes components from the relevant design system to produce an initial design. ## Lessons from Make Designs - Figma originally introduced the feature as **Make Designs** during Config 2024. - The company disabled it after discovering that problems in the underlying design system caused generated mockups to resemble existing applications too closely. - Following analysis, testing, and iteration, Figma relaunched the feature under the name **First Draft**. - The new name emphasizes that the output is meant to be a flexible jumping-off point rather than a polished final design. ## Design Libraries and Future Customization - Users can choose among four libraries tailored to different needs: - Low-fidelity wireframes - More visually expressive, high-fidelity designs - Site-oriented patterns - App-oriented patterns - This contrasts with Visual Search, which helps users find exact existing files or components. - Figma’s longer-term goal is to let organizations use their own custom libraries and company-specific design languages. - The company is also exploring code-backed systems such as Google Material 3 to help designers and product teams iterate more closely with implementation. ## From First Draft to Figma’s Design Agent - First Draft is now incorporated into Figma’s purpose-built design agent. - The agent extends the original concept with: - Re-prompting and deeper iteration - Automated bulk edits - Live feedback on designs and user flows - Direct interaction through chat on the canvas Figma’s approach is to use AI to accelerate early exploration while keeping designers in control. The current recommendation is to use the design agent as an iterative partner for generating, refining, and evaluating ideas rather than treating AI output as a finished solution.

Read original(opens in new tab)