안녕하세요. 토스뱅크 Product Designer 전누리예요. 이번 글에서는 인턴으로 토스에 합류해 처음으로 실험을 설계했던 경험을 공유해보려고 해요. 제가 맡은 첫 과제는 토스뱅크 비회원의 가입 전환율을 높이는 것이었어요. 처음 실험을 설계해야 했던 저는 세 가지가 가장 어려웠어요. 1️⃣ 이탈이 큰 구간이 여러 개인데, 어디부터 개선해야 할까? 2️⃣ 이미 많은 실험이 진행되었는데, 나는 뭘 더 할 수 있을까? 3️⃣ 가설을 어떻게 세워야 흔들리지 않을까? 이 세 가지 고민을 어떻게 풀었는…
Kakao developed its internal POPM (Product Owner/Product Manager) training program by treating the curriculum itself as an evolving product rather than a static lecture series. By applying agile methodologies such as data-driven prioritization and iterative versioning, the program successfully moved from a generic pilot to a structured framework that aligns teams through a shared language of problem-solving. This approach demonstrates that internal capability building is most effective when managed with the same rigor and experimentation used in software development.
## Strategic Motivation for POPM Training
* Addressed the inherent ambiguity of the PO/PM role, where non-visible tasks often make it difficult for practitioners to define their own growth or impact.
* Sought to resolve the disconnect between strategic problem definition (PO) and tactical execution (PM) within Kakao’s teams.
* Prioritized the creation of a "common language" to allow cross-functional team members to define problems, analyze metrics, and design experiments under a unified structure.
## Iterative Design and Versioning
* The program transitioned through multiple "versions," starting with an 8-session pilot that covered the entire lifecycle from bottleneck exploration to execution review.
* Based on participant feedback regarding high fatigue and low efficiency in long presentations, the curriculum was condensed into 5 core modules: Strategy, Metrics, Experiment, Design, and Execution.
* The instructional design shifted from "delivering information" to "designing a rhythm," utilizing a "one slide, one question, one example" rule to maintain engagement.
## Data-Driven Program Refinement
* Applied a "Product Metaphor" to education by calculating "Opportunity Scores" using a matrix of Importance vs. Satisfaction for each session.
* Identified "Data/Metrics" as the highest priority for redesign because it scored high in importance but low in satisfaction, indicating a structural gap in the teaching method.
* Refined the "features" of the training by redesigning worksheets to focus on execution routines and converting mandatory practice tasks into selective, flexible modules.
## Structural Insights for Organizational Growth
* Focused on accumulating "structure" rather than just training individuals, ensuring that even as participants change, the framework for defining problems remains consistent within the organization.
* Designed practice sessions to function as "thinking structures" rather than "answer-seeking" exercises, encouraging teams to bring their training insights directly into actual team meetings.
* Prioritized scalability and simplicity in the curriculum to ensure the structure can be adopted across different departments with varying product needs.
To build effective internal capabilities, organizations should treat training as a product that requires constant maintenance and versioning. Instead of focusing on one-off lectures, leaders should design structural "rhythms" and feedback loops that allow the curriculum to evolve based on the actual pain points of the practitioners.
Discord is launching a seasonal Halloween event that invites users to participate in a themed conflict between "tricks" and "treats." By interacting with the platform's interface, users can select a side and influence their digital presence throughout the holiday period. This update integrates atmospheric elements directly into the user experience, transforming standard notifications into part of a broader community-driven narrative.
**Aesthetic and Interface Enhancements**
* The event is framed within the context of the Onyx client theme, providing a dark, high-contrast visual foundation for the seasonal content.
* Thematic sensory cues, such as specialized notification sounds and candy-corn-themed imagery, are used to signal event milestones and updates.
* Interface shifts are designed to build immersion as the user navigates through the client during the spooky season.
**Faction Selection and Social Influence**
* Users are presented with a definitive choice between two fates: embracing "treacherous tricks" or opting for "treats."
* Once a faction is selected, the platform allows users to display their allegiance publicly to the rest of the world.
* The event includes social mechanics that allow users to help pull others toward their chosen side, fostering community competition.
This Halloween update emphasizes user agency and social signaling, providing a gamified layer to the Discord client that encourages interaction through seasonal factions.
Toss designer Lee Hyeon-jeong argues that business goals and user experience are not mutually exclusive, even when integrating controversial elements like advertising. By identifying the intersection between monetization and usability, her team transformed intrusive ads into value-driven features that maintain user trust while driving significant revenue. The ultimate conclusion is that transparency and appropriate rewards can mitigate negative feedback and even increase user engagement.
### Reducing Friction through Predictability and Placement
* Addressed "surprise" ads by introducing clear labeling, such as "Watch Ad" buttons or specifying ad durations (e.g., "30-second ad"), which reduced negative sentiment without decreasing revenue.
* Discovered that when users are given a choice and clear expectations, their anxiety decreases and their willingness to engage with the content increases.
* Eliminated "flow-breaking" ads that mimicked functional UI elements, such as banners placed inside transaction histories that users frequently mistook for personal bank records.
* Established a design principle to place advertisements only in areas that do not interfere with information discovery or core user navigation tasks.
### Transforming Advertisements into User Benefits
* Developed a dedicated B2B ad platform to scale the variety of available advertisements, ensuring that users receive ads relevant to their specific life stages, such as car insurance or new credit cards.
* Shifted the internal perception of ads from "noise" to "benefits" by focusing on the right timing and high-quality matching between the advertiser and the user's needs.
* Institutionalized regular "creative ideation sessions" to explore interactive formats, including advertisements that respond to phone movement (gyroscope), quizzes, and mini-games.
* Leveraged long-term internal experiments to ensure that even if an idea cannot be implemented immediately, it remains in the team's "creative bank" for future product opportunities.
### Optimizing Value Exchange through Rewards
* Conducted over a year of A/B testing on reward thresholds, comparing small cash amounts (1 KRW to 200 KRW), non-monetary items (gifticons), and high-stakes lottery-style prizes.
* Analyzed the "labor intensity" of ads by adjusting lengths (10 to 30 seconds) to find the psychological tipping point where users felt the reward was worth their time.
* Implemented a high-value lottery system within the Toss Pedometer service, which successfully transitioned a loss-making feature into a profitable revenue stream.
* Maintained user activity and satisfaction levels despite the increased presence of ads by ensuring the "worst-case experience"—viewing ads for no gain—was entirely avoided.
Product teams should stop viewing business requirements and UX as a zero-sum game. By focusing on user psychology—specifically transparency, non-disruption, and fair value exchange—it is possible to achieve aggressive business targets while maintaining a sustainable and trusted user environment.
Is the app layer where AI proves its value? Insights AI Design thinking Thought leadership The next leap in AI won’t come from new models alone—the app layer will be what makes new technology stick. Hero illustration by Zoé Maghamès Peters “Right now we’re in the MS-DOS era for…