Printify

Finastra

Madalina Turlea

Product leader with 10+ years experience

October 2025

March 2026

February 2026

July

June

April

Cohort 4

In this lightning session you will learn to:Identify your AI feature's specific evaluation metricsMove beyond generic metrics to specifics that measure the ways your AI feature fails for your specific use case How to choose between deterministic and LLM-based evaluationUnderstand when to use zero-cost deterministic checks vs. AI-as-judge, and why you should start with deterministic first Build your first automated evaluationSet up practical deterministic checks: format validation, schema checks, length limits, and value ranges

Setting up your first evaluation 

Overwhelmed by the AI hype when trying to build products that actually work?&nbsp;While everyone on LinkedIn claims to have the "magical AI solution," the reality is that 80% of AI projects fail due to inconsistent results and lack of systematic testing. Discover the one proven solution—systematic experimentation—that separates successful AI implementations from the failures, and learn the framework that delivers consistent, valuable results without the technical complexity.

AI Experimentation Intro


Product managers who drive strategy, development, and launch of products.

Applying AI tools and techniques to professional workflows — assign alongside more specific AI topics.

Measuring and evaluating AI model performance, quality, and reliability for production use cases.

Build a full AI evals suite in 3 hours on a real use case

Founder @Lovelaice | 10 years in Product

Product leader with 10+ years in platform and SaaS products | Founder Lovelaice

Founder @ Lovelaice | 2x founder & CTO

Catalina Turlea

2x founder & CTO | 14+ years in tech | Founder @Lovelaice

Scale manual testing of AI features with evals

Project Mangaer

Platforms Product Lead

Product Lead

Product Consultant

Engineers and engineering leaders who build, deploy, and scale software systems.

By the end of 4 weeks, you'll have the skills, the methodology, the tools and the hands-on experience to lead AI initiatives at your company

Co-founder @ Lovelaice, Product Leader

Co-founder @Lovelaice, 10+ years in Product

Founder @Lovelaice | 14+ years in Tech

Founder @Lovelaice, 14+ years leading Tech

Build and evaluate your first AI feature

Full-stack developer

Frontend Developer

A 4-week hands-on course where Product Managers learn to test prompts, benchmark models, write evals and build business cases for AI features using real data on your real use-case.Most PMs are stuck between two extremes: either waiting for engineering to figure it out, or shipping features that fail in production because they only tested on two happy cases.There's a better way.This course teaches you a systematic methodology for building AI features that actually work - before you write a single line of production code.You'll learn how to test prompts across multiple models, evaluate results like a pro, and make data-backed decisions about what to ship.This isn't theory.You'll run real experiments on your own product ideas using the same approach that's helped teams catch critical failures before their customers did, discover that cheaper models often outperform expensive ones, and ship AI features with confidence instead of crossed fingers.By the end of 4 weeks, you'll have the skills, the methodology, the tools and the hands-on experience to lead AI initiatives at your company - not just participate in them.

Stop guessing. Start testing. Ship AI with confidence.

How to integrate AI into your product

Build a eval pipeline for your AI features

You want to be in the top 5% of PMs who actually understand how to build with AI

You're tired of waiting for engineering to lead AI initiatives.You feel pressure to "do something with AI" but don't know where to start

You've shipped an AI feature but aren't confident it's working well (or your customers are finding the bugs)

From AI user to AI feature designer: a live exercise

Setting up your first AI eval with a LLM-as-judge

Setting up your first AI evaluation

How to build AI beyond the classic chatbot

How to test AI when you don't have any data yet

Lessons from one year of AI product building

Trading Central

Building digital products for more than 20+ years - now with AI


Teleclinic

Nilo

SIXT Group

Freeletics

<blockquote>Whether you're building your first AI feature or exploring what AI could do in your product, there's a moment every PM hits: you look at the AI output and think "this seems okay?" but you don't have a structured way to know for sure.You've heard about evals. You know vibe checking isn't enough. But where do you actually start?This workshop takes you from that starting point to a working evaluation suit, built on a real AI feature use case, in 3 hours.You'll write a production system prompt, run it across multiple LLMs, read and annotate real AI responses to understand where they break, find failure patterns through error analysis, define automatic evals based on what you found, and measure whether your improvements actually worked.You'll leave with hands on experience on building your own evals suite, failure taxonomy, and a repeatable process to evaluate and improve any AI feature from here.Every participant works hands-on annotating AI responses, writing evals and running improvement iterations. We've run 1,500+ AI experiments with product teams and this workshop is the compressed version of what we've seen work.</blockquote>

Design, build, validate and iterate on an AI feature, hands-on

Understand the most important components of building AI features at scale

Build an evaluation suite to scale your testing

Learn how to identify failure patterns. Then iterate on both prompt and evals

The PM who wants hands-on experience on how to build high performing AI features

The PM who is overwhelmed by the technical tools and process around building AI

The product lead who wants improve the iteration speed or wants to scale manual testing with automatic evals

Madalina Turlea will teach you how to build impactful AI features

Madalina Turlea

Courses

Build and evaluate your first AI feature

Workshops

Scale manual testing of AI features with evals

Lightning Lessons

From AI user to AI feature designer: a live exercise

Setting up your first AI eval with a LLM-as-judge

Setting up your first AI evaluation

How to build AI beyond the classic chatbot

How to test AI when you don't have any data yet

Lessons from one year of AI product building

Resources

AI Experimentation Intro

Setting up your first evaluation

Madalina Turlea will teach you how to build impactful AI features

Madalina Turlea

Courses

Build and evaluate your first AI feature

Workshops

Scale manual testing of AI features with evals

Lightning Lessons

From AI user to AI feature designer: a live exercise

Setting up your first AI eval with a LLM-as-judge

Setting up your first AI evaluation

How to build AI beyond the classic chatbot

How to test AI when you don't have any data yet

Lessons from one year of AI product building

Resources

AI Experimentation Intro

Setting up your first evaluation

How to build AI beyond the classic chatbot