In this video, we will take a deep dive into the fundamentals of metrics in A/B Testing. By the end of the video, you will have a solid understanding of the common types of metrics and tips for applying them in real-world A/B testing applications. Some ideas are inspired by the book Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing. I'm sure this video will be extremely helpful for both interview preparation and day-to-day work as a DS.

Blog post by Rob and me:
https://towardsdatascience.com/the-ultimate-guide-to-cracking-business-case-interviews-for-data-scientists-part-1-cb768c37edf4

Part 1 of the tutorial: 
https://www.youtube.com/watch?v=VpTlNRUcIDo

Part 2 of the tutorial:
https://www.youtube.com/watch?v=VuKIN9S8Ivs
🟢Get all my free data science interview resources
https://www.emmading.com/resources
🟡 Product Case Interview Cheatsheet https://www.emmading.com/product-case-cheat-sheet 
🟠 Statistics Interview Cheatsheet https://www.emmading.com/statistics-interview-cheat-sheet 
🟣 Behavioral Interview Cheatsheet https://www.emmading.com/behavioral-interview-cheat-sheet 
🔵 Data Science Resume Checklist https://www.emmading.com/data-science-resume-checklist

✅ We work with Experienced Data Scientists to help them land their next dream jobs. Apply now: https://www.emmading.com/coaching 

// Comment
Got any questions? Something to add?
Write a comment below to chat.

// Let's connect on LinkedIn:
https://www.linkedin.com/in/emmading001/

====================
 Contents of this video: 
====================:
0:00 Intro
1:13 Goal Metric
3:13 Driver Metric
4:42 Guardrail Metric
6:14 Application of Metrics
8:17 Metrics for experiments

A/B Testing Metrics: What You Need to Know About Success, Driver, and Guardrail Metrics!

Data Scientists Must Know | Data Science Interview Must Watch: A/B Testing Fundamentals. I will dive deep into practical problems in A/B testing and share things I learned from the book Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing.

🟢Get all my free data science interview resources
https://www.emmading.com/resources
🟡 Product Case Interview Cheatsheet https://www.emmading.com/product-case-cheat-sheet 
🟠 Statistics Interview Cheatsheet https://www.emmading.com/statistics-interview-cheat-sheet 
🟣 Behavioral Interview Cheatsheet https://www.emmading.com/behavioral-interview-cheat-sheet 
🔵 Data Science Resume Checklist https://www.emmading.com/data-science-resume-checklist

✅ We work with Experienced Data Scientists to help them land their next dream jobs. Apply now: https://www.emmading.com/coaching 

✔️ Cracking Hypothesis Testing Problems in Data Science Interviews part 1
https://www.youtube.com/watch?v=IY7y-t30UJc

✔️ Cracking Hypothesis Testing Problems in Data Science Interviews part 2
Practical significance and statistical significance
https://www.youtube.com/watch?v=6uw0A3aKwMc

✔️ Cracking A/B Testing Problems in Data Science Interviews
https://www.youtube.com/watch?v=X8u6kr4fxXc

📚 Trustworthy online controlled experiments, a practical guide to A/B testing
https://www.amazon.com/Trustworthy-Online-Controlled-Experiments-Practical/dp/1108724264

// Comment
Got any questions? Something to add?
Write a comment below to chat.

// Let's connect on LinkedIn:
https://www.linkedin.com/in/emmading001/

====================
 Contents of this video: 
====================
0:00 Intro
1:52 What are A/B tests
3:39 Why A/B tests
5:05 Steps to run A/B tests
5:20 Experiment prerequisites
6:51 Experiment design
8:03 Running Experiments
8:22 Result to decision
10:48 Post-launching monitoring

Emma Ding Transcript on Youtube

A/B Testing Metrics: What You Need to Know About Success, Driver, and Guardrail Metrics!

A/B Testing Fundamentals: What Every Data Scientist Needs to Know!