Yelp Data Science VP on What You Need To Know About Data Science Products

To learn all about Data Science Products and the role they play in product management, you should watch the whole video from Justin Norman’s Speaker Series in San Francisco. The highlights are detailed below.

Product Data Science means building data products, tools and measurement strategies that impact the consumer using a rigorous statistical methodology, expertise, and experience.

Just like products have a product lifecycle, a DS product has its own product lifecycle.

Here is the Data Science (DS) Product Lifecycle:

1. Ideation and Design
2. Data Exploration and Pipeline Development
3. Product Development
4. Experimentation
5. Release!

Types of DS Products:

• Application embedded: Some kind of applied (usually probabilistic) data science or Machine Learning built into an application as a feature. Ideally, without user knowledge.
• Actionable research: It’s not a feature. It’s not something that’s going into the application directly. It’s metrics to help make decisions on where time and resources should be spent.
• Experiment design: Have an experiment plan to help guide the conversation between Data Scientists and Product Managers about the measurement strategy. The Data Scientists, Engineers, and PMs must partner during the experiment execution. Your plan must keep up with the changes in thinking that come as a product evolves.
• Reusable analysis tools: Reusable code and tools enable and promote the use of data in product development. Data Science helps Product Managers explore and select which metrics to use.
• Confident monitoring: When you release a product that has some kind of treatment from a statistical perspective in it, you can pretty much guarantee that you’re gonna have to redo it soon. So, if you have monitoring in place you’re able to react to that quickly. 
• External reporting: These DS products promote the brand and engage the community outside of the core product.

The DS Product Manager Toolbox

• Data Lifecycle and Pipeline Management
• Experimentation and metrics
• DS Development Process

Core Data Science PM Responsibilities:

• Decide on core function, audience and desired use of Data Science product
• Evaluate any inputs and ensure they’re maintained through the lifecycle
• Orchestrate the cross-functional team (Data Engineering, Research, Applied Machine Learning, Data Science, Machine Learning Engineering, Software Engineering, Data Platform, Metrics Platform, Experimentation Platform)
• Decide on key interfaces and designs: data features and UI/X
• Work with Engineers and Data Scientists during development to determine the tech stack
• Coordinate maintenance and support after the product release