One of the toughest moments is when you have to kill your product 💀—when you see that your product is failing.
In this article, I am sharing my piece of advice about reading early on the signs, potential challenges that I have encountered in the AI product development, and last but not least, mitigation strategies!
🔎 Reading the signs
A few signs that indicate your product should be removed from the market:
-
Low performance in primary KPIs: Measuring performance from day one is crucial, especially if your product is costly. When ROI is significantly low and your initial impact estimates are far off—for example, when technical costs are much higher than the value the product brings back to the company—it’s a strong indicator that the product isn’t viable. Post release analysis is absolutely necessary to indentify potential improvements before deciding to retire the product.
-
The company is changing direction: Strategic decisions beyond your control can influence the survival of your product. The company may develop another product that becomes a new priority or industry standard, creating conflicts that lead to your product being deprioritized (it happens!).
-
Customer feedback is not positive: Beyond KPIs, qualitative feedback is equally important. It helps you understand the customer experience and gather ideas for future improvements.
💣 Challenges while building the product
Uncertainty is even higher when building AI products. AI development lifecycles can be longer than traditional software development, meaning it takes more time to confirm that your product works. For instance, in a team working in sprints, after two weeks, an AI team is less likely to have a meaningful increment ready, compared to a team developing a front-end feature for a web service.
There’s a high likelihood that a model won’t perform at the expected level, or that multiple iterations will be needed to achieve the required performance. This is especially critical for products that impact human lives, where high performance is essential.
Side note: I usually explain to stakeholders, new to the AI space, that we might need a few model iterations to get where we want, by showing an image of the Russian dolls, called babushka/matryoshka. We will get eventually to the biggest doll - highest increment.
🌞 Mitigations
Failing fast and controlling the damage should always be top of mind.
To minimize risks, it’s essential to complete an opportunity assessment before starting development to estimate the potential value. Run a few scenarios—what I enjoy doing with analysts is calculating expected outcomes across three versions: optimistic, neutral, and worst-case. Then, clearly define the requirements in the PRD.
During execution, aim for small, valuable increments. Deliver value step by step. Launch experiments or PoCs. This is your reminder to narrow the scope and fully leverage Agile methodologies.
The technical team needs to challenge and provide feedback. What might seem like a small increment to you may require significant time, and you may end up building a full product instead of an MVP (been there, done that). Along with the tech lead and delivery lead—if you’re lucky enough to have one—work on a delivery plan to ensure key milestones are timeboxed and that you can deliver on time and assess early.
This is my piece of advice. It’s time to embrace the learnings and move on! 💖

.png)
Comments
Post a Comment