test-first business
October 06, 2012
I’ve long observed that lean startup methodologies are a lot like agile development. When I explain it to developers, they get it pretty quickly, but that doesn’t resonate with business folk. I’ve been searching for ways to explain why I believe market testing is so important before starting to build a software product.
While there are plenty of folk drinking the Lean Startup Koolaid, the vast majority still believes that the best software comes exclusively from entrepreneurial insight. It is like a devine inspiration, where seeking validation would somehow indicate that that we are doubting our belief in God.
I’ve advocated validating market fit with clients who react with a seeming genuine concern that I lack confidence in my own ability to define the feature set for a new product or they tell me that if I’m afraid to move forward with my own opinions they are happy to just tell me what to do. Given my experience and past success, they want to place a bet on a winning jockey, and are puzzled why this jockey won’t just get on the horse and ride fast.
I have confidence in my ability to turn a great vision into the reality of a software product. I understand that small details can make or break a product, and the magic of great software design and development is found in selecting the right details that reinforce a cohesive product approach, where every feature enhances and supports every other feature. A high-level feature set or set of use cases could be implemented in a hundred different ways, which would each be good. I don’t assume that I (or anyone) could possible know which of those will resonate best with a specific audience. I also know that every company, whether its a new startup or Fortune 500, has a different opportunity for its go-to-market strategy, a different set of people that it could possibly reach. While perhaps the product could be used by “everyone,” it will be used first by the people who hear about it first, and those people can be discovered (and should be discovered) before you ever write a single line of code.
We have such great opportunity these days to envision in a practical way what the product will be like after it is completed. We can so easily put that in front of people to see how they respond. When I first heard about the idea on an MVP Landing Page test, it felt so delightfully obvious that this was a great approach that I’ve struggled to explain it to people.
I think the problem is with the word “testing” and even “validation” doesn’t hit the mark. I think it is just like test-driven development where it isn’t obvious until you do it (a lot) that the goal of testing is not quality assurance. When we write tests first while developing, it gives space and opportunity for to focus on the design of the particular part of the code you are working on. These so-call market tests allow us to see how our product features hang together because we need to express them in words and pictures. Even if we never did an internet advertising campaign to determine the conversion rate and customer acquisition costs, we would still benefit from seeing the product as a whole.
We make so many choices at the beginning of a product, why not let our prospective customers influence them? The key is to use our insights, our creativity and experience, to pick a couple of great options and then, instead of arguing with each other in a room, we let the target customers be the tie-breaker, and as a happy side-effect, if we’re good, we have a group of people eagerly awaiting the results of our hard work.
Also, if you haven’t yet read Eric Ries’ Lean Startup Book, you should buy it now. (I get a referral fee when you buy a book from this post, but that’s not why you should buy it. I keep a stack in the office that I routinely give away.) Unlike Eric, I don’t think people are afraid of negative results, I think it’s just very, very hard to imagine, in a concrete way, what a product will be before it exists. It feels easier to create it first, then try to explain it, but it just feels hard because this methodology is new and different for most of us. And it feels hard, because design is hard, and I’m not talking about colors and fonts, I’m taking about form and function and getting to the elusive question of why someone would want to use your software at all.