Hijacked Again! Three Trends in the Field of VoC: Some Welcome, Some Not
Gary Katz, NPDP
Originally presented: June 27, 2013
Originally published: 2013 (PDMA Visions Magazine, Issue 3, 2013 • Vol 37 • No 3)
Watch time: 55 minutes
Read time: 10 minutes
Access the Webcast
In short, VoC is and always has been about the study of customer needs (see Figure 1) and was intended for:
- Developing new or improved products;
- Designing new or improved services; and
- Improving business processes.
Given these roots—specifically intended as a foundation for innovation—the term has now morphed quite a bit over the years, which leads us to our three current trends.
This first trend is decidedly unwelcome. The naysayers simply argue that VoC doesn’t work. For instance:
- “VoC will never let you be more creative than your most creative customer.”1
- “Ask your customer what they want, and you are bound to get yesterday’s product...”
- Improving business processes.
- “If I’d asked customers what they wanted, they’d have said a faster horse!” (Henry Ford2)
- “You should ‘ignore’ the Voice of the Customer, because no truly innovative idea has ever come from a customer. The customer is the dumbest guy in the room!” (Michael Treacy)
- “It’s hard for [customers] to tell you what they want when they’ve never seen anything remotely like it.” (Steve Jobs)
Great Voc research focuses on what the customer is trying to do and what makes it hard or easy to get it done. clayton christensen and his colleagues describe it in particularly colorful terms: “When customers find that they need to get a job done, they ‘hire’ products or services to do the job.
All of these comments reflect a fundamental misinterpretation of the definition of VoC and, more importantly, a naïveté about how VoC should be conducted. A common amateur mistake, ironically, is to ask the customer, “What do you want?” When carried out with this kind of direct “frontal assault,” the customer assumes that they are supposed to describe the exact feature or solution they want. This approach confuses needs with solutions to those needs.
The naysayers misunderstand the role of market research in innovation. Anyone who thinks that VoC just means “asking customers what they want” is sadly mistaken, and any researcher or product developer who has ever tried this approach understands its futility. Why? Because most customers aren’t very good at coming up with innovative solutions. And frankly, that’s not their job. It’s yours!
Great VoC research focuses on what the customer is trying to do and what makes it hard or easy to get it done. Clayton Christensen and his colleagues describe it in particularly colorful terms: “When customers find that they need to get a job done, they ‘hire’ products or services to do the job.”3 He then goes on to make the case that it is better to focus on the job than on the product. Similarly, Griffin and Hauser define a need as: “A description, in the customer’s own words, of the benefit to be fulfilled by the product or service.”4 They go on to say that it has nothing to do with the way in which the product or service delivers on that benefit, only with the desired benefit itself. With a combination of observation (ethnography) and probing conversation (lots of “why” questions), the VoC process helps us understand the customer’s needs, both articulated and unarticulated. But from there, it is the innovator’s job to come up with the new features or solutions that respond to those needs. Most customers simply lack the technical understanding, the creativity or both.
Even Jobs understood this distinction, even if he didn’t articulate it very well, as he went on to say, “It’s not the consumers’ job to know what they want.” In fact, it is their job, usually Great Voc research focuses on what the customer is trying to do and what makes it hard or easy to get it done. clayton christensen and his colleagues describe it in particularly colorful terms: “When customers find that they need to get a job done, they ‘hire’ products or services to do the job.” • www.pdma.org 19 with some help, to convey their wants and needs—either verbally or non-verbally—in accomplishing jobs or tasks. What is not their job is to come up with the exact solutions.
Whether Jobs did market research (Apple insiders disagree on this point), he could innately sense customer needs so that Apple always seemed to be working on the “right” problems. But what really set him apart from other product developers and made him a “serial innovator” (another term coined by Griffin5) were his solutions—clearly more elegant and intuitive than anything the world had seen. But unlike Jobs, most innovators feel relatively unsure about customer needs. In study after study, it’s still listed as the No. 1 reason for new product failure. So, most innovators still need to do market research. There is no guarantee that they will come up with good solutions, only that they’ll be working on the right problems.
Many product developers are still quick to call Jobs as a lead witness in the case against VoC research, and my objection is always the same: If your CEO is as intuitively creative and visionary as Jobs, you don’t need anyone’s help. If, however, your CEO is like the rest of us, you could probably benefit and significantly reduce risk and time-to-market by spending some time and money in the front end of innovation to research your customers’ needs. You’ll still need to do additional research down the road to test out concepts, evaluate prototypes, fine tune your messaging and so forth. But at least you’ll be working on the right problems.
The second trend, while somewhat veering away from the original definition, is actually quite welcome. The stretchers haveadened the term Voice of the Customer with points like:
- “VoC is just another term for market research. Any interaction with customers is VoC.”
- “VoC is about staying more in touch with your customers.”
- “VoC is for improving the customer experience.”
- “VoC is where we share our new product ideas with customers to see if they like them — just to be sure that we’re on the right track.”
The stretchers take the term VoC well beyond its original definition. For many, VoC has become a euphemism — it sounds better than “market research” or what we once called Customer Satisfaction Measurement (CSM) (and its more recent incarnation, the Net Promoter Score®6) and Customer Relationship Management (CRM). These are good things to do, but they are far afield from what Griffin and Hauser were talking about, because most of these new VoC initiatives focus on existing products and existing customers, rather than next-generation products and potential future customers. Furthermore, most have a decided bias toward the customer service and customer experience components rather than on the product itself.
However, this expanded definition of VoC remains true to its origins if the objective is service and/or process improvement. Remember, the goal of VoC is to provide a springboard for innovation, whether it results in better products, better services or better business processes. The major departure is that this new definition places less emphasis on new product development, and it typically doesn’t include non-customers, competitors’ customers or ex-customers—important sources of information for the development of new and better products.
So what about these stretchers—those who use the term VoC to mean CSM, CRM or Customer Experience Management? Is there still a connection? There certainly should be, although in practice, this connection is often downplayed or ignored altogether. Whether a company uses Overall Satisfaction or the Net Promoter Score (i.e., the likelihood to recommend), both have become a sort of “report card” that indicates how well the company is doing in pleasing its customers (in addition to revenues, of course). Whenever the score rises, there is much self-congratulation and in many companies, additional bonus payments. A falling score, however, invites enormous hand-wringing and finger-pointing (despite the fact that it might just be statistical noise). This is reminiscent of when Johnnyngs home an “F” in reading. Many families reflexively blame the teacher or the grading system instead of asking the more fundamental question: “Why can’t Johnny read?” A report card is never prescriptive, it is only descriptive.
Here’s where the old and new definitions connect. In addition to the overall satisfaction and likelihood to recommend questions, these VoC-centric customer satisfaction programs ask customers to rate a company or product along one to two dozen individual attributes. Whether implicitly or explicitly, these attributes are assumed to be the drivers of overall satisfaction or likelihood to recommend. And indeed, with many of the more sophisticated systems, there is a formal effort to build an empirical model where Overall Satisfaction or the Net Promoter Score is used as the dependent variable and the individual attributes are treated as independent variables, as follows:
- Overall Satisfaction or Net Promoter Score = ƒ (attr1, attr2, attr3, … attrn)
Although there may be many analytical problems to contend with such as multicolinearity, dealing with discrete, categorical or binary variables, etc., the goal is to come up with a coefficient for each attribute whose relative magnitude is an indicator of how much that attribute is assumed to be driving Overall Satisfaction or the Likelihood to Recommend.
Where do these attributes come from? Many companies simply resurrect and tweak an old list from previous research or do some focus groups to come up with a list, with little rigor or deep thought. Here, traditional VoC can make a huge difference, providing a rigorous way to identify those attributes. Why is this important? Because the real drivers of Overall Satisfaction or Likelihood to Recommend can be determined by correlating the scores with how well a company or product is addressing those underlying customer needs. Working with companies like Pacific Gas & Electric, Southern Company, United Parcel Service (UPS) and many others, we have been able to show that using a rigorously derived set of attributes from a formal VoC study can dramatically improve a model’s fit. It explains far more of the variation in Overall Satisfaction or Likelihood to Recommend—proof that they are a better, more realistic set of drivers than the previous set. In doing so, VoC moves customer satisfaction measurement from simply descriptive to deeply prescriptive.
The goal of VoC is to be prescriptive—to identify the attributes that really drive satisfaction and loyalty, and to come up with concrete ways to move the needle higher. If we can get a better handle on what things are actually driving it, especially on attributes where our ratings with customers are somewhat deficient, we can better decide where to focus our resources and attention. Instead of handwringing and finger-pointing over the scores, traditional VoC focuses our attention on:
- Identifying the true drivers;
- Prioritizing which ones to focus on; and
- Providing insights to support the generation of better solutions to improve on them.
Of course, there are no guarantees we’ll always come up with better solutions, but at least we’ll know that we’re concentrating on the right problems.
This last trend is well-intentioned but a bit poorly reasoned. We all know “technovangelists”—those people who believe that new technology is always superior to old, and that whatever you’re using now will be obsolete in a year or two. But reality has a way of setting in, and we often find that new technologies that are great for one application aren’t always great for another. In my view, this third trend falls into that camp.
The technovangelists argue:
- “Traditional VoC is obsolete; it’s been replaced by the use of social media.”
- “Social media can provide all of the data needed to fully understand VoC.”
- “Social media has completely changed the way that innovation is done, because it allows the customer to replace the inventor and innovate on their own.”
Can social media be used as the source from which to gather the VoC? The answer so far is that it can help, but with a number of significant constraints:
- Social media is a far more active phenomenon for consumer products than it is for business-to-business products. Consider dog owners. Millions of dog owners constantly think about products and services to enhance their dogs’ health and happiness and their own lives as dog owners. Thousands of them share their thoughts with anyone who cares to listen. By contrast, there are only a handful of automotive plant managers in the United Sates who are busy people and necessarily secretive about their work, which they consider trade secrets that they prefer not to share online.7
- For better or for worse, social media qualifies as “big data,” with all of the associated benefits and challenges. Companies like social media because the data is already out there, and it is virtually free. Consider the vastness of user-generated content (UGC)—textual material that is there for all to see such as that found in blogs, discussion boards or social media chatter. The sheer volume demands advanced tools to decipher it. The earliest applications were at consumer products companies who wanted to follow their brand’s “buzz.” They developed textmining and analysis tools to classify online comments as positive or negative, and then longitudinally tracked sentiment, homing in on significant blips in the data that might require attention. For instance, if a company can get an early beat on negative chatter about a policy or issue, they may be able to correct it before it goes viral.
Many have attempted to extract customer needs from user-generated content. We’ve found that social media is quite good for problem finding, but getting to the actual need requires intelligent probing from a trained interviewer. Achieving a deep understanding of the underlying task and the difficulties in accomplishing it requires asking “why?”—a lot. Moreover, since some needs remain unspoken or unarticulated, observation is often required as well.
Undoubtedly, the tools will improve; technology always does. But for now, we’ve found two other good ways to make use of social media. First, we examine what people are chatting about in social media to develop a discussion guide of questions and topics to cover in face-to-face VoC interviews. And second, in a number of situations, we have used online communities as a source for recruiting respondents in difficult to reach categories. These specialized communities can be particularly useful when they are focused on low incidence topics such as rare medical conditions, hobbies or users of an unusual product category. Even if participants’ comments on social media fall short of the level of detail needed for VoC, social media is already proving to be an interesting new source for recruiting qualified customers for more in-depth conversation. But it has not and probably will not replace traditional VoC research anytime soon.
The goal of Voc is to be prescriptive—to identify the attributes that really drive satisfaction and loyalty, and to come up with concrete ways to move the needle higher.
Does VOC Work?
Regardless of the definition or the methods you’re using to gather the data, VoC is hardly obsolete. In fact, it is thriving. Of course, skeptics will continue to offer anecdotes of failure. And even a perfectly executed VoC project cannot guarantee a winning product or a better customer experience. But that said, there is plenty of empirical evidence of the overall success of VoC’s role in all kinds of innovation and product management.
The PDMA Foundation conducts a long-running longitudinal study of innovation practice, the Comparative Performance Assessment Study (CPAS). In 2004’s installment, they divided their sample of 416 companies into what they called “the best versus the rest.” The best were the 24 percent of companies who had the best track record on innovation performance using various financial criteria, such as “percent of sales” and “percent of profit from products that were less than two years old.” The rest were the remaining 76 percent of companies. They then went on to ask the question: What is it that the best do differently or more of than the rest (i.e., what variables best discriminate between the two groups)? In every breakdown they tried, VoC was always one of the top discriminators. In fact, the best were generally two to three times more likely to be using VoC then the rest. The most recent wave of the study (2012) confirms these findings. The best now have more than a 50 percent higher innovation success rate than the rest (82.5 percent vs. 53.8 percent), and VoC is now the single most used market research technique, with major impact on reductions in cost and time-to-market.
In another study of more than 160 companies, published in Visions in March 2008, renowned New Produce Development (NPD) experts Bob Cooper and Scott Edgett examined managerial evaluations of 18 different sources of insight and discovery— both their frequency of use and their ultimate effectiveness. Among the most effective techniques were all of the things used in VoC, such as customer visits, ethnography, focus groups, etc. Surprisingly, Open Innovation techniques were rated among the lowest in effectiveness, and techniques like disruptive technologies and communities of enthusiasts were only rated in the middle—considerably less favorably than had been expected.
These studies clearly refute the claims that VoC is ineffective or obsolete, and they verify the potential limitations of social media to replace more traditional methods of data collection. When done properly, the insights obtained from VoC are often pivotal in providing the foundation for all kinds of innovation and product, service or process improvement.
Become and Advocate
Still, the hijacking continues. People continue to drag the VoC into murky territory where it was never really intended to go. Most of this is not ill-intentioned, just misinformed. But there most certainly is a connecting point among all of these destinations, and the benefits of the journey are quite real.
Fortunately, there are still plenty of objective “passengers” on board to redirect these flights to their intended destinations. And there are plenty of good seats still available.
1“Is VOC Killing Innovation?” iSixSigma.com. (May 4 2003). http://www.isixsigma.com/topic/is-voc-killinginnovation/ (accessed Jun 18 2013).
2While this quote has long been attributed to Ford, some have questioned whether he, in fact, ever said it.
3Christensen, Clayton, Anthony, Scott, Berstell, Gerald, and Nitterhouse, Denise, MIT Sloan Management Review, Spring 2007: 2.
4Griffin, Abbie and Hauser, John, “The Voice of the Customer,” Marketing Science, 12 (i): 1-27 (Winter).
5Griffin, Abbie, Price, Raymond L., and Vojak, Bruce A. “Serial Innovators: How Individuals Create and Deliver Breakthrough Innovations in Mature Firms.” Stanford University Press, Stanford, CA, May 2012.
6The Net Promoter Score is a registered trademark of Fred Reichheld, Bain & Company, and Satmetrix.
7That said, in a conversation with a group of petrochemical engineers at one of my clients, I learned that there was actually quite a bit of chatter – mostly anonymous – about how to deal with the BP Deepwater Horizon accident in the Gulf of Mexico back in 2010.
About the Author
Gerry Katz, NPDP, is executive vice president of applied Marketing science Inc., a market research and consulting firm specializing in providing voice of the customer (voC) insights across a wide range of clients and industries.