Customer, Market and Competitive Insight

Introduction

Product and portfolio decisions are rarely improved by asking only, “What product should we launch?” The more consequential questions are: Which customers are being served? What progress are they trying to make? In what context does demand arise? Which alternatives compete for the same customer resources? What value can the organization create and defend?

Customer, market and competitive insight provides the evidence base for answering these questions. It connects customer understanding with category analysis and strategic choice. In brand management, insight is not synonymous with data. Data are observations; insight is a defensible interpretation that explains why a pattern matters and what decision should follow. A useful insight therefore links a customer tension or opportunity to a market condition, a competitive reality and an actionable value proposition.

This chapter integrates segmentation, targeting, jobs-to-be-done (JTBD), customer-journey analysis, voice-of-customer (VoC) research and competitor analysis. It also examines how these methods can be combined to identify demand spaces and differentiated opportunities.

Learning objectives

By the end of this chapter, you should be able to:

1. Explain how customer, market and competitive insight contribute to product and portfolio decisions.
2. Construct and evaluate market segments and select target segments.
3. Apply JTBD to identify functional, emotional and social customer needs.
4. Map customer journeys and diagnose moments of friction and opportunity.
5. Design a rigorous VoC system using qualitative and quantitative evidence.
6. Analyze competitors, substitutes and category dynamics.
7. Synthesize evidence into differentiated value-creation opportunities.
8. Evaluate the ethical, methodological and managerial limitations of insight practices.

1. From information to strategic insight

A market consists not merely of people who buy a product, but of actors, occasions, alternatives, institutions and resources involved in solving a problem. A category may be defined narrowly by product form—for example, “electric toothbrushes”—or more usefully by the customer problem—“maintaining oral health conveniently.” The broader definition reveals substitutes, such as manual brushing, professional cleaning or preventive services.

Three levels of analysis should be distinguished:

Insight becomes decision-relevant when these levels are connected. For example, a customer may complain that a product is expensive. Market analysis may show that the category is becoming subscription-based, while competitor analysis may reveal that low-price competitors have high switching costs. The opportunity may not be a cheaper product, but a transparent, flexible service model.

A strong insight has four characteristics. It is evidence-based, because it can be traced to observations or reliable data. It is explanatory, because it identifies a meaningful cause or tension rather than repeating a fact. It is consequential, because it changes a decision. Finally, it is distinctive, because it reveals something competitors have not adequately addressed.

2. Segmentation and targeting

2.1 The logic of segmentation

Segmentation divides a heterogeneous market into relatively homogeneous groups whose members share relevant needs, behaviors or responses. Segmentation is not an end in itself. Its purpose is to improve choices about value proposition, product design, communication, channels and resource allocation.

Common bases include:

• Demographic: age, income, education, household structure or occupation.
• Geographic: country, climate, urbanization or local infrastructure.
• Psychographic: values, identity, lifestyle or attitudes.
• Behavioral: usage rate, occasion, loyalty, benefits sought or purchase behavior.
• Needs-based: desired outcomes, problems, anxieties or trade-offs.
• Firmographic: industry, organization size, technology environment and procurement structure in business markets.

Demographic variables are easy to measure but often weak explanations of behavior. Two people of the same age may have different needs, while people in different demographic groups may share the same job or usage occasion. Needs-based and behavioral segmentation is therefore often more actionable, especially when supported by contextual and attitudinal evidence.

A segment should be evaluated using five criteria:

1. Identifiability: Can members be recognized using observable variables?
2. Substantiality: Is the segment economically or strategically meaningful?
3. Accessibility: Can it be reached through feasible channels?
4. Responsiveness: Does it respond differently to a tailored offer or marketing mix?
5. Actionability: Can the organization serve it with available capabilities?

Segments should also be internally coherent and externally distinct. Excessively fine segmentation can create operational complexity, fragment brand meaning and increase costs without generating incremental value.

2.2 Segment attractiveness and strategic fit

A target segment is not necessarily the largest segment. A smaller segment may be preferable if it grows rapidly, is underserved, has strong willingness to pay and fits organizational capabilities.

A practical assessment can use a weighted score:

Here, S_j is the total attractiveness score for segment j, w_i is the importance weight assigned to criterion i, and r_ij is the segment’s rating on that criterion. Weights should sum to 1, and ratings must use a consistent scale. This is a decision aid, not an objective measurement of market truth. Sensitivity analysis is necessary because results can change when managers alter weights or ratings.

Illustrative example. Suppose a company evaluates two segments on growth, margin, accessibility and strategic fit. The weights are 0.30, 0.25, 0.20 and 0.25. Segment A receives ratings of 4, 3, 5 and 4 on a five-point scale; Segment B receives 3, 5, 3 and 5.

For Segment A:

S_A = (0.30×4) + (0.25×3) + (0.20×5) + (0.25×4) = 3.90

For Segment B:

S_B = (0.30×3) + (0.25×5) + (0.20×3) + (0.25×5) = 4.00

Segment B ranks slightly higher, but the difference is not sufficiently large to eliminate managerial judgment. If the organization lacks the capabilities implied by “strategic fit,” the apparent score may be misleading.

2.3 Targeting and positioning

Targeting is the choice of which segments to serve and with what level of customization. Typical strategies include undifferentiated, differentiated, concentrated and individualized targeting. Contemporary digital systems can support personalization, but personalization does not eliminate the need for coherent segment and brand strategy.

Positioning specifies the distinctive meaning a brand seeks to occupy in the target customer’s mind relative to alternatives. A useful positioning statement identifies the target, frame of reference, core benefit, reason to believe and distinctive value. It should describe a meaningful difference, not merely a communication slogan.

3. Jobs-to-be-done: understanding demand as progress

The JTBD perspective, associated with scholars and practitioners including Clayton Christensen, proposes that customers “hire” products or services to make progress in a situation. The unit of analysis is therefore not always the demographic customer or product category; it may be the job, occasion and desired outcome.

A job has at least three dimensions:

• Functional: the practical task to be accomplished.
• Emotional: how the customer wants to feel or avoid feeling.
• Social: how the customer wants to be perceived by others.

A job statement should describe the desired progress without embedding a particular solution. “Hire a premium food-delivery app” is solution-defined. “Obtain a reliable evening meal when work ends late, without planning or guilt” is more useful.

JTBD analysis commonly examines:

• the triggering situation;
• the desired outcome;
• existing habits and alternatives;
• anxieties that inhibit adoption;
• forces pushing toward change and forces maintaining the status quo;
• constraints such as time, money, skills, trust and social norms.

The framework is powerful because it reveals competition across categories. A video-conferencing service may compete not only with other software but also with email, travel, asynchronous collaboration and “doing nothing.” However, JTBD should not be treated as a universal replacement for segmentation. Jobs occur in contexts, but people and organizations still differ in resources, identities, access and decision authority.

Outcome-driven opportunity identification

Customers may be dissatisfied with an outcome even when they do not complain about a product. Interviews can therefore ask how important an outcome is and how satisfied customers are with current solutions. An opportunity is often indicated by high importance combined with low satisfaction. Such measures are diagnostic rather than definitive: stated importance can be inflated, and satisfaction can reflect low expectations.

4. Customer-journey analysis

A customer journey is the sequence of experiences through which a person recognizes a need, evaluates alternatives, purchases, uses, receives support and possibly renews or recommends. The journey is not necessarily linear. Customers may loop between stages, use multiple channels and involve other decision makers.

A journey map should specify:

1. Persona or actor: whose journey is being mapped.
2. Scenario and goal: what situation and desired progress define the journey.
3. Stages: for example, trigger, discovery, evaluation, purchase, onboarding, use, support and renewal.
4. Touchpoints: channels, interfaces, people, products and communications.
5. Customer actions and questions.
6. Emotions and perceived effort.
7. Operational backstage processes.
8. Pain points, moments of truth and opportunity areas.

Journey mapping is most useful when it distinguishes the customer’s experience from the organization’s internal process. A company may regard “account activation” as complete when a form is submitted, while the customer experiences completion only when the product produces a useful outcome.

Customer effort can be assessed through observed time, number of steps, failure rates or survey measures. These indicators should not be treated as interchangeable. A short journey may still create anxiety, and a longer journey may be acceptable for a high-risk purchase if it increases trust.

Journey research should combine observation, interviews, behavioral analytics, service records and usability testing. A map based only on internal assumptions is a visualization of beliefs, not evidence.

5. Voice of the customer

VoC is a systematic process for collecting, interpreting and acting on customer requirements and experiences. It includes direct statements—interviews, surveys, complaints and reviews—as well as indirect evidence such as behavior, search patterns, support contacts and abandonment.

5.1 Qualitative methods

Depth interviews explore language, context, contradictions and lived experience. Ethnographic observation reveals workarounds and unarticulated behavior. Diary studies capture experiences over time. Social listening and review analysis can identify recurring themes, but online contributors are self-selected and may not represent the market.

Good qualitative practice requires purposeful sampling, neutral questioning and iterative coding. Interviewers should ask for specific recent episodes rather than abstract opinions. “Tell me about the last time…” generally produces more reliable evidence than “Would you use…?”

A coding process may proceed from descriptive codes, to interpretive themes, to higher-level tensions or opportunity statements. Researchers should preserve disconfirming evidence rather than forcing all statements into a preferred narrative.

5.2 Quantitative methods

Surveys can estimate prevalence, compare segments and measure perceptions. Questionnaire quality depends on construct validity, wording, order, scale design and sampling. A large sample does not correct a biased sampling frame or a leading question.

For a simple proportion estimate, the approximate standard error is:

p̂ is the sample proportion and n is the sample size. This approximation assumes a probability sample and independent observations; practical surveys may require weighting and a design effect. It describes sampling variability, not total survey error. Nonresponse, coverage, measurement and processing errors may be more important.

VoC systems should triangulate evidence. If customers claim that delivery speed matters, managers should compare that claim with actual delivery choices, abandonment, complaints and retention. No single source should automatically be treated as the customer’s “true voice.”

5.3 Translating VoC into requirements

A useful translation process moves from verbatim statement to underlying need, measurable requirement and design implication. For example:

Managers must distinguish “what customers say they want” from “what creates value.” Customers may propose a feature that is only one possible solution to a deeper need. The organization should preserve the need while testing alternative solutions.

6. Competitor and category analysis

Competitive analysis begins by defining competition broadly. Direct competitors offer similar products. Indirect competitors solve a related problem differently. Substitutes compete for the same customer resources, while nonconsumption competes by keeping the current behavior unchanged.

A robust analysis considers four layers:

1. Customer alternatives: what customers compare or use instead.
2. Value propositions: benefits promised and evidence offered.
3. Experience system: product quality, service, channels and community.
4. Capabilities and economics: assets, data, partnerships, cost structure and likely ability to respond.

A competitor matrix can compare alternatives on dimensions that matter to customers, such as convenience and assurance. The dimensions should be derived from research, not selected merely because they make the focal brand look superior. Perceptual maps are hypotheses about mental associations, not direct measures of objective performance.

Strategic-group and capability analysis

Strategic-group analysis identifies clusters of firms with similar strategies, such as low-cost providers, premium specialists and integrated platforms. It can reveal mobility barriers: capabilities that make movement between groups difficult. Porter’s five-forces framework remains useful for examining rivalry, buyer power, supplier power, threat of entry and substitutes, but it should be applied dynamically. Digital ecosystems can blur industry boundaries, and complementors may be simultaneously partners and competitors.

Competitor intelligence must separate fact, inference and speculation. Public information, mystery shopping and product testing may be legitimate; deception, unauthorized access, theft of confidential information and misuse of personal data are not. Ethical intelligence protects the organization from legal and reputational harm.

7. Category dynamics and demand spaces

A demand space is a structured set of customer needs and usage situations, often extending across conventional product categories. Demand spaces can be identified by combining jobs, occasions, desired outcomes, barriers and willingness to exchange resources.

Category dynamics include:

• changes in customer behavior and cultural meaning;
• technology and channel shifts;
• regulation and standards;
• new business models;
• changes in input costs or availability;
• demographic and macroeconomic change;
• ecosystem dependencies and network effects.

The task is not simply to identify a “trend.” A trend becomes strategically relevant only when its direction, scale, affected customers, timing and organizational implications are understood. Managers should distinguish a temporary signal from a structural change and test both base-rate evidence and counterevidence.

A demand-space opportunity can be represented conceptually as:

Opportunity = meaningful unmet outcome × reachable demand × distinctive capability × economic viability.

This is not a mathematical identity; it is a screening logic. If any factor is near zero, the opportunity may be unattractive. A large unmet need is insufficient if customers cannot be reached or the organization cannot serve it profitably and credibly.

8. Integrating insight into differentiated value creation

Insight methods are most powerful when sequenced rather than used in isolation. A practical workflow is:

1. Define the decision and the boundary of the market.
2. Explore customers, situations and alternatives qualitatively.
3. Form provisional segments and job hypotheses.
4. Quantify prevalence, attractiveness and behavioral differences.
5. Map journeys to locate high-friction moments.
6. Analyze competitors, substitutes and capabilities.
7. Identify underserved demand spaces.
8. Generate value propositions and test them with customers.
9. Prioritize opportunities using strategic fit, economics and defensibility.
10. Establish learning metrics and update assumptions after launch.

Differentiation may arise from product performance, experience, access, trust, identity, ecosystem integration, business model or reduced customer risk. A difference becomes strategically valuable when it is important to a target customer, credibly delivered, comparatively distinctive and difficult enough to imitate.

Portfolio managers should also ask whether an opportunity strengthens or weakens the existing portfolio. A new offer may attract new customers, increase usage, enable cross-selling or defend a strategic position. Conversely, it may cannibalize a profitable offer, confuse brand architecture or create channel conflict. Customer insight must therefore be connected to portfolio roles, not treated as a stand-alone research exercise.

9. Illustrative case: Repositioning a refillable household-cleaning brand

Background

The fictional company ClearHome sells concentrated household-cleaning products in refillable aluminum bottles. Sales have grown among environmentally motivated early adopters but plateaued in the mainstream market. Management initially proposes adding more fragrances and reducing price.

Problem

The company does not know whether weak adoption results from insufficient environmental motivation, poor product performance, refill inconvenience, distrust of claims or a mismatch between the target segment and the channel.

Analysis

The team conducts 24 contextual interviews, observes cleaning routines in eight homes, analyzes customer reviews and support contacts, surveys 1,200 category buyers and shops five competing systems. The research identifies three demand patterns:

• Eco-committed planners: willing to tolerate effort and pay a premium, but expect credible evidence.
• Convenience-seeking households: value quick cleaning and reliable availability; environmental benefit is welcome but secondary.
• Safety-conscious caregivers: seek products perceived as effective and safe around children and pets.

JTBD analysis shows that the central job is not “buy sustainable cleaner.” It is “restore a clean, safe home quickly while avoiding unnecessary waste and uncertainty.” The journey map reveals that customers understand the refill concept at advertising but hesitate at first purchase because they cannot judge dilution, performance or refill availability. The principal friction occurs after purchase, when a refill is needed but the customer is uncertain where and how to obtain it.

Competitor analysis finds that supermarket private labels compete on availability and price, while premium brands compete on design and environmental credentials. ClearHome possesses a concentrated formula and a subscription capability but has weak retail distribution.

Approach and solution

The company decides not to compete solely on ecological identity. It develops a “performance with less waste” proposition, introduces clear dilution instructions, provides a performance guarantee, expands retail refill availability and offers reminders based on estimated usage rather than automatic shipment. Claims are supported by accessible evidence, and the company avoids implying that aluminum packaging is impact-free.

The portfolio is organized into a core everyday range for convenience-seeking households, a fragrance-free safety range and a premium limited range for eco-committed customers. Research continues after launch through repeat purchase, refill completion, complaint themes and controlled tests of availability messages.

Outcome

In the illustrative case, trial improves after retail availability and clearer onboarding are introduced. More importantly, repeat purchase increases because the company addresses the journey barrier rather than merely adding features. The case demonstrates that a stated preference for sustainability did not identify the whole opportunity. The opportunity lay at the intersection of a functional job, an emotional need for certainty, a category gap in refill convenience and a capability the firm could build.

Learning points

1. Segment labels are less useful than evidence about situations, jobs and barriers.
2. A customer’s desired value may involve several dimensions simultaneously.
3. Journey friction can prevent adoption even when brand positioning is attractive.
4. Competitor analysis should include substitutes and nonconsumption.
5. Differentiation must be operationally delivered and credibly supported.

10. Limitations, ethics and governance

Insight work contains uncertainty. Customers may misremember, rationalize choices or state socially desirable intentions. Research samples may exclude low-access groups. Algorithms may infer sensitive attributes or reproduce historical bias. Digital listening can blur the boundary between publicly visible information and ethically appropriate use.

Organizations should obtain informed consent where required, minimize data collection, protect personal information, define retention periods and control access. Sensitive attributes should not be used to exploit vulnerability or unfairly restrict access to essential goods and services. Automated segmentation should be audited for disparate impact, proxy discrimination and unstable classifications. Governance should specify who may use customer data, for what purpose and with what review process.

Managers should also avoid “insight theater”: producing attractive personas, maps or dashboards without decisions, accountability or learning. Every research project should identify the decision it informs, the assumptions it tests, the limitations of evidence and the action that follows.

11. Contemporary developments and best practice

Artificial intelligence can accelerate review coding, demand-signal detection, synthetic stimulus generation and personalization. These applications are useful only when training data, prompts, classifications and outputs are validated by qualified researchers. AI-generated summaries can erase minority views or convert ambiguous statements into false certainty. Human review, provenance records and testing against original evidence are essential.

Contemporary insight systems increasingly combine first-party behavioral data, research panels, experimentation, service data and external market intelligence. The objective is not maximal data accumulation but a learning system that links evidence to decisions. Leading practice includes:

• begin with a decision, not a fashionable method;
• triangulate stated and observed behavior;
• recruit beyond easy-to-reach customers;
• separate discovery from validation;
• document assumptions and confidence;
• test competing interpretations;
• make trade-offs explicit;
• connect insight to economics and capabilities;
• protect privacy and vulnerable groups;
• measure post-launch learning, not just pre-launch approval.

Chapter Summary

Customer, market and competitive insight provides the foundation for product and portfolio choices. Segmentation structures heterogeneity, while targeting allocates attention to groups that are attractive, accessible, responsive and strategically compatible. JTBD reframes demand as progress in a situation and exposes functional, emotional and social outcomes. Customer-journey analysis identifies the sequence of experiences and the moments where friction prevents value realization. VoC combines qualitative and quantitative evidence, but all sources require critical evaluation and triangulation.

Competitive analysis must include direct competitors, substitutes, nonconsumption, capabilities and category dynamics. Demand spaces emerge where meaningful unmet outcomes intersect with reachable demand, distinctive capabilities and economic viability. The strongest opportunities are not simply large; they are relevant, deliverable, credible and defensible. Ethical governance, privacy protection, sampling discipline and human judgment are essential, particularly when AI is used to process customer data. Insight becomes strategically valuable only when it changes a product, portfolio, positioning or resource-allocation decision.

Key Terms

Segmentation: Division of a heterogeneous market into relatively homogeneous groups.

Targeting: Selection of segments to serve and the degree of customization offered.

Positioning: Intended distinctive meaning of a brand relative to alternatives.

Needs-based segmentation: Grouping customers according to shared needs or desired outcomes.

Jobs-to-be-done: A perspective that views customers as seeking progress in a particular situation.

Functional job: The practical task a customer wants to accomplish.

Emotional job: The feeling a customer wants to create or avoid.

Social job: The way a customer wants to be perceived by others.

Customer journey: The sequence of customer experiences from need recognition through use and renewal.

Touchpoint: An interaction between a customer and an organization, product or channel.

Moment of truth: A consequential interaction that strongly influences customer evaluation.

Voice of the customer: A systematic process for collecting and using customer requirements and experiences.

Triangulation: Comparison of multiple evidence sources to improve confidence in an interpretation.

Direct competitor: An organization offering a similar solution to a similar customer need.

Substitute: A different solution that satisfies a related need or job.

Demand space: A structured opportunity area defined by needs, situations, outcomes and alternatives.

Differentiation: Creation of meaningful and defensible distinction relative to alternatives.

Strategic fit: Alignment between an opportunity and an organization’s capabilities and objectives.

Insight: An evidence-based, explanatory and actionable interpretation of a customer or market pattern.

Review Questions

Short Answer Questions

1. What distinguishes an insight from a data point?
2. Identify five criteria for evaluating a market segment.
3. What are the functional, emotional and social dimensions of a job?
4. Why should competitor analysis include substitutes and nonconsumption?
5. What is the purpose of triangulating VoC evidence?

Long Answer Questions

1. Critically compare demographic, behavioral and needs-based segmentation for a new consumer service.
2. Explain how JTBD and customer-journey analysis can be used together to diagnose an adoption problem.
3. Discuss the strengths and limitations of qualitative and quantitative VoC research.
4. Explain how category dynamics and organizational capabilities influence opportunity selection.
5. Evaluate the ethical risks of AI-enabled customer segmentation and propose governance safeguards.

Analytical / Application Questions

1. Select a familiar category, define its direct competitors, substitutes and nonconsumption, and identify one underserved demand space.
2. Construct a customer journey for a high-involvement purchase. Identify three friction points and recommend evidence-based interventions.
3. Develop a weighted segment-attractiveness model for two target segments. State your assumptions, calculate the scores and assess the sensitivity of your recommendation.

Multiple Choice Questions with Answers

Question 1

Which characteristic makes a market segment most actionable?

A. It is defined only by age.

B. It can be served using available organizational capabilities.

C. It is the largest possible group.

D. It contains customers with unrelated needs.

Correct Answer: B. It can be served using available organizational capabilities.

Question 2

In the jobs-to-be-done perspective, a customer primarily hires a product to do what?

A. Match a demographic profile

B. Increase the number of available features

C. Make progress in a particular situation

D. Copy the market leader

Correct Answer: C. Make progress in a particular situation

Question 3

Which research question is most appropriate for uncovering a recent customer experience?

A. Would you probably like this idea?

B. Do you always prefer convenience?

C. Tell me about the last time you encountered this problem.

D. Would a lower price solve everything?

Correct Answer: C. Tell me about the last time you encountered this problem.

Question 4

What is a key limitation of a customer journey map based only on internal assumptions?

A. It necessarily includes too much behavioral data.

B. It represents organizational beliefs rather than verified customer experience.

C. It cannot contain operational processes.

D. It always excludes digital touchpoints.

Correct Answer: B. It represents organizational beliefs rather than verified customer experience.

Question 5

A high-priority VoC opportunity is often associated with which combination?

A. Low importance and high satisfaction

B. High importance and low satisfaction

C. Low importance and low awareness only

D. High satisfaction and high switching costs only

Correct Answer: B. High importance and low satisfaction

Question 6

Which option is an example of a substitute rather than a direct competitor for video-conferencing software?

A. Another video-conferencing platform

B. A competing webcam

C. Business travel for an in-person meeting

D. A larger monitor

Correct Answer: C. Business travel for an in-person meeting

Question 7

In the illustrative weighted scoring model, what was the score for Segment B?

A. 3.25

B. 3.70

C. 3.90

D. 4.00

Correct Answer: D. 4.00

Question 8

Why should a positioning difference be supported by organizational capability?

A. Because positioning is only a financial statement

B. Because a promised difference must be credibly and consistently delivered

C. Because customers never compare alternatives

D. Because capabilities eliminate the need for research

Correct Answer: B. Because a promised difference must be credibly and consistently delivered

Question 9

What does triangulation mean in VoC research?

A. Using one very large survey

B. Comparing multiple evidence sources

C. Removing contradictory responses

D. Replacing interviews with analytics

Correct Answer: B. Comparing multiple evidence sources

Question 10

Which is an appropriate governance practice for AI-enabled customer insight?

A. Use sensitive attributes without review if prediction improves.

B. Treat generated summaries as automatically accurate.

C. Audit for bias and validate outputs against original evidence.

D. Collect all available data regardless of purpose.

Correct Answer: C. Audit for bias and validate outputs against original evidence.