Market, Ecosystem and Competitive Discovery

Introduction

Product discovery is not confined to understanding users and their immediate problems. A product exists within a market, an ecosystem of partners and institutions, a competitive field, and a wider technological and regulatory environment. A product may solve a real user problem and still fail because the market is too small, customer acquisition is uneconomic, incumbent responses are underestimated, or critical complements are unavailable.

Market, ecosystem and competitive discovery therefore examines the external conditions that shape product opportunity and strategic viability. It combines market sizing, segmentation, trend analysis, competitor research, substitute analysis, ecosystem mapping, industry-structure analysis and strategic foresight. The objective is not to predict the future with certainty. It is to make assumptions explicit, identify uncertainties, and improve the quality and speed of product decisions.

Learning Objectives

By the end of this chapter, learners should be able to:

1. Distinguish markets, categories, segments, industries, ecosystems and competitive arenas.
2. Estimate TAM, SAM and SOM using defensible assumptions.
3. Analyse industry attractiveness and competitive pressure using Porter’s Five Forces.
4. Identify direct competitors, indirect competitors and substitutes.
5. Construct and interpret positioning maps and category structures.
6. Map ecosystem actors, dependencies, incentives and points of control.
7. Apply trend analysis, scenarios and other strategic-foresight methods.
8. Translate external discovery into product positioning, prioritisation and go-to-market choices.
9. Evaluate the ethical, regulatory and evidential limitations of market intelligence.

1. The Object of Discovery: Market, Category and Ecosystem

A market is a set of actual and potential exchanges involving a customer need, a value proposition and mechanisms for delivering value. A category is a socially recognised grouping of products that customers, analysts and firms treat as comparable. An industry usually refers to firms supplying similar products or relying on similar production capabilities. These concepts overlap but are not identical.

For example, a firm offering remote mental-health support may compete in the digital-health industry, the telehealth category, the employee-wellbeing market and the broader market for mental-health services. The relevant competitive set changes according to the customer’s job-to-be-done. If the job is “reduce work-related stress,” the alternatives may include counselling, meditation applications, managerial support and taking leave—not merely other telehealth platforms.

An ecosystem is a network of interdependent actors whose coordinated activities enable a product or customer outcome. Actors may include users, buyers, suppliers, distributors, complementors, platforms, regulators, standards bodies, communities and investors. Ecosystem analysis asks not only “Who competes with us?” but also “Who must cooperate, permit, integrate with or adapt to us?”

A useful distinction is:

The product manager must define the boundary of analysis deliberately. A narrow boundary improves measurement but can hide substitutes. A broad boundary reveals strategic threats but may produce an unmanageable and inflated opportunity estimate.

2. Market Segmentation and Demand Structure

Segmentation divides a heterogeneous market into groups with meaningful differences in needs, behaviour, willingness to pay, access, or cost to serve. Common bases include:

• Firmographic: industry, organisation size, geography and revenue.
• Demographic: age, income, occupation or household structure.
• Psychographic: values, attitudes and identity.
• Behavioural: usage frequency, switching behaviour, purchase occasion and adoption stage.
• Needs-based: desired outcome, pain intensity and unmet need.
• Economic: willingness to pay, service cost and customer lifetime value.

A strong segment is not merely descriptive. It should support different product, pricing, distribution or communication decisions. A useful segment is measurable, reachable, sufficiently substantial, behaviourally distinct and strategically serviceable.

Segmentation should be tested against evidence rather than assumed from personas. Useful evidence includes customer interviews, search behaviour, usage data, sales records, support contacts, industry reports and experiments. The product team should distinguish the user, economic buyer, technical approver, procurement function, administrator and beneficiary. In business markets, a single “customer” often represents a buying committee with different incentives.

3. Market Sizing: TAM, SAM and SOM

Market sizing provides an estimate of the revenue or volume opportunity under explicitly stated assumptions. It is a decision model, not an objective fact. Three related measures are widely used:

• Total Addressable Market (TAM): the total demand that could theoretically be served by the relevant offering under a defined scope.
• Serviceable Available Market (SAM): the portion of TAM that fits the firm’s geography, capabilities, channel, regulation and product scope.
• Serviceable Obtainable Market (SOM): the portion of SAM that the firm can realistically capture within a stated period, given competition and execution constraints.

3.1 Top-down and bottom-up approaches

A top-down estimate begins with an industry total and applies filters. For example:

Here, each rate is a proportion between 0 and 1, and all terms must refer to the same period, currency and market definition. Top-down estimates are fast, but errors in category definitions and syndicated-report assumptions can be substantial.

A bottom-up estimate builds from observable units:

where N is the number of potential customers or units, f is expected purchase frequency per period, p is average price per purchase, and T is the number of periods in the analysis horizon. If N is measured in organisations, f may be subscriptions per organisation per year and p the annual price per subscription. Unit consistency is essential.

For a transaction marketplace, a distinction should be made between gross merchandise value and revenue:

The take rate is the proportion retained by the platform. It should not be confused with the total value transacted.

3.2 Worked example

Suppose an enterprise software product targets 12,000 eligible organisations. The expected annual contract value is £18,000. A broad theoretical estimate is:

Assume the initial serviceable scope is 40% of organisations because of geography, regulation and integration limitations:

If the firm believes it can win 3% of SAM over a defined planning horizon:

These figures do not prove that £2.592 million is attainable. The 3% assumption must be tested against sales capacity, conversion rates, competitive response, retention and implementation resources. A more operational forecast could calculate customers won as:

If 600 qualified accounts are pursued and the win rate is 12%, expected wins are 72 accounts. At £18,000 annual contract value, the implied annual contract revenue is £1,296,000, materially below the earlier SOM estimate. The difference reveals that the market-share assumption and the sales-capacity model are not yet aligned.

3.3 Limitations of market sizing

TAM can be inflated by defining the market as a broad human need rather than a purchasable product category. SAM can be overstated when regulatory, operational or channel restrictions are ignored. SOM is often presented as a percentage chosen for convenience rather than derived from evidence.

Best practice is to show a range and sensitivity analysis. If the number of customers, price and capture rate are uncertain, calculate conservative, central and optimistic cases. The objective is not false precision but transparent reasoning. Market sizing should be revisited when a product changes its segment, business model, geography or value proposition.

4. Trend and Category Analysis

A trend is a sustained directional change in behaviour, technology, economics, regulation or culture. A fad is a short-lived rise in attention. Trend analysis should examine evidence of persistence, causal mechanisms and implications for the product rather than merely collecting popular headlines.

A practical trend scan considers:

1. Technological: capabilities, cost curves, infrastructure and standards.
2. Economic: income, interest rates, employment, investment and purchasing power.
3. Social: demographics, norms, lifestyles and trust.
4. Political and regulatory: laws, public policy and enforcement.
5. Environmental: resource constraints, climate risks and sustainability expectations.
6. Competitive: new entrants, consolidation, pricing and business-model changes.

Category analysis asks how customers understand the problem and what comparison rules they use. Categories influence search terms, analyst reports, procurement templates, investor expectations and perceived legitimacy. A new product may either enter an established category or attempt to create a new one. Category creation can produce differentiation, but it increases the educational burden and uncertainty of demand.

The product manager should identify category conventions, including expected features, pricing units, proof points, certifications and buying processes. A product that violates conventions may be innovative, confusing or both. Category design is therefore partly a communication and adoption problem.

5. Competitors, Substitutes and Strategic Groups

Competitive discovery should begin with the customer’s decision, not with a list of firms. Four levels are useful:

• Direct competitors: similar products targeting similar customers and jobs.
• Adjacent competitors: products serving a related need or segment.
• Substitutes: different solutions that perform the same underlying job.
• Status quo: the current behaviour, internal process or decision not to act.

The status quo is often the most important competitor in enterprise markets. A spreadsheet, manual workflow or existing staff member may be inferior in functionality but superior in familiarity, switching cost and perceived risk.

A competitor intelligence profile should include:

Evidence should be separated into observed facts, credible inference and speculation. Public pricing pages, product documentation, customer reviews, job postings, regulatory filings, procurement documents, interviews and product trials can be useful. Competitor research must respect terms of service, confidentiality, privacy and applicable law.

Positioning maps

A positioning map displays alternatives along two dimensions that are meaningful to customer choice, such as breadth of functionality and ease of implementation. The dimensions should not be selected merely because they make a preferred “white space.” They must be supported by customer research and should represent relatively independent decision criteria where possible.

A map is a perceptual and strategic aid, not a precise measurement instrument. An apparently empty space may indicate unmet demand, poor economics, technical infeasibility or low customer interest. Teams should validate the map with interviews, conjoint research, win-loss analysis or experiments.

6. Porter’s Five Forces

Porter’s framework analyses the structural forces that influence industry profitability. It is not a scoring checklist and does not directly predict the success of an individual product. The five forces are:

1. Rivalry among existing firms: affected by competitor number and symmetry, market growth, differentiation, switching costs, fixed costs and exit barriers.
2. Threat of new entrants: affected by capital requirements, regulation, brand, distribution access, economies of scale, data and switching costs.
3. Bargaining power of buyers: increased when buyers are concentrated, informed, price-sensitive or able to switch or integrate backward.
4. Bargaining power of suppliers: increased when suppliers are concentrated, differentiated or costly to replace.
5. Threat of substitutes: increased when another solution provides a comparable outcome with attractive price or convenience.

The framework is most useful when applied to a clearly bounded arena. A global statement such as “software has high rivalry” is too broad. The analyst should specify customer segment, geography, time period, value chain and relevant substitutes.

The model also has limitations. It is relatively static, can understate complementors and platforms, and may treat industry boundaries as fixed. Ecosystem and platform markets often require additional analysis of network effects, governance, multihoming, data advantages and bottleneck control.

7. Ecosystem Discovery

An ecosystem map identifies actors, flows and dependencies. Typical flows include money, data, users, attention, permissions, inventory, referrals, standards and risk. Mapping should answer four questions:

1. Who creates, delivers, influences or captures value?
2. What must flow between actors for the customer outcome to occur?
3. Which actor controls access, standards, data or trust?
4. Where can coordination fail?

A product may occupy different roles: component supplier, orchestrator, marketplace, complementor, infrastructure provider or end-user solution. Each role creates different strategic choices. An orchestrator may need governance rules and quality control; a complementor may depend on platform access; a component provider may compete on reliability and integration.

Network effects occur when the value of a product changes as participation changes. Direct network effects arise among users of the same product, while indirect network effects arise when one user group attracts complements or another user group. Network effects should not be assumed merely because a product has many users. The effect must be demonstrated through increased value, liquidity, matching quality, content, trust or reduced cost.

Important ecosystem risks include platform dependency, partner opportunism, data-access restrictions, regulatory liability, concentration of supply, interoperability failure and misaligned incentives. A product manager should identify alternatives for critical dependencies and define governance mechanisms before scale makes change expensive.

8. Strategic Foresight and Disruption

Strategic foresight is the disciplined exploration of plausible futures. It differs from forecasting, which often extrapolates a likely trajectory. Foresight is valuable where uncertainty is high and decisions are difficult to reverse.

Useful methods include:

• Horizon scanning: systematic collection of weak signals, emerging technologies, policy developments and behavioural changes.
• Trend-impact analysis: examination of how a trend could affect customers, competitors, costs and capabilities.
• Scenario planning: construction of several coherent futures based on critical uncertainties.
• Technology roadmapping: linking technological developments to product capabilities and timing.
• Pre-mortem analysis: asking why a proposed strategy might have failed.
• War-gaming: exploring likely responses by competitors, regulators and partners.

A scenario is not a prediction. A robust scenario includes a causal narrative, observable indicators, implications and strategic options. For example, a product team might explore futures in which regulation becomes stricter or looser, and in which platform access becomes open or concentrated. The team can then identify actions that are robust across scenarios and signposts that warrant a change in strategy.

Disruption is frequently used imprecisely. In the theory associated with disruptive innovation, entrants initially serve overlooked or new-market customers with a simpler, more accessible offering and may later move upward as capabilities improve. Not every new technology, low-priced product or successful entrant is disruptive in this technical sense. Product teams should distinguish technological novelty, business-model innovation, market displacement and formal disruption theory.

9. Integrating Discovery into Product Strategy

External discovery becomes valuable when it changes a decision. A practical synthesis process is:

1. Define the customer job, market boundary and unit of analysis.
2. Segment customers by meaningful differences in need and economics.
3. Estimate TAM, SAM and SOM using both top-down and bottom-up evidence.
4. Identify direct competitors, substitutes and the status quo.
5. Analyse industry forces and ecosystem dependencies.
6. Map trends, uncertainties and plausible future states.
7. Identify strategic options and assumptions.
8. Test the highest-risk assumptions through research or experiments.
9. Convert findings into positioning, roadmap, pricing, channel and partnership decisions.
10. Establish leading indicators and review the analysis periodically.

The central discipline is assumption management. Each major claim should have an owner, evidence source, confidence level, decision relevance and expiry condition. A market model that cannot be linked to a product decision is an analytical artefact rather than useful discovery.

Applied Case: RouteWise for Small-Fleet Logistics

This is an illustrative fictional case.

Background

RouteWise is a proposed software product for small delivery fleets. It combines route planning, driver communication and delivery-status updates. The founding team initially defined its market as “the global logistics software market” and estimated a TAM of several billion pounds from an industry report.

Problem

Early interviews revealed that small fleet operators were not primarily seeking sophisticated optimisation. Their urgent problems were missed delivery windows, customer complaints and the time required to coordinate drivers using telephone calls and messaging applications. The team also discovered that many operators already used accounting software and a vehicle-tracking system, creating integration requirements.

Analysis

The team redefined the arena as independent delivery firms operating 5–50 vehicles in two initial regions. It separated three segments: parcel subcontractors, local retailers with their own fleets and specialist service businesses. Parcel subcontractors had high route volume but low willingness to pay; specialist service businesses had fewer routes but higher costs of missed appointments.

A bottom-up estimate identified 4,000 eligible firms, an average annual price of £2,400 and an initial serviceability factor of 50%:

The team did not assume a market-share percentage for SOM. Instead, it modelled sales capacity: two account executives could each close 30 customers annually, producing 60 customers or £144,000 in first-year contract value before expansion revenue.

Competitor analysis identified route-optimisation suites, generic field-service tools and spreadsheets. The status quo was strong because operators trusted their existing process and feared disruption during peak periods. Ecosystem analysis identified mapping APIs, vehicle-tracking providers, delivery marketplaces and telecommunications networks as important complements. Dependence on a single mapping API was judged a material risk.

Approach and outcome

RouteWise narrowed its initial positioning to “reduce missed delivery windows for small fleets without replacing existing accounting or tracking systems.” It built integrations before advanced optimisation features, offered a pilot with one depot, and measured on-time delivery, dispatcher time and driver adoption. The company also negotiated a second mapping provider and documented data-processing responsibilities.

The case demonstrates that a smaller, evidence-based market definition can produce a stronger opportunity than an inflated industry estimate. It also shows that competition includes familiar routines and that ecosystem dependencies can shape product architecture.

Learning points

• Market size must reflect a specific customer, problem, geography and period.
• The status quo can be harder to displace than a visible software competitor.
• Bottom-up sales capacity can produce a more credible early SOM than a percentage assumption.
• Integrations and supplier alternatives are strategic, not merely technical concerns.
• Positioning should express a customer outcome and a meaningful basis for comparison.

10. Ethics, Governance and Evidence Quality

Market and competitive intelligence can create ethical risks. Teams should avoid collecting personal data without a lawful basis, misrepresenting identity during research, violating confidential agreements, scraping restricted information, or using sensitive competitor information obtained improperly. Customer reviews and social posts may contain personal or unverifiable claims and should be treated cautiously.

AI tools can accelerate competitor summarisation, trend scanning and classification, but they may reproduce outdated information, hallucinate sources, confuse similarly named firms or infer sensitive attributes. Human review, source preservation, date stamping and confidence ratings are essential. AI-generated market estimates should never be accepted without inspecting the underlying assumptions and units.

Governance should define who can access research, how evidence is stored, how personal data is minimised, and how conflicts of interest are handled. Regulatory requirements may affect market access, product claims, data use, safety, accessibility, competition and consumer protection. A strategically attractive market may be commercially unsuitable if compliance obligations cannot be met responsibly.

Challenges and Limitations

Market discovery is constrained by several recurring problems:

• Boundary ambiguity: different analysts may count different products in the same market.
• Evidence delay: published reports may describe yesterday’s market.
• Selection bias: interviews often overrepresent accessible or enthusiastic customers.
• Revealed versus stated preference: what customers say they value may differ from what they buy or use.
• Competitive opacity: private firms rarely disclose reliable economics.
• Endogeneity: market growth may result from the very innovation being evaluated.
• False precision: a single number can conceal wide uncertainty.
• Strategic interaction: competitors change behaviour in response to the entrant.
• Dynamic ecosystems: platform rules, regulation and standards may change quickly.

These limitations do not invalidate analysis. They require triangulation, explicit assumptions, ranges, sensitivity analysis and continuous updating.

Chapter Summary

Market, ecosystem and competitive discovery expands product discovery beyond the immediate user problem. Markets should be bounded by customer, job, geography, period and exchange mechanism. Segmentation identifies groups with materially different needs or economics. TAM, SAM and SOM provide progressively more realistic views of opportunity, but their quality depends on transparent assumptions, unit consistency and bottom-up validation.

Competitive discovery includes direct competitors, adjacent alternatives, substitutes and the status quo. Positioning maps clarify customer comparison criteria, while Porter’s Five Forces helps assess structural pressure when applied to a clearly defined arena. Ecosystem mapping reveals partners, complementors, dependencies, governance issues and points of control. Strategic foresight supports decisions under uncertainty through trends, scenarios, signposts and robust options.

The professional product manager converts these analyses into decisions about positioning, product scope, pricing, distribution, architecture, partnerships and experimentation. Ethical research practice, evidence quality and responsible use of AI are essential to credible discovery.

Key Terms

TAM: Total demand theoretically addressable within a defined market scope.

SAM: The portion of TAM that fits the product’s current serviceability constraints.

SOM: The portion of SAM realistically obtainable within a stated period.

Market segment: A group with sufficiently similar needs, behaviour or economics.

Category: A recognised grouping of products treated as comparable by customers or institutions.

Industry: Firms sharing related supply-side activities, capabilities or outputs.

Ecosystem: Interdependent actors jointly enabling or constraining a customer outcome.

Direct competitor: A firm offering a similar solution to a similar target customer.

Substitute: A different solution that performs the same underlying job.

Status quo: The existing behaviour or process that a new product must displace.

Positioning: The intended meaning and comparative place of a product in the customer’s mind.

Porter’s Five Forces: A framework for analysing rivalry, entry, buyers, suppliers and substitutes.

Network effect: A change in product value associated with changes in participation or connected users.

Complementor: An actor whose product or service increases the value of another offering.

Strategic foresight: Structured exploration of plausible futures and their implications.

Scenario: A coherent, plausible future narrative used to test strategic choices.

Weak signal: An early, ambiguous indication of possible change.

Bottom-up market sizing: Estimation built from observable customers, units, prices and frequencies.

Review Questions

Short Answer Questions

1. Distinguish a market, a category and an ecosystem.
2. What is the difference between TAM, SAM and SOM?
3. Why should the status quo be treated as a competitor?
4. Name the five forces in Porter’s framework.
5. What is the purpose of scenario planning?

Long Answer Questions

1. Explain how a product team should design and validate a market segmentation scheme.
2. Compare top-down and bottom-up market-sizing methods, including their principal limitations.
3. Explain how substitutes and switching costs affect competitive discovery.
4. Discuss how ecosystem dependencies can influence product architecture and strategy.
5. Critically evaluate the usefulness and limitations of Porter’s Five Forces for platform markets.

Analytical / Application Questions

1. A company identifies 25,000 potential customers, an annual price of £1,200 and a serviceability factor of 40%. Calculate TAM and SAM, state the assumptions, and explain why the result is not yet a credible SOM.
2. Select a product category and construct a competitor set containing direct competitors, substitutes and the status quo. Explain the customer job that makes each alternative relevant.
3. Develop two plausible scenarios for a product affected by changing regulation and platform access. Identify one signpost and one robust strategic action for each scenario.

Multiple Choice Questions with Answers

Question 1

Which measure represents the portion of a market that a firm can realistically capture within a defined period?

A. TAM

B. SAM

C. SOM

D. Industry revenue

Correct Answer: C. SOM

Question 2

In the bottom-up formula TAM = N × f × p × T, what does p represent?

A. Number of potential customers

B. Purchase frequency

C. Average price per purchase

D. Market-share percentage

Correct Answer: C. Average price per purchase

Question 3

A spreadsheet-based manual process that customers currently use instead of a new application is best classified as what?

A. Complementor

B. Status quo

C. Supplier

D. Direct network effect

Correct Answer: B. Status quo

Question 4

Which of the following is one of Porter’s Five Forces?

A. Internal employee capability

B. Bargaining power of suppliers

C. Brand colour consistency

D. Product usability score

Correct Answer: B. Bargaining power of suppliers

Question 5

Why should an apparently empty space on a positioning map not automatically be treated as an opportunity?

A. Maps cannot contain more than four products

B. Empty space may reflect low demand or poor economics

C. Competitors cannot occupy map positions

D. Positioning maps measure only financial performance

Correct Answer: B. Empty space may reflect low demand or poor economics

Question 6

Which actor is a complementor?

A. A firm whose offering increases the value of the focal product

B. A customer who refuses to switch products

C. A regulator that prohibits market entry

D. A competitor selling an identical product

Correct Answer: A. A firm whose offering increases the value of the focal product

Question 7

A platform retains 8% of transaction value. If transaction value is £500,000, what is platform revenue before other adjustments?

A. £4,000

B. £8,000

C. £40,000

D. £62,500

Correct Answer: C. £40,000

Question 8

What is the principal distinction between forecasting and strategic foresight?

A. Forecasting uses no evidence

B. Foresight explores multiple plausible futures rather than only one likely trajectory

C. Forecasting applies only to technology

D. Foresight guarantees accurate predictions

Correct Answer: B. Foresight explores multiple plausible futures rather than only one likely trajectory

Question 9

Which practice most improves the credibility of a market-size estimate?

A. Reporting a single precise number without assumptions

B. Using only competitor marketing claims

C. Triangulating top-down and bottom-up evidence

D. Defining the market as the broadest human need

Correct Answer: C. Triangulating top-down and bottom-up evidence

Question 10

In the RouteWise case, why was a second mapping provider strategically valuable?

A. It eliminated all competitive rivalry

B. It reduced dependency risk in the ecosystem

C. It increased the theoretical TAM

D. It converted a substitute into a direct competitor

Correct Answer: B. It reduced dependency risk in the ecosystem