Chapter 5
Media Data Sources, Collection and Governance
Bachelors Program in Mass Media Management
Media Analytics & Consumer Insights
•
Bachelor
Media Data Sources, Collection and Governance
Introduction
Media organisations operate in an environment in which audiences leave many kinds of data traces: they watch programmes, click advertisements, subscribe to services, comment on social platforms, respond to surveys, and interact with branded content. These traces can support decisions about content commissioning, audience development, advertising sales, distribution, pricing and public communication. However, data are not automatically equivalent to insight. A large dataset may be incomplete, commercially biased, poorly defined or collected without adequate consent.
Media analytics therefore begins before statistical analysis. It begins with identifying the appropriate data source, defining the population and variables, selecting a collection method, evaluating data quality, and establishing governance controls. This chapter examines first-, second- and third-party data; primary research methods; platform and digital data; data quality and taxonomy; and the ethical, legal and managerial requirements for responsible data use.
Learning Objectives
By the end of this chapter, students should be able to:
Distinguish first-, second- and third-party data and assess their uses and limitations.
Compare surveys, interviews, focus groups, observation, panels, platform data, social listening and digital tracking.
Select collection methods appropriate to a media-management problem.
Evaluate data quality using dimensions such as accuracy, completeness, validity, timeliness and uniqueness.
Explain the role of taxonomies, metadata, data dictionaries and governance structures.
Apply ethical and regulatory principles to audience-data management.
Design a practical data-collection and governance plan for a media organisation.
1. Data Sources in Media Management
A data source is an origin from which observations, records or measurements are obtained. In media, a single project may combine subscription records, website events, survey responses, advertising logs and social conversation. Combining sources can improve understanding, but it also increases the risk of incompatible definitions, duplicate records and unlawful or unexpected use.
First-party data
First-party data are collected directly by an organisation from its own audience, customers, employees or operational systems. Examples include:
subscription and registration records;
website and application interaction logs;
customer-service contacts;
newsletter openings and clicks;
advertising-delivery records;
content-consumption histories;
responses to an organisation’s own survey.
First-party data are valuable because the organisation controls their collection context and can often connect them to business processes. A streaming service can examine whether a subscriber watched a programme after receiving a recommendation. A newspaper can compare article engagement with subscription conversion.
Their limitations are equally important. First-party data describe the organisation’s users, not necessarily the whole population. They may reflect only people who logged in, accepted cookies, used a particular device or remained customers. Operational systems may also use inconsistent definitions. For example, “active user” could mean one login in 30 days, one content view in seven days, or a paid account that has not been cancelled.
Second-party data
Second-party data are another organisation’s first-party data obtained through a direct relationship, such as a partnership, data-sharing agreement, sponsorship arrangement or research collaboration. A broadcaster might receive audience information from a ticketing partner; a publisher might work with a retail partner to study campaign outcomes.
Second-party arrangements can provide information unavailable internally, but they require scrutiny of collection methods, consent, ownership, permitted uses, security controls and data definitions. A partner’s “household” or “conversion” variable may not mean the same thing as the media organisation’s equivalent variable.
Third-party data
Third-party data are collected and aggregated by an intermediary that did not have the direct relationship with the individual at the point of use. Examples include commercial demographic segments, syndicated audience estimates, market databases and data-broker products.
Third-party data can supply market benchmarks and reach people outside an organisation’s own customer base. Nevertheless, provenance may be unclear. The buyer should ask how the data were collected, how recently they were updated, whether individuals were informed, how segments were inferred, and whether the data can lawfully be used for the intended purpose. Third-party data should not be treated as inherently objective merely because they are supplied commercially.
Data category
Typical source
Main strength
Main risk
First-party
CRM, app, website, subscription system
Direct operational relevance
Narrow or self-selected population
Second-party
Partner or contractual exchange
Access to complementary audiences
Incompatible definitions or permissions
Third-party
Data vendor or syndicated research
Market scale and benchmarking
Weak provenance, outdated segments
A useful decision rule is to select the source that best matches the question. Internal behavioural data may answer “What did registered users do?” but not “Why did they behave that way?” A survey or interview may answer the second question, while a probability sample may be required to estimate the wider population.
2. Primary Research Methods
Primary research collects new evidence for a specific research purpose. Method selection should follow the decision problem, not the convenience of the researcher.
Surveys
Surveys collect standardised responses from a sample through questionnaires delivered online, by telephone, face to face or through another channel. They are useful for measuring attitudes, awareness, satisfaction, media use, demographic characteristics and self-reported behaviour.
Good survey design requires clear constructs, neutral wording, logical sequencing and suitable response scales. “How satisfied are you with our excellent news service?” contains both a leading adjective and an assumption that the respondent used the service. Better wording separates eligibility, behaviour and evaluation.
If a response rate is being assessed, the basic calculation is:
The numerator is the number of completed usable responses; the denominator must be defined consistently, usually as eligible sampled units rather than every contact attempt. A high response rate does not guarantee representativeness, and a low response rate does not by itself prove that results are unusable. Non-response bias must be considered.
For a simple random sample, an approximate margin of error for a proportion is:
MOE = z × √[p(1 − p) ÷ n]
Here, p is the estimated proportion, n is the sample size, and z is the critical value associated with the chosen confidence level. For a 95% confidence level, z is approximately 1.96. This approximation assumes a probability sample and ignores design effects, non-response adjustment and finite-population correction. It should not be presented as a guarantee that the sample is representative.
Interviews
Interviews are particularly useful when researchers need depth, explanation and personal context. A semi-structured interview uses a topic guide while allowing participants to explain unexpected experiences. Interviews can reveal why audiences distrust a news brand, how producers interpret analytics dashboards, or what barriers prevent accessibility.
Interviews are time-intensive and vulnerable to interviewer effects, selective recruitment and retrospective error. The interviewer should record the sampling rationale, consent procedure, interview setting, transcription approach and coding process.
Focus groups
A focus group is a moderated discussion among several participants who share views about a topic, product or media experience. Interaction between participants can generate language, associations and disagreements that would not arise in an individual interview. Focus groups are useful in concept development, programme testing, brand exploration and exploratory audience research.
They are not miniature public-opinion polls. Dominant participants may influence others, socially desirable responses may occur, and participants may perform for the group. Results should normally be interpreted as qualitative insight rather than population estimates.
Observation
Observation examines behaviour in a natural or designed setting. It may involve observing newsroom workflows, audience movement at an event, user testing, or the way people navigate a media application. Observation can reveal differences between what people say and what they do.
Researchers must address reactivity, privacy, observer bias and the boundary between public visibility and ethical permission. A person appearing in a public digital space has not necessarily consented to unrestricted profiling or commercial use.
Panels
A panel repeatedly measures the same individuals, households or devices over time. Audience panels can estimate television viewing, radio listening, print readership or cross-media behaviour. Repeated measurement supports trend analysis and individual-level change, but panel conditioning, attrition and coverage error can affect findings.
Panels may be probability-based, recruited from a defined population, or non-probability-based, recruited through invitations, platforms or volunteers. The recruitment design determines what claims are defensible.
3. Platform, Social and Digital Tracking Data
Platform data
Platforms such as video services, social networks, podcast hosts and advertising systems generate metrics including impressions, reach, views, watch time, completion, clicks, shares and audience characteristics. These data are often available quickly and at large scale.
Platform metrics are not automatically comparable. A “view” may require a particular duration on one platform but not another. Reach may be estimated rather than directly counted. Some metrics are modelled, sampled, deduplicated or affected by privacy controls. Media managers should document the metric definition, reporting window, attribution rule and any platform changes.
Social listening
Social listening involves collecting and analysing publicly available or licensed online conversations. It may include keyword monitoring, sentiment classification, topic modelling, network analysis and identification of emerging issues.
Social listening is useful for detecting themes, reactions and reputational risks, but online conversation is not equivalent to public opinion. Users are unevenly represented; automated accounts and coordinated campaigns may distort volume; sarcasm and local language complicate sentiment analysis; and private or semi-private content raises additional ethical concerns. Analysts should report source coverage and uncertainty rather than presenting a sentiment score as a direct measure of collective mood.
Digital tracking
Digital tracking records interactions such as page views, session starts, searches, scrolls, video plays, purchases and advertising exposures. Tracking may use server logs, cookies, software development kits, pixels, device identifiers or authenticated account IDs.
A tracking plan should specify each event, its trigger, required parameters, responsible system, retention period and intended use. It should also distinguish between an event, a session, a user and a device. These are not interchangeable units. A single person may use several devices, while several people may use one shared device.
A simple conversion rate is:
Conversion rate = Number of defined conversions ÷ Number of eligible opportunities × 100%
The numerator and denominator must refer to the same population and time period. If conversions are divided by impressions in one report and by unique visitors in another, the resulting rates should not be compared without qualification.
4. From Raw Data to Governed Information
Data governance is the framework of roles, policies, standards and controls through which data are managed as an organisational asset and a social responsibility. Governance is not limited to cybersecurity. It includes meaning, quality, access, accountability, retention, lawful processing and appropriate use.
Media data governance lifecycle
Figure: Media data governance lifecycle
Figure: A governance lifecycle for media data.
Data quality
Important dimensions of quality include:
Accuracy: Does the value correctly represent the thing measured?
Completeness: Are required values present?
Validity: Does the value conform to permitted formats and rules?
Consistency: Do the same concepts have compatible values across systems?
Uniqueness: Are duplicate records controlled?
Timeliness: Is the data sufficiently current for the decision?
Fitness for purpose: Is the data appropriate for the intended analysis?
Quality is contextual. A weekly audience estimate may be timely enough for programming decisions but inadequate for real-time campaign optimisation. A demographic field may be complete yet inaccurate because it was inferred from an unreliable source.
A quality assessment should examine missingness, duplicate rates, invalid values, unexpected changes, outliers and reconciliation with trusted totals. Corrections should be documented rather than silently overwriting the original record. Where data are estimated or modelled, the method and uncertainty should be recorded.
Taxonomy and metadata
A taxonomy is a structured classification of concepts. In media, it may classify content by genre, topic, format, audience, brand, platform or campaign. A controlled taxonomy improves reporting, search, recommendation and cross-platform comparison.
A useful taxonomy has defined terms, inclusion rules, ownership, version control and a process for handling new categories. “Sports,” “Sport,” and “sports-news” should not be treated as equivalent unless the system explicitly maps them.
Metadata are data about data. Examples include the content creator, publication time, language, rights status, content type, collection method, consent status and retention date. A data dictionary gives each field a name, definition, format, allowed values, business owner and sensitivity classification. Without these controls, dashboards can create an appearance of precision while different teams measure different things.
5. Governance, Ethics and Regulation
Media data governance must protect people as well as organisations. Core principles include purpose limitation, data minimisation, transparency, security, accountability, fairness and retention control. Data should be collected for specified purposes and not repurposed without a defensible legal and ethical basis.
Privacy regulation differs by jurisdiction, but common obligations include identifying a lawful basis for processing, providing clear notices, respecting rights of access or deletion where applicable, managing consent appropriately, controlling processors and vendors, and reporting or mitigating breaches. Organisations operating across borders must examine where data are collected, stored, processed and transferred.
Consent should be informed, specific and freely given where consent is the relevant basis. A preselected box, confusing interface or refusal that blocks an unrelated service may not represent meaningful choice. Consent records should show what was explained, when permission was obtained and how it can be withdrawn.
Sensitive attributes and inferred characteristics require heightened care. Targeting based on health, political belief, ethnicity, precise location or vulnerable status can create discrimination or manipulation risks. Even apparently neutral variables can act as proxies. Governance should therefore include impact assessments, access controls, retention limits and human review for high-risk uses.
Artificial intelligence can assist with classification, transcription, anomaly detection, recommendation and sentiment analysis. It can also reproduce biased training data, infer sensitive characteristics, expose personal information or produce unsupported conclusions. Human oversight, documentation of model inputs, validation across relevant groups and an appeal or correction process are essential.
6. Selecting a Collection Strategy
A robust project starts with a decision statement: what decision must the evidence support? The researcher then defines the target population, unit of analysis, variables, time period, source, collection method and quality criteria.
A practical mixed-method design may combine:
first-party behavioural data to identify a usage pattern;
a survey to estimate how common the pattern is and measure attitudes;
interviews to understand motivations and barriers;
platform or market data to provide external comparison;
governance review to ensure lawful and appropriate use.
Triangulation does not mean that all sources will produce identical results. Different methods measure different aspects of reality. If observed viewing is lower than self-reported viewing, the difference may reflect recall error, shared devices, different definitions or social desirability. The discrepancy is a research finding requiring investigation, not an automatic reason to discard one source.
Applied Case: Northstar News Digital Retention Project
This is an illustrative case. Northstar News, a regional digital publisher, observed that registered users read several articles but rarely converted to paid subscriptions. Management initially proposed using a third-party “high-income news enthusiast” segment for aggressive retargeting.
Problem
The proposed segment had unclear provenance, and the organisation’s internal reports used different definitions of an active reader. Marketing counted a page view, editorial counted a session, and product counted a logged-in user.
Analysis
The analytics team created a data dictionary. It defined an active reader as a registered account with at least two qualifying article views on separate days during a 30-day period. It then examined first-party event logs, a short survey and twelve semi-structured interviews. The survey measured perceived value, payment barriers and privacy expectations. Interviews explored why readers stopped before subscribing.
The team found that many users encountered the paywall on mobile devices but did not understand the subscription benefits. Several users shared devices, making device-based frequency measures misleading. The third-party segment added little explanatory value and could not be confidently linked to consent for Northstar’s intended use.
Approach and solution
Northstar adopted a first-party strategy. It improved event definitions, introduced a transparent subscription explanation, offered a consent-based preference centre, and used aggregated cohorts rather than individual-level targeting where possible. Survey and interview findings were combined with behavioural data, but no claim was made that behavioural records alone revealed motivation.
Outcome
The publisher obtained more consistent reporting, reduced reliance on opaque external segments and created an auditable process for access and deletion requests. The key managerial outcome was not simply a higher conversion metric; it was a more defensible relationship between data collection, audience value and user expectations.
Learning points
Data volume cannot compensate for unclear definitions.
Behavioural data and qualitative evidence answer different questions.
Third-party data require provenance and permission checks.
A data dictionary is a managerial tool, not merely a technical document.
Privacy and audience trust are part of long-term media performance.
Best-Practice Checklist
Before launching a media-data project, ask:
What decision will the data support?
Who is the target population, and who is excluded?
Is the source first-, second- or third-party?
What are the unit of analysis and operational definitions?
What consent, notice or other lawful basis applies?
Are the data accurate, complete, valid, unique and timely enough?
Are fields and metrics documented in a data dictionary?
Who owns the data and who may access it?
How long will it be retained, and how will it be deleted?
What biases, harms or unintended uses could arise?
How will findings and limitations be communicated?
Chapter Summary
Media data come from organisational systems, partners, vendors, research participants, platforms and digital interactions. First-party data are operationally relevant but often narrow; second-party data expand perspective but require contractual and definitional alignment; third-party data provide scale but demand careful assessment of provenance and permitted use. Surveys, interviews, focus groups, observation and panels offer different forms of evidence, while platform data, social listening and digital tracking provide timely behavioural and conversational signals.
Sound analytics depends on more than collection. Data quality must be assessed through accuracy, completeness, validity, consistency, uniqueness, timeliness and fitness for purpose. Taxonomies, metadata and data dictionaries establish shared meaning. Governance provides controls for consent, access, security, retention, accountability and ethical use. The most credible media insights combine appropriate methods, transparent definitions, critical interpretation and respect for audience rights.
Key Terms
First-party data: Data collected directly by an organisation from its own audience or operations.
Second-party data: Another organisation’s first-party data shared through a direct relationship.
Third-party data: Data obtained from an external intermediary that collected or aggregated it from other sources.
Primary research: Collection of new data for a specific research purpose.
Survey: A standardised instrument for collecting responses from sampled participants.
Interview: A structured or semi-structured conversation used to obtain detailed evidence.
Focus group: A moderated group discussion used mainly for exploratory qualitative insight.
Panel: A group measured repeatedly over time.
Platform data: Metrics and records generated by a media or advertising platform.
Social listening: Systematic monitoring and analysis of online conversations.
Digital tracking: Recording digital interactions such as views, clicks and conversions.
Data governance: Policies, roles, standards and controls for responsible data management.
Data quality: The degree to which data are accurate, complete, valid, consistent, unique, timely and fit for purpose.
Taxonomy: A structured classification system for organising concepts or content.
Metadata: Information describing the characteristics, origin and conditions of data.
Data dictionary: A documented list of fields, definitions, formats, values and ownership.
Purpose limitation: Using data only for specified and defensible purposes.
Non-response bias: Systematic difference between respondents and eligible units that do not respond.
Triangulation: Combining methods or sources to develop a more robust interpretation.
Review Questions
Short Answer Questions
What is the principal difference between first-party and third-party data?
Why is a focus group unsuitable for estimating population proportions on its own?
Name four dimensions of data quality.
What is the purpose of a data dictionary?
Why should a platform’s definition of “view” be documented before comparison with another platform?
Long Answer Questions
Compare the strengths and limitations of first-, second- and third-party data in media management.
Explain how surveys, interviews, focus groups, observation and panels produce different kinds of evidence.
Discuss the principal ethical and regulatory issues in digital audience tracking.
Explain how taxonomy and metadata improve media analytics.
Describe a complete governance lifecycle for a media-data project.
Analytical / Application Questions
A streaming service reports that 60% of users completed a programme, while a survey reports that 78% of respondents watched it to the end. Design an investigation of the discrepancy, identifying definitions, sampling, measurement and privacy issues that should be examined.
A broadcaster wants to buy a third-party political-interest segment for targeted advertising. Evaluate the proposal using provenance, consent, fairness, security and purpose-limitation criteria.
Design a mixed-method research plan for a publisher whose mobile readers have high article engagement but low subscription conversion. Specify the data sources, collection methods, quality controls and governance requirements.
Multiple Choice Questions with Answers
Question 1
Which statement best defines first-party data?
A. Data purchased from an anonymous data broker
B. Data collected directly by an organisation from its own audience or operations
C. Data borrowed from a competitor without a contract
D. Data produced only by a government census
Correct Answer: B. Data collected directly by an organisation from its own audience or operations
Question 2
What is a major limitation of platform metrics such as views and reach?
A. They are never available quickly
B. They cannot describe digital behaviour
C. Their definitions and counting rules may differ across platforms
D. They always require face-to-face interviews
Correct Answer: C. Their definitions and counting rules may differ across platforms
Question 3
Which method is most suitable for exploring why users abandon a subscription process?
A. A semi-structured interview
B. A raw impression count
C. A content taxonomy alone
D. A duplicate-record report
Correct Answer: A. A semi-structured interview
Question 4
In the response-rate formula, the denominator should be defined consistently as the number of:
A. All people in the country
B. Eligible sampled units
C. Completed interviews only
D. Social-media followers
Correct Answer: B. Eligible sampled units
Question 5
Which data-quality dimension asks whether required values are present?
A. Completeness
B. Timeliness
C. Uniqueness
D. Accuracy
Correct Answer: A. Completeness
Question 6
What is the main purpose of a data dictionary?
A. To increase the number of advertisements served
B. To replace all privacy policies
C. To document field meanings, formats, values and ownership
D. To guarantee that every sample is representative
Correct Answer: C. To document field meanings, formats, values and ownership
Question 7
Why should social-listening results not automatically be treated as public opinion?
A. Online users are always randomly selected
B. Online conversations may be unrepresentative and affected by bots or coordinated activity
C. Social platforms contain no text
D. Sentiment analysis measures only television ratings
Correct Answer: B. Online conversations may be unrepresentative and affected by bots or coordinated activity
Question 8
Which principle limits the use of collected data to specified purposes?
A. Purpose limitation
B. Unlimited retention
C. Audience duplication
D. Metric inflation
Correct Answer: A. Purpose limitation
Question 9
A conversion rate is calculated by dividing conversions by:
A. Any convenient total from a different time period
B. Eligible opportunities defined for the same measure
C. The number of employees in the organisation
D. The number of taxonomy categories
Correct Answer: B. Eligible opportunities defined for the same measure
Question 10
What is triangulation in media research?
A. Deleting all qualitative evidence
B. Using only third-party data
C. Combining methods or sources to develop a more robust interpretation
D. Counting one user on three devices as three confirmed people
Correct Answer: C. Combining methods or sources to develop a more robust interpretation
Media Analytics & Consumer Insights
Chapter 5
of 14