Bachelors Program in Business Analytics
Research Methodology
•
Bachelor
Foundations of Research Methodology
Introduction
Business analytics is often described as the use of data to support better decisions. Yet data alone do not constitute research. Research requires a disciplined process for defining a problem, developing questions, gathering evidence, evaluating explanations, and communicating conclusions. Research methodology provides the logic that connects a business problem to a defensible answer.
For an analyst, this foundation is essential. A dashboard may show that customer churn increased, but it does not by itself explain why churn increased, whether a proposed retention programme caused improvement, or whether the result will generalize to other customers. Those questions require different forms of inquiry and different standards of evidence.
This chapter introduces the central ideas of scientific inquiry and business research. It explains how theories are built, how constructs become measurable variables, how propositions and hypotheses guide investigation, and how researchers reason about evidence and causality. It also distinguishes exploratory, descriptive, explanatory, predictive, and evaluative research.
Learning Objectives
By the end of this chapter, you should be able to:
Explain the nature and stages of scientific inquiry.
Distinguish research methodology, methods, data, evidence, and analysis.
Describe the roles of theory, constructs, variables, propositions, and hypotheses.
Explain measurement, operationalization, reliability, and validity.
Distinguish association from causation and identify major threats to causal inference.
Classify research as exploratory, descriptive, explanatory, predictive, or evaluative.
Formulate a suitable research approach for a business analytics problem.
Recognize ethical, governance, and professional responsibilities in business research.
1. Scientific Inquiry and the Logic of Research
Scientific inquiry is a systematic approach to producing and evaluating knowledge. It is not limited to laboratory science. In business, scientific inquiry can be used to study markets, employees, operations, consumers, technologies, and organizational performance.
Scientific inquiry generally involves the following cycle:
Recognizing a problem or phenomenon. An organization identifies an important uncertainty, anomaly, opportunity, or decision.
Reviewing existing knowledge. The researcher examines theories, prior studies, industry reports, and relevant data.
Formulating a question or explanation. The problem is converted into a researchable question, proposition, or hypothesis.
Designing an investigation. The researcher chooses appropriate sources, measures, samples, and analytical procedures.
Collecting evidence. Data are gathered systematically and documented.
Analyzing and interpreting evidence. Patterns, relationships, explanations, and uncertainties are assessed.
Communicating conclusions. Findings, limitations, implications, and recommendations are reported.
Learning and revising. New evidence may refine, reject, or extend existing explanations.
Scientific inquiry is characterized by several principles:
Systematicity: procedures are planned rather than improvised.
Transparency: decisions, definitions, sources, and limitations are documented.
Fallibility: conclusions are treated as open to revision.
Empirical grounding: claims are connected to observable evidence.
Logical consistency: conclusions should follow from the question, design, and analysis.
Critical scrutiny: alternative explanations and possible errors are considered.
Reproducibility or auditability: another competent researcher should be able to understand how the result was obtained, even when exact replication is not possible.
Scientific inquiry does not mean that every study must use numerical data. Qualitative interviews, observations, documents, and case studies can provide empirical evidence when they are collected and interpreted systematically.
2. Business Research: Essential Terminology
Several terms are frequently confused in business analytics.
Term
Meaning
Research
A systematic investigation intended to develop or evaluate knowledge.
Methodology
The overall logic, philosophical assumptions, design, and justification of a study.
Method
A specific procedure for collecting or analyzing data, such as a survey or regression model.
Data
Recorded observations, measurements, responses, transactions, or documents.
Evidence
Data that are relevant, credible, and appropriately interpreted in relation to a claim.
Population
The complete set of units to which a study is intended to relate.
Sample
A subset of the population actually studied.
Unit of analysis
The entity about which conclusions are drawn, such as a customer, employee, store, or firm.
Parameter
A characteristic of a population, usually unknown.
Statistic
A characteristic calculated from a sample.
Measurement
The process of assigning values or labels to attributes according to rules.
Operationalization
Translating an abstract concept into observable indicators or procedures.
Bias
A systematic tendency that distorts findings away from the phenomenon of interest.
Uncertainty
The incompleteness or imprecision surrounding a conclusion.
Generalizability
The extent to which findings apply beyond the study context.
A business report may contain data without containing research. For example, a monthly sales report records transactions, whereas a research study might investigate whether a pricing change caused a sales shift. The latter requires a question, a design, evidence, and an argument.
3. From Business Problem to Research Question
A business problem is a practical situation requiring attention, such as falling retention, slow delivery, low employee engagement, or uncertain demand. A research problem is the specific knowledge gap that must be addressed to understand or resolve the business problem.
Consider the distinction:
Business problem: A subscription company is losing customers.
Weak research question: Why are customers unhappy?
Better research question: Which service experiences are associated with cancellation among customers whose contracts became renewable during the last six months?
Causal question: Does reducing response time decrease cancellation, after accounting for customer tenure and plan type?
A good research question is clear, focused, answerable with available or collectable evidence, and significant to a decision or body of knowledge. It should also identify the relevant population, context, time period, and key concepts.
A research question should not be confused with a recommendation. “Should the company introduce a loyalty programme?” is a decision question. Research may inform it by asking whether loyalty incentives increase repeat purchase, for which customer segments, and at what cost.
4. Theory, Constructs, and Conceptual Models
4.1 What is a theory?
A theory is a systematically organized set of concepts and relationships that explains or predicts a phenomenon. A theory is more than a list of facts. It identifies mechanisms, conditions, and expected relationships.
For example, a theory of technology adoption may propose that perceived usefulness and perceived ease of use influence a person’s intention to use a system. The theory helps a researcher decide what to measure and what relationships to test.
A useful theory typically performs four functions:
Description: identifies important elements of a phenomenon.
Explanation: proposes why elements are related.
Prediction: indicates what may occur under specified conditions.
Guidance: helps select questions, measures, and analytical strategies.
Theories are not permanently proven. Evidence may support a theory, qualify it, or reveal that it does not apply in a particular context. Strong research therefore states the boundaries of a theory rather than treating it as universally true.
4.2 Constructs
A construct is an abstract concept that cannot usually be observed directly. Examples include trust, service quality, employee engagement, perceived risk, innovation capability, and brand loyalty.
Constructs differ from ordinary variables because they often represent complex ideas. A customer’s trust may be reflected in confidence that a firm will protect data, fulfil promises, and act fairly. No single observation may capture the entire construct.
A conceptual model shows how constructs are expected to relate. For example:
Conceptual model linking service quality to customer loyalty through satisfaction
Figure: Conceptual model linking service quality to customer loyalty through satisfaction
Figure: An illustrative conceptual model in which satisfaction may mediate the relationship between service quality and loyalty.
A conceptual model is not proof. The arrows express proposed relationships that must be examined through appropriate evidence.
4.3 Variables and operationalization
A variable is a characteristic that can take different values across cases or time. Common roles include:
Independent or explanatory variable: a presumed influence or predictor.
Dependent or outcome variable: the result to be explained or predicted.
Mediator: a variable that helps explain how an influence operates.
Moderator: a variable that changes the strength or direction of a relationship.
Control variable: a variable included to account for plausible alternative explanations.
A construct becomes usable in empirical research through operationalization. For example, “employee engagement” might be operationalized using responses to several survey items, participation in optional activities, absenteeism records, or a validated engagement scale. Each operational choice captures some aspects and may omit others.
Measurement quality has two central dimensions:
Reliability: consistency of a measure. A reliable measure produces reasonably stable results under similar conditions.
Validity: whether the measure supports the intended interpretation. A measure can be reliable but invalid; a consistently inaccurate scale is an example.
Important forms of validity include construct validity, content validity, criterion-related validity, internal validity, and external validity. Researchers should define how a construct is measured, justify the indicators, and acknowledge limitations.
5. Propositions and Hypotheses
A proposition is a reasoned statement about the relationship between concepts. It is often used in conceptual or qualitative research. For example: “Greater perceived fairness is associated with stronger employee commitment.”
A hypothesis is a testable statement about expected relationships between measurable variables. For example: “Employees reporting higher perceived fairness will report higher organizational commitment, holding job level constant.”
A hypothesis should identify the variables, expected direction where justified, population or context, and relevant conditions. It should be derived from theory or prior evidence rather than selected merely because it is easy to test.
A statistical test does not prove a hypothesis in an absolute sense. Researchers evaluate whether the observed evidence is sufficiently inconsistent with a specified null model, while considering effect size, uncertainty, design quality, and practical importance. Statistical significance should not be confused with managerial significance.
6. Evidence and the Quality of Research Claims
Evidence supports a claim only when it is relevant and credible. A large dataset does not automatically provide strong evidence. Administrative data may contain missing values, changing definitions, duplicate records, or selection effects. Survey data may reflect nonresponse, wording effects, and socially desirable answers.
Researchers should evaluate evidence using questions such as:
Is the source appropriate for the claim?
How were observations selected?
Are concepts measured adequately?
Could missing data or measurement error distort the result?
Are alternative explanations plausible?
Is the analysis appropriate for the design and data type?
Are conclusions broader than the evidence permits?
Can the process be audited or reproduced?
Triangulation strengthens inquiry by examining a question through different data sources, methods, researchers, or theoretical perspectives. For example, customer interviews may reveal reasons for dissatisfaction, transaction data may show behavioral patterns, and a controlled intervention may test whether a proposed solution changes outcomes.
7. Association, Explanation, and Causality
An association means that two variables vary together. Causality is a stronger claim: changing one factor produces a change in another through a specified mechanism, under defined conditions.
A causal claim generally requires attention to three issues:
Temporal order: the proposed cause occurs before the effect.
Covariation: the cause and outcome are related in the data.
Alternative explanations: competing causes are controlled, balanced, or otherwise assessed.
A useful causal structure is:
Causal diagram showing treatment, outcome, confounder, and mediator
Figure: Causal diagram showing treatment, outcome, confounder, and mediator
Figure: A simplified causal model showing how a confounder can affect both treatment and outcome, while a mediator represents a possible mechanism.
A confounder is related to both the proposed cause and outcome and can create a misleading association. For example, motivated customers may both use a support feature and be less likely to churn. The observed relationship between feature use and retention may therefore partly reflect motivation.
Common approaches to causal inference include randomized experiments, natural experiments, quasi-experimental designs, longitudinal studies, matching, regression adjustment, and interrupted time-series analysis. Each relies on assumptions. Randomization can balance measured and unmeasured factors on average, but implementation failures, noncompliance, attrition, and limited generalizability remain possible.
Correlation alone does not establish causation. A relationship may reflect reverse causality, confounding, selection bias, common trends, or measurement problems. Analysts should use cautious language when the design does not support a causal interpretation.
8. Major Types of Business Research
Research types can overlap. A single project may begin exploratorily, become descriptive, test explanations, generate predictions, and evaluate an intervention. The categories below describe the dominant purpose of a study.
Type
Central question
Typical methods
Example
Exploratory
What is happening, and what concepts or explanations may matter?
Which accounts are at high risk of churn next month?
Evaluative
Did a policy, programme, or intervention work, for whom, and at what cost?
Experimental and quasi-experimental designs, outcome evaluation, cost analysis
Did a retention campaign reduce cancellations?
Exploratory research
Exploration is appropriate when the problem is poorly understood or existing concepts may be inadequate. It is especially useful before designing a structured survey or predictive model. Its purpose is usually to generate concepts, mechanisms, questions, or hypotheses rather than estimate population parameters with precision.
Descriptive research
Descriptive research establishes the distribution and characteristics of a phenomenon. It can be highly valuable for management, but description should not be presented as explanation. A report that shows that churn is higher among new customers does not establish that newness causes churn.
Explanatory research
Explanatory research examines relationships and mechanisms. It may use quantitative models, comparative cases, experiments, or mixed methods. The strength of explanation depends on design, measurement, temporal structure, and treatment of alternative explanations.
Predictive research
Prediction focuses on accuracy for future or unobserved cases. A model can predict well without identifying a causal relationship. For instance, a customer’s login frequency may predict churn even if increasing logins would not prevent churn. Predictive models must be validated on data not used to train them and monitored for drift.
Evaluative research
Evaluation judges the implementation, outcomes, impact, efficiency, and sometimes equity of an intervention. It should define success criteria in advance where possible. A programme may produce positive average effects while harming a subgroup, or achieve its outcome at a cost greater than its benefit.
9. An Illustrative Case: Reducing Subscription Churn
The following is a fictional illustrative case designed for learning purposes.
Background
StreamNow, a digital subscription service, observes that monthly cancellation has risen from 4% to 6% over two quarters. Managers believe that slow customer support is responsible and propose a priority-support programme.
Problem
The initial claim—“slow support causes churn”—is plausible but untested. Customers who contact support may already be experiencing serious problems, so support contact itself may be a marker of dissatisfaction rather than a cause of cancellation.
Analysis
The analytics team first conducts exploratory interviews with recently cancelled customers. Themes include billing confusion, missing content, unresolved technical faults, and limited perceived value. The team then performs descriptive analysis by tenure, plan, device, complaint type, and response time.
The descriptive results show that customers with unresolved technical complaints have higher cancellation rates. However, these customers also have older devices and shorter tenure. These factors may confound the relationship between support response time and cancellation.
Approach and solution
The team defines:
Outcome: cancellation within 30 days of a support case.
Proposed treatment: response within four hours rather than the existing service target.
Potential confounders: tenure, plan, device type, prior complaints, and usage.
Mechanism: faster resolution may increase satisfaction, which may reduce cancellation.
Rather than assigning priority service to customers judged likely to cancel, the company pilots the programme using a transparent randomized assignment among eligible cases. The team preregisters the primary outcome, records implementation failures, and compares results with an appropriate control group. Interviews are used to interpret why the programme did or did not work.
Outcome
Suppose the pilot finds that faster initial response improves satisfaction but does not substantially reduce cancellation. Further analysis shows that unresolved technical faults, rather than initial response time, drive most cancellations. The company therefore shifts resources toward technical resolution and clearer device support.
Learning points
A visible association may not identify the causal mechanism.
Exploratory research can improve the design of a later evaluation.
Descriptive segmentation helps identify relevant subgroups and controls.
A predictive risk score would not, by itself, show that priority support prevents churn.
Evaluation should measure implementation and outcomes, not outcomes alone.
The best decision may follow from combining qualitative and quantitative evidence.
10. Ethics, Governance, and Responsible Analytics
Research involving people and organizational data creates ethical responsibilities. Core principles include respect for persons, informed consent where appropriate, minimization of harm, fairness, confidentiality, and accountability.
Business researchers should collect only data necessary for a legitimate purpose, protect sensitive information, control access, and establish retention and deletion rules. Personal data should not be repurposed casually. De-identification reduces risk but may not eliminate re-identification, especially when datasets are combined.
Researchers must disclose conflicts of interest, avoid fabricating or selectively reporting results, distinguish exploratory analyses from pre-specified tests, and report limitations. When artificial intelligence is used, governance should address data provenance, privacy, bias, explainability, human oversight, model drift, and the consequences of automated decisions.
Ethical compliance is not merely a legal exercise. A technically accurate analysis can still be unacceptable if it discriminates, invades privacy, manipulates participants, or creates unreasonable risk. Analysts should ask who benefits, who bears risk, which groups may be excluded, and whether affected people can challenge a decision.
11. Best Practices for Beginning a Research Project
A strong research project usually follows these practices:
Begin with a decision-relevant problem and a clearly bounded question.
Review prior research before selecting measures or models.
Define the unit of analysis and target population explicitly.
Distinguish constructs from their indicators.
Match the research design to the claim: description, prediction, explanation, or evaluation.
Document data sources, transformations, exclusions, and assumptions.
Consider alternative explanations before interpreting results.
Separate statistical significance, predictive performance, causal impact, and practical value.
Validate important findings using suitable holdout data, replication, triangulation, or sensitivity analysis.
Communicate uncertainty and limitations in language decision-makers can understand.
Protect participants and govern data throughout the research lifecycle.
Chapter Summary
Research methodology provides the logic for turning a business uncertainty into a defensible conclusion. Scientific inquiry is systematic, transparent, empirical, critical, and open to revision. Business research distinguishes practical problems from researchable questions and distinguishes data from evidence.
Theory organizes concepts and relationships to describe, explain, predict, and guide inquiry. Constructs are abstract ideas that must be operationalized through suitable variables and indicators. Propositions express conceptual relationships, while hypotheses make testable claims about measurable variables. Reliability concerns consistency; validity concerns whether the evidence supports the intended interpretation.
Association is weaker than causation. Causal reasoning requires temporal order, covariation, and attention to alternative explanations. Confounding, reverse causality, selection, and measurement error can distort conclusions. Exploratory, descriptive, explanatory, predictive, and evaluative research serve different purposes and require appropriately matched designs. Ethical governance, transparency, privacy, fairness, and responsible use of analytics are integral to professional research practice.
Key Terms
Scientific inquiry: Systematic production and evaluation of knowledge through evidence and reasoning.
Research methodology: The overall logic, assumptions, design, and justification of a research study.
Research method: A specific procedure for collecting or analyzing data.
Theory: An organized explanation of concepts and relationships.
Construct: An abstract concept that is not directly observable in its entirety.
Variable: A characteristic that can take different values.
Operationalization: Translation of an abstract construct into observable indicators or procedures.
Reliability: Consistency of a measurement procedure.
Validity: Adequacy of the interpretation supported by a measure or design.
Proposition: A conceptual statement about a relationship between constructs.
Hypothesis: A testable statement about measurable variables.
Evidence: Relevant and credible information used to support or assess a claim.
Confounder: A factor related to both a proposed cause and an outcome that can distort their observed relationship.
Mediator: A factor representing a mechanism through which an influence may operate.
Moderator: A factor that changes the strength or direction of a relationship.
Causality: A relationship in which a change in one factor produces a change in another under defined conditions.
Exploratory research: Research used to investigate poorly understood issues and generate concepts or hypotheses.
Descriptive research: Research that characterizes distributions, patterns, or conditions.
Predictive research: Research focused on forecasting outcomes for new or future cases.
Evaluative research: Research that assesses the implementation, effects, value, or fairness of an intervention.
Review Questions
Short Answer Questions
What is the difference between a business problem and a research problem?
Define a construct and explain why operationalization is necessary.
Distinguish reliability from validity.
What are the three central requirements commonly considered when making a causal claim?
Why does predictive accuracy not necessarily demonstrate causality?
Long Answer Questions
Explain the stages of scientific inquiry and show how they can be applied to a customer-retention problem.
Discuss the roles of theory, constructs, variables, propositions, and hypotheses in a business research project.
Compare exploratory, descriptive, explanatory, predictive, and evaluative research, including an example of each.
Explain how confounding, reverse causality, and selection bias can produce misleading business conclusions.
Discuss the ethical and governance responsibilities of a business analyst using personal and organizational data.
Analytical / Application Questions
A retailer observes that customers who receive discount emails purchase more frequently. Design a study to determine whether the emails cause increased purchasing, identifying likely confounders and an appropriate comparison.
A bank wants to predict which customers may default. Explain how the bank should distinguish a predictive objective from a causal objective and identify governance risks associated with the model.
A company introduces a four-day workweek and reports higher employee satisfaction after three months. Assess what additional evidence would be needed to evaluate whether the policy caused the improvement and whether it should be adopted broadly.
Multiple Choice Questions with Answers
Question 1
Which statement best distinguishes research methodology from a research method?
A. Methodology is a specific statistical test, whereas a method is a theory.
B. Methodology is the overall logic and justification of a study, whereas a method is a specific procedure.
C. Methodology is the dataset, whereas a method is the research question.
D. Methodology applies only to qualitative studies, whereas methods apply only to quantitative studies.
Correct Answer: B. Methodology is the overall logic and justification of a study, whereas a method is a specific procedure.
Question 2
Which of the following is an example of a construct?
A. Annual revenue recorded in dollars
B. Number of customer complaints
C. Perceived trust in a company
D. Date of an employee’s hire
Correct Answer: C. Perceived trust in a company
Question 3
What is the primary purpose of operationalization?
A. To replace theory with opinion
B. To translate an abstract construct into observable indicators
C. To guarantee that a causal relationship exists
D. To eliminate the need for data collection
Correct Answer: B. To translate an abstract construct into observable indicators
Question 4
A factor related to both a proposed cause and an outcome is called a:
A. Mediator
B. Moderator
C. Confounder
D. Parameter
Correct Answer: C. Confounder
Question 5
Which research type primarily asks what is happening, who is affected, and how much?
A. Descriptive research
B. Evaluative research
C. Exploratory research
D. Causal research
Correct Answer: A. Descriptive research
Question 6
Why might a predictive model identify useful risk indicators without proving that changing those indicators will change the outcome?
A. Prediction and causation are identical concepts.
B. Predictive associations may not represent causal mechanisms.
C. Prediction never uses observed data.
D. Causal research cannot use variables.
Correct Answer: B. Predictive associations may not represent causal mechanisms.
Question 7
Which condition is essential for a proposed cause to precede its effect?
A. Temporal order
B. External validity
C. Content validity
D. Triangulation
Correct Answer: A. Temporal order
Question 8
A proposition differs from a hypothesis mainly because a proposition:
A. Is always based on experimental data
B. Expresses a conceptual relationship and need not specify measurable variables
C. Can never be tested
D. Is a population statistic
Correct Answer: B. Expresses a conceptual relationship and need not specify measurable variables
Question 9
Which statement about reliability and validity is correct?
A. A measure can be reliable without being valid.
B. Validity means that a measure gives identical results every time.
C. Reliability and validity are interchangeable terms.
D. A valid measure is necessarily free from all sampling error.
Correct Answer: A. A measure can be reliable without being valid.
Question 10
A study that assesses whether a new employee-training programme improved performance is primarily: