14. Research Quality, Ethics and Governance

Introduction and Context

Research quality is not a decorative feature added after data collection. It is the condition that makes evidence worthy of interpretation, publication, organisational use and policy influence. In business research, weak quality can produce more than an incorrect academic conclusion: it can lead to misguided investment, discriminatory algorithms, unsafe employment practices, reputational damage or unlawful processing of personal data. Quality therefore includes methodological soundness, ethical legitimacy, transparency, security and accountability.

The meaning of quality varies partly with research design. Quantitative researchers commonly emphasise validity, reliability, measurement precision, statistical conclusion validity and robustness. Qualitative researchers often discuss credibility, dependability, confirmability and transferability. Mixed-methods researchers must evaluate both strands and, additionally, the quality of integration between them. These are not competing vocabularies. They represent related attempts to answer four questions: Is the study addressing the intended phenomenon? Are its findings stable and well supported? Can another person inspect how conclusions were reached? Under what conditions may the findings reasonably be applied?

Ethics and governance extend these questions to the conduct and consequences of research. A study may be technically rigorous yet ethically unacceptable if participants were deceived without justification, data were collected without valid consent, vulnerable people were exposed to avoidable risk, or findings were selectively reported. Conversely, ethical approval does not guarantee methodological quality. Doctoral researchers must therefore treat quality, ethics and governance as an integrated system of research accountability.

Learning Objectives

By the end of this chapter, readers should be able to:

1. Distinguish validity, reliability, credibility, dependability, confirmability, transferability and robustness.

2. Select quality criteria appropriate to quantitative, qualitative and mixed-methods studies.

3. Design procedures for reflexivity, auditability, privacy, consent and protection of vulnerable participants.

4. Explain the roles of institutional review, data protection, cybersecurity and research-integrity controls.

5. Evaluate conflicts of interest, authorship decisions and responsible dissemination.

6. Apply a governance framework to a complex organisational research problem.

Quality as an Argument Rather Than a Label

A research claim is persuasive when the chain from question to conclusion is coherent. This chain includes the conceptualisation of constructs, sampling, measurement or elicitation, data management, analysis and inference. Quality is consequently an argument supported by evidence, not a certificate attached to a project. Statements such as “the instrument is valid” are incomplete unless they specify valid for what purpose, population, context and interpretation.

Quantitative quality

Validity has several dimensions. Construct validity concerns whether an operational measure represents the theoretical construct. A measure of employee engagement, for example, should not merely capture job satisfaction if the research claim concerns involvement, energy and dedication. Content validity asks whether relevant dimensions have been adequately represented. Criterion-related validity considers association with an appropriate external criterion, while internal validity concerns whether the observed relationship can plausibly be attributed to the proposed causal explanation rather than confounding, selection or history. External validity concerns the scope of generalisation beyond the studied sample and setting.

Reliability concerns consistency, but consistency alone is not accuracy. A systematically biased scale may be highly reliable and still lack validity. Internal consistency, test–retest stability, inter-rater agreement and parallel-form reliability answer different questions. Researchers should report the form of reliability relevant to the design rather than treating a single coefficient as a universal quality indicator.

Statistical conclusion validity concerns whether the analysis supports the stated inference. Inadequate power, inappropriate model assumptions, fishing across many outcomes, missing-data bias and failure to account for clustering can undermine conclusions even when measurement is sound. Robustness analysis tests whether conclusions persist under reasonable alternative specifications, operationalisations, samples or analytic decisions. Robustness does not mean that every analysis produces the same result; it means that the researcher has examined the dependence of the claim on defensible choices.

Qualitative quality

Credibility refers to the plausibility and evidential grounding of interpretations. Prolonged engagement, attention to disconfirming evidence, triangulation, respondent engagement where appropriate and rich contextual description may contribute to credibility, but none is automatically sufficient. Dependability concerns the traceability and consistency of the research process. A decision trail should show how sampling, interview protocols, coding changes and analytical judgments developed. Confirmability concerns the extent to which findings are grounded in participants’ accounts and observable analytic procedures rather than researcher preference. Reflexive journals, audit trails, codebooks, peer debriefing and transparent quotations can support it.

Transferability is not statistical generalisation. It concerns whether readers can judge the relevance of findings to another context. The researcher supports this judgment through thick description of the organisation, participants, institutional conditions and study boundaries. The responsibility is shared: researchers provide contextual evidence, while readers assess similarity to the intended application.

Mixed-methods quality

A mixed-methods study can contain a credible qualitative component and a reliable quantitative component yet fail as an integrated inquiry. Integration quality asks whether the methods address complementary aspects of the question, whether sampling and timing are connected appropriately, and whether conclusions genuinely combine the evidence. Researchers should identify convergence, complementarity, expansion or contradiction rather than forcing agreement. Divergent findings may reveal mechanisms, subgroup differences or measurement limitations.

Reflexivity, Positionality and Interpretive Responsibility

Researcher positionality concerns how professional role, identity, authority, values, institutional affiliation and relationship to the field shape access, interaction and interpretation. Reflexivity is the disciplined examination and management of these influences. It is not a confessional autobiography and does not imply that researchers can become entirely neutral. Rather, it makes assumptions visible and permits readers to evaluate their consequences.

A doctoral researcher studying leadership in the researcher’s own organisation may possess valuable insider knowledge but also face pressures concerning loyalty, confidentiality and interpretation. Participants may censor criticism because they perceive the researcher as a manager. An outsider may encourage candour but misunderstand local meanings. Neither position is intrinsically superior. Quality requires explicit positionality statements, role clarification, reflexive notes, careful recruitment, separation of research and managerial decisions, and attention to voices that challenge the researcher’s preferred account.

Ethical Foundations and Institutional Review

Research ethics is commonly organised around respect for persons, beneficence, non-maleficence and justice. Respect requires meaningful voluntary participation and recognition of autonomy. Beneficence and non-maleficence require a favourable balance of potential value over foreseeable harm. Justice concerns fair distribution of research burdens and benefits, including fair recruitment rather than convenient exploitation.

Institutional review committees or ethics boards assess whether proposed procedures are ethically acceptable before data collection begins. Applications normally describe the research question, participants, recruitment, consent, risks, benefits, incentives, confidentiality, data handling, withdrawal procedures and dissemination. Approval is not a substitute for judgment in the field. Amendments, adverse events, protocol deviations and unexpected risks must be reported according to institutional requirements. Researchers remain responsible for stopping or modifying procedures when circumstances change.

Consent must be informed, voluntary, comprehensible and appropriately documented. It is a process, not merely a signature. Participants should understand the purpose, procedures, time commitment, risks, benefits, data uses, recording arrangements, withdrawal limits and contact routes for concerns. Where deception is necessary, it requires strong justification, minimal risk, approval in advance and timely debriefing. In organisational research, employees may feel that participation is expected even when it is formally voluntary; recruitment must therefore avoid managerial coercion and make non-participation safe.

Vulnerable participants may have reduced autonomy or increased exposure to harm. They can include children, people with cognitive impairments, people in dependent relationships, migrants with insecure status, patients, economically disadvantaged groups and employees whose careers may be affected by participation. Vulnerability is contextual rather than a permanent label. Safeguards may include accessible information, additional consent procedures, independent advocates, privacy protections, culturally appropriate communication and carefully designed compensation. Exclusion is not always ethical, because it may deny groups the benefits and representation of research; inclusion should instead be accompanied by proportionate protection.

Privacy, Data Protection and Cybersecurity

Privacy concerns control over personal information, bodily or social space and the circumstances of disclosure. Confidentiality concerns the researcher’s obligation to protect information entrusted by participants. Anonymisation removes the possibility of identifying a person using reasonably available means; pseudonymisation replaces identifiers but does not eliminate identifiability. Small organisational samples, distinctive quotations, job titles and combinations of demographic variables can permit re-identification even when names are removed.

A defensible data-management plan specifies data minimisation, purpose limitation, lawful processing, retention, access, sharing, deletion and secure destruction. Researchers should collect only information necessary for the approved purpose, separate identifiers from research data, use coded keys, restrict access by role and document transfers. Sensitive data require heightened safeguards and, where applicable, a formal impact assessment. Applicable law varies by jurisdiction, but doctoral researchers should identify the governing data-protection regime before collection rather than assuming that academic status creates an exemption.

Cybersecurity is part of research ethics because a breach can expose participants to financial, professional or psychological harm. Practical controls include strong authentication, encryption in transit and at rest, secure institutional storage, patched devices, tested backups, phishing awareness, controlled software permissions and an incident-response plan. Personal devices, unapproved cloud services and email attachments can create avoidable vulnerabilities. Data should not be uploaded to generative AI or external analytical platforms unless the provider, institutional policy, contractual terms and participant permissions permit that use. Researchers must also consider model leakage, re-identification and the retention of prompts or uploaded files.

Integrity, Conflicts and Authorship

Research integrity requires honesty, accuracy, transparency, accountability and respect for the scholarly record. Fabrication invents data; falsification manipulates materials, procedures or results; plagiarism presents another’s work without appropriate acknowledgement. Less dramatic practices can also damage integrity: selective reporting, undisclosed hypothesis changes, inappropriate image manipulation, p-hacking, duplicate publication, honorary authorship and suppression of inconvenient findings.

A conflict of interest exists when financial, professional, personal or institutional interests could reasonably be perceived to influence research judgment. A conflict is not necessarily misconduct, but it must be disclosed and managed. Management may involve independent analysis, blinded assessment, additional oversight, public disclosure, recusal or restrictions on access. Sponsorship agreements should preserve the researcher’s ability to report results, including null or adverse findings.

Authorship should reflect substantial intellectual contribution, participation in drafting or critical revision, approval of the final version and accountability for the work. Administrative support, funding acquisition or routine data collection may deserve acknowledgement rather than authorship unless accompanied by qualifying intellectual contribution. Authorship expectations should be discussed early, recorded in a contribution statement and revisited when the project changes.

A Governance Framework for Doctoral Research

A practical governance framework links five stages. First, anticipate risks through a proportionate assessment of methodological, ethical, legal, social and cybersecurity issues. Second, authorise the project through institutional review, data-access permissions, contracts and documented roles. Third, operate with version-controlled protocols, consent records, secure data handling, reflexive documentation and quality checks. Fourth, review progress through monitoring, peer challenge, audit trails, deviation reporting and independent scrutiny where appropriate. Fifth, disclose and preserve by reporting methods and limitations honestly, sharing materials where lawful and useful, retaining records for the required period and closing the project responsibly.

This framework should be adapted rather than applied mechanically. A low-risk anonymous survey may require limited controls, whereas research combining employee performance records, interviews and algorithmic profiling requires layered governance. Proportionality means matching controls to potential harm and complexity, not reducing standards for convenience.

Illustrative Case: The Predictive Retention Project

Background

A fictional multinational retailer, Northstar Stores, asks a doctoral researcher to evaluate a machine-learning model intended to predict which employees are likely to resign. The company proposes combining attendance records, performance ratings, survey responses and demographic data. Senior management wants a rapid answer and offers the researcher access to internal systems.

Problem

The project presents several risks. Employees may fear that participation or survey responses will influence promotion. Historical performance ratings may encode managerial bias. The model may produce different error rates across demographic groups. Individual-level predictions could be used for punitive monitoring. The researcher also has a consulting relationship with the software vendor, creating a conflict of interest.

Analysis and approach

The researcher first separates the research purpose from managerial action. The protocol states that study outputs will be aggregated and will not be used to make employment decisions. An ethics application and data-protection assessment examine lawful basis, proportionality, retention and access. Employees receive plain-language information explaining which records are used, which are optional, how withdrawal operates and who can see results. Participation in interviews is recruited by an independent team rather than line managers.

The researcher minimises data, excludes unnecessary identifiers and stores the linkage key separately. Access is logged and restricted. The analytical plan is preregistered where feasible and includes baseline comparisons, missing-data analysis, subgroup performance, calibration, false-positive and false-negative rates, sensitivity analyses and documentation of model changes. Qualitative interviews with employees and managers examine how predictions might be interpreted and whether the organisational context explains apparent risk.

The researcher discloses the vendor relationship, appoints an independent reviewer and agrees that publication will not be subject to veto, subject to legitimate confidentiality protections. Findings are integrated cautiously: a high predictive score is not treated as an employee characteristic or causal explanation. The study reports uncertainty, limitations and possible disparate effects.

Outcome

The model shows moderate predictive usefulness but substantially higher false-positive rates for a particular occupational group, partly because historical ratings and scheduling patterns reflect unequal managerial practices. Northstar decides not to deploy individual-level alerts. Instead, it commissions a review of scheduling and supervision, uses only aggregated findings for organisational learning and establishes an employee consultation process.

Learning points

The case demonstrates that technical accuracy is insufficient for responsible research. Governance must address consent, power, data minimisation, bias, conflicts, security, interpretability and downstream use. It also illustrates that a negative deployment decision can be a successful research outcome when evidence prevents foreseeable harm.

Common Failures and Their Consequences

Researchers often seek a single quality indicator, such as a reliability coefficient, and overlook construct validity or contextual limitations. Others treat ethics approval as a one-time administrative event, fail to report protocol changes or collect more personal data than the research question requires. In qualitative work, “themes emerged” may conceal weak analytic decisions, unexamined positionality or selective quotations. In quantitative work, robustness may be claimed without specifying the alternative models tested.

Other recurring failures include confusing anonymity with pseudonymity, storing identifiers in the same file as responses, using personal cloud storage, allowing sponsors to suppress results, adding senior colleagues as honorary authors, and presenting exploratory findings as confirmatory. Researchers should also resist overclaiming transferability or causal inference. Limitations are not admissions of failure; they are part of an honest account of what the evidence can support.

Emerging Developments

Open science practices increasingly encourage preregistration, registered reports, transparent analytic code, data dictionaries, reproducible workflows and responsible sharing of materials. These practices improve auditability but must be balanced against confidentiality, intellectual property, participant expectations and the risk of re-identification. Synthetic or de-identified data may facilitate teaching and replication, although they can still reproduce bias or disclose sensitive patterns.

Generative AI and automated analytics introduce new governance questions: who is accountable for machine-assisted coding, whether outputs are reproducible, how confidential data are protected, whether generated text contains unattributed material, and how bias or hallucination is detected. AI should be treated as an instrument requiring validation and disclosure, not as an epistemic authority. Human researchers remain responsible for interpretation, consent compliance and the accuracy of reported results.

Best-Practice Checklist

Before beginning, align the question, design, measures and claims; map risks and stakeholders; identify conflicts; obtain required approvals; and prepare a data-management and cybersecurity plan. During the study, maintain consent, monitor risk, document deviations, preserve an audit trail, challenge emerging interpretations and restrict access. Before dissemination, conduct robustness and sensitivity checks, examine alternative explanations, report null and adverse findings, verify authorship and disclose funding, conflicts, limitations and any use of automated tools. After completion, retain or destroy data according to approved policy, close access permissions and record lessons for future research.

Chapter Summary

Research quality is a reasoned assessment of whether evidence supports the claims made from it. Quantitative studies require attention to validity, reliability, statistical conclusion validity and robustness; qualitative studies require credibility, dependability, confirmability and transferability; mixed-methods studies must also demonstrate meaningful integration. Reflexivity makes researcher influence visible, while ethical practice protects autonomy, welfare, privacy and justice. Institutional review, proportionate governance, data protection and cybersecurity continue throughout the research lifecycle. Integrity requires accurate reporting, disclosure of conflicts, responsible authorship and resistance to fabrication, falsification, plagiarism and selective reporting. Contemporary tools such as preregistration, open workflows and AI-assisted analysis create opportunities for transparency but also require careful oversight. The central doctoral responsibility is to ensure that research is not only methodologically persuasive but also lawful, trustworthy and socially responsible.

Key Terms

Validity: The extent to which evidence supports the intended interpretation or inference.

Reliability: The consistency or stability of a measurement or research procedure.

Robustness: The persistence of a conclusion under reasonable alternative assumptions or analyses.

Credibility: The plausibility and evidential grounding of a qualitative interpretation.

Dependability: The traceability and consistency of a qualitative research process.

Confirmability: The extent to which findings are grounded in evidence rather than researcher preference.

Transferability: The potential relevance of findings to other contexts judged through contextual description.

Positionality: The researcher’s social, professional and epistemic location in relation to the study.

Reflexivity: Critical examination of how the researcher influences the research process and interpretation.

Informed consent: Voluntary agreement based on adequate understanding of the research and its implications.

Vulnerability: A contextual condition that may reduce autonomy or increase exposure to harm.

Confidentiality: The obligation to protect information provided by participants.

Anonymisation: Processing data so that identification is not reasonably possible.

Pseudonymisation: Replacing identifiers while retaining a separate means of re-identification.

Data minimisation: Collecting and retaining only data necessary for a specified purpose.

Research integrity: Honest, transparent, accountable and responsible conduct of research.

Conflict of interest: An interest that could influence, or appear to influence, research judgment.

Audit trail: A documented record of methodological decisions and changes.

Triangulation: Use of multiple sources, methods, researchers or perspectives to examine a phenomenon.

Authorship: Scholarly credit and accountability based on substantial intellectual contribution.

Review Questions

Short Answer Questions

1. Distinguish construct validity from reliability.

2. What is meant by transferability in qualitative research?

3. Why is informed consent considered an ongoing process?

4. Explain the difference between anonymisation and pseudonymisation.

5. Identify two controls that can reduce cybersecurity risks in research.

Long Answer Questions

1. Explain how validity, reliability and robustness contribute to the quality of a quantitative business study.

2. Compare credibility, dependability, confirmability and transferability, giving suitable examples.

3. Discuss how researcher positionality can influence access, participation and interpretation.

4. Evaluate the role of institutional review and data-protection governance across the research lifecycle.

5. Explain how conflicts of interest, authorship and selective reporting affect research integrity.

Analytical / Application Questions

1. You are studying employee wellbeing using identifiable survey data and sickness records. Design an ethical, secure and methodologically defensible governance plan.

2. A qualitative study reports three themes but provides no reflexive account, audit trail or disconfirming evidence. Assess its quality and recommend improvements.

3. A predictive hiring model has high overall accuracy but substantially different error rates across demographic groups. Explain how you would investigate, govern and report the model.

22. Multiple Choice Questions with Answers

Question 1

Which statement best distinguishes reliability from validity?

A. Reliability concerns consistency, whereas validity concerns whether the intended construct or inference is supported.

B. Reliability is relevant only to qualitative research, whereas validity is relevant only to quantitative research.

C. Validity guarantees that results will be statistically significant, whereas reliability guarantees generalisability.

D. Reliability concerns ethics, whereas validity concerns data security.

Correct Answer: A. Reliability concerns consistency, whereas validity concerns whether the intended construct or inference is supported.

Question 2

A qualitative researcher maintains a decision log showing changes to sampling, interview questions and coding. Which quality criterion is most directly supported?

A. External validity

B. Dependability

C. Criterion validity

D. Statistical conclusion validity

Correct Answer: B. Dependability

Question 3

Which practice best supports transferability in a qualitative study?

A. Claiming that findings apply to all organisations

B. Using a larger sample regardless of context

C. Providing thick description of the setting, participants and study boundaries

D. Removing contextual details to protect the researcher

Correct Answer: C. Providing thick description of the setting, participants and study boundaries

Question 4

An employee survey is conducted by participants’ direct managers, who can see who declined. What is the principal ethical concern?

A. Excessive external validity

B. Potential coercion undermining voluntary participation

C. Insufficient statistical power only

D. Failure to establish test–retest reliability

Correct Answer: B. Potential coercion undermining voluntary participation

Question 5

Which statement about pseudonymisation is correct?

A. It permanently eliminates all possibility of identification.

B. It replaces identifiers but retains a separate means of re-identification.

C. It permits unrestricted public disclosure.

D. It is identical to deleting all research data.

Correct Answer: B. It replaces identifiers but retains a separate means of re-identification.

Question 6

A researcher tests many models and reports only the specification producing a significant result. This practice most directly threatens:

A. Research integrity and robustness

B. Participant comprehension of consent forms only

C. Physical safety in fieldwork only

D. Transferability through thick description

Correct Answer: A. Research integrity and robustness

Question 7

A sponsor funds a study and reserves the right to suppress unfavourable findings. The strongest governance response is to:

A. Accept the condition because funding determines validity

B. Disclose and manage the conflict while preserving independent reporting rights

C. Allow the sponsor to rewrite the results

D. Remove all limitations from the final report

Correct Answer: B. Disclose and manage the conflict while preserving independent reporting rights

Question 8

In the predictive retention case, why was individual-level deployment rejected?

A. The model had no computational value at all

B. The study lacked any quantitative data

C. Subgroup error patterns and possible organisational bias created unacceptable risks

D. Employees were not relevant stakeholders

Correct Answer: C. Subgroup error patterns and possible organisational bias created unacceptable risks

Question 9

Which action best reflects confirmability?

A. Selecting only quotations that support the initial theory

B. Grounding interpretations in documented evidence and examining alternative explanations

C. Avoiding all researcher reflection

D. Treating participant agreement as proof of truth

Correct Answer: B. Grounding interpretations in documented evidence and examining alternative explanations

Question 10

When using generative AI with research material, the researcher should primarily:

A. Assume the tool is confidential because it is commercially available

B. Upload all raw data to improve output quality

C. Assess confidentiality, institutional policy, reproducibility, bias and accountability before use

D. Treat generated analysis as exempt from methodological review

Correct Answer: C. Assess confidentiality, institutional policy, reproducibility, bias and accountability before use