Introduction to Business Analytics

Chapter 12
Artificial Intelligence and Machine Learning in Business

Diploma in Business Analytics
Introduction to Business Analytics   •   Diploma

Artificial Intelligence and Machine Learning in Business

Introduction

Artificial intelligence (AI) has moved from a specialist technical field into a core business capability. Organisations use AI to interpret large datasets, automate repetitive work, predict future events, personalise customer experiences and support managerial decisions. However, AI is not a substitute for business understanding. A technically accurate model can still produce poor business outcomes if it uses unreliable data, optimises the wrong objective, ignores fairness, or is introduced without appropriate human oversight.

This chapter examines three closely related ideas: machine learning, generative AI and intelligent automation. It explains how these technologies work, how they are applied in recommendation, fraud detection, forecasting, customer service and decision augmentation, and why their limitations and risks must be actively managed.

Learning Objectives

By the end of this chapter, you should be able to:

  1. Define AI, machine learning, generative AI and intelligent automation.
  2. Distinguish supervised, unsupervised and reinforcement learning.
  3. Explain the main stages of an AI business project.
  4. Evaluate applications in recommendation, fraud detection, forecasting and customer service.
  5. Explain how AI augments rather than automatically replaces managerial judgement.
  6. Interpret basic model-performance measures.
  7. Identify technical, commercial, ethical, legal and operational risks.
  8. Recommend practical governance and implementation controls.

1. Artificial Intelligence, Machine Learning and Generative AI

Artificial intelligence is the broad field concerned with systems that perform tasks normally requiring human cognitive capabilities, such as perception, language understanding, classification, planning and decision-making. AI includes rule-based systems, optimisation, expert systems, computer vision, natural-language processing and machine learning.

Machine learning (ML) is a subset of AI in which a system learns patterns from data and uses those patterns to make predictions, classifications or decisions. Instead of programming every rule explicitly, developers specify a learning objective, provide data and assess the resulting model.

A model is a mathematical or computational representation that maps inputs to outputs. For example, a retailer may use customer history, product characteristics and browsing behaviour to estimate the probability that a customer will purchase a product.

Generative AI refers to systems that create new content—such as text, images, audio, software code or synthetic data—based on patterns learned from training data. Large language models generate text by estimating likely sequences of tokens. Their output may be fluent and useful, but fluency does not guarantee truth, originality, fairness or suitability.

Intelligent automation combines automation technologies with AI. Conventional automation follows explicit rules: “if an invoice is received, copy its fields into the accounting system.” Intelligent automation may use optical character recognition, language processing or anomaly detection to interpret less-structured inputs before applying workflow rules. It therefore combines perception, reasoning or prediction with process execution.

These concepts overlap but are not identical:

ConceptMain purposeTypical output
AIBroad capability of intelligent systemsPrediction, planning or action
Machine learningLearn patterns from dataScore, class, forecast or recommendation
Generative AIProduce new contentText, image, code or summary
Intelligent automationExecute processes using rules and AICompleted workflow or routed case

2. How Machine Learning Learns

2.1 Supervised learning

In supervised learning, the training data contain input variables and a known target. A model learns a relationship between them.

  • Regression predicts a numerical value, such as sales revenue or delivery time.
  • Classification predicts a category, such as fraudulent/not fraudulent or likely to churn/not likely to churn.

A general prediction can be represented as:

ŷ = f(x; θ)

Here, x is the input vector, ŷ is the predicted output, f is the model form, and θ represents learned parameters. The notation is applicable whenever a model maps observed inputs to an estimated output; it does not imply that the model is causal.

The model is trained by minimising a loss function. For observations indexed by i = 1, 2, …, n, a common general form is:

θ* = arg min_θ (1/n) ∑ᵢ L(yᵢ, f(xᵢ; θ))

Here, yᵢ is the observed target, L is a loss function, n is the number of training observations and θ* is the parameter set giving the smallest average training loss. The loss must match the task. Mean squared error is often used for continuous prediction; logarithmic loss is commonly used for probabilistic classification.

2.2 Unsupervised learning

Unsupervised learning uses data without a labelled target. Clustering can group customers according to similarity, while dimensionality-reduction methods can simplify complex datasets for exploration or visualisation. The resulting groups are not automatically meaningful business segments; analysts must interpret and validate them.

2.3 Reinforcement learning

In reinforcement learning, an agent takes actions in an environment and receives rewards or penalties. It seeks a policy that maximises expected cumulative reward. This approach is relevant to dynamic pricing, inventory control and recommendation sequencing, but requires careful reward design. If the reward is poorly specified, the system may achieve the metric while damaging customer trust or long-term value.

2.4 Training, validation and testing

A dataset is commonly divided into training, validation and test sets. The training set estimates model parameters, the validation set supports model selection and tuning, and the test set provides an approximately unbiased final evaluation. For time-dependent data, chronological splitting is usually more appropriate than random splitting because random splitting can allow future information to influence the past.

Overfitting occurs when a model captures noise or peculiarities of training data and performs poorly on new cases. Underfitting occurs when the model is too simple to capture important structure. Regularisation, cross-validation, simpler models and careful feature selection can reduce overfitting.

Data leakage is a particularly serious error. It occurs when information unavailable at the time of prediction enters the training data. For example, using a repayment status recorded after a loan decision to predict default creates an unrealistically strong model.

3. Evaluating Business Models

Evaluation must consider both technical performance and business consequences. A model with high accuracy may be unsuitable when the cost of false positives and false negatives differs substantially.

For binary classification:

  • True positive (TP): a positive case correctly identified.
  • True negative (TN): a negative case correctly identified.
  • False positive (FP): a negative case incorrectly identified as positive.
  • False negative (FN): a positive case missed by the model.

Important measures include:

Accuracy = (TP + TN) / (TP + TN + FP + FN)
Precision = TP / (TP + FP)
Recall = TP / (TP + FN)

Accuracy is useful when classes and error costs are reasonably balanced. Precision answers, “Of the cases flagged positive, how many were actually positive?” Recall answers, “Of the actual positive cases, how many were found?” These measures assume a defined classification threshold and reliable labels.

For a fraud system, high recall may be desirable to detect more fraud, but low precision may inconvenience many genuine customers. A threshold should therefore be chosen using estimated costs, operational capacity and customer impact—not by selecting a metric in isolation.

For numerical forecasts, mean absolute error is:

MAE = (1/n) ∑ᵢ |yᵢ − ŷᵢ|

MAE is expressed in the same units as the target and treats errors linearly. It is appropriate when an error of 10 units is considered twice as serious as an error of 5 units. Other measures may be useful when scale or asymmetric costs matter.

4. From Business Problem to Deployed System

An AI project should begin with a business decision, not with a fascination with a technology. A practical lifecycle is:

  1. Define the decision and value proposition. Specify who will act, what action is possible and how success will be measured.
  2. Identify data and permissions. Establish source systems, ownership, quality, privacy requirements and permitted uses.
  3. Prepare data. Correct errors, define time windows, address missing values and prevent leakage.
  4. Build a baseline. Compare the proposed model with a simple rule, existing process or naive forecast.
  5. Train and validate. Use an appropriate split, metrics and error analysis.
  6. Assess business and ethical consequences. Examine costs, fairness, explainability, security and customer experience.
  7. Pilot safely. Use a limited rollout, human review or an A/B test where appropriate.
  8. Deploy with controls. Record model versions, inputs, outputs, users and decisions.
  9. Monitor and improve. Track data drift, performance, complaints, overrides and unintended effects.

A model is not the whole system. Data pipelines, interfaces, policies, human roles, cybersecurity and escalation procedures determine whether a model creates value.

5. Business Applications

5.1 Recommendation systems

Recommendation systems suggest products, content or actions. Collaborative filtering uses patterns of interaction among users and items. Content-based methods use item attributes and a user’s previous preferences. Hybrid systems combine both approaches.

Recommendations can increase relevance, conversion and customer convenience. However, they may create popularity bias, narrow exposure, filter bubbles or unfair treatment of new products. Cold-start problems arise when a new user or item has little historical data. Businesses should monitor not only clicks but also margin, repeat purchase, diversity, customer satisfaction and long-term retention.

5.2 Fraud detection

Fraud detection may combine supervised classification, anomaly detection, rules and network analysis. Useful features can include transaction amount, timing, device information, location consistency and account relationships. Since fraud patterns change, models require monitoring and periodic retraining.

A fraud score should normally trigger an action policy rather than an automatic accusation. Low-risk transactions may proceed, medium-risk transactions may require additional verification, and high-risk transactions may be held for trained investigators. Excessive false positives can exclude legitimate customers and disproportionately affect particular groups.

5.3 Forecasting

Forecasting estimates future demand, cash flow, staffing needs or inventory requirements. A forecast should specify its horizon, frequency, unit and information available at the forecast date. Seasonality, promotions, holidays, economic conditions and supply constraints may be important.

A forecast is not a guarantee. Decision-makers should examine prediction intervals, scenarios and the consequences of error. For example, an organisation may deliberately hold additional inventory when stockouts are much more costly than excess stock.

5.4 Customer service

AI can classify incoming requests, retrieve relevant knowledge, summarise conversations, translate messages and draft responses. Generative AI can support agents by proposing answers, but it may hallucinate—that is, produce plausible but unsupported content. Retrieval from approved knowledge sources, confidence thresholds, citation links and human approval are important controls.

Customer-service automation should provide a clear route to a human, especially for complaints, vulnerable customers, financial hardship, safety issues or legally significant decisions. Performance measures should include resolution quality and customer outcomes, not merely average handling time.

5.5 Decision augmentation

Decision augmentation means presenting predictions, evidence or alternatives to a human decision-maker. Examples include a sales lead score, a maintenance alert or a credit-risk assessment. The human remains responsible for interpreting the recommendation and considering information that may not be represented in the model.

Human involvement is not automatically protective. A reviewer may over-trust an algorithm, ignore contradictory evidence or apply inconsistent overrides. Effective augmentation requires training, an understandable interface, documented authority, reason codes and review of override patterns.

6. Generative AI in Organisations

Generative AI is useful for drafting, summarising, brainstorming, coding assistance, document classification and natural-language interfaces to enterprise information. A prompt alone is not a reliable control. Business use should define the approved data, model provider, retention policy, output review and intellectual-property position.

Important risks include:

  • Hallucination: unsupported or fabricated output.
  • Confidentiality leakage: sensitive information being sent to an unauthorised service.
  • Bias: stereotypes or unequal treatment reproduced from training data.
  • Copyright and provenance concerns: unclear ownership or use of protected material.
  • Prompt injection: instructions in retrieved or user-provided content that manipulate system behaviour.
  • Automation bias: people accepting fluent output without verification.

A useful operating principle is “human accountability, machine assistance.” Generative AI may accelerate work, but employees must verify material claims, calculations, citations and decisions.

7. Illustrative Case: Retail Fraud and Customer Experience

Background. A fictional online retailer experiences increasing payment fraud. Manual review protects the business but delays genuine orders and creates investigator workload.

Problem. Management proposes a model that assigns every transaction a fraud probability. The business must reduce fraud losses without substantially increasing false declines.

Analysis. The analytics team first defines the decision at authorisation time and excludes information recorded after the transaction. Historical labels are incomplete because some fraud is never reported. The team therefore treats performance estimates cautiously and includes investigator review in the process analysis.

Approach. A baseline rules engine is compared with a supervised model using transaction, device and account features. Transactions are divided chronologically into training, validation and test periods. The team evaluates precision, recall, monetary fraud loss, false-decline rate and review capacity. Rather than automatically rejecting all high-score transactions, it creates three bands: approve, verify and investigate. A sample of decisions is reviewed for group disparities and recurring data-quality errors.

Outcome. The pilot reduces avoidable fraud losses while keeping most legitimate orders flowing. The result is not judged solely by model accuracy: customer complaints, review time, investigator agreement and fraud losses are monitored. The model is scheduled for drift monitoring because fraudsters adapt to controls.

Learning points. The case demonstrates that the best solution is a decision process, not merely a prediction model. Labels, thresholds, costs, human workflows and monitoring are central to value. It also shows why a model should be compared with a baseline and evaluated using business outcomes.

8. Risks, Ethics and Governance

Fairness and discrimination

Historical data may reflect unequal access, biased decisions or under-reporting. A model can therefore reproduce or amplify disadvantage. Fairness cannot be reduced to one universal formula: different fairness criteria can conflict, and acceptable treatment depends on the application and law. Organisations should identify affected groups, test relevant outcomes, investigate causal mechanisms and document decisions.

Privacy and data protection

Data collection should have a legitimate purpose, appropriate notice, access controls, retention limits and security safeguards. Sensitive attributes may be restricted, but excluding them does not guarantee fairness because proxy variables can remain. Data minimisation and privacy-preserving design should be considered from the beginning.

Explainability and contestability

Some users need to know why an outcome occurred and how to challenge it. A feature-importance chart does not necessarily provide a complete explanation of an individual decision. Organisations should provide meaningful reasons, correction channels and human review where decisions have significant effects.

Security and resilience

AI systems can be attacked through manipulated inputs, data poisoning, model extraction or prompt injection. Controls include authentication, least-privilege access, secure software practices, input validation, red-team testing, logging, backup procedures and incident response.

Accountability

Governance should assign responsibility for data, model development, deployment, monitoring and escalation. A model inventory, risk classification, approval record and change log support accountability. Procurement contracts should address data use, service availability, security, audit rights and incident notification.

Regulatory requirements vary by jurisdiction and sector. Organisations must consult applicable privacy, consumer-protection, employment, financial-services, safety and emerging AI regulation rather than assuming that a technically successful system is legally acceptable.

9. Best Practices for Business Analysts

Business analysts often connect technical teams, process owners and executives. Effective practice includes:

  • Translate vague aims into a defined decision, population, time horizon and success measure.
  • Ask when each variable became available; this is the strongest defence against leakage.
  • Establish a simple baseline before recommending complexity.
  • Examine errors by customer segment, geography, product and time period.
  • Distinguish correlation from causation; predictive usefulness does not prove that changing a variable will cause an outcome.
  • Report uncertainty and limitations in plain language.
  • Design human workflows, escalation routes and override policies.
  • Test the complete process, not only the model in isolation.
  • Monitor drift, performance, fairness, security, complaints and financial outcomes after deployment.
  • Retire or retrain systems when their purpose, data or environment changes.

Contemporary Developments

Foundation models are increasingly being adapted to organisational information through retrieval-augmented generation, fine-tuning and tool use. Edge AI places inference closer to devices, potentially reducing latency and data transfer. Synthetic data can support development where real data are scarce, but synthetic data may reproduce the weaknesses of the original data. Multimodal systems combine text, images, audio and structured information.

These developments increase capability but also increase governance demands. The central managerial question remains unchanged: does the system improve a clearly defined decision or process while meeting requirements for reliability, fairness, privacy, security and accountability?

Chapter Summary

AI is a broad field; machine learning learns patterns from data; generative AI creates new content; and intelligent automation combines AI capabilities with workflow execution. Supervised learning uses labelled outcomes, unsupervised learning identifies structure without labels, and reinforcement learning learns through rewards.

Business AI projects should begin with a defined decision and proceed through data assessment, baseline comparison, validation, piloting, deployment and monitoring. Recommendation systems, fraud detection, forecasting, customer-service tools and decision augmentation can create significant value, but each involves trade-offs and operational risks. Classification measures such as accuracy, precision and recall must be interpreted in relation to error costs. Forecasting requires attention to time, uncertainty and business consequences.

AI systems may suffer from bias, leakage, drift, hallucination, privacy violations, security attacks and automation bias. Responsible implementation requires human accountability, documented governance, meaningful explanations, contestability, secure data practices and continuous monitoring. The most effective business analyst evaluates the complete decision system rather than treating a model score as the final answer.

Key Terms

Artificial intelligence: The broad field of systems performing tasks associated with human cognitive capabilities.

Machine learning: Methods that learn patterns from data to make predictions or decisions.

Generative AI: AI that produces new text, images, audio, code or other content.

Intelligent automation: Automation combining rules, AI-based interpretation and process execution.

Supervised learning: Learning from inputs paired with known target outcomes.

Unsupervised learning: Learning structure from data without labelled targets.

Reinforcement learning: Learning actions through rewards and penalties.

Classification: Prediction of a categorical outcome.

Regression: Prediction of a numerical outcome.

Overfitting: Strong performance on training data but poor generalisation to new data.

Data leakage: Use of information unavailable at prediction time.

Precision: Proportion of predicted positive cases that are actually positive.

Recall: Proportion of actual positive cases correctly identified.

False positive: Negative case incorrectly classified as positive.

False negative: Positive case incorrectly classified as negative.

Model drift: Decline in performance as data or relationships change.

Hallucination: Generative-AI output that is plausible but unsupported or false.

Decision augmentation: Use of AI to support, rather than wholly replace, human judgement.

Human-in-the-loop: A process in which people review, approve or intervene in automated outputs.

AI governance: Policies, roles and controls for responsible AI development and use.

Review Questions

5 Short Answer Questions

  1. Distinguish artificial intelligence from machine learning.
  2. What is the difference between precision and recall?
  3. Why can random data splitting be inappropriate for time-dependent forecasting?
  4. Give two examples of intelligent automation.
  5. What is a hallucination in generative AI?

5 Long Answer Questions

  1. Explain the machine-learning lifecycle from business problem definition to post-deployment monitoring.
  2. Compare supervised, unsupervised and reinforcement learning, giving one business application of each.
  3. Discuss the benefits and risks of AI-based recommendation systems.
  4. Explain why a fraud-detection model should be evaluated using business outcomes as well as technical metrics.
  5. Analyse the governance controls required for responsible organisational use of generative AI.

3 Analytical / Application Questions

  1. A bank’s fraud model has high recall but produces many false positives. Recommend operational and analytical changes, explaining the trade-offs.
  2. A retailer wants to forecast demand for a seasonal product. Design a validation approach and identify information that could cause data leakage.
  3. A customer-service chatbot frequently gives fluent but inaccurate answers. Propose a safer redesign covering data, workflow, human review and performance measurement.

Multiple Choice Questions with Answers

Question 1

Which statement best describes supervised learning?

A. It learns from labelled examples with known target outcomes.

B. It learns only through physical interaction with machines.

C. It creates content without using any training data.

D. It groups data while refusing to use target variables.

Correct Answer: A. It learns from labelled examples with known target outcomes.

Question 2

A false positive in fraud detection occurs when:

A. Fraud is correctly identified.

B. A genuine transaction is incorrectly flagged as fraud.

C. Fraud is not detected.

D. A transaction is correctly approved.

Correct Answer: B. A genuine transaction is incorrectly flagged as fraud.

Question 3

Which measure answers the question, “Of the cases flagged positive, how many were actually positive?”

A. Recall

B. Accuracy

C. Precision

D. Mean absolute error

Correct Answer: C. Precision

Question 4

Why is data leakage harmful?

A. It makes datasets smaller than necessary.

B. It uses information unavailable when the prediction would be made.

C. It guarantees that all groups receive equal outcomes.

D. It prevents models from being validated.

Correct Answer: B. It uses information unavailable when the prediction would be made.

Question 5

Which is a typical use of generative AI?

A. Creating a draft customer-service response

B. Measuring storage capacity only

C. Replacing all organisational policies automatically

D. Ensuring that every prediction is factual

Correct Answer: A. Creating a draft customer-service response

Question 6

What is the main purpose of a baseline model?

A. To guarantee perfect accuracy

B. To provide a simple comparison for judging added value

C. To remove the need for business objectives

D. To prevent any model monitoring after deployment

Correct Answer: B. To provide a simple comparison for judging added value

Question 7

Which situation is most likely to require high recall?

A. Finding as many genuine safety incidents as possible

B. Minimising the number of emails sent

C. Selecting the shortest product description

D. Reducing the number of database columns

Correct Answer: A. Finding as many genuine safety incidents as possible

Question 8

What does model drift mean?

A. The model is deliberately deleted.

B. The model’s performance declines as data or relationships change.

C. The model uses a validation set.

D. A human reviews a prediction.

Correct Answer: B. The model’s performance declines as data or relationships change.

Question 9

Which practice best reduces generative-AI hallucination in enterprise customer service?

A. Allowing the system to answer every question without review

B. Using approved knowledge sources and escalation to human agents

C. Removing all records of model outputs

D. Measuring only response speed

Correct Answer: B. Using approved knowledge sources and escalation to human agents

Question 10

Decision augmentation means that AI:

A. Always makes the final decision without human involvement

B. Supports human judgement with predictions or evidence

C. Can operate without data or objectives

D. Is used only for producing images

Correct Answer: B. Supports human judgement with predictions or evidence

Introduction to Business Analytics
Chapter 12 of 15