9. Cloud Analytics, Business Intelligence and Decision SupportIntroduction and ContextCloud analytics is the use of cloud-based storage, computing, data-management, and analytical services to transform data into insight and action. It has changed the economics and architecture of business intelligence (BI). Instead of relying exclusively on locally installed servers and fixed reporting systems, organisations can now combine data from enterprise applications, websites, sensors, mobile devices, social platforms, and external providers in scalable cloud environments. The purpose of cloud analytics is not merely to move a database to the cloud. Its organisational value arises when data is made accessible, understandable, trustworthy, and relevant to decisions. Business intelligence provides descriptive and diagnostic views of performance; advanced analytics may estimate future outcomes or recommend actions; decision-support systems connect these insights with managerial processes. Thus, the central concern is the movement from data to decision, not technology in isolation. Cloud analytics is relevant at three decision levels. Operational managers may monitor order delays, service queues, or machine conditions in near real time. Tactical managers may examine regional profitability, customer retention, or campaign performance. Senior leaders may evaluate strategic growth, risk exposure, investment priorities, and competitive position. A well-designed analytical environment serves all three levels while recognising their different requirements for speed, detail, context, and governance. Learning ObjectivesAfter studying this chapter, students should be able to: 1. Explain the relationship between cloud analytics, business intelligence, OLAP, dashboards, and decision support. 2. Distinguish analytical architectures, data models, and workload types used in cloud environments. 3. Formulate metrics and dimensions that support reliable managerial interpretation. 4. Design appropriate dashboards and self-service analytical workflows. 5. Evaluate the technical, organisational, ethical, and governance implications of cloud analytics. 6. Apply a structured approach to an organisational analytics problem and justify a decision-support solution. From Cloud Data to Organisational DecisionsA useful analytical chain consists of data acquisition, preparation, modelling, analysis, communication, decision, and feedback. Data may arrive through batch files, application programming interfaces, event streams, transactional systems, or connected devices. It is then stored in a data lake, warehouse, lakehouse, or combination of platforms. Transformation establishes consistent formats, identifiers, business rules, and quality controls. A semantic model translates technical tables into concepts familiar to users, such as customer, product, revenue, region, and period. The analytical layer supports queries, aggregations, statistical analysis, visualisation, and machine learning. The communication layer includes reports, scorecards, dashboards, alerts, and embedded analytics. Finally, decision-makers interpret the evidence in relation to objectives, constraints, experience, and risk. Feedback is essential: outcomes should be measured and compared with the original decision so that models, metrics, and processes can improve. This chain also exposes a common misconception. A visually attractive dashboard does not necessarily provide decision support. Decision support exists only when information is connected to a decision, a responsible person, a time horizon, and an available course of action. A chart showing declining sales may be informative; a system that identifies the affected segment, estimates the financial impact, recommends investigation, and assigns an action owner is more useful as decision support. Cloud Analytical ArchitecturesA traditional data warehouse stores structured, integrated data designed primarily for reporting and analytical queries. A cloud data warehouse provides similar capabilities with elastic compute, managed infrastructure, separation of storage and computation, and integration with other cloud services. Users can increase resources for heavy workloads and reduce them when demand falls, although cost controls remain necessary. A data lake stores data in its original or lightly processed form and can accommodate structured, semi-structured, and unstructured data. Its flexibility supports exploration and machine learning, but weak governance can produce duplication, unclear ownership, and unreliable analysis. A lakehouse attempts to combine the flexibility of a lake with the management, transaction, and performance features associated with a warehouse. The choice among these architectures should follow data characteristics, workload needs, governance maturity, and organisational capability rather than fashion. Cloud analytics commonly uses a layered architecture: - Ingestion layer: captures batch and streaming data from internal and external sources.
- Storage layer: retains raw, curated, historical, and sometimes aggregated data.
- Processing layer: cleans, integrates, transforms, and enriches data.
- Modelling layer: creates facts, dimensions, semantic models, and reusable metrics.
- Consumption layer: delivers SQL analysis, reports, dashboards, alerts, notebooks, and applications.
- Governance layer: manages identity, access, metadata, quality, lineage, privacy, security, and cost.
Modern platforms often separate storage from compute. This permits different user groups to run workloads independently, but it also creates a need for workload management, resource policies, query optimisation, and monitoring. A technically scalable platform can still fail if queries are poorly designed or if every user creates uncontrolled copies of data. Querying, Modelling, and OLAPStructured Query Language (SQL) remains central to cloud analytics. Analytical SQL commonly filters records, joins datasets, groups observations, calculates aggregates, and uses window functions to compare values across time or categories. Query design should reflect the analytical question. For example, a question about monthly revenue by region requires a well-defined date field, revenue measure, region dimension, treatment of returns, and rule for handling incomplete transactions. Analytical data models often distinguish fact tables from dimension tables. A fact table contains measurable events such as sales transactions, shipments, or support interactions. Dimension tables describe the context of those events, such as customer, product, location, and date. A star schema places a central fact table around denormalised dimensions and is frequently effective for BI because it simplifies queries and supports predictable aggregation. OLAP, or online analytical processing, enables users to examine data across multiple dimensions. Common OLAP operations include: - Roll-up: aggregate from a lower level to a higher level, such as daily sales to monthly sales.
- Drill-down: move from a summary to greater detail, such as company revenue to branch transactions.
- Slice: select one value of a dimension, such as sales for one quarter.
- Dice: select a subset across several dimensions, such as sales for two regions, three products, and one quarter.
- Pivot: reorient dimensions to view the data from another perspective.
OLAP is valuable because managerial questions are multidimensional. Profitability may need to be examined by product, customer segment, geography, channel, and time. However, OLAP results are only as reliable as the underlying grain and definitions. If one table records orders and another records order lines, joining them without care may duplicate revenue. Analysts must understand the grain of each fact table before combining measures. Metrics, Semantics, and the Discipline of MeasurementA metric is a quantified measure used to assess a condition or performance. A key performance indicator (KPI) is a metric linked explicitly to an organisational objective and a target. The distinction matters: page views may be a metric, while qualified leads per campaign may be a KPI if the organisation seeks profitable customer acquisition. A robust metric definition specifies the business meaning, formula, unit, population, time period, source, refresh frequency, owner, and exclusions. Consider customer retention. It is not meaningful to report a retention percentage without defining the starting customer population, observation period, treatment of dormant accounts, and handling of cancellations. Different definitions may be valid, but they must not be silently mixed. Metric systems should distinguish: - Measures: numerical values such as units sold or cost.
- Dimensions: categories used to segment measures, such as channel or region.
- Targets: desired levels or thresholds.
- Ratios: relationships between measures, such as conversion rate.
- Leading indicators: signals that may precede an outcome, such as qualified opportunities.
- Lagging indicators: outcomes observed after activity, such as quarterly profit.
Metrics can also create dysfunctional behaviour. If a call centre is evaluated only on average handling time, employees may shorten calls without resolving customer problems. Balanced measurement therefore combines efficiency, quality, customer, financial, and risk indicators. Metrics should support decisions rather than encourage local optimisation at the expense of organisational performance. Dashboards and Visual AnalyticsA dashboard is a coordinated visual interface that presents selected information for monitoring, exploration, or action. Its design begins with the decision context, not the choice of chart. The designer should identify the audience, decisions, frequency of use, acceptable latency, level of detail, and likely response to an exception. Operational dashboards often display current status, alerts, queues, and exceptions. Tactical dashboards emphasise trends, comparisons, causes, and performance against targets. Strategic dashboards present a smaller number of indicators related to long-term objectives. A single dashboard should not attempt to perform all these functions without clear navigation and prioritisation. Effective visualisation follows several principles. Use position and length for precise comparisons, choose scales that do not mislead, label units clearly, and avoid unnecessary decoration. Colour should communicate meaning consistently and remain interpretable for users with colour-vision deficiencies. Time-series charts are generally suitable for trends, bar charts for category comparison, and maps only when geographic pattern is genuinely relevant. A dashboard should reveal exceptions and relationships, not merely display every available field. Interaction can support drill-down, filtering, brushing, and tooltips, but excessive interaction increases cognitive load and may allow users to create misleading views. Every chart should answer a question. If users cannot explain what action a visual supports, it may not belong on the dashboard. Self-Service Analytics and Decision RightsSelf-service analytics allows business users to explore governed data without submitting every request to a central IT team. It can shorten the time between question and insight and encourage analytical literacy. However, self-service does not mean uncontrolled access. The most effective model is governed self-service: the organisation provides certified datasets, common definitions, access controls, training, documentation, and support while allowing users flexibility in exploration. A useful division of responsibility is that data engineering teams maintain pipelines and platform reliability, data stewards define meaning and quality rules, analysts develop reusable models and analyses, and business users interpret results and make decisions. These roles may overlap in small organisations, but accountability must remain explicit. Self-service environments require a catalogue containing dataset descriptions, owners, freshness, lineage, sensitivity, and certification status. Users should be able to distinguish an official revenue measure from an experimental calculation. Version control and promotion procedures are also important when a personal analysis becomes an organisational report. A Decision-Support FrameworkA practical framework for analytics-enabled decisions contains six stages: 1. Frame the decision. State the decision, decision owner, alternatives, constraints, and deadline. 2. Define success. Select outcome measures, targets, risk limits, and relevant leading indicators. 3. Assemble evidence. Identify sources, quality requirements, historical context, and assumptions. 4. Analyse alternatives. Use descriptive, diagnostic, predictive, or prescriptive techniques as appropriate. 5. Communicate and act. Present the evidence, uncertainty, recommendation, and accountable action. 6. Review outcomes. Compare actual results with expectations and revise the process. The framework prevents a frequent error: beginning with a tool rather than with a decision. Descriptive analytics answers what happened; diagnostic analytics investigates why; predictive analytics estimates what may happen; prescriptive analytics evaluates what could be done. These forms are complementary, but predictive or prescriptive output should not be treated as certainty. Decisions must account for data quality, model assumptions, changing conditions, and the consequences of error. Applied Case: Cloud Decision Support for a Regional RetailerBackground. The following is an illustrative case. A retailer operates stores, an online channel, a loyalty programme, and a delivery service. Sales data is stored in a transactional system, online behaviour in web logs, and delivery information in a third-party platform. Regional managers receive weekly spreadsheets and disagree about which products are profitable. Situation and problem. The organisation wants to reduce stock-outs without increasing excess inventory. Reports use different definitions of sales, returns, and available stock. Managers cannot easily distinguish a genuine demand increase from a delayed delivery or a promotional effect. Analysis. The analytics team first framed the decision as: which products should be replenished, in what quantity, and at which location during the next planning cycle? It documented the grain of each source: sales at order-line level, stock as a periodic snapshot, and delivery events at shipment level. A common product and location master was established. The team also identified that revenue could not be joined directly to delivery events without a defined order and shipment relationship. Approach. Batch and streaming ingestion brought transactions, inventory snapshots, promotions, and delivery events into a cloud platform. Curated fact tables were created for sales, inventory, and shipments, with shared product, store, customer, and date dimensions. A governed metric layer defined net sales, stock-out rate, inventory days, fulfilment time, and gross margin. A dashboard showed current stock exceptions, a trend of demand, promotion status, supplier lead time, and a drill-down to store and product. A forecasting model generated demand estimates, but recommendations were displayed with confidence ranges and were reviewed by inventory planners. Outcome. The organisation obtained a single analytical view and moved from spreadsheet reconciliation to exception-based planning. The important outcome was not merely faster querying. Managers could see the evidence behind a recommendation, challenge unusual results, and record the action taken. Subsequent review compared forecast demand, replenishment decisions, and actual stock outcomes. Learning points. The case demonstrates that decision support depends on data grain, shared definitions, ownership, workflow integration, and feedback. A cloud platform improves scalability, but it does not resolve ambiguous business rules or guarantee responsible decisions. Risks, Governance, and Professional ResponsibilityCloud analytics introduces risks concerning confidentiality, integrity, availability, privacy, vendor dependence, and cost. Access should follow least privilege, with strong identity management, role-based permissions, encryption, network controls, logging, and periodic review. Sensitive data should be classified, retained only as long as justified, and masked or anonymised where possible. Governance also includes data lineage, quality monitoring, master-data management, retention policies, incident response, and contractual controls over cloud providers. Regulatory obligations vary by jurisdiction and industry, but organisations should be able to explain what data is collected, why it is used, who can access it, and how long it is retained. Cross-border transfer and third-party processing require particular scrutiny. Ethical analytics extends beyond legal compliance. Analysts should consider fairness, proportionality, transparency, and the potential harms of automated decisions. A model used to prioritise customers or assess employee performance may reproduce historical bias. Dashboards can also create misleading certainty by hiding missing data, uncertainty, or alternative interpretations. Responsible practice requires documenting assumptions, testing impacts on relevant groups, enabling human review where appropriate, and providing mechanisms for correction. Common implementation mistakes include migrating poor-quality data without remediation, defining KPIs after building visualisations, allowing multiple unofficial versions of the truth, ignoring query and storage costs, and treating user adoption as automatic. Another mistake is measuring platform activity rather than business value. Successful programmes monitor decision cycle time, data quality, user trust, action completion, and realised outcomes. Contemporary Developments and Best PracticeSeveral developments are reshaping cloud analytics. Real-time analytics supports fraud detection, connected operations, dynamic pricing, and service monitoring. Embedded analytics places insights inside operational applications rather than requiring users to open a separate BI tool. Data products treat curated datasets as managed products with owners, service expectations, documentation, and user feedback. Data contracts formalise expectations between producers and consumers about schema, quality, and change. Generative AI is increasingly used to translate natural-language questions into SQL, summarise dashboards, explain anomalies, and assist with data preparation. These capabilities can improve access, but generated queries and explanations require validation. AI may misinterpret ambiguous metric definitions, expose sensitive information, or produce plausible but incorrect conclusions. Human oversight and governed semantic models remain essential. Best practice is therefore socio-technical. Organisations should begin with high-value decisions, establish trusted data products, define metrics collaboratively, design for the actual workflow, automate quality and lineage checks, control platform costs, train users in interpretation, and evaluate results after action. Architecture, governance, visual design, analytical methods, and organisational accountability must be developed together. Chapter SummaryCloud analytics combines scalable cloud infrastructure with data integration, modelling, querying, visualisation, and decision processes. Business intelligence describes and diagnoses performance, while predictive and prescriptive analytics extend decision support toward future conditions and possible actions. Data warehouses, lakes, and lakehouses serve different but sometimes overlapping purposes; their value depends on governance and workload design. OLAP enables multidimensional analysis through roll-up, drill-down, slice, dice, and pivot operations. Reliable dashboards depend on well-defined metrics, suitable visual encodings, and a clear decision context. Governed self-service balances user autonomy with common definitions, security, and accountability. Effective implementation also addresses privacy, ethics, cost, data quality, uncertainty, and feedback from decisions to analytical models. Key TermsCloud analytics: Analysis performed using cloud-hosted data, computing, and analytical services. Business intelligence: Processes and technologies that transform organisational data into information for management and action. Decision-support system: A system that helps users evaluate situations, alternatives, and actions. Data warehouse: A governed repository of integrated, structured data designed primarily for analytical workloads. Data lake: A repository that stores diverse data, often in raw or lightly processed form. Lakehouse: An architecture combining data-lake flexibility with warehouse-style management and analytical performance. Fact table: A table containing measurable business events at a defined grain. Dimension table: A table describing the context of facts, such as product, customer, location, or time. OLAP: Online analytical processing across multiple business dimensions. Roll-up: Aggregating data to a higher level of summarisation. Drill-down: Moving from summary information to more detailed information. KPI: A metric explicitly connected to an objective, target, and performance assessment. Semantic model: A business-oriented representation that gives data fields consistent meaning and relationships. Dashboard: A visual interface presenting selected information for monitoring, exploration, or action. Self-service analytics: User-led exploration and reporting using accessible analytical data and tools. Data lineage: A record of data origins, transformations, movement, and use. Governed self-service: Self-service analytics operating within standards for quality, access, definitions, and accountability. Prescriptive analytics: Analysis that evaluates or recommends possible actions. Data product: A managed, documented, reusable dataset or analytical asset designed for consumers. Review QuestionsShort Answer Questions1. How does cloud analytics differ from simply storing files in the cloud? 2. Distinguish a fact table from a dimension table. 3. What is the difference between a metric and a KPI? 4. Define governed self-service analytics. 5. Explain the OLAP operations of roll-up and drill-down. Long Answer Questions1. Explain the layered architecture of a cloud analytics platform and the purpose of each layer. 2. Discuss how metric definitions, data grain, and semantic models affect trust in BI reports. 3. Compare data warehouses, data lakes, and lakehouses in terms of flexibility, governance, and analytical use. 4. Explain the six-stage decision-support framework presented in this chapter. 5. Discuss the ethical, privacy, security, and cost risks associated with cloud analytics. Analytical / Application Questions1. A sales dashboard reports different revenue figures for finance and marketing. Diagnose possible causes and propose a governance-based resolution. 2. Design a dashboard for a hospital operations manager. Specify the decision, audience, five metrics, appropriate visualisations, and likely actions. 3. An organisation wants an AI assistant that generates SQL from natural-language questions. Evaluate the benefits, risks, controls, and conditions required for responsible deployment. 22. Multiple Choice Questions with AnswersQuestion 1Which feature most directly distinguishes decision support from simple reporting? A. It uses a cloud database. B. It connects evidence with an actionable decision, owner, and time frame. C. It contains more charts. D. It refreshes only once a month. Correct Answer: B. It connects evidence with an actionable decision, owner, and time frame. Question 2A manager moves from annual regional sales totals to monthly sales for one selected region. Which OLAP operations are primarily involved? A. Roll-up followed by slice. B. Drill-down followed by slice. C. Pivot followed by roll-up. D. Dice followed by drill-down. Correct Answer: B. Drill-down followed by slice. Question 3Why must analysts understand the grain of fact tables before joining them? A. To select dashboard colours. B. To prevent duplicated measures and incorrect aggregations. C. To eliminate the need for dimensions. D. To guarantee that forecasts are accurate. Correct Answer: B. To prevent duplicated measures and incorrect aggregations. Question 4Which practice best represents governed self-service analytics? A. Allowing every user to create unrestricted copies of production data. B. Restricting all analysis to a central IT team. C. Providing certified datasets, common definitions, access controls, and user exploration. D. Removing metadata so users can work independently. Correct Answer: C. Providing certified datasets, common definitions, access controls, and user exploration. Question 5A retailer measures call-centre success only by average handling time, and resolution quality declines. What does this illustrate? A. The value of a balanced set of performance measures. B. The superiority of lagging indicators. C. A successful prescriptive model. D. A data-lake storage problem. Correct Answer: A. The value of a balanced set of performance measures. Question 6Which visualisation is generally most appropriate for showing monthly revenue trends over two years? A. A time-series line chart. B. A pie chart with one slice per month. C. A map without geographic data. D. A word cloud. Correct Answer: A. A time-series line chart. Question 7In the illustrative retail case, why was revenue not joined directly to delivery events without further modelling? A. Cloud platforms cannot join tables. B. The datasets had different business relationships and grains. C. Revenue is never suitable for analysis. D. Delivery events are always unstructured. Correct Answer: B. The datasets had different business relationships and grains. Question 8Which control is most appropriate when a generative AI tool produces SQL for business users? A. Accepting every generated query if it runs successfully. B. Removing access controls to improve convenience. C. Validating queries against governed definitions and reviewing results. D. Using only unlabelled experimental datasets. Correct Answer: C. Validating queries against governed definitions and reviewing results. Question 9Which statement best describes predictive analytics? A. It reports only what happened in the past. B. It estimates likely future outcomes using data and assumptions. C. It automatically makes every organisational decision. D. It replaces the need for data governance. Correct Answer: B. It estimates likely future outcomes using data and assumptions. Question 10An organisation wants to reduce stock-outs using cloud analytics. Which first step is most appropriate? A. Choose chart colours and publish a dashboard immediately. B. Frame the replenishment decision, owner, constraints, and success measures. C. Train a complex model before examining data quality. D. Combine all tables without documenting their grain. Correct Answer: B. Frame the replenishment decision, owner, constraints, and success measures.
|