Immersive, Interactive and Synthetic Media

Introduction and Context

Media industries are moving from a screen-centred model toward experiences in which audiences can move, act, speak, create and sometimes appear inside mediated environments. Augmented reality (AR), virtual reality (VR), spatial computing, games, interactive narratives, virtual influencers and synthetic characters are examples of this transition. Together they form an expanding field often called immersive, interactive and synthetic media.

The commercial importance of these media does not arise simply from novelty. Their value depends on whether they solve a communication, entertainment, education or business problem better than conventional media. A museum may use AR to reveal hidden historical layers; a news organisation may use VR to communicate spatial scale; a brand may use a virtual character for sustained storytelling; and a game studio may create a social world in which users become participants rather than spectators.

For media managers, the central question is therefore not “Can this technology be used?” but “What audience value, organisational capability and ethical responsibility justify its use?” This chapter develops a framework for answering that question.

Learning Objectives

By the end of this chapter, students should be able to:

1. Distinguish AR, VR, mixed reality, spatial computing and related forms of immersive media.
2. Explain how interactivity changes audience roles, narrative structure and media economics.
3. Evaluate virtual influencers, synthetic characters and digital humans as communication assets.
4. Analyse games, interactive storytelling and metaverse-related experiences as media systems.
5. Select appropriate technologies using audience, production, business, accessibility and ethical criteria.
6. Design a responsible immersive-media proposal and identify its risks and performance indicators.

1. A Conceptual Map of Immersive Media

Immersive media can be classified along several dimensions rather than as a single technology category.

Presence refers to the psychological feeling of being located within a mediated environment. VR generally seeks a strong sense of presence by replacing the user’s visual field with a digitally produced environment. AR adds digital information to the user’s view of the physical world. Mixed reality (MR) describes experiences in which physical and digital objects are spatially integrated and may respond to each other. Spatial computing is a broader term covering the sensing, mapping, rendering and interaction systems that allow digital content to behave as if it occupies physical space.

Interactivity concerns the degree to which user actions influence content or outcomes. A video with a pause button is technically interactive, but its narrative does not change. A branching story, game or social virtual world has much greater interaction because user choices alter progression, relationships or the environment.

Synthetic media is media content substantially generated or altered by computational systems. It includes AI-generated images, voices, video, avatars and characters. A synthetic character may be fictional, while a digital human may be designed to resemble a real person or to perform human-like communication. The distinction is not always technical; it is also social and legal. Audiences need to know whether they are encountering a human, an authorised representation or an autonomous system.

2. The Experience Stack

A useful way to manage immersive media is to view it as an experience stack. The layers are interconnected, but each creates distinct managerial responsibilities.

1. Hardware layer: Head-mounted displays, smartphones, cameras, spatial sensors, controllers, haptic devices and network equipment.
2. Perception layer: Tracking, mapping, rendering, spatial audio, gesture recognition and computer vision.
3. Content layer: 3D models, environments, animation, scripts, characters, interaction rules and sound.
4. Intelligence layer: Recommendation systems, conversational agents, procedural generation, moderation and adaptive difficulty.
5. Experience layer: The user’s journey, emotional response, sense of presence, agency and social participation.
6. Business and governance layer: Revenue, ownership, privacy, safety, accessibility, labour and compliance.

Failure at one layer can damage the whole experience. High-quality 3D graphics cannot compensate for uncomfortable motion, unclear interaction or a weak narrative. Similarly, an engaging virtual influencer can create reputational damage if its identity, sponsorship or data practices are deceptive.

3. Augmented, Virtual and Mixed Reality

Augmented Reality

AR overlays digital content on a physical environment. Mobile AR uses a phone camera and screen; wearable AR uses glasses or a head-mounted display. Effective AR content is spatially relevant, timely and easy to understand. It should not merely reproduce a poster in 3D. Its advantage lies in adding information at the point of attention.

Applications include virtual try-on, location-based storytelling, live-event overlays, maintenance guidance, tourism interpretation and advertising. A publisher could allow readers to scan a printed map and see a three-dimensional reconstruction of an event. A retailer could let customers visualise furniture in their homes.

Virtual Reality

VR creates a digitally rendered environment viewed through a headset. Its distinctive communication capability is experiential perspective: users can inspect a place, perform an action or experience a simulated situation from within. This can support empathy and learning, but presence does not guarantee understanding. A dramatic VR experience may be memorable while still oversimplifying a complex issue.

VR production requires attention to locomotion, field of view, frame rate, sound, interaction and user comfort. Sudden camera movement controlled by the system can produce discomfort because visual motion conflicts with bodily signals. Designers therefore commonly prefer user-controlled movement, teleportation, fixed viewpoints or carefully calibrated transitions.

Mixed Reality and Spatial Computing

MR combines digital content with awareness of physical surfaces, objects and people. A virtual object may appear to rest on a table, remain behind a real wall or respond to the user’s hand. Spatial computing makes location and embodied interaction central to the interface.

The managerial implication is that production becomes partly environmental. Teams must consider room dimensions, lighting, safety, network quality, device compatibility and the social behaviour of people sharing the same space. A spatial experience is not finished when the digital asset is exported; it must work in diverse physical contexts.

4. Interactivity and the Changing Audience Role

Traditional mass media generally distributes a relatively stable text to a large audience. Interactive media distributes a system that produces different experiences through audience action. This changes the audience from spectator to participant, player, explorer, co-author or data contributor.

Interactivity can be analysed through four questions:

• Agency: Can users make meaningful choices?
• Responsiveness: Does the system recognise and respond to those choices?
• Consequentiality: Do choices alter later content or outcomes?
• Transparency: Do users understand the available actions and their consequences?

A branching story with ten choices is not necessarily more interactive than a linear story. If all branches quickly return to the same outcome, the apparent agency may be superficial. Conversely, a museum installation with a small number of choices may be highly meaningful if those choices determine what evidence visitors encounter.

Interactive storytelling requires a different writing practice. Authors design worlds, rules, character states and possible sequences rather than one fixed path. Production costs can increase rapidly because every branch requires writing, design, testing, localisation and quality assurance. Consequently, many successful experiences use “branch-and-bottleneck” structures: choices create local variation while major narrative milestones remain shared.

5. Games as Media Systems

Games are not simply containers for stories. They communicate through rules, goals, feedback, challenge, spatial design and player action. A game can express a viewpoint through what it rewards, prohibits or makes difficult. This is sometimes described as procedural rhetoric: arguments communicated through processes and rules.

Game-based media applications include entertainment, education, public information, journalism, brand engagement, training and social interaction. A serious game about climate adaptation may require players to allocate a limited budget among competing risks. Its educational value comes not only from facts but from experiencing trade-offs.

A media manager should evaluate a game through:

• learning or communication outcomes;
• quality and fairness of rules;
• accessibility of controls;
• difficulty and onboarding;
• retention without exploitative compulsion;
• community moderation;
• platform and device reach; and
• total cost of content updates.

Games also generate behavioural data. This can support evaluation, but data collection must be proportionate and clearly explained. Engagement time alone is a weak success measure: a user may remain in an experience because it is confusing, addictive or difficult to exit.

6. Virtual Influencers, Synthetic Characters and Digital Humans

A virtual influencer is a designed or computer-generated persona that maintains a public identity and communicates through social platforms. A synthetic character is a fictional entity generated or animated for narrative, promotional or interactive purposes. A digital human is a human-like digital representation capable of visual, vocal or conversational performance. It may be fictional, based on a performer, or modelled on a real person.

These categories overlap, but their management issues differ. A virtual influencer is primarily an identity and relationship asset. A synthetic character is primarily a narrative or design asset. A digital human may be treated by audiences as a social actor, which increases expectations of authenticity and accountability.

Their advantages include consistency, scalability, multilingual adaptation, continuous availability and control over brand presentation. Their risks include uncanny appearance, audience deception, cultural stereotyping, unauthorised likeness, synthetic misinformation and the displacement or exploitation of human performers.

Disclosure should be clear and prominent. It should identify material sponsorship and, where relevant, explain that a character or voice is synthetic. Disclosure is not merely a legal formality: it supports informed audience interpretation and protects long-term trust.

A responsible synthetic-character workflow includes:

1. Define the character’s purpose, audience and boundaries.
2. Document ownership of the name, likeness, voice, training data and design assets.
3. Obtain consent and contracts for any performer’s likeness or voice.
4. Establish prohibited outputs and escalation procedures.
5. Test representation, language, accessibility and cultural assumptions.
6. Label synthetic content in context.
7. Monitor audience feedback and harmful misuse.
8. Provide a human accountability channel.

7. The Metaverse as an Experience and Business Idea

The term metaverse has been used to describe persistent, networked, spatial or virtual environments in which users interact through avatars, objects and communities. It is better treated as a contested umbrella concept than as one finished product. Some experiences are decentralised; others are controlled by a platform. Some use immersive headsets; others use ordinary screens.

A metaverse-related media experience may include persistent identity, a shared world, user-generated content, social presence, virtual goods, live events and an economy. However, persistence and virtual ownership do not automatically create value. A media organisation must determine what audiences repeatedly need: community, access, status, creativity, learning, entertainment or utility.

Important business models include subscriptions, ticketed events, advertising, sponsorship, digital goods, licensing, commissions and service contracts. Digital goods require careful consideration of transferability, refunds, moderation, platform dependency and consumer expectations. Speculative scarcity or tokenisation is not a substitute for audience value.

8. Evaluating Viability: The ICEA Framework

A practical evaluation framework is ICEA: Intent, Capability, Experience and Accountability.

Intent asks what problem the experience solves and for whom. The proposal should identify a measurable communication or business objective.

Capability examines whether the organisation has the talent, hardware, data, production pipeline, distribution access and budget required.

Experience evaluates usability, presence, agency, narrative quality, accessibility and repeat value. User research should include first-time users and people with disabilities.

Accountability covers privacy, safety, disclosure, intellectual property, consent, labour, environmental impact and platform governance.

A simple weighted decision model can help compare alternatives. If each criterion receives a score from 1 to 5 and a weight whose total is 1, the overall score is:

Here, S is the weighted score, wᵢ is the importance weight of criterion i, and rᵢ is the proposal’s rating for that criterion. The score is only a decision aid, not an objective truth. Scores should be supported by evidence, and a proposal that fails a non-negotiable safety or legal requirement should not be approved merely because its total is high.

Worked Example

Suppose a media company evaluates an AR cultural-tourism project using four criteria:

The score is S = 4.05 out of 5. The result indicates strong potential, but the capability rating of 3 suggests that the organisation should begin with a limited pilot or external partnership rather than a full national launch.

9. Applied Case: “Harbour Stories”

The following is an illustrative case.

Background

A regional public broadcaster wants to attract younger audiences to a neglected waterfront district. It considers a VR documentary, an AR walking trail and a persistent virtual waterfront.

Problem

The broadcaster has limited funds, uneven access to headsets and a public-service responsibility to represent local communities accurately. It must create engagement without turning residents’ histories into spectacle.

Analysis

Audience research shows that residents value historical recognition and visitors want convenient information. Schools want curriculum-linked material. Headset ownership is low, but smartphone use is high. The organisation has documentary producers but little experience in 3D development.

Approach and Solution

The broadcaster selects an AR walking trail as the first release. Users scan location markers to see archival photographs aligned with present-day views, hear short interviews and choose between several historical perspectives. The project includes a web alternative for people unable to visit the site and captions, transcripts and audio description.

Residents provide informed consent for interviews. Historical claims are reviewed by an advisory group. The interface labels reconstructed scenes and distinguishes archival evidence from dramatic interpretation. Location data is minimised, and the organisation does not require account creation for basic access.

A later VR version is produced for libraries and schools, using selected stories rather than attempting to reproduce the entire trail. A virtual world is postponed because its maintenance cost and audience value are not yet demonstrated.

Outcome

The pilot produces strong completion rates and is adopted by local schools. User testing identifies confusion about map permissions, which is corrected in a later release. The broadcaster learns that the most valuable innovation was not the most technologically ambitious option; it was the combination of situated storytelling, public access and community governance.

Learning Points

1. Distribution conditions should shape format selection.
2. A small, well-designed AR experience may outperform a costly virtual world.
3. Accessibility must be designed from the beginning.
4. Historical and cultural content requires community accountability.
5. Prototyping can test audience value before major investment.

10. Ethics, Governance and Regulation

Immersive and synthetic media intensify familiar media ethics because they can create stronger presence, collect richer behavioural data and imitate people more convincingly.

Privacy: Spatial devices may capture faces, rooms, body movement, voice and gaze. Organisations should collect only necessary data, explain purposes, restrict retention and secure sensitive records. Biometric and inferred data may require additional legal protection depending on jurisdiction.

Consent and likeness: A person’s face, voice, movement or identity should not be reproduced without valid permission. Consent should specify duration, territory, uses, modification rights and withdrawal conditions where applicable.

Truth and provenance: Synthetic images, voices and digital humans can mislead audiences. Clear labelling, provenance records, editorial review and rapid correction processes are essential, especially in journalism and political communication.

Accessibility: Headsets may be unsuitable for some users; motion, sound, colour and gesture requirements can exclude people. Alternatives such as captions, audio description, keyboard or controller support, seated modes and non-headset versions should be planned rather than added after launch.

Safety and wellbeing: Users may encounter harassment, manipulation, disorientation or distressing content. Platforms need reporting tools, moderation, age-appropriate design, safe physical boundaries and mechanisms for human intervention.

Intellectual property and labour: 3D assets, datasets, voices, performances and user-generated worlds raise copyright and contractual questions. Generative systems may also alter the distribution of creative labour. Transparent crediting, fair contracts and human oversight are central to sustainable production.

Environmental responsibility: Rendering, storage, device manufacture and network use consume resources. Managers should consider device life, asset optimisation, cloud usage, repairability and whether the experience’s public value justifies its footprint.

11. Contemporary Developments and Best Practices

Recent development has been shaped by improvements in real-time 3D engines, computer vision, generative AI, spatial audio, hand tracking and lightweight wearable devices. Generative AI can accelerate concept art, dialogue variation, localisation and environment prototyping, but generated outputs require editorial review for bias, errors, rights and continuity.

Best practice is organised around disciplined experimentation:

• Begin with an audience problem, not a device demonstration.
• Create a low-cost prototype and test it with representative users.
• Measure comprehension, task success, emotional response, accessibility and trust, not only views or time spent.
• Design for the least capable supported device where reach matters.
• Use modular assets so stories can move across mobile, web, headset and live formats.
• Separate experimental features from safety-critical functions.
• Maintain records of data sources, permissions, model use and editorial decisions.
• Establish a post-launch plan for moderation, updates and technical support.

A viable immersive-media strategy is therefore both creative and operational. It joins narrative design, interaction design, technology management, audience research, legal review and ethical governance.

Chapter Summary

Immersive, interactive and synthetic media transform audiences from passive recipients into participants, players, explorers and sometimes co-creators. AR overlays digital information on the physical world; VR places users within a digital environment; MR and spatial computing connect digital objects to physical space. Interactive storytelling and games communicate through choice, rules, feedback and consequence. Virtual influencers, synthetic characters and digital humans extend media identity but introduce significant issues of disclosure, likeness, consent and accountability.

The experience stack shows that successful projects require coordination among hardware, perception, content, intelligence, user experience and governance. The ICEA framework evaluates Intent, Capability, Experience and Accountability, while weighted scoring can support—but not replace—professional judgement. The Harbour Stories case demonstrates that the most viable solution is often a carefully scoped, accessible and socially responsible pilot rather than the most technologically ambitious proposal. Future media managers must combine experimentation with evidence, inclusion, transparency and long-term stewardship.

Key Terms

Augmented reality: Digital content overlaid on a view of the physical world.

Virtual reality: A digitally rendered environment designed to create a sense of presence.

Mixed reality: A form of spatial media in which physical and digital elements are integrated and may interact.

Spatial computing: Computing that senses, maps and renders digital content in relation to physical space.

Presence: The psychological feeling of being located within a mediated environment.

Interactivity: The capacity of a media system to respond to user actions.

Agency: The user’s ability to make meaningful choices.

Synthetic media: Media content generated or substantially altered by computational systems.

Virtual influencer: A designed or computer-generated persona with a public social identity.

Synthetic character: A computationally generated or animated fictional character.

Digital human: A human-like digital representation capable of visual, vocal or conversational performance.

Procedural rhetoric: Communication of ideas through rules, processes and simulations.

Metaverse: A contested term for persistent, networked, social or spatial virtual environments.

Spatial audio: Sound designed to appear located around the listener in three-dimensional space.

Branching narrative: A story structure in which user choices produce different sequences or outcomes.

Likeness rights: Legal and contractual rights relating to a person’s identity, appearance or voice.

Provenance: Information about the origin, transformation and ownership of media content.

Presence design: The deliberate design of sensory, spatial and interaction features that shape immersion.

Review Questions

Short Answer Questions

1. What is the principal difference between augmented reality and virtual reality?
2. Define synthetic media and give two examples.
3. What are the four dimensions used to analyse interactivity in this chapter?
4. Why is disclosure important for virtual influencers?
5. What does the ICEA framework evaluate?

Long Answer Questions

1. Explain how spatial computing changes the production and management of media experiences.
2. Discuss the opportunities and risks associated with digital humans and synthetic characters.
3. Analyse games as communicative systems rather than merely entertainment products.
4. Explain why accessibility and governance should be integrated at the beginning of an immersive-media project.
5. Compare the strategic value of an AR walking trail, a VR documentary and a persistent virtual world for a public broadcaster.

Analytical / Application Questions

1. A museum has a limited budget and wants to engage school students with an archaeological site. Using the ICEA framework, recommend an immersive format and justify your decision.
2. Design a governance plan for a virtual influencer used in a sponsored health campaign. Identify disclosure, consent, safety, data and accountability measures.
3. A game studio wants to use generative AI to create voices for non-player characters. Analyse the creative, labour, intellectual-property and audience-trust issues before launch.

Multiple Choice Questions with Answers

Question 1

Which feature most clearly distinguishes augmented reality from virtual reality?

A. AR always requires a game engine

B. AR keeps the physical world visible while adding digital content

C. AR cannot respond to user input

D. AR is used only for advertising

Correct Answer: B. AR keeps the physical world visible while adding digital content

Question 2

In the ICEA framework, which question belongs primarily to the Accountability dimension?

A. What audience problem is being solved?

B. Does the organisation possess the required production skills?

C. How engaging and accessible is the experience?

D. How will privacy, consent and safety be managed?

Correct Answer: D. How will privacy, consent and safety be managed?

Question 3

What makes a user choice meaningful in an interactive narrative?

A. It is displayed in a bright colour

B. It requires a headset

C. It changes content, relationships or outcomes

D. It increases the number of advertisements

Correct Answer: C. It changes content, relationships or outcomes

Question 4

Which statement best describes procedural rhetoric?

A. Arguments communicated through rules and processes

B. A method for compressing 3D files

C. A legal licence for virtual goods

D. A technique for recording spatial audio

Correct Answer: A. Arguments communicated through rules and processes

Question 5

A weighted evaluation uses weights 0.30, 0.20, 0.25 and 0.25, with ratings 4, 3, 4 and 5 respectively. What is the total score?

A. 3.05

B. 3.75

C. 4.05

D. 4.80

Correct Answer: C. 4.05

Question 6

Which practice is most appropriate when reproducing a performer’s voice in a digital human?

A. Use the voice without notification if the character is fictional

B. Obtain clear permission covering the intended uses

C. Assume copyright disappears after recording

D. Allow the model to determine consent automatically

Correct Answer: B. Obtain clear permission covering the intended uses

Question 7

Why might a public broadcaster select an AR walking trail before building a persistent virtual world?

A. AR never requires content maintenance

B. A walking trail may better match audience access and organisational capability

C. Virtual worlds cannot contain historical content

D. AR eliminates all privacy concerns

Correct Answer: B. A walking trail may better match audience access and organisational capability

Question 8

Which measurement is least sufficient by itself for evaluating a game-based media project?

A. Task or learning success

B. Accessibility performance

C. User comprehension

D. Time spent in the experience

Correct Answer: D. Time spent in the experience

Question 9

What is a central privacy concern in spatial media?

A. The inability to render colour

B. Collection of spatial, biometric, voice or gaze data

C. The absence of narrative choices

D. The use of printed photographs

Correct Answer: B. Collection of spatial, biometric, voice or gaze data

Question 10

A synthetic character is best distinguished from a virtual influencer because the synthetic character is primarily a:

A. Narrative or design asset

B. Physical-world navigation device

C. Network encryption protocol

D. Copyright tribunal

Correct Answer: A. Narrative or design asset