11. 3D Vision, Scene Understanding, and Embodied Systems

Introduction and Context

Computer vision began largely as an attempt to interpret two-dimensional images: detect edges, recognize objects, classify scenes, and estimate motion in image coordinates. Yet intelligent interaction with the physical world requires more than labels and contours. An autonomous vehicle must estimate how far a pedestrian is, determine whether a road is traversable, and predict how the scene will change as the vehicle moves. A mobile robot must build a map while simultaneously locating itself within that map. An industrial manipulator must infer the three-dimensional position, orientation, and physical accessibility of an object before grasping it. These tasks require a geometric and spatial account of the world.

Three-dimensional vision addresses the recovery and interpretation of scene structure from images, video, depth sensors, and multimodal observations. Scene understanding extends this recovery process by assigning semantic meaning to surfaces, objects, places, and relationships. Embodied systems use these representations to perceive, decide, and act through a physical body. The central concern is therefore not simply whether a system can recognize an object, but whether it can maintain a useful world model for situated action.

This chapter examines the principal technologies that connect visual sensing to spatial intelligence: structure from motion, visual odometry, simultaneous localization and mapping (SLAM), point clouds, depth sensing, 3D reconstruction, scene graphs, neural rendering, robotics, autonomous systems, and spatial decision-making. The discussion emphasizes both mathematical foundations and engineering trade-offs. In practice, reliable embodied intelligence depends on the interaction of geometry, probability, learned representations, calibration, control, and system design.

Learning Objectives

After studying this chapter, the learner should be able to:

1. Explain how multiple images and sensor measurements provide information about three-dimensional structure.

2. Distinguish structure from motion, visual odometry, and SLAM.

3. Compare stereo, time-of-flight, structured-light, LiDAR, and monocular depth-sensing approaches.

4. Describe the representation and processing of point clouds, depth maps, meshes, voxels, and scene graphs.

5. Formulate the role of camera models, coordinate transformations, calibration, and uncertainty in 3D vision.

6. Explain how semantic perception is integrated with geometric mapping and spatial reasoning.

7. Evaluate the use of 3D vision in robotics, autonomous vehicles, industrial systems, and augmented reality.

8. Analyze failure modes, ethical concerns, and design trade-offs in embodied perception systems.

From Image Measurements to Spatial Structure

A camera records a projection of the three-dimensional world onto a two-dimensional image plane. In the ideal pinhole model, a 3D point $(X,Y,Z)$ is projected according to

$x = fX/Z + c_x, \qquad y = fY/Z + c_y,$

where $f$ is focal length and $(c_x,c_y)$ is the principal point. The division by depth $Z$ is fundamental: distant objects appear smaller, and a single image generally does not uniquely determine the original depth. This ambiguity is known as the monocular depth ambiguity.

The camera model becomes more realistic when lens distortion, skew, sensor noise, rolling shutter, and exposure effects are included. Calibration estimates intrinsic parameters such as focal length and distortion, and extrinsic parameters that describe the camera pose relative to another sensor or coordinate frame. Errors in calibration can produce systematic errors in reconstructed geometry, especially over long trajectories.

A 3D vision system commonly operates with several coordinate frames: a world frame, a robot or vehicle frame, an IMU frame, and one or more camera frames. A rigid transformation between frames is represented by a rotation and translation,

$T = \begin{bmatrix}R & t\\0 & 1\end{bmatrix} \in SE(3).$

Homogeneous coordinates allow points and transformations to be composed conveniently. Maintaining consistent frame conventions is not a minor implementation detail; many practical failures arise from incorrect axis directions, timestamp mismatches, or confusion between active and passive transformations.

The Geometry of Correspondence

If the same physical point is observed in two images, its image locations form a correspondence. With a calibrated stereo pair, corresponding points lie on an epipolar line. The difference between their horizontal coordinates, called disparity, is inversely related to depth:

$Z = fB/d,$

where $B$ is the baseline between cameras and $d$ is disparity. Small disparities at long range are difficult to measure, so stereo accuracy generally decreases with distance. Feature matching, optical flow, and dense correspondence algorithms provide alternative ways to identify image points across views.

For a moving monocular camera, image motion depends jointly on camera motion and scene structure. This coupling makes motion estimation and depth recovery an interdependent problem. Structure from motion (SfM) seeks to recover camera poses and 3D point structure from multiple images, usually under assumptions such as a static scene and sufficient viewpoint variation. A typical pipeline detects features, matches them across images, estimates relative poses using epipolar geometry, triangulates points, and refines all variables through bundle adjustment.

Bundle adjustment minimizes reprojection error. Given 3D points $X_j$, camera poses $T_i$, and image observations $u_{ij}$, the optimization has the form

$\min_{T_i,X_j} \sum_{i,j} \rho(\|u_{ij}-\pi(T_iX_j)\|^2),$

where $\pi$ is the projection function and $\rho$ may be a robust loss that reduces the influence of outliers. The solution is usually defined only up to a global similarity transformation in monocular SfM: scale, global rotation, and global translation cannot be recovered from images alone without additional information.

Visual Odometry and SLAM

Visual odometry estimates the motion of a camera or vehicle by analyzing successive observations. It is primarily a local tracking problem. A system may use sparse features, direct photometric alignment, semi-dense image gradients, stereo depth, or learned correspondences. The output is a trajectory, often expressed as a sequence of relative transformations.

Visual odometry is vulnerable to accumulated drift. Small errors in each estimate compound over time, causing the estimated trajectory and reconstructed map to diverge from reality. Loop closure addresses this problem by recognizing a previously visited place and adding a constraint between the current and earlier poses. Optimization over the resulting pose graph distributes the correction across the trajectory.

SLAM combines localization and mapping: the system estimates its pose while constructing a representation of an initially unknown environment. A probabilistic formulation treats robot pose, landmarks, and sensor observations as uncertain variables. The system alternates conceptually between prediction from a motion model and correction from observations, although modern systems often solve a nonlinear factor-graph or pose-graph optimization problem.

A practical SLAM architecture commonly contains:

• front-end tracking and feature or scan matching;
• local mapping and landmark or surface management;
• loop-closure detection and geometric verification;
• back-end optimization of poses, landmarks, and sensor biases;
• map representation and interfaces for planning or navigation.

Visual-inertial odometry fuses cameras with an inertial measurement unit. The IMU provides high-rate measurements of angular velocity and acceleration, while the camera supplies visual constraints that limit inertial drift. Tight fusion requires accurate temporal synchronization, extrinsic calibration, and estimation of IMU biases. LiDAR-inertial systems use analogous principles, replacing image correspondences with geometric scan constraints.

SLAM performance depends on observability. A camera moving forward through a textureless corridor may experience weak lateral constraints. Pure rotation provides little or no translational depth information in monocular vision. Repetitive patterns, dynamic objects, rapid illumination changes, motion blur, and feature-poor surfaces can all cause tracking failure. Robust systems therefore use multiple sensing modalities, recovery strategies, uncertainty monitoring, and maps that distinguish static from dynamic content.

Depth Sensors and 3D Data Representations

Depth can be measured or inferred in several ways. Stereo cameras estimate depth through triangulation. Structured-light sensors project a known pattern and infer deformation of that pattern. Time-of-flight cameras measure the travel time or phase shift of emitted light. LiDAR measures ranges using laser pulses or continuous-wave techniques and can provide accurate geometry over substantial distances. Monocular depth networks infer depth from learned visual regularities, but their metric scale and reliability depend strongly on training data and deployment conditions.

No depth sensor is universally superior. Stereo is passive and relatively inexpensive, but requires texture and adequate illumination. Structured light can be precise at short range but is affected by sunlight and interference. Time-of-flight sensors may suffer from multipath effects and range-dependent noise. LiDAR offers strong geometric measurements but introduces cost, power, weather, and mechanical or scanning constraints. Learned depth is flexible and can fill gaps, but predictions may be confidently wrong under distribution shift.

A depth map stores one depth value per pixel, preserving image organization. A point cloud stores 3D points, often with color, intensity, normal, or semantic attributes. Point-cloud processing includes filtering, downsampling, registration, normal estimation, segmentation, surface reconstruction, and object fitting. The Iterative Closest Point (ICP) algorithm aligns two partially overlapping point clouds by repeatedly associating points and minimizing geometric distances. Its performance depends on a reasonable initial alignment and sufficient geometric structure.

Meshes represent surfaces with vertices, edges, and polygonal faces. They are suitable for rendering, simulation, and collision checking, but reconstruction can be difficult when observations are incomplete. Volumetric representations divide space into cells, such as voxels or truncated signed distance fields. They support surface fusion and occupancy reasoning, though memory requirements can be high. Sparse voxel structures, octrees, and neural implicit representations reduce this burden.

Representation choice should follow the task. A navigation system may need free-space and obstacle occupancy rather than photorealistic surfaces. A robot grasping system requires local geometry and object pose. A digital twin may require a textured mesh and semantic metadata. A learned policy may consume a compact latent representation, but safety-critical components often require interpretable geometric checks alongside it.

Reconstruction, Semantics, and Scene Graphs

3D reconstruction converts observations into a persistent model of the environment. Classical multi-view stereo estimates dense depth from many calibrated images, while volumetric fusion combines successive depth frames into a consistent surface model. Neural methods may represent a scene as a continuous function that maps spatial coordinates and viewing direction to density and color. The quality of a reconstruction depends on viewpoint coverage, calibration, exposure consistency, motion estimation, and treatment of occlusions.

Geometry alone is insufficient for many tasks. A map containing millions of points does not explicitly say that a cluster is a chair, that a table supports a cup, or that a doorway connects two rooms. Scene understanding assigns semantic categories and relationships to geometric entities. It may include semantic segmentation, instance segmentation, 3D object detection, object pose estimation, affordance recognition, and place recognition.

A scene graph provides a structured representation of entities and relations. Nodes may represent rooms, surfaces, objects, agents, or regions; edges may encode relations such as “inside,” “on,” “near,” “connected to,” or “in front of.” A metric-semantic scene graph combines geometric estimates with labels and relational structure. It can support queries such as identifying all movable objects on a particular shelf or finding a collision-free route to a workstation.

The distinction between category, instance, and affordance is important. “Chair” is a category label; “the chair beside the desk” identifies an instance; “can be sat on” describes an affordance relevant to action. Embodied systems should represent uncertainty in each of these dimensions. A robot that is uncertain whether an object is a cup may still be confident that it is graspable, while an object’s category may be clear but its precise pose may be uncertain.

Neural Rendering and Learned 3D Representations

Neural rendering methods learn to synthesize views or represent scenes using neural networks. Neural radiance fields (NeRFs), for example, model a scene through a function that predicts density and color at sampled spatial locations and viewing directions. Rendering integrates these predictions along camera rays to produce an image. Given accurate camera poses and sufficient observations, such methods can generate highly detailed novel views.

Neural rendering has expanded the boundary between reconstruction and image generation. It can provide view synthesis, appearance completion, and compact continuous representations. However, photorealism does not guarantee geometric correctness. A model may reproduce observed appearance while hallucinating unseen surfaces or representing dynamic content inconsistently. Training and rendering costs can also be significant, although fast and explicit alternatives are increasingly available.

For embodied systems, the key question is not whether a representation looks realistic, but whether it supports reliable prediction and action. A robot requires physically meaningful occupancy, contact geometry, uncertainty, and temporal consistency. Hybrid systems therefore combine learned features or neural scene representations with geometric constraints, sensor data, and classical optimization.

Embodied Systems and Spatial Decision-Making

An embodied system closes a perception–action loop. Sensors observe the environment; perception estimates objects, geometry, and state; a world model organizes those estimates; planning selects a course of action; control executes it; and new observations update the model. Errors can propagate through every stage. A small localization error may lead to an incorrect object pose, an unsafe grasp, or a failed navigation maneuver.

Robotic navigation typically separates global planning from local planning. A global planner uses a map to identify a route, while a local planner accounts for current obstacles, dynamics, and uncertainty. Occupancy grids, signed distance fields, and topological maps are common planning representations. For manipulation, perception must estimate object pose, graspable regions, collision geometry, and the relationship between the object and the robot’s end effector.

Spatial decision-making is often formulated as a partially observable decision problem. The system does not directly observe the complete state; it maintains a belief over possible states and chooses actions that balance task progress, safety, and information gain. For example, a robot may move around an occluding object not only to reach a target but also to reduce uncertainty about the target’s location. Active perception treats sensing as an action: viewpoint selection, camera motion, and inspection trajectories are planned deliberately.

Autonomous vehicles illustrate the integration challenge. Cameras provide rich semantic information, LiDAR supplies geometric structure, radar contributes range and velocity under adverse visibility, and inertial and satellite systems support localization. The vehicle must track dynamic agents, predict their motion, estimate drivable space, obey traffic rules, and make decisions under incomplete information. Redundancy and conservative uncertainty handling are essential because perception errors have physical consequences.

Applied Case Study: Illustrative Warehouse Robot System

Background

Consider an illustrative autonomous mobile robot deployed in a warehouse to transport containers between storage aisles and packing stations. The robot carries a stereo camera, a 2D LiDAR, an IMU, wheel encoders, and a small manipulator for retrieving lightweight containers.

Situation and Problem

The warehouse layout changes regularly. Pallets may obstruct aisles, workers move unpredictably, and containers can be placed at slightly different positions. A fixed map is therefore inadequate. The robot must localize itself, update the map, distinguish permanent structures from temporary objects, and select safe grasping and navigation actions.

Analysis

Wheel odometry is locally smooth but accumulates drift. The stereo camera provides depth for nearby shelves but performs poorly on reflective packaging and low-texture surfaces. LiDAR offers reliable planar geometry but does not directly identify containers or workers. The system consequently requires sensor fusion rather than dependence on a single modality.

The robot maintains a pose graph whose local constraints arise from visual-inertial odometry, wheel motion, and LiDAR scan matching. Loop closures are proposed using visual place recognition and accepted only after geometric verification. A semantic layer labels shelves, floor regions, containers, and people. Dynamic observations are excluded from the long-term structural map but retained in a short-lived obstacle layer.

Approach and Solution

At startup, the robot estimates camera–LiDAR–IMU extrinsic calibration and synchronizes timestamps. During operation, an estimator fuses inertial, wheel, visual, and range measurements. A local occupancy map supports collision checking, while a semantic scene graph records relations such as “container on shelf” and “packing station connected to aisle.”

When asked to retrieve a container, the robot first plans a route to the relevant aisle. It then uses active perception to select a viewpoint with minimal occlusion. Stereo depth and object detection estimate the container’s pose; the manipulator checks reachability and collision clearance using a local point cloud. If pose uncertainty is too high, the robot moves to a second viewpoint rather than attempting a risky grasp. After retrieval, the updated observation is used to correct the object’s map position.

Outcome

The system is more robust than a camera-only or wheel-only design because each sensor compensates for weaknesses in the others. Nevertheless, performance remains sensitive to calibration drift, reflective surfaces, crowded aisles, and changes in shelf appearance. The system reports confidence and requests human assistance when localization or grasping uncertainty exceeds operational limits.

Learning Points

The case demonstrates that embodied perception is a systems problem. A strong object detector cannot compensate for poor coordinate transformations, and an accurate map is not useful if it lacks semantics or cannot support planning. Sensor fusion, temporal consistency, uncertainty estimation, active perception, and recovery behavior are as important as individual algorithms.

Challenges, Risks, and Common Mistakes

A principal challenge is the mismatch between laboratory assumptions and deployment environments. Static scenes, stable illumination, calibrated sensors, and abundant texture are rarely guaranteed in practice. Dynamic objects can corrupt geometric estimation, while changing weather and lighting can alter both pixel appearance and sensor reliability.

Scale ambiguity remains a central issue for monocular systems. Drift, loop-closure errors, false correspondences, and map deformation can lead to plausible but incorrect spatial models. Learned models introduce additional risks: domain shift, shortcut learning, poor calibration of confidence, and failure on rare objects or unusual viewpoints. A visually convincing neural reconstruction may conceal missing geometry.

Common engineering mistakes include neglecting timestamp synchronization, treating calibration as permanent, using raw point clouds without outlier filtering, evaluating only average accuracy, and failing to test long-duration operation. Another mistake is optimizing perception metrics independently of task performance. A small improvement in segmentation mean Intersection over Union may be less valuable than a reliable estimate of free space or grasp pose.

Evaluation should include trajectory error, map consistency, depth and pose accuracy, detection and tracking performance, localization recovery, collision rate, task success, latency, power consumption, and behavior under degraded sensing. Uncertainty should be evaluated through calibration and failure detection, not merely reported as a numerical variance.

Ethical, Safety, and Governance Considerations

Embodied systems operate in shared spaces and can affect physical safety, privacy, employment, and access to services. Cameras and depth sensors may record workers, customers, homes, or sensitive activities. Data collection should follow purpose limitation, access control, retention policies, and applicable privacy law. Systems should avoid unnecessary identification when spatial understanding can be achieved without personal recognition.

Safety requires explicit operating boundaries, redundant sensing where appropriate, emergency stopping, human override, and audit logs. A perception system should not silently convert uncertainty into decisive action. In high-risk domains, safety cases must address foreseeable failure modes, validation conditions, software updates, and responsibility allocation between manufacturers, operators, and users.

Bias can arise when training environments do not represent the appearance, mobility aids, clothing, or behavior of all users. A system that tracks people poorly in certain conditions may create unequal safety risks. Governance should therefore include representative testing, incident reporting, traceable model versions, and procedures for withdrawing or retraining systems when unacceptable failures occur.

Current Developments and Emerging Directions

Several research directions are reshaping 3D vision. Foundation models increasingly provide transferable visual and multimodal features, while 3D-aware models connect language, objects, geometry, and action. Gaussian splatting and related explicit radiance representations offer efficient novel-view synthesis in some settings. Neural implicit maps, differentiable rendering, and learned correspondence methods continue to improve reconstruction and localization.

At the same time, practical systems are moving toward hybrid architectures. Learned perception proposes features, semantics, or priors; geometric estimation enforces consistency; probabilistic filters and optimization manage uncertainty; and planners use explicit constraints for safety. Event cameras, radar–camera fusion, tactile sensing, and low-cost solid-state LiDAR may broaden operation in high dynamic range, poor visibility, and contact-rich environments.

The long-term challenge is persistent world modeling. An embodied agent must recognize that an object remains the same despite viewpoint changes, reason about changes over time, distinguish temporary from structural information, and connect perception with language and action. Progress will depend not only on larger models, but also on data efficiency, physical grounding, continual learning, interpretability, and dependable evaluation.

Best Practices for Designing 3D Vision Systems

A robust design begins with the task and its failure costs rather than with a preferred sensor or algorithm. Define the required spatial accuracy, range, latency, update rate, environmental conditions, and acceptable risk. Select representations that support the downstream decision: occupancy for navigation, object pose for manipulation, and semantic relations for task planning.

Calibrate every sensor chain, synchronize clocks, and monitor calibration and data quality during operation. Use complementary modalities when failure modes are not correlated. Separate short-term dynamic obstacle maps from long-term structural maps. Maintain uncertainty estimates and establish explicit thresholds for replanning, additional sensing, or human intervention.

Validate the complete perception–action loop in realistic conditions, including occlusion, motion blur, lighting changes, sensor dropout, dynamic agents, and long-duration drift. Measure task success and safety, not only isolated recognition scores. Finally, design recovery behavior as a first-class capability: a system that knows when it is lost and can safely stop or seek information is more useful than one that produces confident but unsupported estimates.

Chapter Summary

Three-dimensional vision transforms image and sensor measurements into geometric and semantic descriptions of the world. Camera projection, calibration, epipolar geometry, triangulation, and bundle adjustment provide the foundations for recovering structure. Structure from motion estimates scene geometry and camera poses from multiple images; visual odometry estimates local motion; and SLAM jointly maintains localization and a map while correcting drift through loop closure and global optimization.

Depth cameras, stereo, LiDAR, inertial sensors, and learned models offer complementary capabilities and limitations. Point clouds, meshes, volumetric maps, and neural representations serve different operational goals. Scene graphs add semantic entities and relationships to geometric maps, enabling spatial queries and task reasoning. In embodied systems, perception is integrated with mapping, planning, control, and active sensing. Reliable deployment requires uncertainty awareness, sensor fusion, calibration, recovery strategies, safety governance, and evaluation in realistic environments.

Key Terms

Camera calibration: Estimation of camera intrinsic and extrinsic parameters.

Epipolar geometry: Geometric relationship between corresponding image points viewed from two camera positions.

Structure from motion: Recovery of scene structure and camera motion from multiple images.

Bundle adjustment: Joint nonlinear refinement of camera poses and 3D points by minimizing reprojection error.

Visual odometry: Estimation of camera or vehicle motion from sequential visual observations.

SLAM: Simultaneous localization and mapping in an initially unknown environment.

Loop closure: Recognition of a previously visited place used to correct accumulated drift.

Pose graph: Graph whose nodes represent poses and whose edges represent relative spatial constraints.

Visual-inertial odometry: Motion estimation through fusion of camera and inertial measurements.

Point cloud: Collection of 3D points representing observed geometry.

Depth map: Image-aligned array containing estimated or measured depth values.

ICP: Iterative algorithm for aligning overlapping point clouds.

Occupancy map: Spatial representation indicating whether regions are free, occupied, or unknown.

Scene graph: Graph representation of entities and semantic or spatial relationships.

Affordance: Action possibility offered by an object or environment to an agent.

Neural rendering: Learned synthesis or representation of scene appearance from spatial observations.

Metric-semantic map: Map combining geometric measurements with semantic labels.

Active perception: Deliberate selection of sensing actions or viewpoints to reduce uncertainty.

Embodied system: An agent whose perception, decision-making, and action are coupled through a physical or simulated body.

Review Questions

Short Answer Questions

1. Why is monocular depth generally ambiguous from a single image?

2. What is the purpose of loop closure in SLAM?

3. Distinguish a depth map from a point cloud.

4. What information does a scene graph add to a geometric map?

5. Why are camera–IMU time synchronization and extrinsic calibration important?

Long Answer Questions

1. Explain the structure-from-motion pipeline, including feature correspondence, triangulation, camera estimation, and bundle adjustment.

2. Compare stereo cameras, structured-light sensors, time-of-flight cameras, LiDAR, and learned monocular depth methods.

3. Describe a complete SLAM architecture and explain the roles of tracking, mapping, loop closure, and back-end optimization.

4. Discuss how geometric mapping and semantic scene understanding can be integrated for robotic manipulation.

5. Explain the major safety, privacy, and governance challenges associated with embodied 3D vision systems.

Analytical / Application Questions

1. A monocular robot moves through a long, textureless corridor and gradually loses scale and localization accuracy. Diagnose the causes and propose a sensing and algorithmic strategy to improve robustness.

2. Design a representation and perception pipeline for a warehouse robot that must navigate around people and retrieve containers from shelves. Justify your choices of sensors, map types, and uncertainty-handling mechanisms.

3. A neural rendering system produces highly realistic views of a room but occasionally invents surfaces behind occlusions. Explain why this can occur and determine whether the representation is suitable for safety-critical robot navigation.

22. Multiple Choice Questions with Answers

Question 1

Which statement best distinguishes visual odometry from SLAM?

A. Visual odometry estimates local motion, whereas SLAM also builds and maintains a map with mechanisms such as loop closure.

B. Visual odometry requires LiDAR, whereas SLAM requires only a monocular camera.

C. Visual odometry performs semantic segmentation, whereas SLAM performs image compression.

D. Visual odometry eliminates drift completely, whereas SLAM introduces drift.

Correct Answer: A. Visual odometry estimates local motion, whereas SLAM also builds and maintains a map with mechanisms such as loop closure.

Question 2

In monocular structure from motion, which quantity is generally not recoverable without additional information?

A. Relative image correspondence

B. Camera orientation change

C. Absolute metric scale

D. Reprojection error

Correct Answer: C. Absolute metric scale

Question 3

Why does loop closure improve a long-term SLAM trajectory?

A. It increases camera frame rate.

B. It adds a constraint linking the current pose to a previously observed place, allowing accumulated drift to be redistributed.

C. It removes the need for camera calibration.

D. It converts all point clouds into semantic labels.

Correct Answer: B. It adds a constraint linking the current pose to a previously observed place, allowing accumulated drift to be redistributed.

Question 4

A robot must navigate around obstacles but does not need photorealistic surface appearance. Which representation is most directly useful?

A. An occupancy map

B. A texture-only image

C. A color histogram

D. A classification confusion matrix

Correct Answer: A. An occupancy map

Question 5

What is a major advantage of visual-inertial odometry?

A. The IMU provides high-rate motion information while visual observations constrain inertial drift.

B. It guarantees perfect localization in textureless environments.

C. It removes the need for temporal synchronization.

D. It estimates object categories without image data.

Correct Answer: A. The IMU provides high-rate motion information while visual observations constrain inertial drift.

Question 6

Which situation is most likely to cause failure in ICP point-cloud registration?

A. A good initial alignment with distinctive overlapping geometry

B. Partially overlapping clouds with a reasonable sampling density

C. A poor initial alignment and repetitive or insufficient geometric structure

D. Point clouds that contain surface normals

Correct Answer: C. A poor initial alignment and repetitive or insufficient geometric structure

Question 7

What is the principal purpose of a metric-semantic scene graph?

A. To store only raw pixel intensities

B. To combine spatial geometry with entities and relationships useful for reasoning and action

C. To replace all sensor calibration procedures

D. To encode only the robot's battery level

Correct Answer: B. To combine spatial geometry with entities and relationships useful for reasoning and action

Question 8

A robot is uncertain about an object's pose because of occlusion. Which behavior exemplifies active perception?

A. Attempting the grasp immediately without further sensing

B. Discarding the object permanently

C. Moving to a viewpoint that is expected to reduce occlusion and pose uncertainty

D. Disabling collision checking

Correct Answer: C. Moving to a viewpoint that is expected to reduce occlusion and pose uncertainty

Question 9

Why may a photorealistic neural rendering model still be unsuitable for safety-critical navigation?

A. Photorealistic models cannot represent color.

B. Visual realism does not guarantee geometrically correct occupancy, especially in unseen or occluded regions.

C. Neural rendering always requires a LiDAR sensor at runtime.

D. Navigation never uses geometric information.

Correct Answer: B. Visual realism does not guarantee geometrically correct occupancy, especially in unseen or occluded regions.

Question 10

Which design practice most directly supports safe deployment of an embodied vision system?

A. Optimizing only average object-recognition accuracy

B. Ignoring uncertainty to simplify planning

C. Using explicit failure thresholds, recovery behavior, and human override mechanisms

D. Removing all redundant sensors to reduce data volume

Correct Answer: C. Using explicit failure thresholds, recovery behavior, and human override mechanisms