A DICOM RT Structure Set is a persistent information object that encodes three-dimensional geometric contours delineating Gross Tumor Volumes (GTVs), Organs-at-Risk (OARs), and other anatomical landmarks on a reference CT or MR image series. It serves as the standard interoperability format for exchanging segmentation data between treatment planning systems and radiation delivery devices in oncology.
Glossary
DICOM RT Structure Set

What is DICOM RT Structure Set?
The DICOM RT Structure Set is a specialized medical imaging file format that stores regions of interest (ROIs), contours, and anatomical structures defined for radiotherapy treatment planning.
Each structure is stored as a named set of planar polyline contours or point clouds with associated metadata, including ROI color, interpretation type, and frame of reference UID. The object links directly to its parent image series via spatial registration, ensuring that contours align precisely with the underlying voxel data for accurate dose calculation and beam placement.
Key Characteristics of RT Structure Sets
The DICOM RT Structure Set is the universal oncology format for encoding regions of interest, anatomical contours, and treatment targets. It serves as the definitive bridge between diagnostic imaging and therapeutic intervention.
Contour Data Encoding
Stores regions of interest as sequences of 3D coordinate points defining closed planar contours on individual image slices. Each structure is composed of multiple contour sequences that collectively define a volumetric shape.
- Geometric Type: Points, open polylines, or closed planar contours
- Coordinate System: Patient-based 3D coordinates referenced to the image position
- Interpolation: Volumetric rendering requires interpolation between sparse slice-based contours
Structure Set ROI Module
Each region of interest is identified by a unique ROI Number and described using a ROI Name and optional ROI Description. The ROI Observation Class specifies the semantic category.
- ROI Number: Unique integer identifier within the structure set
- ROI Name: Human-readable label such as 'GTV_Primary' or 'Spinal_Cord'
- Observation Class: Defines whether the structure is an organ-at-risk, target volume, or anatomical reference
- Generation Algorithm: Records whether contours were manually drawn, auto-segmented, or atlas-based
Referenced Image Series
Each contour is spatially registered to a specific series of DICOM images through Referenced Frame of Reference and Referenced Image Sequence attributes. This ensures contours align precisely with the underlying voxel data.
- Frame of Reference UID: Uniquely identifies the coordinate system
- Contour Image Sequence: Lists the specific SOP Instance UIDs for each slice containing a contour
- Spatial Registration: Enables fusion with other imaging modalities via rigid or deformable registration objects
ROI Physical Properties
Optional attributes store derived quantitative metrics for each structure, supporting treatment planning calculations and clinical documentation.
- ROI Volume: Computed volume in cubic centimeters
- ROI Mean/Max/Min Intensity: Statistical descriptors of the underlying image values within the contour
- ROI Standard Deviation: Quantifies tissue heterogeneity
- ROI Generation Algorithm: Records whether contours were manually drawn, auto-segmented, or atlas-based
Approval and Workflow Status
The Structure Set Label and Approval Status attributes track the clinical workflow state, indicating whether contours have been reviewed, approved, or are still in draft.
- Approval Status: Values include 'UNAPPROVED', 'APPROVED', or 'REJECTED'
- Structure Set Date/Time: Timestamp of creation or last modification
- Reviewer Name: Identifies the clinician responsible for contour validation
- Structure Set Description: Free-text field for workflow notes and clinical context
Interoperability with Treatment Systems
RT Structure Sets serve as the primary input for Treatment Planning Systems and Record and Verify Systems, enabling dose calculation, plan optimization, and machine delivery.
- DICOM RT Plan: References structure sets to define beam geometry and dose constraints
- DICOM RT Dose: Stores calculated dose distributions mapped to the same frame of reference
- DICOM RT Image: Portal images and setup verification referenced against planned structures
- Cross-Vendor Compatibility: Standardized encoding ensures contours transfer between systems from different manufacturers
RT Structure Set vs. DICOM Segmentation Object
Comparison of the two DICOM standards for storing segmentation data in medical imaging, highlighting their distinct use cases in radiotherapy and general radiology.
| Feature | RT Structure Set | DICOM Segmentation Object |
|---|---|---|
Primary Use Case | Radiotherapy treatment planning | General radiology and quantitative imaging |
Data Representation | Vector-based contours (planar polylines) | Raster-based label maps (pixel/voxel grids) |
Spatial Dimensionality | 2D contours on individual slices | Native 3D volumetric segmentation |
Geometric Precision | Sub-pixel (contour vertex coordinates) | Pixel-level (resolution-dependent) |
Supports Fractional Membership | ||
Supports Overlapping Segments | ||
Standard for Dose Calculation | ||
Interoperability with PACS | Limited (requires RT-aware viewers) | Broad (standard image display) |
Frequently Asked Questions
A DICOM RT Structure Set is the standard object for exchanging radiotherapy segmentation data, storing regions of interest, contours, and anatomical structures defined for treatment planning. Below are answers to common questions about its role in medical image segmentation and oncology workflows.
A DICOM RT Structure Set is a specialized DICOM Information Object Definition (IOD) that stores regions of interest (ROIs), contours, and anatomical structures defined for radiotherapy planning. It serves as the standard format for exchanging segmentation data in oncology. The object contains a list of ROIContourSequence items, each referencing a series of 2D or 3D coordinates that delineate a specific structure—such as a Gross Tumor Volume (GTV) or an Organ-at-Risk (OAR). Each structure is associated with metadata including a name, a color for display, and a frame of reference UID that spatially registers the contours to the corresponding CT or MR image series. The structure set does not contain pixel data itself; instead, it stores geometric descriptions that can be rasterized into binary segmentation masks for downstream deep learning tasks like U-Net training or nnU-Net inference.
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
Related Terms
Master the ecosystem of radiotherapy structure sets by understanding the core segmentation tasks, evaluation metrics, and processing algorithms that interact directly with DICOM RT Structure Set data.
Organ-at-Risk (OAR) Segmentation
The delineation of healthy anatomical structures surrounding a tumor that are sensitive to radiation dose. OARs are stored as individual regions of interest within the DICOM RT Structure Set and are critical for minimizing collateral damage during treatment planning.
- Common OARs: spinal cord, parotid glands, optic chiasm, heart
- Dose-volume histograms (DVHs) are computed directly from these contours
- Automatic OAR segmentation reduces inter-physicist variability
Gross Tumor Volume (GTV)
The macroscopic extent of a malignant tumor as visible on imaging or clinical examination. The GTV is the primary target volume defined in the DICOM RT Structure Set and serves as the foundation for expanding clinical and planning target volumes.
- Defined using CT, MRI, or PET fusion
- Stored as a 3D contour sequence in the structure set
- GTV delineation accuracy directly impacts tumor control probability
Dice Score (F1 Score)
A statistical measure of spatial overlap between a predicted segmentation mask and the ground truth annotation. The Dice Score is the most common metric for evaluating automatic OAR and GTV segmentation algorithms before their contours are exported to a DICOM RT Structure Set.
- Formula: 2 * |A ∩ B| / (|A| + |B|)
- Ranges from 0 (no overlap) to 1 (perfect agreement)
- A Dice score above 0.7 is generally considered acceptable for clinical use
Hausdorff Distance
A boundary-based metric that measures the maximum distance from any point in one set to the nearest point in the other. The Hausdorff Distance quantifies the worst-case segmentation boundary error, which is critical for radiotherapy where a single large deviation can cause a geographic miss of the tumor.
- 95th percentile Hausdorff Distance (HD95) is used to exclude outliers
- Measured in millimeters on the original image grid
- Sensitive to small, spurious false positive predictions
Marching Cubes
A computer graphics algorithm that extracts a polygonal mesh of an isosurface from a 3D scalar field. Marching Cubes is commonly used to generate surface renderings from the binary volumetric masks stored in or derived from a DICOM RT Structure Set for visualization and 3D printing of patient-specific anatomy.
- Operates on a voxel-by-voxel basis using a lookup table
- Generates triangle meshes suitable for rendering
- Used in treatment planning systems for 3D dose visualization
Isotropic Resampling
The process of interpolating a volumetric medical image to achieve uniform voxel spacing in all three spatial dimensions. Isotropic resampling is a critical preprocessing step before automatic segmentation because DICOM RT Structure Sets require contours defined on the original acquisition grid, and networks perform best with consistent spatial context.
- Typical target resolution: 1mm x 1mm x 1mm
- Uses spline or linear interpolation
- Prevents anisotropic feature distortion in 3D CNNs

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us