Inferensys

Glossary

DICOM RT Structure Set

A DICOM RT Structure Set is a standardized medical imaging file that stores regions of interest (ROIs), contours, and anatomical structures defined for radiotherapy treatment planning, serving as the canonical format for exchanging segmentation data in oncology.
Data engineer managing feature store on laptop, feature definitions visible, casual data engineering session.
RADIOTHERAPY DATA STANDARD

What is DICOM RT Structure Set?

The DICOM RT Structure Set is a specialized medical imaging file format that stores regions of interest (ROIs), contours, and anatomical structures defined for radiotherapy treatment planning.

A DICOM RT Structure Set is a persistent information object that encodes three-dimensional geometric contours delineating Gross Tumor Volumes (GTVs), Organs-at-Risk (OARs), and other anatomical landmarks on a reference CT or MR image series. It serves as the standard interoperability format for exchanging segmentation data between treatment planning systems and radiation delivery devices in oncology.

Each structure is stored as a named set of planar polyline contours or point clouds with associated metadata, including ROI color, interpretation type, and frame of reference UID. The object links directly to its parent image series via spatial registration, ensuring that contours align precisely with the underlying voxel data for accurate dose calculation and beam placement.

RADIOTHERAPY DATA STANDARD

Key Characteristics of RT Structure Sets

The DICOM RT Structure Set is the universal oncology format for encoding regions of interest, anatomical contours, and treatment targets. It serves as the definitive bridge between diagnostic imaging and therapeutic intervention.

01

Contour Data Encoding

Stores regions of interest as sequences of 3D coordinate points defining closed planar contours on individual image slices. Each structure is composed of multiple contour sequences that collectively define a volumetric shape.

  • Geometric Type: Points, open polylines, or closed planar contours
  • Coordinate System: Patient-based 3D coordinates referenced to the image position
  • Interpolation: Volumetric rendering requires interpolation between sparse slice-based contours
02

Structure Set ROI Module

Each region of interest is identified by a unique ROI Number and described using a ROI Name and optional ROI Description. The ROI Observation Class specifies the semantic category.

  • ROI Number: Unique integer identifier within the structure set
  • ROI Name: Human-readable label such as 'GTV_Primary' or 'Spinal_Cord'
  • Observation Class: Defines whether the structure is an organ-at-risk, target volume, or anatomical reference
  • Generation Algorithm: Records whether contours were manually drawn, auto-segmented, or atlas-based
03

Referenced Image Series

Each contour is spatially registered to a specific series of DICOM images through Referenced Frame of Reference and Referenced Image Sequence attributes. This ensures contours align precisely with the underlying voxel data.

  • Frame of Reference UID: Uniquely identifies the coordinate system
  • Contour Image Sequence: Lists the specific SOP Instance UIDs for each slice containing a contour
  • Spatial Registration: Enables fusion with other imaging modalities via rigid or deformable registration objects
04

ROI Physical Properties

Optional attributes store derived quantitative metrics for each structure, supporting treatment planning calculations and clinical documentation.

  • ROI Volume: Computed volume in cubic centimeters
  • ROI Mean/Max/Min Intensity: Statistical descriptors of the underlying image values within the contour
  • ROI Standard Deviation: Quantifies tissue heterogeneity
  • ROI Generation Algorithm: Records whether contours were manually drawn, auto-segmented, or atlas-based
05

Approval and Workflow Status

The Structure Set Label and Approval Status attributes track the clinical workflow state, indicating whether contours have been reviewed, approved, or are still in draft.

  • Approval Status: Values include 'UNAPPROVED', 'APPROVED', or 'REJECTED'
  • Structure Set Date/Time: Timestamp of creation or last modification
  • Reviewer Name: Identifies the clinician responsible for contour validation
  • Structure Set Description: Free-text field for workflow notes and clinical context
06

Interoperability with Treatment Systems

RT Structure Sets serve as the primary input for Treatment Planning Systems and Record and Verify Systems, enabling dose calculation, plan optimization, and machine delivery.

  • DICOM RT Plan: References structure sets to define beam geometry and dose constraints
  • DICOM RT Dose: Stores calculated dose distributions mapped to the same frame of reference
  • DICOM RT Image: Portal images and setup verification referenced against planned structures
  • Cross-Vendor Compatibility: Standardized encoding ensures contours transfer between systems from different manufacturers
SEGMENTATION DATA FORMATS

RT Structure Set vs. DICOM Segmentation Object

Comparison of the two DICOM standards for storing segmentation data in medical imaging, highlighting their distinct use cases in radiotherapy and general radiology.

FeatureRT Structure SetDICOM Segmentation Object

Primary Use Case

Radiotherapy treatment planning

General radiology and quantitative imaging

Data Representation

Vector-based contours (planar polylines)

Raster-based label maps (pixel/voxel grids)

Spatial Dimensionality

2D contours on individual slices

Native 3D volumetric segmentation

Geometric Precision

Sub-pixel (contour vertex coordinates)

Pixel-level (resolution-dependent)

Supports Fractional Membership

Supports Overlapping Segments

Standard for Dose Calculation

Interoperability with PACS

Limited (requires RT-aware viewers)

Broad (standard image display)

DICOM RT STRUCTURE SET

Frequently Asked Questions

A DICOM RT Structure Set is the standard object for exchanging radiotherapy segmentation data, storing regions of interest, contours, and anatomical structures defined for treatment planning. Below are answers to common questions about its role in medical image segmentation and oncology workflows.

A DICOM RT Structure Set is a specialized DICOM Information Object Definition (IOD) that stores regions of interest (ROIs), contours, and anatomical structures defined for radiotherapy planning. It serves as the standard format for exchanging segmentation data in oncology. The object contains a list of ROIContourSequence items, each referencing a series of 2D or 3D coordinates that delineate a specific structure—such as a Gross Tumor Volume (GTV) or an Organ-at-Risk (OAR). Each structure is associated with metadata including a name, a color for display, and a frame of reference UID that spatially registers the contours to the corresponding CT or MR image series. The structure set does not contain pixel data itself; instead, it stores geometric descriptions that can be rasterized into binary segmentation masks for downstream deep learning tasks like U-Net training or nnU-Net inference.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.