Inferensys

Glossary

SynthRAD2023

SynthRAD2023 is a grand challenge that benchmarks deep learning methods for generating synthetic CT (sCT) scans from MRI data, establishing a standardized framework for evaluating image-to-image translation in radiotherapy planning.
Finance professional using AI FP&A copilot on laptop, board presentation visible on screen, home office work session.
GRAND CHALLENGE

What is SynthRAD2023?

SynthRAD2023 is a grand challenge that establishes a standardized benchmark for generating synthetic CT scans from MRI data, directly advancing radiotherapy treatment planning.

SynthRAD2023 is a scientific competition that rigorously evaluates image-to-image translation algorithms, specifically the task of synthesizing synthetic Computed Tomography (sCT) from Magnetic Resonance Imaging (MRI). The challenge provides a multi-institutional dataset to benchmark the geometric accuracy and Hounsfield Unit (HU) fidelity required for dose calculation in adaptive radiotherapy.

By defining a unified evaluation framework using metrics like the Mean Absolute Error (MAE) in HU and Structural Similarity Index (SSIM), SynthRAD2023 addresses the clinical need to eliminate redundant CT scans. It accelerates the validation of deep learning models, including GANs and diffusion models, for generating clinically actionable synthetic images directly from non-ionizing MRI.

BENCHMARKING SYNTHETIC CT FOR RADIOTHERAPY

Key Features of the SynthRAD2023 Challenge

SynthRAD2023 is a grand challenge establishing a standardized framework for evaluating image-to-image translation methods that generate synthetic CT scans from MRI data, directly targeting the clinical need for accurate dose planning without ionizing radiation.

01

Task 1: MR-to-CT Brain Synthesis

The primary task focuses on generating synthetic CT (sCT) scans from multi-contrast MRI inputs of the brain. Participants must accurately predict Hounsfield Units (HU) to enable precise radiotherapy dose calculations.

  • Input: T1-weighted and T2-weighted MRI sequences
  • Output: A 3D synthetic CT volume with accurate bone/soft-tissue contrast
  • Clinical Goal: Eliminate the need for a separate planning CT scan, reducing patient radiation exposure and registration errors between MRI and CT.
2
MRI Contrasts as Input
HU
Target Output Unit
02

Task 2: MR-to-CT Pelvis Synthesis

This task extends the challenge to the pelvic region, where anatomical variability and organ motion present significant difficulties. Models must handle complex bone structures and soft tissue boundaries.

  • Challenge: Higher anatomical variation and presence of gas pockets causing signal voids
  • Metric Focus: Geometric accuracy of femoral heads and sacrum for robust patient alignment
  • Impact: Validates the generalizability of synthesis algorithms across different anatomical sites.
Pelvis
Anatomical Site
03

Task 3: Cone-Beam CT to CT Synthesis

Moving beyond MRI, this task evaluates the correction of Cone-Beam CT (CBCT) artifacts to generate high-quality planning CT scans. CBCT is widely used for patient positioning but suffers from severe scatter and noise.

  • Input: Low-quality, noisy CBCT with limited field-of-view
  • Output: Corrected, high-quality synthetic CT suitable for adaptive radiotherapy
  • Key Metric: Preservation of electron density information for dose re-calculation during treatment.
CBCT
Input Modality
04

Standardized Evaluation Metrics

SynthRAD2023 mandates a multi-faceted evaluation protocol to prevent over-optimization on a single metric. Rankings are determined by a composite score.

  • MAE (Mean Absolute Error): Quantifies voxel-wise HU differences.
  • PSNR (Peak Signal-to-Noise Ratio): Measures reconstruction quality.
  • SSIM (Structural Similarity Index): Evaluates perceived structural degradation.
  • Dose Accuracy: Gamma analysis comparing dose distributions calculated on sCT vs. real CT.
4+
Validation Metrics
05

Open Dataset & Reproducibility

The challenge provides a large, multi-center dataset of paired MRI-CT and CBCT-CT scans to ensure statistically significant benchmarking. All data is de-identified and shared under a research license.

  • Training Data: Includes ground-truth paired scans for supervised learning.
  • Hidden Test Set: Final rankings are determined on a sequestered test set to prevent leaderboard hacking.
  • Code Submission: Participants often submit containerized algorithms to ensure reproducibility and fair compute comparison.
Multi-Center
Data Provenance
06

Clinical Relevance & Dose Planning

The ultimate benchmark is clinical utility. SynthRAD2023 emphasizes that geometric similarity is insufficient; the synthetic output must be dosimetrically equivalent to a real CT.

  • Electron Density Mapping: sCT must accurately map HU values to relative electron density for the treatment planning system.
  • Gamma Pass Rate: The percentage of voxels where the dose difference and distance-to-agreement meet clinical tolerance (e.g., 2%/2mm).
  • Workflow Integration: The winning solutions demonstrate seamless integration into existing radiotherapy pipelines.
2%/2mm
Gamma Tolerance
SYNTHETIC CT GENERATION

Frequently Asked Questions

Essential questions about the SynthRAD2023 grand challenge, its evaluation methodology, and its impact on radiotherapy planning and medical image synthesis.

SynthRAD2023 is a grand challenge that establishes a standardized benchmark for generating synthetic CT (sCT) images from MRI scans for radiotherapy treatment planning. Its importance lies in creating the first large-scale, multi-center evaluation framework that directly compares state-of-the-art image-to-image translation methods—including GANs, diffusion models, and VAEs—on a clinically relevant task. By providing a common dataset and rigorous metrics, SynthRAD2023 accelerates the development of algorithms that can eliminate the need for separate CT scans, reducing patient radiation exposure and streamlining clinical workflows. The challenge specifically targets the pelvis and brain anatomical regions, where accurate Hounsfield Unit (HU) estimation from MRI is critical for dose calculation.

BENCHMARK EVOLUTION

SynthRAD2023 vs. Prior Synthetic CT Challenges

Comparison of the SynthRAD2023 grand challenge design against earlier synthetic CT generation benchmarks, highlighting methodological rigor and clinical relevance.

FeatureSynthRAD2023AAPM 2019 MRI-to-CTMICCAI 2017 Head & Neck

Primary Modality Pairing

MRI to CT (brain & pelvis)

MRI to CT (brain only)

CT to synthetic CT (head & neck)

Multi-Contrast MRI Input

Multi-Center Clinical Data

Paired Ground Truth Available

Dose Calculation Endpoint

Hounsfield Unit Accuracy Metric

MAE < 50 HU

MAE reported

MAE reported

Number of Participating Sites

3 (UMCG, UU, RUG)

1

2

Total Patient Dataset Size

1080 subjects

~15 subjects

~30 subjects

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.