SynthRAD2023 is a scientific competition that rigorously evaluates image-to-image translation algorithms, specifically the task of synthesizing synthetic Computed Tomography (sCT) from Magnetic Resonance Imaging (MRI). The challenge provides a multi-institutional dataset to benchmark the geometric accuracy and Hounsfield Unit (HU) fidelity required for dose calculation in adaptive radiotherapy.
Glossary
SynthRAD2023

What is SynthRAD2023?
SynthRAD2023 is a grand challenge that establishes a standardized benchmark for generating synthetic CT scans from MRI data, directly advancing radiotherapy treatment planning.
By defining a unified evaluation framework using metrics like the Mean Absolute Error (MAE) in HU and Structural Similarity Index (SSIM), SynthRAD2023 addresses the clinical need to eliminate redundant CT scans. It accelerates the validation of deep learning models, including GANs and diffusion models, for generating clinically actionable synthetic images directly from non-ionizing MRI.
Key Features of the SynthRAD2023 Challenge
SynthRAD2023 is a grand challenge establishing a standardized framework for evaluating image-to-image translation methods that generate synthetic CT scans from MRI data, directly targeting the clinical need for accurate dose planning without ionizing radiation.
Task 1: MR-to-CT Brain Synthesis
The primary task focuses on generating synthetic CT (sCT) scans from multi-contrast MRI inputs of the brain. Participants must accurately predict Hounsfield Units (HU) to enable precise radiotherapy dose calculations.
- Input: T1-weighted and T2-weighted MRI sequences
- Output: A 3D synthetic CT volume with accurate bone/soft-tissue contrast
- Clinical Goal: Eliminate the need for a separate planning CT scan, reducing patient radiation exposure and registration errors between MRI and CT.
Task 2: MR-to-CT Pelvis Synthesis
This task extends the challenge to the pelvic region, where anatomical variability and organ motion present significant difficulties. Models must handle complex bone structures and soft tissue boundaries.
- Challenge: Higher anatomical variation and presence of gas pockets causing signal voids
- Metric Focus: Geometric accuracy of femoral heads and sacrum for robust patient alignment
- Impact: Validates the generalizability of synthesis algorithms across different anatomical sites.
Task 3: Cone-Beam CT to CT Synthesis
Moving beyond MRI, this task evaluates the correction of Cone-Beam CT (CBCT) artifacts to generate high-quality planning CT scans. CBCT is widely used for patient positioning but suffers from severe scatter and noise.
- Input: Low-quality, noisy CBCT with limited field-of-view
- Output: Corrected, high-quality synthetic CT suitable for adaptive radiotherapy
- Key Metric: Preservation of electron density information for dose re-calculation during treatment.
Standardized Evaluation Metrics
SynthRAD2023 mandates a multi-faceted evaluation protocol to prevent over-optimization on a single metric. Rankings are determined by a composite score.
- MAE (Mean Absolute Error): Quantifies voxel-wise HU differences.
- PSNR (Peak Signal-to-Noise Ratio): Measures reconstruction quality.
- SSIM (Structural Similarity Index): Evaluates perceived structural degradation.
- Dose Accuracy: Gamma analysis comparing dose distributions calculated on sCT vs. real CT.
Open Dataset & Reproducibility
The challenge provides a large, multi-center dataset of paired MRI-CT and CBCT-CT scans to ensure statistically significant benchmarking. All data is de-identified and shared under a research license.
- Training Data: Includes ground-truth paired scans for supervised learning.
- Hidden Test Set: Final rankings are determined on a sequestered test set to prevent leaderboard hacking.
- Code Submission: Participants often submit containerized algorithms to ensure reproducibility and fair compute comparison.
Clinical Relevance & Dose Planning
The ultimate benchmark is clinical utility. SynthRAD2023 emphasizes that geometric similarity is insufficient; the synthetic output must be dosimetrically equivalent to a real CT.
- Electron Density Mapping: sCT must accurately map HU values to relative electron density for the treatment planning system.
- Gamma Pass Rate: The percentage of voxels where the dose difference and distance-to-agreement meet clinical tolerance (e.g., 2%/2mm).
- Workflow Integration: The winning solutions demonstrate seamless integration into existing radiotherapy pipelines.
Frequently Asked Questions
Essential questions about the SynthRAD2023 grand challenge, its evaluation methodology, and its impact on radiotherapy planning and medical image synthesis.
SynthRAD2023 is a grand challenge that establishes a standardized benchmark for generating synthetic CT (sCT) images from MRI scans for radiotherapy treatment planning. Its importance lies in creating the first large-scale, multi-center evaluation framework that directly compares state-of-the-art image-to-image translation methods—including GANs, diffusion models, and VAEs—on a clinically relevant task. By providing a common dataset and rigorous metrics, SynthRAD2023 accelerates the development of algorithms that can eliminate the need for separate CT scans, reducing patient radiation exposure and streamlining clinical workflows. The challenge specifically targets the pelvis and brain anatomical regions, where accurate Hounsfield Unit (HU) estimation from MRI is critical for dose calculation.
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
SynthRAD2023 vs. Prior Synthetic CT Challenges
Comparison of the SynthRAD2023 grand challenge design against earlier synthetic CT generation benchmarks, highlighting methodological rigor and clinical relevance.
| Feature | SynthRAD2023 | AAPM 2019 MRI-to-CT | MICCAI 2017 Head & Neck |
|---|---|---|---|
Primary Modality Pairing | MRI to CT (brain & pelvis) | MRI to CT (brain only) | CT to synthetic CT (head & neck) |
Multi-Contrast MRI Input | |||
Multi-Center Clinical Data | |||
Paired Ground Truth Available | |||
Dose Calculation Endpoint | |||
Hounsfield Unit Accuracy Metric | MAE < 50 HU | MAE reported | MAE reported |
Number of Participating Sites | 3 (UMCG, UU, RUG) | 1 | 2 |
Total Patient Dataset Size | 1080 subjects | ~15 subjects | ~30 subjects |
Related Terms
Master the core concepts underpinning the SynthRAD2023 challenge, from the generative architectures used for MRI-to-CT translation to the quantitative metrics that define state-of-the-art performance.
Image-to-Image Translation
The foundational task of mapping an input image from a source domain (MRI) to a corresponding output image in a target domain (CT). Unlike simple style transfer, this requires learning a bijective mapping that preserves anatomical geometry while accurately synthesizing tissue-specific Hounsfield Unit (HU) values. Architectures often employ encoder-decoder structures with skip connections to retain high-resolution structural details during the domain shift.
Hounsfield Unit (HU) Fidelity
The quantitative standard for radiodensity in CT imaging, where water is defined as 0 HU and air as -1000 HU. A synthetic CT generator must not only produce visually convincing images but also assign precise HU values to bone, soft tissue, and air cavities. Errors in HU estimation directly corrupt dose calculation algorithms in radiotherapy planning, making this the most clinically critical evaluation metric in SynthRAD2023.
Structural Similarity Index (SSIM)
A perceptual metric that quantifies the degradation of structural information between a synthetic CT and the ground truth. Unlike simple pixel-wise error, SSIM evaluates luminance, contrast, and structure independently, mimicking human visual perception. It is a core evaluation metric in SynthRAD2023, ensuring that generated images preserve fine anatomical boundaries and do not introduce geometric distortions that could compromise treatment margins.
Fréchet Inception Distance (FID)
A distribution-level metric that measures the similarity between the feature statistics of generated synthetic CTs and real CTs. A lower FID score indicates that the synthetic images capture the textural diversity and realism of true CT scans. SynthRAD2023 uses FID to penalize mode collapse, where a generator produces only a limited variety of anatomically plausible outputs, failing to represent the full patient population.
Dose Calculation Validation
The ultimate clinical endpoint for SynthRAD2023. Synthetic CTs are fed into Monte Carlo simulation or clinical treatment planning systems to compute radiation dose distributions. The challenge evaluates the gamma pass rate between dose maps calculated on synthetic CTs versus real CTs. A passing rate above 95% under strict criteria (e.g., 1%/1mm) is the gold standard for clinical acceptability in MR-only radiotherapy workflows.

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us