TotalSegmentator is a self-configuring segmentation model built on the nnU-Net architecture, trained on a diverse dataset of whole-body CT images. It automatically delineates major organs, bones, vessels, and muscles without manual intervention, outputting precise pixel-level masks for each structure. The model handles the inherent variability in patient anatomy and imaging protocols through nnU-Net's automated preprocessing, topology adaptation, and post-processing pipeline, making it a reliable off-the-shelf tool for quantitative imaging workflows.
Glossary
TotalSegmentator

What is TotalSegmentator?
TotalSegmentator is a pre-trained deep learning model based on the nnU-Net framework that performs fully automated segmentation of over 100 anatomical structures in whole-body CT scans, serving as a robust baseline for organ volumetry and radiological analysis.
Widely adopted as a benchmark in medical image analysis, TotalSegmentator enables rapid organ volumetry, radiation dose planning, and population-level morphometric studies. It generates standardized DICOM Segmentation Objects compatible with clinical software, and its open-source availability has accelerated research in semantic segmentation, radiomics feature extraction, and federated learning across institutions. The model's consistent performance across heterogeneous CT acquisitions demonstrates the power of self-adapting deep learning frameworks in diagnostic support.
Key Features of TotalSegmentator
TotalSegmentator is a pre-trained nnU-Net model that performs fully automatic segmentation of over 100 anatomical structures in whole-body CT scans. It serves as a robust baseline for organ volumetry, surgical planning, and population-level imaging studies.
104 Anatomical Structures in a Single Pass
TotalSegmentator segments 104 distinct anatomical structures across the entire body from a single CT volume, including:
- Major organs: liver, spleen, kidneys, pancreas, lungs, heart
- Vascular structures: aorta, inferior vena cava, iliac arteries and veins
- Skeletal system: individual vertebrae (C1-L5), ribs, hip bones, sacrum
- Gastrointestinal tract: stomach, duodenum, small bowel, colon
- Brain substructures: gray matter, white matter, ventricles
This comprehensive coverage eliminates the need for multiple task-specific models, dramatically reducing inference pipeline complexity.
Trained on a Large-Scale Multi-Institutional Dataset
The model was trained on 1,204 whole-body CT scans from multiple institutions, with ground truth labels generated through a combination of:
- Atlas-based segmentation propagation for initial label generation
- Manual correction by trained radiographers to refine boundary accuracy
- Multi-rater consensus review for challenging anatomical regions
The diverse training data spans varying scanner vendors, acquisition protocols, and patient populations, contributing to the model's strong generalization across clinical settings. Publicly available CT datasets were also incorporated to expand anatomical coverage.
Robust Performance Across Anatomical Regions
TotalSegmentator achieves strong Dice similarity coefficients across diverse anatomical structures, with performance varying by organ complexity and boundary definition:
- High-performing organs (Dice > 0.90): lungs, liver, spleen, kidneys, heart
- Moderate performance (Dice 0.80–0.90): pancreas, adrenal glands, individual vertebrae
- Challenging structures (Dice 0.70–0.80): small bowel, duodenum, thin vascular branches
The model's performance degrades gracefully on structures with high anatomical variability or low soft-tissue contrast, providing transparent quality indicators for downstream clinical workflows. Quantitative validation was performed against expert radiologist annotations using both Dice score and Hausdorff distance metrics.
Subdivision into Task-Specific Variants
Beyond the full 104-structure model, TotalSegmentator offers specialized sub-models for focused clinical applications:
- TotalSegmentator MRI: adaptation for whole-body magnetic resonance imaging with Dixon sequences
- Lung lobe segmentation: fine-grained pulmonary lobe delineation for surgical planning
- Cardiac substructure segmentation: individual heart chambers and great vessels
- Vertebral body segmentation: individual vertebra labeling with anatomical numbering
- Body composition analysis: segmentation of adipose tissue compartments (subcutaneous, visceral, intramuscular)
These task-specific variants achieve higher accuracy on their target structures by reducing the label space and focusing model capacity.
Frequently Asked Questions
Addressing common technical and clinical queries regarding the deployment and mechanics of the TotalSegmentator model for whole-body CT analysis.
TotalSegmentator is a pre-trained deep learning model based on the self-configuring nnU-Net framework designed to perform fully automatic segmentation of over 100 anatomical structures in whole-body CT scans. It works by ingesting a volumetric CT image and processing it through a convolutional neural network that has been trained on a diverse, multi-institutional dataset. The model predicts a pixel-level label map, assigning each voxel to a specific organ or bone class. Unlike manual segmentation, which can take hours, TotalSegmentator generates a complete whole-body segmentation in under a minute on modern GPU hardware, making it a robust baseline for organ volumetry and surgical planning.
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
TotalSegmentator vs. Other Segmentation Models
Feature and performance comparison of TotalSegmentator against general-purpose and medical-specific segmentation architectures for whole-body CT analysis.
| Feature | TotalSegmentator | nnU-Net (Custom) | SAM / MedSAM | Mask R-CNN |
|---|---|---|---|---|
Primary Task | Whole-body multi-organ semantic segmentation | User-configured segmentation (any task) | Promptable general-purpose segmentation | Instance segmentation with bounding boxes |
Pre-trained Organs (CT) | 104+ structures | 0 (requires training) | 0 (zero-shot, no CT specificity) | 0 (requires training) |
Self-Configuring Pipeline | ||||
Training-Free Deployment | ||||
3D Volumetric Native Support | ||||
Average Dice Score (Abdominal Organs) | 0.93 | 0.91–0.95 (task-dependent) | 0.78–0.85 (zero-shot) | 0.85–0.90 (trained) |
Inference Time (Full-Body CT) | < 60 sec (GPU) | Varies by configuration | < 10 sec (2D slices) |
|
DICOM Segmentation Object Output |
Related Terms
TotalSegmentator operates within a rich ecosystem of segmentation architectures, evaluation metrics, and preprocessing standards. Understanding these adjacent concepts is critical for engineering robust diagnostic pipelines.
nnU-Net (no-new-Net)
The self-configuring framework that powers TotalSegmentator. It automatically adapts preprocessing, network topology, and post-processing to any medical dataset without manual tuning.
- Eliminates manual architecture engineering
- Automates data fingerprint extraction
- Defines the state-of-the-art for out-of-the-box segmentation
- TotalSegmentator is a pre-trained nnU-Net model checkpoint
Dice Score (F1 Score)
The primary spatial overlap metric for validating TotalSegmentator outputs. Calculated as twice the intersection divided by the sum of predicted and ground truth areas.
- Ranges from 0 (no overlap) to 1 (perfect match)
- TotalSegmentator achieves >0.9 Dice on most major organs
- Sensitive to both false positives and false negatives
- Equivalent to the F1 Score in binary classification
Hausdorff Distance
A boundary-based metric that quantifies the worst-case segmentation error. It measures the maximum distance from any point on the predicted boundary to the nearest point on the ground truth boundary.
- Identifies clinically dangerous outlier errors
- Critical for Organ-at-Risk (OAR) segmentation in radiotherapy
- 95th percentile variant (HD95) is more robust to noise
- Complements Dice Score for comprehensive evaluation
Isotropic Resampling
A critical preprocessing step that ensures uniform voxel spacing in all three spatial dimensions before feeding CT scans to TotalSegmentator.
- Converts anisotropic clinical scans to 1mm³ or similar isotropic grids
- Prevents model bias toward in-plane features
- Essential for consistent 3D segmentation performance
- Handled automatically by nnU-Net's data fingerprinting
Organ-at-Risk (OAR) Segmentation
The primary clinical application of TotalSegmentator. OARs are healthy structures surrounding a tumor that must be delineated to calculate radiation dose constraints.
- TotalSegmentator segments 100+ structures including parotid glands, spinal cord, and heart
- Reduces manual contouring time from hours to seconds
- Enables automated radiotherapy treatment planning
- Critical for minimizing collateral radiation damage

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us