Challenge organization and open datasets

Challenges are competitions organized to evaluate algorithms solving the same task using the same data and benchmarks. They have become a landmark of biomedical imaging as they rationalize the evaluation and the comparison while providing large datasets to the community. This page lists the challenges which have been co-organized by CREATIS' researchers:

  • EMPIRE (2010, data provider) for the evaluation of methods for pulmonary image registration
  • CETUS (2014, co-organizer) Challenge on Endocardial Three-dimensional Ultrasound Segmentation
  • PICMUS  (2016, main organizer) IEEE IUS Plane-wave Imaging Challenge in Medical UltraSound
  • ACDC (2017, main organizer) Automated Cardiac Diagnosis Challenge
  • SAVFI (2018, co-organizer) IEEE IUS challenge on Synthetic Aperture Vector Flow Imaging
  • SPARE (2018, data provider) Sparse-view Reconstruction Challenge for Four-dimensional Cone-beam CT
  • CAMUS (2019, co-organizer) challenge on Cardiac Acquisitions for Multi-structure Ultrasound Segmentation
  • MSSEG-2 (2021, co-organizer) MS new lesions SEGmentation
  • MYOSAIQ (2024, co-organizer) MYOcardial Segmentation with Automated Infarct Quantification
  • MS-Multi-Spine (2025, co-organizer) for Multiple Sclerosis Spinal Cord Lesion Detection from MultiSequence MRIs

CREATIS has also opened several datasets to the community: