AI-supported precision medicine for breast cancer prognosis and prediction

The customer

YottaSen Forschungs GmbH is an innovative company based in Hamburg, specializing in the development of next-generation AI-powered image analysis methods. Its goal is to provide personalized prognosis, prediction and stratification for breast cancer patients. By combining deep medical expertise, a unique dataset and cutting-edge AI technology, YottaSen aims to significantly enhance prognostic and predictive capabilities in breast cancer treatment.

The challenge

In oncological diagnostics, biomarkers such as Ki67, ER, PR and Her2 play a central role in therapy decisions. These markers are typically identified through elaborate and costly immunohistochemical (IHC) staining. The goal of the project was to investigate whether this information could also be predicted directly from more widely available hematoxylin-eosin (HE) stained images using machine learning.

A particular challenge lay in the elastic registration of gigapixel image data: for reliable model training, HE images had to be precisely aligned with the corresponding IHC images, despite differences in color, resolution and format. This accurate mapping was essential for generating training data and enabling meaningful prediction of IHC markers from the HE images.

The elastic registration of the gigapixel image data posed a particular challenge: For reliable model training, HE images had to be precisely aligned with the corresponding IHC images, even though they differed in color, resolution and format. This precise assignment was essential in order to generate training data and enable a meaningful prediction of the IHC markers from the HE images.

This project produced results in a very short space of time. In addition to AI expertise, the Merantix Momentum team was also able to contribute domain expertise and together we were able to develop a functioning proof of concept. This enabled us to successfully demonstrate that the data can be used to make a prediction and that the technical implementation is possible. An important step for the development of patient-specific solutions for breast cancer.
Nils Niendorf
Co-Founder & CEO

Solution

Together with YottaSen, we developed a machine learning solution for predicting oncological biomarkers (Ki67, ER, PR, Her2) directly from HE-stained histology images. The initial focus was on data preparation: the different image modalities - HE and IHC - had to be registered automatically, reliably and with high precision in order to generate a valid training set.

On this basis, an initial ML pipeline was set up, which included image pre-processing, model training and evaluation. The aim was to test the predictive power of the HE images in relation to specific IHC markers and to create a basis for the development of a robust prediction model.

Results & effects

The project confirmed the fundamental feasibility of extracting biomarker-relevant information from HE images using machine learning. The ML pipeline developed enabled the first reliable predictions for individual markers and provided valuable insights into the potential and limitations of this method.

With the roadmap developed, YottaSen now has a clear strategic and technical basis for the further development of an ML-based analysis tool that can contribute to faster, more cost-effective and more personalized diagnostic procedures in the long term.

Overview

About the company
  • YottaSen Research Ltd.
  • Focus on AI-supported image analysis in breast diagnostics
  • Specialized in HE- and IHC-based procedures in oncology
  • Combines in-depth medical expertise with state-of-the-art machine learning technology

Implemented services
  • Machine learning for digital pathology
  • Analysis of histological image data
  • Prediction of biomarkers from HE sections
  • Development and evaluation of an ML pipeline
  • Proof of concept & creation of a technological roadmap

Project period
03/2024-04/2024
SHARE

Get in touch with us

  • Critical and holistic evaluation of the approach
  • Development of guidelines for reliable implementation
  • Free of charge and without obligation
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
We would like to get to know you!

Start your AI journey with us now

Subscribe to the Merantix Momentum Newsletter now.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

Get in touch with us

  • Critical and holistic evaluation of the approach
  • Development of guidelines for reliable implementation
  • Free of charge and without obligation
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
We would like to get to know you!

Start your AI journey with us now

Subscribe to the Merantix Momentum Newsletter now.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.