Closed
Milestone
Nov 1, 2022–Mar 31, 2023
Milestone Q1/23 - v0.2.0
Milestone ID: 1536
TODO:
- Updated Components:
- Minio
- OHIF
- CTP
- Landing-Page (Vue 3)
- dcm4chee
- code-server
- busybox
DONE:
-
Updated Components:
- Microk8s v0.1.26
- Helm v3.10
- Traefik 2.9.9
- Grafana: 8.4.7
- Prometheus: 2.34.0
- Alertmanager: v0.25.0
- Kubernetes Dashboard: v2.7.0
- metrics-scraper : v1.0.9
- Airflow: 2.5.2
- Keycloak: 21.0.1
- kube-state-metrics: v2.8.2
- oauth2-proxy: v7.4.0
- OpenSearch Dashboards: 2.6.0
- OpenSearch: v2.6.0
-
New Extensions
- 3D Slicer
- Model-Hub
- TCIA-Downloader
- RateMe
First list of possible adjustments:
- updates of components
- Bug-fixes of known issues
- Improvement of the documentation
- POC new data-model @philipp.schader
- POC data curation tool @stefan.denner
-
New federated features?Experiment Management System @markus.bujotzek - Basic maintenance UI (management of platform-updates + extensions) @uenal.akuenal
- New testing system @lorenz.feineis
- VM creation capabilities
- New Methods:
- TotalSegmentator
- PyRadiomics @uenal.akuenal
- Basic classification training capabilities
- New nifti2DICOM SEG operator (python-based) @jens.beyermann
- BCA? (we need to ask UK Esses if it would be ok)
Release Notes / Changelog Draft
Version 0.2.0 - Released May [XX], 2023
New Features:
- git-describe-based versioning for Kaapana
- Introduced black as code style
- Introduction of dark mode to the landing page
- Integration of new components:
-
Workflow Management System:
- Introduction of Kaapana Object "Workflow":
- Workflows semantically bind together multiple jobs, the data on which the jobs are running on and the orchestrating/triggering and the runner instances of the jobs
- Workflow Execution:
- only spot to trigger executable jobs on Kaapana platform
- also directly accessible from Datasets view
- remote/federated workflow execution on connected remote Kaapana instances more built-in
- Workflow List:
- visualizes all workflows which are or were running on the platform including:
- information regarding the workflow specification
- live status updates of workflow's jobs
- workflow actions to abort, restart or delete workflows including all their jobs
- each workflow can be expanded to visualize a list of jobs of the corresponding workflow including:
- information regarding the job specification
- live updates of the job's status
- redirect links to the job's airflow DAG run
- if job fails: redirect link to the airflow logs of the job's failed operator
- job actions to abort, restart or delete jobs
- visualizes all workflows which are or were running on the platform including:
- Instance Overview:
- Visualization of the local Kaapana instance
- information regarding the instance specification
- specifications can be adapted during platform deployment to change SSL verification, fernet encryption of federated communication, federated syncing and execution mechanism, for remote/federated execution allowed Airflow DAGs, for remote/federated execution allowed datasets possibility to add remote Kaapana instances
- Visualization of remote Kaapana instances
- information regarding the instance specification
- specifications can be adapted during platform deployment to change http prt of remote instance, identity verification token, SSL verification and fernet encryption of federated communication
- Workflows can be executed:
- local: orchestrating instance = runner instance
- remote: orchestrating instance != runner instance
- federated: orchestrating instance orchestrates federated execution by starting jobs workflows including jobs on remote instances which the report data/information back to the orchestrating instance (for federated learning)
- each remote runner instance has always the possibility to abort its jobs which are orchestrated by another instance
- every remote instance has the possibility to disable automatic workflow execution on its instance such that the instance user will be asked for confirmation
- Workflow actions:
- abort, restart, delete local workflows
- abort, restart remote/federated workflows
- service-workflows:
- background services (e.g. pipelines triggered whenever a DICOM image arrives in the platform) are also visualized in the WMS and indicated as service-worflows with service-jobs
- Visualization of the local Kaapana instance
- ...
- Introduction of Kaapana Object "Workflow":
-
Datasets
- Added intuitive Gallery-style view visualizing thumbnails and (configurable) metadata of DICOM Series
- Added Multiselect which allows performing actions on multiple series at once including add/removing to/from a dataset, executing workflows on individual series or creating new datasets based on the selection
- Added configurable sidepanel metadata dashboard allowing the exploration of Metadata distributions (based on selections)
- Introduced intuitive shortcut based tagging functionality allowing fast and convenient annotation and categorization of series
- (Full-text) search to filter for items based on meta data
- Added option to open a series in a side panel visualizing the DICOM using (an adjusted) OHIF Viewer-v3 next to all Metadata of the specific series.
-
Admin-Tools
- ...
-
Workflow Management System:
- Integration of new analysis pipelines and methods
- TotalSegmentator
- RTSTRUCT support for DICOM to NIfTi conversion
- New example workflow (Otsus method)
- Security Improvements
- Security Scanning
- Extended auth-checker
Updates:
- Improved Landing page navigation to make workflows more present and more intuitive to interact with
- Improved build-system (more reliable + faster)
- Split offline installation support for Microk8s + Kaapana
- New base-images
Bug Fixes: