Service Usage Plots

In this project, plots are generated from service usage data. The data is incorporated via submodules from separate projects.

Generated Plots (most recent)

All plots are generated automatically when changes are detected or the generation pipeline is triggered. Also daily plots are generated.

General overview plots

• Latest build, all graphs
• Download all graphs in zip file
• Previously used graphs, used in reports, reproduced with most recent data.
• Gallery Overview
• Graphs pdf collection
• Example of inline svg (AAI users):
  

KPI plots

• Latest build, all graphs
• Download all graphs in zip file
• KPI Gallery Overview
• Graphs pdf collection
• Overall Cloud KPI result
  • Contribution per service
  • Contribution of single service / KPI components
  • see here for documentation of the Helmholtz Cloud Service Operation KPI.
• Contributions of services to overall KPI:
  
• Example of KPI plot (HZDR Codebase):
  

Local execution

Clone this repository recursively, i.e. including the data, with:

git clone --recursive git@codebase.helmholtz.cloud:hifis/overall/kpi/kpi-plots-ci.git

If you have cloned the repository already, you might need to update the submodules (i.e., data) with

git submodule sync --recursive
git submodule update --remote --recursive --init

Necessary for converting and plotting: gnuplot, gawk, imagemagick, poppler-utils.

cd plots_scripts      # or any other of the sub-folders
./plot.sh

Structure

• subprojects: Linked projects providing the source data. Internal structure is very heterogenous atm.
• data: Collected raw data (links) from subprojects.
  • servicename: One Level of subfolders with one service per folder.
    • data.csv (mandatory): Raw data with one date/time column, and at least one data column
    • timefmt.txt (optional): Provide specific date/time format, if needed. Standard is %Y-%m-%d %H:%M.
    • filter.sh (optional): Provide filter/data integration script, if needed. Otherwise raw data is plotted.
• kpi-weights.csv: Weighting of all separate service contributions to overall KPI; usually 50% service users+50% service usage.
• plots: Collection of all plots to be output => Artifacts folder