Basic Architecture Overview

This repository is for the edge pod implementation, monitoring, and analysis in SUCCESS6G project.

Solution overview

Solution is deployed in Microk8s.

Description of the components:

• Grafana - dashboards
• Ingress - expose services to the operator
• Prometheus - gather pod metrics
• InfluxDB - gather vehicular measurements and predictions
• MinIO - store models and training/testing data
• JupyterHub - develop new models
• MLflow - MLops, experiment and model tracking
• Kserve - serve inference models to predefined pods
• Istio - to ensure optimal traffic flow between microservices
• Knative - to ensure autoscaling of inference service pods
• Kepler - gather energy consumption data
• Redis - API for transfer of OBU measurements to Kubernetes

Additional ideas

• KubeEdge deployment - same as Microk8s except with KubeEdge and Kubeflow/Kserver is swapped for Sedna
• implement multimodel pods e.g. by ModelMesh, or alpha feature of Kserve
• use Rancher to manage multi cluster Kubernetes