About¶
The Data Services Hub (DSH) is a platform that allows tenants to stream data:
- Deploy platform services and custom services.
- Share data with other tenants on the same platform, using Apache Kafka.
- Produce data that external clients can consume, via Kafka, MQTT or HTTP.
- Consume data that external clients produce, via Kafka, MQTT or HTTP.
A tenant on the DSH is a collection of resources, limits, services and applications, and of users that can access them.
Use cases¶
The DSH can handle several scenarios:
- MQTT/HTTP: Many clients that send/receive small volumes of data continuously.
- Kafka: Few clients that send/receive huge volumes of data regularly.
- The combination of MQTT/HTTP and Kafka:
- Collect data from many MQTT/HTTP clients, and make it available to Kafka clients.
- Collect data from Kafka clients, process it, and make the results available to many MQTT/HTTP clients.
This makes the DSH ideal for handling your data in different ways, for example:
- Collect data from devices and make it available for further analysis.
- Collect data from devices, process it using your logic, and trigger alerts in case of problems.
- Send log files from different sources to the DSH, align them, and analyze them.
- Share data with other tenants.
- Collect data from your devices, process it and send messages out to many devices again.
As a consequence, you can use the DSH as a platform to develop your solutions for the Internet of Things, traffic control, device management, log file management, etc. Even though the combination of Kafka and MQTT/HTTP is the DSH’s strength, you can also decide to use only certain aspects of it.
Tip
Visit the KPN DSH page on kpn.com (Dutch) to find out more about use cases, customers etc.
Open source¶
The DSH runs on cloud-native infrastructure, using open-source technology:
- You can develop your own services and deploy them on the DSH as Docker containers.
- The DSH also has an App Catalog with several applications that you can deploy easily.
- The DSH uses open-source technology in different solutions:
- Kubernetes
- Apache Kafka, Apache ZooKeeper, Calico; Keycloak
- Metrics and monitoring: Prometheus and Grafana
- Message tracing: OpenTelemetry and Jaeger UI
- Container image registry: Harbor
- Stream processing: Apache Flink
- Schema Store: Apicurio Registry
More information¶
Do you have any questions?