This code sample is a supplement to Building real-time monitoring and observable systems for Media architecture and highlights a use case in the Media industry for providing real-time monitoring and observability of systems and end-user device telemetry.
This code sample includes the necessary Infrastructure-as-Code (IaC) to bootstrap development as well as Azure Functions to ingest and transform the data from HTTP and Blob endpoints.
Architecture diagram of an observable system. Raw telemetry is streamed to Azure via HTTP and connectors to Blob Storage. The raw telemetry is processed, transformed, normalized, and saved in Data Explorer for analysis. Systems like Grafana and Metrics Advisor can read data from Data Explorer and show insights to end customers.
Key components of this architecture include:
- Instrumentation
- Ingestion
- Transformation and persistence
- Monitoring
- Anomaly detection
Note: This architecture deviates from the Azure Architecture Center article in that the Event Hubs ingestion service is not implemented.
- Infrastructure Deployment and Configuration
- Local Development Setup
- Extending and Customizing Transformation Logic
- Function Trigger Types
- Metrics Advisor Setup
- Running Tests Locally
This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.opensource.microsoft.com.
To contribute, please start by creating a self-assigned issue giving a high-level overview of what you'd like to do. Once any discussion there concludes, follow up with a PR.
This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.