Category: Big Data

Real-time air quality monitoring and alerting – Part 2 – Training Azure Anomaly Detector

In the first part of this series, I looked at how you can use a sensor from PurpleAir to capture data on the quality of the air at a location and then route that information to a custom IoT endpoint in Microsoft Azure. The captured data on its own is not that useful, and really … Continue reading Real-time air quality monitoring and alerting – Part 2 – Training Azure Anomaly Detector →

Easy Filtering of IoT Data Streams with Azure Stream Analytics and JSON reference data

I am currently working on an next-gen widget dispenser solution that is gradually being rolled out to trial sites across Australia. The dispenser hardware is a modern platform that provides telemetry data that can be used for various purposes by the locations at which the dispenser is deployed and potentially by other third parties. In … Continue reading Easy Filtering of IoT Data Streams with Azure Stream Analytics and JSON reference data →

Not Your Father’s Cloud: Microsoft Azure HDInsights Explained

If you need to understand the format of this post, take a look at my introduction to the series. Like A Boss HDInsights is designed to help tame the Big Data beast by providing an on-demand Apache Hadoop solution hosted on Azure.  You can create a Cluster of between 1 and 32 Nodes and use standard Hadoop tools like … Continue reading Not Your Father’s Cloud: Microsoft Azure HDInsights Explained →