Streaming Data to retrieve Real-Time Insights
Processing streaming data is becoming increasingly popular as streaming enables businesses to get real-time metrics on business operations. The majority of data today which we need are continuous streams: sensor events from devices, users activity on websites, financial trades etc. – all these data are created as a series of events over time. This presentation and demo will focus upon how easily users can build streaming data pipelines on Google Cloud Platform. I will showcase how to build a streaming pipeline with GCP products like Pub/Sub (for ingestion), Dataflow (for processing) & BigQuery (as a DataWarehouse). I will also focus on the ease of use of Google Cloud Platform by showcasing how you can leverage pre-built templates from Dataflow and land data from Pub/Sub to BigQuery.
There is no specific prerequisites required for this session. However, it will be great if someone has basic python understanding.
- Build Streaming Pipelines by using Cloud Platform
- Streaming IoT Data to retrieve Real-Time Insights