Mrinal Chaudhary

Camp Counselor

Swadha Varshney

Camp Counselor

Streaming Data to retrieve Real-Time Insights

Event Logo

Wednesday, July 27, 2022 - 3:30 PM UTC, for 1 hour.

Regular, 60 minute presentation

Room: G

Real-Time
Streaming Pipelines
IoT Data
IoT Devices
Pre-Built Templates

Processing streaming data is becoming increasingly popular as streaming enables businesses to get real-time metrics on business operations. The majority of data today which we need are continuous streams: sensor events from devices, users activity on websites, financial trades etc. – all these data are created as a series of events over time. This presentation and demo will focus upon how easily users can build streaming data pipelines on Google Cloud Platform. I will showcase how to build a streaming pipeline with GCP products like Pub/Sub (for ingestion), Dataflow (for processing) & BigQuery (as a DataWarehouse). I will also focus on the ease of use of Google Cloud Platform by showcasing how you can leverage pre-built templates from Dataflow and land data from Pub/Sub to BigQuery.

Prerequisites

There is no specific prerequisites required for this session. However, it will be great if someone has basic python understanding.

Take Aways

  • Build Streaming Pipelines by using Cloud Platform
  • Streaming IoT Data to retrieve Real-Time Insights
favorited by:
Josh Kinstler Cate Renner Dan Willman Swadha Varshney Robin Schroeder Robert Loesch Cacie Robichaux Justin Weyenberg Drew Nys Brent Davis Bob Dankert Eric Boyd Ken Samson Simone LaMarche