Introduction To Streaming Data
In this hands-on course we will learn about streaming data, including the tools, architectures and patterns that are being used to build real time data pipelines and customer experiences.
Course Overview
Streaming data is data that is generated continuously and in high volumes. Common examples include stock price updates, click stream events, logs, and data from IOT devices.
Increasingly, businesses are looking to process and respond to this type of data to generate real time insights and improve their customer experience.
Processing so much data with low latency does however require new tools and approaches that are a step change in how data platforms are designed today.
In this course, we will introduce the concepts of streaming data, and explain the considerations as businesses move from traditional batch approaches to modern streaming architectures.
Sign Up To Access The Full Course Content
Timeflow Academy is a free online, hands-on platform for learning about Cloud Data Engineering using modern, open source tools and platforms. Please register with us for full access to our content.
Introduction To Streaming Data
In this lesson we will introduce streaming data and some of the main concepts relating to it.
Introduction To Stream Processing
In this lesson we will introduce the concept of stream processing and introduce the role that frameworks such as Flink and Kafka Streams play.
Key Technologies In Streaming Data
In this lesson we will learn about some of the key technologies, tools and platforms that are being used to process streaming data.
Challenges Associated With Streaming Data
In this lesson we will explain why working with real time and streaming data is challenging.
Building A Stream Processing Platform
In this lesson we will discuss the considerations when building a stream processing capability;
Stream Processing vs Real Time Data Warehouses
In this lesson we will constrast stream processing with performing real time analytics in a data warehouse.
Sourcing Events For Stream Processing
In this lesson we will explain some methods and tools for sourcing events from legacy platforms.
Real Time Stream Processing On AWS
In this lesson we will explain some of the AWS platform features which can support stream processing initiatives.
Stateful and Stateless Event Processing
In this lesson we will explain the two classes of stream processing that we need to carry out.
