Hands-On Training For The Modern Data Stack
Timeflow Academy is an online, hands-on platform for learning about Data Engineering and modern Cloud Native Databases including tools such as DBT, Clickhouse, Snowflake, Kafka, Spark and Airflow...
The Modern Data Stack
Introduction To The Modern Data Stack
Introducing The Concept Of The Modern Data Stack or Modern Data Platform
ViewArchitecture Of The Modern Data Stack
Architectural patterns and concepts when building a Modern Data Platform
ViewIngesting Data Into A Modern Data Stack
How data is typically sourced and integrated into Modern Data Platforms
ViewAnalytics and Business Intelligence
Analysis, Reporting and Dashboards in the Modern Data Platform
ViewData Warehouse In The Modern Data Stack
The Data Warehouse And It's Role In The Modern Data Stack
ViewIntroduction To Stream Processing
Introduction to stream processing and why it's advantages over batch processing
ViewWhat Is Data Engineering?
What Data Engineering is and why it is an increasingly important business capability
ViewIntroduction To The Modern Data Stack
Introducing The Concept Of The Modern Data Stack or Modern Data Platform
ViewArchitecture Of The Modern Data Stack
Architectural patterns and concepts when building a Modern Data Platform
ViewIngesting Data Into A Modern Data Stack
How data is typically sourced and integrated into Modern Data Platforms
ViewAnalytics and Business Intelligence
Analysis, Reporting and Dashboards in the Modern Data Platform
ViewData Warehouse In The Modern Data Stack
The Data Warehouse And It's Role In The Modern Data Stack
ViewIntroduction To Stream Processing
Introduction to stream processing and why it's advantages over batch processing
ViewWhat Is Data Engineering?
What Data Engineering is and why it is an increasingly important business capability
ViewDBT For Data Engineers
Creating A DBT Project
Using the DBT Command Line Interface to create and configure our first DBT project.
ViewConfiguring DBT Profiles
The DBT profile system and best practices for managing profiles for maintainable code.
ViewExecuting Your First Transformations
Implementing and running our first transformations using DBT models that build both tables and views.
ViewDBT Views and Tables
Using DBT to materialise to tables and views, and the associated incremental and ephemeral options.
ViewTesting With DBT
Using the testing features of DBT to validate data transformations and pipelines.
ViewEthemeral Views
Using DBTs ethemeral view feature to improve your pipeline readability.
ViewSources and Exposures
Using DBTs source and exposure features to capture better metadata regarding your pipelines.
ViewCreating A DBT Project
Using the DBT Command Line Interface to create and configure our first DBT project.
ViewConfiguring DBT Profiles
The DBT profile system and best practices for managing profiles for maintainable code.
ViewExecuting Your First Transformations
Implementing and running our first transformations using DBT models that build both tables and views.
ViewDBT Views and Tables
Using DBT to materialise to tables and views, and the associated incremental and ephemeral options.
ViewTesting With DBT
Using the testing features of DBT to validate data transformations and pipelines.
ViewEthemeral Views
Using DBTs ethemeral view feature to improve your pipeline readability.
ViewSources and Exposures
Using DBTs source and exposure features to capture better metadata regarding your pipelines.
ViewKafka For Data Engineers
What Is Kafka Streams?
Kafka Streams is the component of the Kafka ecosystem which can be used for stream processing. This involves taking messages from Kafka, usually as they are produced in real time, and processing or responding to them in some way.
ViewIntroduction To Kafka
Introduction to Apache Kafka including some of it's key features and use cases.
ViewCore Concepts Of Kafka
Introducing some of the core concepts and terminology associated with Kafka.
ViewAdministering Kafka Topics
Learning about Kafka Topics, including what they are and how to configure and optimise them.
ViewConsuming Data From Kafka
In this lesson we will learn about consuming data in Kafka.
ViewKafka Partitions
In this lesson we will learn about Kafka partitions, which are the one of the main ways in which we can improve parallelism and therefore performance of your Kafka deployment.
ViewKafka Performance Test Scripts
In this lesson we will learn about the Kafka performance test scripts, which can be used for measuring the performance of your Kafka deployment for both producers and consumers.
ViewWhat Is Kafka Streams?
Kafka Streams is the component of the Kafka ecosystem which can be used for stream processing. This involves taking messages from Kafka, usually as they are produced in real time, and processing or responding to them in some way.
ViewIntroduction To Kafka
Introduction to Apache Kafka including some of it's key features and use cases.
ViewCore Concepts Of Kafka
Introducing some of the core concepts and terminology associated with Kafka.
ViewAdministering Kafka Topics
Learning about Kafka Topics, including what they are and how to configure and optimise them.
ViewConsuming Data From Kafka
In this lesson we will learn about consuming data in Kafka.
ViewKafka Partitions
In this lesson we will learn about Kafka partitions, which are the one of the main ways in which we can improve parallelism and therefore performance of your Kafka deployment.
ViewKafka Performance Test Scripts
In this lesson we will learn about the Kafka performance test scripts, which can be used for measuring the performance of your Kafka deployment for both producers and consumers.
ViewWhat Is Kafka Streams?
Kafka Streams is the component of the Kafka ecosystem which can be used for stream processing. This involves taking messages from Kafka, usually as they are produced in real time, and processing or responding to them in some way.
ViewClickhouse For Data Engineers
Materialised Views
Introducing materialised views, and demonstrate how they are more powerful than materialsied views as implemented by other databases.
ViewConnecting To Clickhouse
Connecting to Clickhouse and learning about the different deployment options.
ViewClickhouse Role Based Access Control (RBAC)
The Clickhouse users, role and permission model
ViewConnecting Clickhouse To Kafka
How to connect Clickhouse to Kafka to ingest in real time streams of messages.
ViewMaterialised Views
Introducing materialised views, and demonstrate how they are more powerful than materialsied views as implemented by other databases.
ViewConnecting To Clickhouse
Connecting to Clickhouse and learning about the different deployment options.
ViewClickhouse Role Based Access Control (RBAC)
The Clickhouse users, role and permission model
ViewConnecting Clickhouse To Kafka
How to connect Clickhouse to Kafka to ingest in real time streams of messages.
ViewMaterialised Views
Introducing materialised views, and demonstrate how they are more powerful than materialsied views as implemented by other databases.
ViewSpark For Data Engineers
From Spark To Databricks
In this lesson we will learn about the differences between Spark and Databricks, and the advantages of moving from Spark to Databricks.
ViewIntroduction To Apache Spark
Introducing Apache Spark and cover some of the core concepts and use cases.
ViewLoading Static Files
Introducing Apache Spark and describe how to load data from static CSV and JSON files.
ViewFrom Spark To Databricks
In this lesson we will learn about the differences between Spark and Databricks, and the advantages of moving from Spark to Databricks.
ViewIntroduction To Apache Spark
Introducing Apache Spark and cover some of the core concepts and use cases.
ViewLoading Static Files
Introducing Apache Spark and describe how to load data from static CSV and JSON files.
ViewFrom Spark To Databricks
In this lesson we will learn about the differences between Spark and Databricks, and the advantages of moving from Spark to Databricks.
ViewSnowflake For Data Engineers
Snowflake Accounts
Learn about the different types of Snowflake account and the choices that you need to make when creating one.
ViewSnowflake Permission Model
The Snowflake permission and Role Based Access Control model.
ViewUnderstanding Snowflake Load and Performance
Understanding Snowflake load and performance.
ViewLoading Data Into Snowflake
Batch loading data into snowflake and how to use staging areas.
ViewSnowflake Accounts
Learn about the different types of Snowflake account and the choices that you need to make when creating one.
ViewSnowflake Permission Model
The Snowflake permission and Role Based Access Control model.
ViewUnderstanding Snowflake Load and Performance
Understanding Snowflake load and performance.
ViewLoading Data Into Snowflake
Batch loading data into snowflake and how to use staging areas.
ViewDagster For Data Engineers
Datafold For Data Engineers
Apache Druid For Data Engineers
Integrating Plotly Dash With Apache Druid
Work through a scenario for integrating Plotly Dash with Apache Druid.
ViewAnomaly Detection Using Data Stored In Apache Druid
How to emit operational metrics from Druid into Apache Kafka for monitoring purposes.
ViewEmitting Druid Metrics To Kafka
How to emit operational metrics from Druid into Apache Kafka for monitoring purposes.
ViewIntegrating Plotly Dash With Apache Druid
Work through a scenario for integrating Plotly Dash with Apache Druid.
ViewAnomaly Detection Using Data Stored In Apache Druid
How to emit operational metrics from Druid into Apache Kafka for monitoring purposes.
ViewEmitting Druid Metrics To Kafka
How to emit operational metrics from Druid into Apache Kafka for monitoring purposes.
ViewIntegrating Plotly Dash With Apache Druid
Work through a scenario for integrating Plotly Dash with Apache Druid.
ViewYugabyte For Data Engineers
Introduction To Yugabyte
An introduction to Yugabyte and it's differentiating features.
ViewIntroduction To Yugabyte
An introduction to Yugabyte and it's differentiating features.
ViewDuckDB For Data Engineers
Stream Processing For Data Engineers
Stateful and Stateless Event Processing
An explanation of the two classes of event processing operators.
ViewStream Processing vs the Data Warehouse
Can stream processing be carried out in a data warehouse?
ViewBuild vs Buy For Stream Processing Platforms
Should you build or buy your stream processing platform?
ViewReal Time Stream Processing On AWS
A summary of the services which AWS offers for working with streaming data.
ViewStateful and Stateless Event Processing
An explanation of the two classes of event processing operators.
ViewStream Processing vs the Data Warehouse
Can stream processing be carried out in a data warehouse?
ViewBuild vs Buy For Stream Processing Platforms
Should you build or buy your stream processing platform?
ViewReal Time Stream Processing On AWS
A summary of the services which AWS offers for working with streaming data.
View