Hands On Training For Data Engineers
Timeflow Academy is an online, hands-on platform for learning about Data Engineering using open source and leading cloud native platforms including DBT, Clickhouse, Snowflake, Kafka, Spark and Airflow.
Bought to you by Timeflow Systems
DBT For Data Engineers
Incremental Updates
In this lesson we will learn abuout DBT incremental updates.
View lessonsIntroduction To DBT
In this section we will introduce DBT, explain the value it brings and explain some of the core concepts.
View lessonsCreating A DBT Project
In this lesson we will begin using the DBT Command Line Interface. We will then create and configure our first DBT project.
View lessonsConfiguring DBT Profiles
In this lesson we will learn more about the DBT profile system and best practices for managing profiles for maintainable code.
View lessonsExecuting Your First Transformations
In this lesson we will implement and run our first transformations using DBT models that build both tables and views.
View lessonsDBT Views and Tables
In this lesson we will learn how DBT materialsies data into tables and views and how to configure them.
View lessonsIncremental Updates
In this lesson we will learn abuout DBT incremental updates.
View lessonsIntroduction To DBT
In this section we will introduce DBT, explain the value it brings and explain some of the core concepts.
View lessonsCreating A DBT Project
In this lesson we will begin using the DBT Command Line Interface. We will then create and configure our first DBT project.
View lessonsConfiguring DBT Profiles
In this lesson we will learn more about the DBT profile system and best practices for managing profiles for maintainable code.
View lessonsExecuting Your First Transformations
In this lesson we will implement and run our first transformations using DBT models that build both tables and views.
View lessonsDBT Views and Tables
In this lesson we will learn how DBT materialsies data into tables and views and how to configure them.
View lessonsIncremental Updates
In this lesson we will learn abuout DBT incremental updates.
View lessonsKafka For Data Engineers
Kafka Performance Test Scripts
In this lesson we will learn about the Kafka performance test scripts, which can be used for measuring the performance of your Kafka deployment for both producers and consumers.
View lessonsIntroduction To Kafka
Introduction to Apache Kafka including some of the core concepts and use cases.
View lessonsSetting Up Your Kafka Broker
In this lesson we will setup our Kafka broker in standalone mode.
View lessonsAdministering Kafka Topics
In this lesson we will learn about Kafka Topics, including what they are and how to configure and optimise them.
View lessonsKafka Partitions
In this lesson we will learn about Kafka partitions, which are the one of the main ways in which we can improve parallelism and therefore performance of your Kafka deployment.
View lessonsKafka Consumer Groups
In this lesson we will learn about Kafka Consumer Groups, including how to configure them and some of the relevant parameters.
View lessonsKafka Performance Test Scripts
In this lesson we will learn about the Kafka performance test scripts, which can be used for measuring the performance of your Kafka deployment for both producers and consumers.
View lessonsIntroduction To Kafka
Introduction to Apache Kafka including some of the core concepts and use cases.
View lessonsSetting Up Your Kafka Broker
In this lesson we will setup our Kafka broker in standalone mode.
View lessonsAdministering Kafka Topics
In this lesson we will learn about Kafka Topics, including what they are and how to configure and optimise them.
View lessonsKafka Partitions
In this lesson we will learn about Kafka partitions, which are the one of the main ways in which we can improve parallelism and therefore performance of your Kafka deployment.
View lessonsKafka Consumer Groups
In this lesson we will learn about Kafka Consumer Groups, including how to configure them and some of the relevant parameters.
View lessonsKafka Performance Test Scripts
In this lesson we will learn about the Kafka performance test scripts, which can be used for measuring the performance of your Kafka deployment for both producers and consumers.
View lessonsClickhouse For Data Engineers
Materialised Views
In this lesson we will introduce materialised views, and demonstrate how they are more powerful than materialsied views as implemented by other databases.
View lessonsIntroduction To Clickhouse
In this lesson we will introduce Clickhouse and cover it's distinctive features.
View lessonsConnecting To Clickhouse
In this lesson we will connect to Clickhouse, and learn about the different deployment options.
View lessonsAdministering Database Objects
In this lesson we will learn about some of the core database objects in Clickhouse.
View lessonsClickhouse Role Based Access Control (RBAC)
In this lesson we will look at the Clickhouse users, role and permission model
View lessonsConnecting Clickhouse To Kafka
In this lesson we will learn how to connect Clickhouse to Kafka to ingest in real time streams of messages.
View lessonsMaterialised Views
In this lesson we will introduce materialised views, and demonstrate how they are more powerful than materialsied views as implemented by other databases.
View lessonsIntroduction To Clickhouse
In this lesson we will introduce Clickhouse and cover it's distinctive features.
View lessonsConnecting To Clickhouse
In this lesson we will connect to Clickhouse, and learn about the different deployment options.
View lessonsAdministering Database Objects
In this lesson we will learn about some of the core database objects in Clickhouse.
View lessonsClickhouse Role Based Access Control (RBAC)
In this lesson we will look at the Clickhouse users, role and permission model
View lessonsConnecting Clickhouse To Kafka
In this lesson we will learn how to connect Clickhouse to Kafka to ingest in real time streams of messages.
View lessonsMaterialised Views
In this lesson we will introduce materialised views, and demonstrate how they are more powerful than materialsied views as implemented by other databases.
View lessonsSnowflake For Data Engineers
Referential Integrity In Snowflake
In this lesson we will learn about referential integrity in Snowflake.
View lessonsIntroduction To Snowflake
In this lesson we will introduce Snowflake and describe some of it's key differentiators and architectural features.
View lessonsSnowflake Accounts
In this lesson we will learn about the different types of Snowflake account and the choices that you need to make.
View lessonsPermission Model
In this lesson we will learn about Snowflake billing.
View lessonsSnowflake Streams
In this lesson we will learn about snowflake streams, which allow us to resopnd to database DML statements.
View lessonsSnowflake Tasks
In this lesson we will learn about Snowflake tasks, which allow us to run database jobs on a schedule.
View lessonsLoading Data Into Snowflake
In this lesson we will learn about batch loading data into snowflake and how to use staging areas.
View lessonsReferential Integrity In Snowflake
In this lesson we will learn about referential integrity in Snowflake.
View lessonsIntroduction To Snowflake
In this lesson we will introduce Snowflake and describe some of it's key differentiators and architectural features.
View lessonsSnowflake Accounts
In this lesson we will learn about the different types of Snowflake account and the choices that you need to make.
View lessonsPermission Model
In this lesson we will learn about Snowflake billing.
View lessonsSnowflake Streams
In this lesson we will learn about snowflake streams, which allow us to resopnd to database DML statements.
View lessonsSnowflake Tasks
In this lesson we will learn about Snowflake tasks, which allow us to run database jobs on a schedule.
View lessonsLoading Data Into Snowflake
In this lesson we will learn about batch loading data into snowflake and how to use staging areas.
View lessonsReferential Integrity In Snowflake
In this lesson we will learn about referential integrity in Snowflake.
View lessons