Course Overview
Orchestrating Data Platforms With Dagster


Lesson #6

In this lesson we will:

  • Learn about scheduling runs using Dagster;
  • Declarative scheduling.

About Schedules

Though there is a move towards continuous streaming based approaches, much of the data world still operations on periodic batch runs.

This involves running jobs on for instance an hourly or daily schedule.

Many of these jobs are scheduled using an external sheduler such as Cron.

Teams who have implemented an orchestrator such as Airflow might have moved to a more sophisticated.

Declaring A Schedule In Dagster

Schedulers are ran by the dagster-daeomon process as described in the [core concepts] lesson.

Starting and Stopping Schedules

Schedules can be turned on and off, and must be in an on state in order to run.

Next Lesson:


In this lesson we will use Dagster sensors to automate pipeline runs based on changing source data.

0h 15m

Continuous Delivery For Data Engineers

This site has been developed by the team behind Timeflow, an Open Source CI/CD platform designed for Data Engineers who use dbt as part of the Modern Data Stack. Our platform helps Data Engineers improve the quality, reliability and speed of their data transformation pipelines.

Join our mailing list for our latest insights on Data Engineering:

Timeflow Academy is the leading online, hands-on platform for learning about Data Engineering using the Modern Data Stack. Bought to you by Timeflow CI

© 2023 Timeflow Academy. All rights reserved