In this lesson we will:

  • Learn about the DBT ethemeral views feature.

What Are Ephemeral Views?

DBT executes it's transformations as a series of chained operations represented by a Directed Acyclic Graph (DAG).

For each of the intermediate and final steps of this chain of operations, we can choose how to materialise the results. Typically people will choose between tables and views.

As DBT executes the operations, each of the tables and views will be generated in the database. If they are tables, they of course would require storage. If they are views, the object will simply be created in the database on top of the underlying data.

There are many cases where we would prefer our data consumers do not use these intermediate objects. Perhaps they are likely to change, or contain data in a structure which is in some way not ready or appropriate for consumption.

Ethemeral views can be useful in this situation, as they are not actually created in the database.

The Ethemeral view allows us to represent some intermediate concept in our transformation logic, but it is never actually created in the database. Instead, DBT will interpolate the query so that it is used.

Next Lesson:
12

Sources and Exposures

In this lesson we will learn about DBTs source and exposure features to capture better metadata regarding your pipelines.

0h 15m



Continuous Delivery For Data Engineers

This site has been developed by the team behind Timeflow, an Open Source CI/CD platform designed for Data Engineers who use dbt as part of the Modern Data Stack. Our platform helps Data Engineers improve the quality, reliability and speed of their data transformation pipelines.

Join our mailing list for our latest insights on Data Engineering:

Timeflow Academy is the leading online, hands-on platform for learning about Data Engineering using the Modern Data Stack. Bought to you by Timeflow CI

© 2023 Timeflow Academy. All rights reserved