2024-01-18 11:24:35 +01:00
|
|
|
# Name your project! Project names should contain only lowercase characters
|
|
|
|
|
# and underscores. A good package name should reflect your organization's
|
|
|
|
|
# name or the intended use of these models
|
2024-02-22 16:14:16 +01:00
|
|
|
name: "dwh_dbt"
|
|
|
|
|
version: "1.0.0"
|
2024-01-18 11:24:35 +01:00
|
|
|
config-version: 2
|
|
|
|
|
|
|
|
|
|
# This setting configures which "profile" dbt uses for this project.
|
2024-02-22 16:14:16 +01:00
|
|
|
profile: "dwh_dbt"
|
2024-01-18 11:24:35 +01:00
|
|
|
|
|
|
|
|
# These configurations specify where dbt should look for different types of files.
|
|
|
|
|
# The `model-paths` config, for example, states that models in this project can be
|
|
|
|
|
# found in the "models/" directory. You probably won't need to change these!
|
|
|
|
|
model-paths: ["models"]
|
|
|
|
|
analysis-paths: ["analyses"]
|
|
|
|
|
test-paths: ["tests"]
|
|
|
|
|
seed-paths: ["seeds"]
|
|
|
|
|
macro-paths: ["macros"]
|
|
|
|
|
snapshot-paths: ["snapshots"]
|
|
|
|
|
|
2024-02-22 16:14:16 +01:00
|
|
|
clean-targets: # directories to be removed by `dbt clean`
|
2024-01-18 11:24:35 +01:00
|
|
|
- "target"
|
|
|
|
|
- "dbt_packages"
|
|
|
|
|
|
|
|
|
|
# Configuring models
|
|
|
|
|
# Full documentation: https://docs.getdbt.com/docs/configuring-models
|
|
|
|
|
|
|
|
|
|
# In this example config, we tell dbt to build all models in the example/
|
|
|
|
|
# directory as views. These settings can be overridden in the individual model
|
|
|
|
|
# files using the `{{ config(...) }}` macro.
|
|
|
|
|
models:
|
2024-05-10 00:31:27 +02:00
|
|
|
+unlogged: true
|
2024-01-18 11:24:35 +01:00
|
|
|
dwh_dbt:
|
2024-01-18 12:20:14 +01:00
|
|
|
staging:
|
2024-02-16 11:57:13 +01:00
|
|
|
+materialized: table
|
2024-01-18 12:20:14 +01:00
|
|
|
+schema: staging
|
2024-02-01 16:46:41 +01:00
|
|
|
intermediate:
|
2024-01-18 14:25:13 +01:00
|
|
|
+materialized: view
|
2024-02-01 16:46:41 +01:00
|
|
|
+schema: intermediate
|
2024-01-18 14:49:33 +01:00
|
|
|
reporting:
|
|
|
|
|
+materialized: table
|
2024-02-22 15:49:36 +01:00
|
|
|
+schema: reporting
|
|
|
|
|
|
2024-02-23 13:59:13 +01:00
|
|
|
seeds:
|
|
|
|
|
dwh_dbt:
|
|
|
|
|
schema: staging
|
|
|
|
|
|
2024-02-22 15:49:36 +01:00
|
|
|
vars:
|
2024-02-22 16:14:16 +01:00
|
|
|
"dbt_date:time_zone": "Europe/London"
|
2024-06-14 15:12:44 +02:00
|
|
|
# A general cutoff date for relevancy. Many models assume this to be the point
|
|
|
|
|
# in time after which they should work.
|
Merged PR 2164: Adding booking metrics by deal id for business kpis
This is a first approach to compute some easy metrics for the "deal" based business kpis. At this stage, it contains the information of bookings (created, checkout, cancelled) per deal and month, including both historic months as well as the current one. This do not contain MTD computation because it's overkill to do a MTD at deal level (+ we have 1k deals, so scalability can become a problem in the future)
Models:
- **int_dates_by_deal**: simple model that reads from **int_dates** and just joins it with **unified_users** to retrieve the deals. It will be used as the 'source of truth' for which deals should be considered in a given month, basically, since the first host associated to a deal is created (not necessarily booked)
- **int_core__monthly_booking_history_by_deal**: it contains the history of bookings per deal id in a monthly basis. It should be easy enough to integrate here, in the future and if needed, B2B macro segmentation.
In terms of performance, comparing the model **int_core__monthly_booking_history_by_deal** and **int_core__mtd_booking_metrics** you'll see that I removed the joined with the **int_dates_xxx** in the CTEs. This is because I want to avoid a double join of date & deal that I tried and I stopped after 5 min running. Since this computation is in a monthly basis - no MTD - it's easy enough to just apply the **int_dates_by_deal** on the last part of the query. With this approach, it runs in 7 seconds.
Related work items: #17689
2024-07-01 16:00:14 +00:00
|
|
|
"start_date": "'2020-01-01'"
|
|
|
|
|
|
|
|
|
|
# Booking state variables
|
|
|
|
|
# States should be strings in capital letters. Models need to force an upper()
|
2024-07-04 09:54:41 +00:00
|
|
|
"cancelled_booking_state": "'CANCELLED'"
|
|
|
|
|
|
|
|
|
|
# Payment state variables
|
|
|
|
|
# States should be strings in capital letters. Models need to force an upper()
|
|
|
|
|
"paid_payment_state": "'PAID'"
|