counterweight/data-dwh-dbt-project
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
data-dwh-dbt-project/models/intermediate/kpis
History
Oriol Roqué Paniagua d26e08bffd Merged PR 3909: Fixes created_date_utc and updated_date_utc in SH User and its dependencies 
# Description

The model `stg_core__superhog_user` contained the fields `created_date_utc` and `updated_date_utc`, which were actually timestamps, not dates. This created issues a while ago in KPIs that were fixed by forcing a date conversion at `int_kpis` level, but the source issue remained unfixed.

This PR just creates the proper fields in staging, meaning:
* `created_at_utc` and `created_date_utc`
* `updated_at_utc` and `updated_date_utc`

And propagates the changes through all dependencies. On KPIs, it also removes the hardcoded date conversion since it's no longer needed. It also adds the different schema entries on which these fields were already defined. Note I didn't update the staging entry since there's no entry for the rest of the fields.

I recommend checking this PR in the commits order.

What I've tested:
* Unified User and User Host have plenty of dependencies that I've checked one by one, at each dependency layer by using dbt docs.
* Run `core__unified_user` and the full execution of +`mtd_aggregated_metrics`

What clearly will fail:
* There's the famous `Users_dashboard` PBI report that shouldn't exist that has a dependency with `core__unified_user`. This report will fail. But it does not exist. I'd like to drop it once and forever

# Checklist

- [X] The edited models and dependants run properly with production data. **See above**
- [X] The edited models are sufficiently documented.
- [X] The edited models contain PK tests, and I've ran and passed them.
- [X] I have checked for DRY opportunities with other models and docs.
- [X] I've picked the right materialization for the affected models.

# Other

- [X] Check if a full-refresh is required after this PR is merged. **The staging model is incremental!**

Related work items: #23703
2024-12-31 08:04:03 +00:00
..
_kpis_readme.md Merged PR 3329: First version of KPIs refactored - created bookings 2024-10-30 08:55:19 +00:00
int_kpis__agg_daily_deals.sql Merged PR 3451: Adds Deal Daily Lifecycle and metrics 2024-11-07 10:49:06 +00:00
int_kpis__agg_daily_listings.sql Merged PR 3461: Creates models for listing metrics 2024-11-07 16:56:43 +00:00
int_kpis__agg_daily_new_dash_chargeable_services.sql Merged PR 3676: Hotfix - Chargeable Services - Daily Agg 2024-11-26 16:52:48 +00:00
int_kpis__agg_daily_new_dash_created_services.sql Merged PR 3654: New Dash KPIs - Chargeable Services (Revenue) 2024-11-26 10:14:37 +00:00
int_kpis__agg_dates_main_kpis.sql Merged PR 3909: Fixes created_date_utc and updated_date_utc in SH User and its dependencies 2024-12-31 08:04:03 +00:00
int_kpis__agg_monthly_billable_bookings.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_monthly_cancelled_bookings.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_monthly_check_out_bookings.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_monthly_completed_guest_journeys.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_monthly_created_bookings.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_monthly_created_guest_journeys.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_monthly_guest_journeys_with_payment.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_monthly_guest_payments.sql renamed test entity 2024-11-07 12:56:49 +01:00
int_kpis__agg_monthly_host_resolutions.sql Merged PR 3419: Adds Host Resolutions metrics in new KPIs 2024-11-05 07:45:41 +00:00
int_kpis__agg_monthly_invoiced_revenue.sql Merged PR 3431: Adds Invoicing metrics 2024-11-05 16:57:23 +00:00
int_kpis__agg_monthly_new_dash_chargeable_services.sql Merged PR 3667: Creates Chargeable metrics for New Dash KPIs 2024-11-26 14:19:41 +00:00
int_kpis__agg_monthly_new_dash_created_services.sql Merged PR 3599: New Dash KPIs skeleton with Created Services 2024-11-20 09:43:30 +00:00
int_kpis__agg_monthly_started_guest_journeys.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_mtd_billable_bookings.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_mtd_cancelled_bookings.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_mtd_check_out_bookings.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_mtd_completed_guest_journeys.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_mtd_created_bookings.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_mtd_created_guest_journeys.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_mtd_guest_journeys_with_payment.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_mtd_guest_payments.sql renamed test entity 2024-11-07 12:56:49 +01:00
int_kpis__agg_mtd_host_resolutions.sql Merged PR 3419: Adds Host Resolutions metrics in new KPIs 2024-11-05 07:45:41 +00:00
int_kpis__agg_mtd_invoiced_revenue.sql Merged PR 3431: Adds Invoicing metrics 2024-11-05 16:57:23 +00:00
int_kpis__agg_mtd_started_guest_journeys.sql aggregated to agg 2024-11-05 12:17:26 +01:00
int_kpis__agg_weekly_guest_payments.sql renamed test entity 2024-11-07 12:56:49 +01:00
int_kpis__agg_weekly_new_dash_chargeable_services.sql Merged PR 3667: Creates Chargeable metrics for New Dash KPIs 2024-11-26 14:19:41 +00:00
int_kpis__agg_weekly_new_dash_created_services.sql Merged PR 3616: Compute weekly new dash created services 2024-11-21 11:30:36 +00:00
int_kpis__dimension_daily_accommodation.sql Merged PR 3329: First version of KPIs refactored - created bookings 2024-10-30 08:55:19 +00:00
int_kpis__dimension_date_product_guest.sql Added billing_country 2024-11-26 12:36:54 +01:00
int_kpis__dimension_dates.sql Merged PR 3810: Adds is_end_of_month_or_yesterday for Main KPIs 2024-12-09 16:13:52 +00:00
int_kpis__lifecycle_daily_accommodation.sql Merged PR 3433: Change lifecycle daily to just handle last available day 2024-11-06 11:10:31 +00:00
int_kpis__lifecycle_daily_deal.sql Merged PR 3909: Fixes created_date_utc and updated_date_utc in SH User and its dependencies 2024-12-31 08:04:03 +00:00
int_kpis__metric_daily_billable_bookings.sql Merged PR 3391: Adds Check-Out, Cancelled and Billable Bookings 2024-10-31 14:31:19 +00:00
int_kpis__metric_daily_cancelled_bookings.sql Merged PR 3391: Adds Check-Out, Cancelled and Billable Bookings 2024-10-31 14:31:19 +00:00
int_kpis__metric_daily_check_in_attributed_guest_journeys.sql Changed to updated_at_utc 2024-11-19 09:23:28 +01:00
int_kpis__metric_daily_check_out_bookings.sql Merged PR 3391: Adds Check-Out, Cancelled and Billable Bookings 2024-10-31 14:31:19 +00:00
int_kpis__metric_daily_completed_guest_journeys.sql Merged PR 3379: Fixes null on dates 2024-10-30 13:33:11 +00:00
int_kpis__metric_daily_created_bookings.sql Merged PR 3329: First version of KPIs refactored - created bookings 2024-10-30 08:55:19 +00:00
int_kpis__metric_daily_created_guest_journeys.sql Merged PR 3377: Adds GJ Created, Started and Completed in new KPIs flow 2024-10-30 11:45:45 +00:00
int_kpis__metric_daily_deals.sql Merged PR 3461: Creates models for listing metrics 2024-11-07 16:56:43 +00:00
int_kpis__metric_daily_guest_journeys_with_payment.sql Merged PR 3385: Adds Guest Journey with Payment metric 2024-10-30 16:43:50 +00:00
int_kpis__metric_daily_guest_payments.sql Commit saved model 2024-11-09 15:21:20 +01:00
int_kpis__metric_daily_host_resolutions.sql Merged PR 3419: Adds Host Resolutions metrics in new KPIs 2024-11-05 07:45:41 +00:00
int_kpis__metric_daily_invoiced_revenue.sql Merged PR 3431: Adds Invoicing metrics 2024-11-05 16:57:23 +00:00
int_kpis__metric_daily_listings.sql Merged PR 3461: Creates models for listing metrics 2024-11-07 16:56:43 +00:00
int_kpis__metric_daily_new_dash_chargeable_services.sql Updated all PK in created and chargeable services models 2024-12-02 12:42:47 +01:00
int_kpis__metric_daily_new_dash_created_services.sql Updated all PK in created and chargeable services models 2024-12-02 12:42:47 +01:00
int_kpis__metric_daily_started_guest_journeys.sql Merged PR 3379: Fixes null on dates 2024-10-30 13:33:11 +00:00
int_kpis__metric_monthly_billable_bookings.sql Merged PR 3391: Adds Check-Out, Cancelled and Billable Bookings 2024-10-31 14:31:19 +00:00
int_kpis__metric_monthly_cancelled_bookings.sql Merged PR 3391: Adds Check-Out, Cancelled and Billable Bookings 2024-10-31 14:31:19 +00:00
int_kpis__metric_monthly_check_out_bookings.sql Merged PR 3391: Adds Check-Out, Cancelled and Billable Bookings 2024-10-31 14:31:19 +00:00
int_kpis__metric_monthly_completed_guest_journeys.sql Merged PR 3377: Adds GJ Created, Started and Completed in new KPIs flow 2024-10-30 11:45:45 +00:00
int_kpis__metric_monthly_created_bookings.sql Merged PR 3329: First version of KPIs refactored - created bookings 2024-10-30 08:55:19 +00:00
int_kpis__metric_monthly_created_guest_journeys.sql Merged PR 3377: Adds GJ Created, Started and Completed in new KPIs flow 2024-10-30 11:45:45 +00:00
int_kpis__metric_monthly_guest_journeys_with_payment.sql Merged PR 3385: Adds Guest Journey with Payment metric 2024-10-30 16:43:50 +00:00
int_kpis__metric_monthly_guest_payments.sql monthly and weekly metric models 2024-11-07 12:06:37 +01:00
int_kpis__metric_monthly_host_resolutions.sql Merged PR 3419: Adds Host Resolutions metrics in new KPIs 2024-11-05 07:45:41 +00:00
int_kpis__metric_monthly_invoiced_revenue.sql Merged PR 3431: Adds Invoicing metrics 2024-11-05 16:57:23 +00:00
int_kpis__metric_monthly_new_dash_chargeable_services.sql Updated all PK in created and chargeable services models 2024-12-02 12:42:47 +01:00
int_kpis__metric_monthly_new_dash_created_services.sql Updated all PK in created and chargeable services models 2024-12-02 12:42:47 +01:00
int_kpis__metric_monthly_started_guest_journeys.sql Merged PR 3377: Adds GJ Created, Started and Completed in new KPIs flow 2024-10-30 11:45:45 +00:00
int_kpis__metric_mtd_billable_bookings.sql Merged PR 3391: Adds Check-Out, Cancelled and Billable Bookings 2024-10-31 14:31:19 +00:00
int_kpis__metric_mtd_cancelled_bookings.sql Merged PR 3391: Adds Check-Out, Cancelled and Billable Bookings 2024-10-31 14:31:19 +00:00
int_kpis__metric_mtd_check_out_bookings.sql Merged PR 3391: Adds Check-Out, Cancelled and Billable Bookings 2024-10-31 14:31:19 +00:00
int_kpis__metric_mtd_completed_guest_journeys.sql Merged PR 3377: Adds GJ Created, Started and Completed in new KPIs flow 2024-10-30 11:45:45 +00:00
int_kpis__metric_mtd_created_bookings.sql Merged PR 3329: First version of KPIs refactored - created bookings 2024-10-30 08:55:19 +00:00
int_kpis__metric_mtd_created_guest_journeys.sql Merged PR 3377: Adds GJ Created, Started and Completed in new KPIs flow 2024-10-30 11:45:45 +00:00
int_kpis__metric_mtd_guest_journeys_with_payment.sql Merged PR 3385: Adds Guest Journey with Payment metric 2024-10-30 16:43:50 +00:00
int_kpis__metric_mtd_guest_payments.sql monthly and weekly metric models 2024-11-07 12:06:37 +01:00
int_kpis__metric_mtd_host_resolutions.sql Merged PR 3419: Adds Host Resolutions metrics in new KPIs 2024-11-05 07:45:41 +00:00
int_kpis__metric_mtd_invoiced_revenue.sql Merged PR 3431: Adds Invoicing metrics 2024-11-05 16:57:23 +00:00
int_kpis__metric_mtd_started_guest_journeys.sql Merged PR 3377: Adds GJ Created, Started and Completed in new KPIs flow 2024-10-30 11:45:45 +00:00
int_kpis__metric_weekly_guest_payments.sql monthly and weekly metric models 2024-11-07 12:06:37 +01:00
int_kpis__metric_weekly_new_dash_chargeable_services.sql Updated all PK in created and chargeable services models 2024-12-02 12:42:47 +01:00
int_kpis__metric_weekly_new_dash_created_services.sql Updated all PK in created and chargeable services models 2024-12-02 12:42:47 +01:00
int_kpis__product_guest_agg_metrics.sql Modified mtd filter 2024-11-27 09:52:05 +01:00
int_kpis__product_guest_daily_metrics.sql fixed model copy paste 2024-11-26 12:36:54 +01:00
int_kpis__product_new_dash_agg_metrics.sql Merged PR 3667: Creates Chargeable metrics for New Dash KPIs 2024-11-26 14:19:41 +00:00
schema.yml Merged PR 3810: Adds is_end_of_month_or_yesterday for Main KPIs 2024-12-09 16:13:52 +00:00