data-dwh-dbt-project/models/intermediate/core
Oriol Roqué Paniagua cf1d6e28cc Merged PR 2849: Fix: KYG lite migration with proper date migration handling
# Description

This PR fixes the New Dash migration issue that happened on September 10th 2024. In this migration, users were directly assigned the claim of KygMvp that does not contain a date value. We were using a default hardcode of the first MVP migration, thus in DWH all users have been considered to be migrated late July instead of splitting the first 22 in late July and the ~200 others in September.

The issue lies in the fact that users have configured a ProductBundle and can have Bookings with ProductBundle BEFORE the migration date, which greatly breaks the logic of a migration monitoring.

Changes:
* New migration phase added based on the claim MvpMigratedUser, that Ben created on Friday 13th
* Adaptation of the code in int_core__user_migration to detect if the claim_value (a text field) has a date or not. If so, use that date as long as it's equal or greater than the deployment date, if not use the deployment date. If the claim does not contain a date, use the deployment date (this is the case for the first true 22 migrated users)

I checked that volumes now look correct with this fix.

# Checklist

- [X] The edited models and dependants run properly with production data.
- [X] The edited models are sufficiently documented.
- [X] The edited models contain PK tests, and I've ran and passed them.
- [X] I have checked for DRY opportunities with other models and docs.
- [X] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Related work items: #20773
2024-09-16 07:57:41 +00:00
..
int_core__accommodation.sql Merged PR 2125: Fixing accommodation host 2024-06-26 14:47:15 +00:00
int_core__accommodation_to_product_bundle.sql Merged PR 2652: Adds accommodation to product bundle in intermediate 2024-08-27 14:05:24 +00:00
int_core__address_validations.sql Removed coalesce so it includes NULL for failed validations 2024-08-20 09:49:34 +02:00
int_core__booking_charge_events.sql Merged PR 2642: Booking Charge Events to have a similar logic as invoicing 2024-09-03 13:15:40 +00:00
int_core__booking_to_product_bundle.sql Merged PR 2650: Added int_core__booking_to_product_bundle in intermediate 2024-08-27 12:51:55 +00:00
int_core__bookings.sql Thanks Uri for the catch, then when id_user_guest is NULL it won't be considered a duplicate. 2024-07-31 16:23:27 +02:00
int_core__check_in_cover_listings.sql fixed testing for core__check_in_cover_listings 2024-08-28 10:47:31 +02:00
int_core__check_in_cover_prices.sql propagating renames 2024-05-08 12:03:44 +02:00
int_core__check_in_cover_users.sql Merged PR 2201: Fixing errors raised by texts 2024-07-05 15:12:04 +00:00
int_core__country.sql Merged PR 2077: Adding Country to intermediate 2024-06-19 15:34:15 +00:00
int_core__deal.sql First version of name unification for a deal 2024-09-06 17:08:50 +02:00
int_core__duplicate_bookings.sql Thanks Uri for the catch, then when id_user_guest is NULL it won't be considered a duplicate. 2024-07-31 16:23:27 +02:00
int_core__guest_satisfaction_responses.sql remove explicit version reference, rely on latest 2024-09-13 15:20:39 +02:00
int_core__host_booking_fees.sql Merged PR 2725: Force id user field to lower in staging 2024-09-03 14:36:21 +00:00
int_core__invoicing_price_plans_per_month.sql Merged PR 2642: Booking Charge Events to have a similar logic as invoicing 2024-09-03 13:15:40 +00:00
int_core__monthly_accommodation_history_by_deal.sql Merged PR 2172: Adding accommodation metrics by deal id 2024-07-02 09:32:52 +00:00
int_core__monthly_booking_history_by_deal.sql Merged PR 2825: Propagates deal Name and Billing Country in int_monthly_aggregated_metrics_history_by_deal 2024-09-12 12:04:04 +00:00
int_core__monthly_guest_journey_history_by_deal.sql remove explicit version reference, rely on latest 2024-09-13 15:20:39 +02:00
int_core__monthly_guest_payments_history_by_deal.sql remove explicit version reference, rely on latest 2024-09-13 15:20:39 +02:00
int_core__mtd_accommodation_lifecycle.sql Merged PR 2125: Fixing accommodation host 2024-06-26 14:47:15 +00:00
int_core__mtd_accommodation_metrics.sql Merged PR 2743: Fixes deal-based issues on the billing country dimension 2024-09-05 09:53:16 +00:00
int_core__mtd_accommodation_segmentation.sql Merged PR 2615: Beautification of KPIs dimensions 2024-08-21 14:42:05 +00:00
int_core__mtd_booking_metrics.sql comment a bit more 2024-09-09 12:31:34 +02:00
int_core__mtd_deal_lifecycle.sql Merged PR 2825: Propagates deal Name and Billing Country in int_monthly_aggregated_metrics_history_by_deal 2024-09-12 12:04:04 +00:00
int_core__mtd_deal_metrics.sql Merged PR 2743: Fixes deal-based issues on the billing country dimension 2024-09-05 09:53:16 +00:00
int_core__mtd_guest_journey_metrics.sql remove explicit version reference, rely on latest 2024-09-13 15:20:39 +02:00
int_core__mtd_guest_payments_metrics.sql remove explicit version reference, rely on latest 2024-09-13 15:20:39 +02:00
int_core__new_dash_user_overview.sql Merged PR 2662: New Dash MVP - with. fix on production issue 2024-08-28 10:09:08 +00:00
int_core__price_plans.sql docs and moving stuff 2024-04-08 09:44:32 +02:00
int_core__unified_user.sql Merged PR 2676: Propagates Billing Country information 2024-08-29 08:25:05 +00:00
int_core__unique_accommodation_to_user.sql Merged PR 2125: Fixing accommodation host 2024-06-26 14:47:15 +00:00
int_core__user_host.sql Merged PR 2743: Fixes deal-based issues on the billing country dimension 2024-09-05 09:53:16 +00:00
int_core__user_migration.sql Merged PR 2849: Fix: KYG lite migration with proper date migration handling 2024-09-16 07:57:41 +00:00
int_core__user_product_bundle.sql Merged PR 2636: First version of User Product Bundle 2024-08-26 09:18:56 +00:00
int_core__user_role.sql Merged PR 2516: Create host_user and user_role in intermediate 2024-08-07 14:28:34 +00:00
int_core__verification_payments.sql v1 goes back to original state 2024-09-13 15:20:39 +02:00
int_core__verification_payments_v2.sql replace hardcode with variable 2024-09-13 15:21:22 +02:00
int_core__verification_request_booking_source.sql Removed guests_id and modified query structure 2024-07-11 16:49:24 +02:00
int_core__verification_request_completed_date.sql Merged PR 2028: guest journey estimated completed date 2024-06-13 13:30:22 +00:00
int_core__verification_request_completeness.sql Merged PR 2020: Verification request completeness for intermediate steps + schema documentation 2024-06-13 08:14:11 +00:00
int_core__verification_requests.sql Added the new field to int_core__bookings and to int_core__verification_requests 2024-07-11 17:16:51 +02:00
int_core__vr_check_in_cover.sql remove explicit version reference, rely on latest 2024-09-13 15:20:39 +02:00
schema.yml replace custom generic test with standard range between one 2024-09-13 15:21:22 +02:00