Commit graph

1289 commits

Author SHA1 Message Date
uri
c3d75bb143 Differentiate exposures 2024-12-09 17:22:16 +01:00
Oriol Roqué Paniagua
06603d01e2 Merged PR 3810: Adds is_end_of_month_or_yesterday for Main KPIs
# Description

Adds `is_end_of_month_or_yesterday` for Main KPIs.
Apparently, the fact that we do not show the ongoing value of the month on some tabs of Main KPIs is the main blocker for Ben C to consistently use Main KPIs, which he actually retrieves from the SH legacy reporting. Since I'm sceptical about the data shown there, I want to remove this blocker.
It will require a small PR on PBI as well.

# Checklist

- [X] The edited models and dependants run properly with production data.
- [X] The edited models are sufficiently documented.
- [X] The edited models contain PK tests, and I've ran and passed them.
- [X] I have checked for DRY opportunities with other models and docs.
- [NA] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Related work items: #25342
2024-12-09 16:13:52 +00:00
Joaquin Ossa
8586dc2aec Merged PR 3802: exposures update
# Description

Exposures update of new Screen & Protect report

# Checklist

- [ ] The edited models and dependants run properly with production data.
- [ ] The edited models are sufficiently documented.
- [ ] The edited models contain PK tests, and I've ran and passed them.
- [ ] I have checked for DRY opportunities with other models and docs.
- [ ] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

exposures update

Related work items: #25244
2024-12-09 13:54:33 +00:00
Joaquin Ossa
dfd7e50edd Changed it to API Reports and added E-Deposit Verifications 2024-12-09 11:12:37 +01:00
Joaquin Ossa
be6e87efb1 exposures update 2024-12-09 09:20:15 +01:00
uri
0c82a9592d Remove accepted values test from service status in stg_core__booking_view_to_service 2024-12-04 16:49:07 +01:00
Joaquin Ossa
32f1dd68a1 Merged PR 3775: Final clarifications
# Description

A few changes on some fields I got clarified, some of the protection amount fields are used for some types of protections.
Also verified the difference between created date and creation date (Cosmos value)

# Checklist

- [x] The edited models and dependants run properly with production data.
- [x] The edited models are sufficiently documented.
- [x] The edited models contain PK tests, and I've ran and passed them.
- [ ] I have checked for DRY opportunities with other models and docs.
- [ ] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Final clarifications

Related work items: #25243
2024-12-04 15:42:14 +00:00
Joaquin Ossa
1f683ec651 Final clarifications 2024-12-04 16:33:50 +01:00
Joaquin Ossa
0b6612f25b Merged PR 3771: Intermediate and reporting models
# Description

Intermediate and reporting models for Screen and Protect verifications.
Added a field I missed before, ProtectionType

# Checklist

- [x] The edited models and dependants run properly with production data.
- [x] The edited models are sufficiently documented.
- [x] The edited models contain PK tests, and I've ran and passed them.
- [ ] I have checked for DRY opportunities with other models and docs.
- [ ] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

intermediate and reporting models

Related work items: #25243
2024-12-04 13:51:03 +00:00
Joaquin Ossa
2a19f1d19a Added ProtectionType 2024-12-04 14:36:49 +01:00
Joaquin Ossa
c8ee8bd456 intermediate and reporting models 2024-12-04 11:15:21 +01:00
Joaquin Ossa
fba05c5dd3 Merged PR 3763: Staging model for S&P
# Description

Staging model for S&P
What do you think of the name of both the folder and model, I would prefer to leave it as `screen&protect` instead of `screen_and_protect` what do you think??

# Checklist

- [x] The edited models and dependants run properly with production data.
- [x] The edited models are sufficiently documented.
- [x] The edited models contain PK tests, and I've ran and passed them.
- [x] I have checked for DRY opportunities with other models and docs.
- [ ] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Staging model for S&P

Related work items: #25209
2024-12-04 09:59:51 +00:00
Joaquin Ossa
588e94ed7c Upper cased 2024-12-04 10:59:13 +01:00
Oriol Roqué Paniagua
616b949ba4 Merged PR 3769: Adds int_core__ab_test_monitoring_guest_journey
# Description

Adds a table that contain the main information needed for metric computation at verification request level that is part of an A/B test.

# Checklist

- [X] The edited models and dependants run properly with production data.
- [X] The edited models are sufficiently documented.
- [X] The edited models contain PK tests, and I've ran and passed them.
- [NA] I have checked for DRY opportunities with other models and docs.
- [X] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Related work items: #25146
2024-12-04 09:45:09 +00:00
Oriol Roqué Paniagua
37c508fa69 Merged PR 3766: First version of ab_test_tracking_guest_journey
# Description

A very simple, clean table to get the records needed for A/B test tracking on GJ side.

The table already removes weird cases that are somehow usual within A/B test configurations, to ensure that the monitoring is as clean (and less biased) as possible.

# Checklist

- [X] The edited models and dependants run properly with production data.
- [X] The edited models are sufficiently documented.
- [X] The edited models contain PK tests, and I've ran and passed them.
- [X] I have checked for DRY opportunities with other models and docs.
- [X] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Related work items: #25145
2024-12-04 07:58:14 +00:00
Oriol Roqué Paniagua
896526fe15 Merged PR 3761: Remove no longer existing fields from Accommodation
# Description

This PR aims to properly fix the Accommodation removal of fields that have been dropped today.

# Checklist

- [X] The edited models and dependants run properly with production data.
- [NA] The edited models are sufficiently documented.
- [X] The edited models contain PK tests, and I've ran and passed them.
- [NA] I have checked for DRY opportunities with other models and docs.
- [NA] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Related work items: #25199
2024-12-03 16:39:05 +00:00
Joaquin Ossa
d5f0db71fd Staging model for S&P 2024-12-03 17:29:37 +01:00
Oriol Roqué Paniagua
e8f7278032 Merged PR 3756: First version of verification request feature flag
# Description

Brings VerificationRequestFeatureFlag to staging. Needs further modelling to clean data for A/B test tracking purposes, but this will be done in intermediate.

# Checklist

- [X] The edited models and dependants run properly with production data.
- [X] The edited models are sufficiently documented.
- [X] The edited models contain PK tests, and I've ran and passed them.
- [X] I have checked for DRY opportunities with other models and docs.
- [X] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Related work items: #25145
2024-12-03 16:01:23 +00:00
Oriol Roqué Paniagua
62e1b6ea3b Merged PR 3752: Adds new PROTECTED accepted value for new pricing services
# Description

Adds Protected accepted value - linked to new services after New Dash v3 launch

# Checklist

- [NA] The edited models and dependants run properly with production data.
- [NA] The edited models are sufficiently documented.
- [X] The edited models contain PK tests, and I've ran and passed them.
- [NA] I have checked for DRY opportunities with other models and docs.
- [NA] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Adds new PROTECTED accepted value for new pricing services
2024-12-03 13:36:24 +00:00
Oriol Roqué Paniagua
c5b7d919c5 Merged PR 3743: Hotfix for staging core accommodation
# Description

Fixes dbt execution after 2 fields in use were dropped in the backend.

# Checklist

- [X] The edited models and dependants run properly with production data.
- [NA] The edited models are sufficiently documented.
- [X] The edited models contain PK tests, and I've ran and passed them.
- [NA] I have checked for DRY opportunities with other models and docs.
- [NA] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Related work items: #25196
2024-12-03 11:26:52 +00:00
Joaquin Ossa
7ef6fb3031 Merged PR 3740: Added missing values
# Description

Hardcoded the nigthly_fee for Guesty verifications and added some missing fields on the models.
There are some fields that are only `NULL` values for each of the verifications but I included them for the sake of the union

# Checklist

- [x] The edited models and dependants run properly with production data.
- [x] The edited models are sufficiently documented.
- [x] The edited models contain PK tests, and I've ran and passed them.
- [ ] I have checked for DRY opportunities with other models and docs.
- [ ] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Added missing values

Related work items: #24825
2024-12-03 11:11:17 +00:00
Joaquin Ossa
1af03e2b42 included id_accommodation 2024-12-03 11:58:42 +01:00
Joaquin Ossa
63b3cae062 Removed null fields 2024-12-03 11:35:03 +01:00
Joaquin Ossa
4d0c45e49d updated schemas 2024-12-03 10:46:01 +01:00
Joaquin Ossa
5e17ca93a7 Included level of protection 2024-12-03 10:42:03 +01:00
Joaquin Ossa
d6f30a8e67 Added missing values 2024-12-03 10:37:05 +01:00
Oriol Roqué Paniagua
7a987d92c4 Merged PR 3731: Add 1e-6 threshold in kpis_additive_metrics_per_dimension_are_consistent
# Description

Add 1e-6 threshold in kpis_additive_metrics_per_dimension_are_consistent. This should fix the issue on churn rate metrics that are rounded to this precision

# Checklist

- [X] The edited models and dependants run properly with production data. Only tried the test.
- [ ] The edited models are sufficiently documented.
- [X] The edited models contain PK tests, and I've ran and passed them.
- [ ] I have checked for DRY opportunities with other models and docs.
- [ ] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Related work items: #25075
2024-12-02 17:00:52 +00:00
Joaquin Ossa
4c7820608a Merged PR 3698: added service_business_type to new_dash_created_services models
# Description

Added service_business_type to new_dash_created_services models.
Points to check on the chargeable_services models:
- I think it also needs to account for `UNKNOWN` values
- Adding the service_business_type to the unique test on the weekly and monthly metric models

```
case
    when icbsd.service_business_type = 'UNKNOWN'
    then 'UNSET'
    else coalesce(icbsd.service_business_type, 'UNSET')
end as service_business_type
```
@<Oriol Roqué Paniagua> Let me know what you think and I can make the changes if needed

# Checklist

- [x] The edited models and dependants run properly with production data.
- [x] The edited models are sufficiently documented.
- [x] The edited models contain PK tests, and I've ran and passed them.
- [ ] I have checked for DRY opportunities with other models and docs.
- [ ] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

added service_business_type to new_dash_created_services models

Related work items: #24767
2024-12-02 11:53:48 +00:00
Joaquin Ossa
7e8e403dec Updated all PK in created and chargeable services models 2024-12-02 12:42:47 +01:00
Joaquin Ossa
6d2ca174f8 Merged PR 3723: Added total fee cost of booking
# Description

Added total fee cost of booking

# Checklist

- [x] The edited models and dependants run properly with production data.
- [x] The edited models are sufficiently documented.
- [x] The edited models contain PK tests, and I've ran and passed them.
- [ ] I have checked for DRY opportunities with other models and docs.
- [ ] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Added total fee cost of booking

Related work items: #24825
2024-12-02 10:53:59 +00:00
Joaquin Ossa
3015c12e18 updated schema 2024-12-02 11:14:34 +01:00
Joaquin Ossa
62893d77fc fixing the rebase 2024-12-02 11:07:34 +01:00
Joaquin Ossa
54df02cac8 Addressed comments 2024-12-02 11:06:09 +01:00
Joaquin Ossa
b03982b708 Added total fee cost of booking 2024-12-02 08:44:24 +01:00
Joaquin Ossa
126e702c6e Merged PR 3706: model to reporting
# Description

Verifications model to reporting
I created a new folder `cross` for this model in reporting

# Checklist

- [x] The edited models and dependants run properly with production data.
- [x] The edited models are sufficiently documented.
- [x] The edited models contain PK tests, and I've ran and passed them.
- [x] I have checked for DRY opportunities with other models and docs.
- [x] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

model to reporting

Related work items: #24825
2024-11-29 11:48:38 +00:00
Joaquin Ossa
1c9bb5ec31 model to reporting 2024-11-29 11:24:57 +01:00
Joaquin Ossa
23dbf3c97a Merged PR 3705: APIs verifications
# Description

Cross model to unite Edeposit and Guesty verifications

# Checklist

- [x] The edited models and dependants run properly with production data.
- [x] The edited models are sufficiently documented.
- [x] The edited models contain PK tests, and I've ran and passed them.
- [x] I have checked for DRY opportunities with other models and docs.
- [x] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Related work items: #24825
2024-11-29 10:04:26 +00:00
Joaquin Ossa
edbeac253c Name change 2024-11-29 11:03:59 +01:00
Joaquin Ossa
c6a03d531a Cleaned commit 2024-11-29 10:06:15 +01:00
Joaquin Ossa
4e6690c013 API verifications model 2024-11-29 09:59:35 +01:00
Joaquin Ossa
07038e8c18 added service_business_type to new_dash_created_services models 2024-11-28 16:12:02 +01:00
Joaquin Ossa
c3fedec0f9 Merged PR 3686: Update exposures
# Description

Update exposures on Guest KPIs Report

# Checklist

- [ ] The edited models and dependants run properly with production data.
- [ ] The edited models are sufficiently documented.
- [ ] The edited models contain PK tests, and I've ran and passed them.
- [ ] I have checked for DRY opportunities with other models and docs.
- [ ] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Update exposures

Related work items: #24604
2024-11-27 16:43:07 +00:00
Joaquin Ossa
fc2ee14acb Update exposures 2024-11-27 16:29:19 +01:00
Pablo Martín
9dcfbd6fd2 Merged PR 3682: Remove unused accommodation fields
# Description

Dash squad is going to remove four fields from the `Accommodation` table in SQL Server. We are removing them from the project as well to avoid errors. The removal is painless because we weren't really using them for anything important, they were simply brought as part of the `Accommodation` table.

# Checklist

- [X] The edited models and dependants run properly with production data.
- [X] The edited models are sufficiently documented.
- [X] The edited models contain PK tests, and I've ran and passed them.
- [X] I have checked for DRY opportunities with other models and docs.
- [X] I've picked the right materialization for the affected models.

# Other

- [X] Check if a full-refresh is required after this PR is merged.
2024-11-27 14:05:44 +00:00
Pablo Martin
ff2079a0c6 remove fields from docs 2024-11-27 14:47:43 +01:00
Pablo Martin
f460a47833 remove fields from stg 2024-11-27 14:46:41 +01:00
Pablo Martin
878e2e81b6 remove fields from int 2024-11-27 14:46:03 +01:00
Joaquin Ossa
fd7a993085 Merged PR 3678: Changed filters
# Description

Changed filters on the calculation of the aggregated metrics.
There was an issue before with the filter for the yearly metrics and I modified the ones for monthly as well to help with performance.

# Checklist

- [x] The edited models and dependants run properly with production data.
- [x] The edited models are sufficiently documented.
- [x] The edited models contain PK tests, and I've ran and passed them.
- [ ] I have checked for DRY opportunities with other models and docs.
- [ ] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Changed filters

Related work items: #24604
2024-11-27 08:58:52 +00:00
Joaquin Ossa
f38696f3a3 Merged PR 3677: fixed test
# Description

Fixed test to detect outliers in kpis daily metric models

# Checklist

- [x] The edited models and dependants run properly with production data.
- [x] The edited models are sufficiently documented.
- [x] The edited models contain PK tests, and I've ran and passed them.
- [ ] I have checked for DRY opportunities with other models and docs.
- [ ] I've picked the right materialization for the affected models.

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

fixed test

Related work items: #24590
2024-11-27 08:58:46 +00:00
Joaquin Ossa
80f42d5426 Modified mtd filter 2024-11-27 09:52:05 +01:00