data-dwh-dbt-project/macros
Oriol Roqué Paniagua 070d067709 Merged PR 2918: Integrates screening API verifications into DWH staging
# Description

This PR integrates screening API verifications into staging.

There's 2 commits:
* The earliest one, it just copy-pastes the strategy followed by edeposit and adapts it to fit screening API case, which is simpler. Note here that the schema entries contain a low number of tests. This is because we only have 7 records in production - and these seem fake anyway :) - so it's complex to extrapolate. Those I could extrapolate (NoFlags/Flagged) I'm taking from the data transformation within the PBI report.
* The last commit, it's just a DRY. It handles the deduplication logic for cosmos db in a macro, and I applied it on both the screening API and the edeposit verifications. Works well from my POV.

Since you guys are far more knowledgeable on APIs scope, I'll let you take a close look in case I missed something.

# Checklist

- [X] The edited models and dependants run properly with production data.
- [ ] The edited models are sufficiently documented. **I guess it can be improved, waiting for your comments here**
- [X] The edited models contain PK tests, and I've ran and passed them.
- [X] I have checked for DRY opportunities with other models and docs.
- [ ] I've picked the right materialization for the affected models. **Used default coming from stg_edeposit__verifications**

# Other

- [ ] Check if a full-refresh is required after this PR is merged.

Related work items: #20127
2024-09-25 10:52:50 +00:00
..
tests Adding new column test: latest_date_is_yesterday 2024-09-06 09:13:27 +02:00
.gitkeep start project 2024-01-18 11:24:35 +01:00
business_kpis_configuration.sql Fix config - again 2024-09-05 16:34:17 +02:00
calculate_safe_relative_increment.sql Merged PR 2232: KPI refactor - 1st step, bookings 2024-07-08 15:58:36 +00:00
cosmos_db_utils.sql DRY on stg cosmos db models 2024-09-19 15:17:33 +02:00
generate_schema_name.sql macros docs 2024-05-22 11:42:42 +02:00
generate_stripe_sources_unioned_select.sql Create macro and use it in balance transactions 2024-03-05 13:33:13 +01:00
is_date_before_previous_month.sql Merged PR 2257: Expose guest revenue and guest journey payment metrics 2024-07-10 14:17:05 +00:00
user_migration_configuration.sql Merged PR 2920: Adapt user migration configuration to take into account V2 migrated users 2024-09-20 10:42:12 +00:00