Commit graph

531 commits

Author SHA1 Message Date
Pablo Martin
8b91babad6 remove old table from cte 2024-06-18 11:31:59 +02:00
Pablo Martin
1f9df9ea5c remove old table 2024-06-18 11:24:03 +02:00
Pablo Martin
d96c8b2abb change which field we join on: payment date is not always informed 2024-06-18 11:23:10 +02:00
Pablo Martin
6f625ec7db do both rates to compare and test 2024-06-18 11:13:51 +02:00
Pablo Martin
e3be2708ad add new rates to CTEs 2024-06-18 11:06:27 +02:00
Oriol Roqué Paniagua
4958976733 Merged PR 2053: Added number_format category in mtd_aggregated_metrics
Added number_format category in mtd_aggregated_metrics

Related work items: #17458
2024-06-17 14:59:01 +00:00
Pablo Martín
a686c16978 Merged PR 2041: Fix Backward Currency Projection Bug
The CTEs that project currency rates backwards have a few mistakes that introduce additional dates in the period where we do have actual, factual rates. This PR fixes the errors that cause this.
2024-06-17 13:42:52 +00:00
Oriol Roqué Paniagua
484060df47 Merged PR 2046: Guest Journey KPIs
Implements the following metrics:
- Guest Journey Created
- Guest Journey Started
- Guest Journey Completed
- Guest Journey Start Rate
- Guest Journey Completion Rate
- Guest Journey Incompletion Rate

A new model, namely int_core__mtd_guest_journey_metrics have been created, that mainly reads from int_core__verification_requests and the estimated start and complete dates logic.

Metrics are integrated into the already existing mtd_aggregated_metrics. Small changes here to allow multi-source via macro.

Finally, increased documentation regarding the aggregated model and added a exposure for the main_kpis dashboard.

I also took the opportunity to include the git ignore of the new package integrated in the previous PR.

To keep in mind: no change on the dashboard applies, the metrics should appear automatically at the moment this PR is merged & production is updated with the changes

Related work items: #17311
2024-06-17 13:13:03 +00:00
uri
c8807ddf60 Adding exposure of main kpis dashboard 2024-06-17 14:04:51 +02:00
Pablo Martin
0606f2c93d go back to var, made a mistake in the last commit 2024-06-17 11:32:20 +02:00
uri
cc930c5202 Extra documentation in the int_core__mtd_aggregated_metrics model 2024-06-17 11:32:13 +02:00
Pablo Martin
1203d0921b use proper table, proper col, and remove off by one error 2024-06-17 11:31:54 +02:00
Pablo Martin
a8892e7d5d this max should have been an int 2024-06-17 11:27:44 +02:00
uri
17f2e92ddc Adding guest journey KPIs. Updating gitignore 2024-06-17 11:10:13 +02:00
Pablo Martín
f900ca794f Merged PR 2039: Simple rates
- Creates a simplified rates model that hides some of the complexities of the full blown exchange rates model.

Related work items: #17212
2024-06-14 15:33:01 +00:00
Pablo Martin
4c68df570f tests 2024-06-14 16:46:28 +02:00
Pablo Martin
913c07dad6 docs 2024-06-14 16:44:48 +02:00
Pablo Martin
84cd5ed7d0 simple model 2024-06-14 16:44:40 +02:00
Pablo Martin
fe304442a1 add dbt utils to deps 2024-06-14 16:39:07 +02:00
Pablo Martín
670cf9f30f Merged PR 2036: Create int rates table
- Creates an intermediate rates table that both uses real rates from xe.com and also make some assumptions about future and past dates.
- Also took the chance to place all orphan int models into a `cross` folder.

Related work items: #17212
2024-06-14 14:30:15 +00:00
Pablo Martin
41a7f7a510 replace hardcode with global var 2024-06-14 16:28:25 +02:00
Pablo Martin
bceb81ea18 more detail in docs 2024-06-14 16:26:18 +02:00
Pablo Martin
d4decdcd8b remove years into the future hardcode 2024-06-14 16:26:18 +02:00
Pablo Martin
2b878e9478 union all instead of union 2024-06-14 16:26:18 +02:00
Pablo Martin
e9ed1cfe02 wrong comment 2024-06-14 16:26:18 +02:00
Pablo Martin
eaeb7cb936 schema and tests for new table 2024-06-14 16:26:18 +02:00
Pablo Martin
15ec3db1f2 fixed off by one errors in date projections 2024-06-14 16:26:18 +02:00
Pablo Martin
9d11aa165b past working 2024-06-14 16:26:18 +02:00
Pablo Martin
3431f46502 little comment to explain var 2024-06-14 16:26:18 +02:00
Pablo Martin
a07a50793b ctes for first isntead of last xe rate 2024-06-14 16:26:18 +02:00
Pablo Martin
7707bc1254 compiles and runs 2024-06-14 16:26:18 +02:00
Pablo Martin
71be833123 start cross folder in int to stop piling models at int root 2024-06-14 16:26:18 +02:00
Pablo Martín
7d245a3b08 Merged PR 2037: Make XE Rates stg model incremental
make model incremental to improve performance

Related work items: #17212
2024-06-14 14:20:28 +00:00
Pablo Martin
79345a6ab7 make model incremental 2024-06-14 16:01:33 +02:00
Pablo Martín
eaf1a87ab3 Merged PR 2034: Add XE rates to staging
Ingests XE exchange rates from the new sync schema into staging.

Related work items: #17212
2024-06-14 12:30:46 +00:00
Pablo Martin
97f1c6216b fix typos 2024-06-14 14:28:26 +02:00
Pablo Martin
589656d1bf place test in proper folder 2024-06-14 14:27:20 +02:00
Pablo Martin
3a66358338 add test 2024-06-14 14:18:09 +02:00
Pablo Martin
bf97a947ed small text fixes 2024-06-14 13:24:23 +02:00
Pablo Martin
0d6e980832 documentation 2024-06-14 13:21:21 +02:00
Pablo Martin
8979f4d092 add composite key 2024-06-14 13:15:35 +02:00
Pablo Martin
7e548f5feb staging model 2024-06-14 12:21:36 +02:00
Pablo Martin
e41774e6a4 typo 2024-06-14 12:19:52 +02:00
Pablo Martin
cf0019fd20 add to sources 2024-06-14 12:18:45 +02:00
Oriol Roqué Paniagua
4f6728003a Merged PR 2029: Guest Journey - start date based on used link
Added verification estimated started at/date utc.
Ensured continuity for existing reports

I also noticed I missed one propagation of the end date, it's fixed here.

Note: changed the naming from 'start' to 'started' since we already had 'completed' and 'used_link'

Related work items: #17268
2024-06-13 14:53:58 +00:00
Oriol Roqué Paniagua
7914d7d8d7 Merged PR 2028: guest journey estimated completed date
This PR includes the logic to handle the completed date of guest journey

Check the schema file to understand the logic implemented. It's an estimation, and in some cases, weird stuff happens on end dates before link usage dates, which effectively breaks the computation. I added a boolean for this

Related work items: #17268
2024-06-13 13:30:22 +00:00
Oriol Roqué Paniagua
6b4490b017 Merged PR 2020: Verification request completeness for intermediate steps + schema documentation
Add more detailed logic into the verification request completeness for intermediate stages. Added schema documentation

Related work items: #17268
2024-06-13 08:14:11 +00:00
Joaquin Ossa
6ef278a271 Merged PR 2009: Added core__unified_user to reporting with the documentation
Added core__unified_user to reporting with the documentation for the dashboard for Ana and Clay

Related work items: #17146
2024-06-12 13:19:16 +00:00
Joaquin Ossa
c4f87d9403 Applied changes according to comments 2024-06-12 15:11:07 +02:00
Joaquin Ossa
33aac0be1a Added core__unified_user to reporting with the documentation 2024-06-12 15:11:07 +02:00