Commit graph

509 commits

Author SHA1 Message Date
Pablo Martin
d4decdcd8b remove years into the future hardcode 2024-06-14 16:26:18 +02:00
Pablo Martin
2b878e9478 union all instead of union 2024-06-14 16:26:18 +02:00
Pablo Martin
e9ed1cfe02 wrong comment 2024-06-14 16:26:18 +02:00
Pablo Martin
eaeb7cb936 schema and tests for new table 2024-06-14 16:26:18 +02:00
Pablo Martin
15ec3db1f2 fixed off by one errors in date projections 2024-06-14 16:26:18 +02:00
Pablo Martin
9d11aa165b past working 2024-06-14 16:26:18 +02:00
Pablo Martin
3431f46502 little comment to explain var 2024-06-14 16:26:18 +02:00
Pablo Martin
a07a50793b ctes for first isntead of last xe rate 2024-06-14 16:26:18 +02:00
Pablo Martin
7707bc1254 compiles and runs 2024-06-14 16:26:18 +02:00
Pablo Martin
71be833123 start cross folder in int to stop piling models at int root 2024-06-14 16:26:18 +02:00
Pablo Martín
7d245a3b08 Merged PR 2037: Make XE Rates stg model incremental
make model incremental to improve performance

Related work items: #17212
2024-06-14 14:20:28 +00:00
Pablo Martin
79345a6ab7 make model incremental 2024-06-14 16:01:33 +02:00
Pablo Martín
eaf1a87ab3 Merged PR 2034: Add XE rates to staging
Ingests XE exchange rates from the new sync schema into staging.

Related work items: #17212
2024-06-14 12:30:46 +00:00
Pablo Martin
97f1c6216b fix typos 2024-06-14 14:28:26 +02:00
Pablo Martin
589656d1bf place test in proper folder 2024-06-14 14:27:20 +02:00
Pablo Martin
3a66358338 add test 2024-06-14 14:18:09 +02:00
Pablo Martin
bf97a947ed small text fixes 2024-06-14 13:24:23 +02:00
Pablo Martin
0d6e980832 documentation 2024-06-14 13:21:21 +02:00
Pablo Martin
8979f4d092 add composite key 2024-06-14 13:15:35 +02:00
Pablo Martin
7e548f5feb staging model 2024-06-14 12:21:36 +02:00
Pablo Martin
e41774e6a4 typo 2024-06-14 12:19:52 +02:00
Pablo Martin
cf0019fd20 add to sources 2024-06-14 12:18:45 +02:00
Oriol Roqué Paniagua
4f6728003a Merged PR 2029: Guest Journey - start date based on used link
Added verification estimated started at/date utc.
Ensured continuity for existing reports

I also noticed I missed one propagation of the end date, it's fixed here.

Note: changed the naming from 'start' to 'started' since we already had 'completed' and 'used_link'

Related work items: #17268
2024-06-13 14:53:58 +00:00
Oriol Roqué Paniagua
7914d7d8d7 Merged PR 2028: guest journey estimated completed date
This PR includes the logic to handle the completed date of guest journey

Check the schema file to understand the logic implemented. It's an estimation, and in some cases, weird stuff happens on end dates before link usage dates, which effectively breaks the computation. I added a boolean for this

Related work items: #17268
2024-06-13 13:30:22 +00:00
Oriol Roqué Paniagua
6b4490b017 Merged PR 2020: Verification request completeness for intermediate steps + schema documentation
Add more detailed logic into the verification request completeness for intermediate stages. Added schema documentation

Related work items: #17268
2024-06-13 08:14:11 +00:00
Joaquin Ossa
6ef278a271 Merged PR 2009: Added core__unified_user to reporting with the documentation
Added core__unified_user to reporting with the documentation for the dashboard for Ana and Clay

Related work items: #17146
2024-06-12 13:19:16 +00:00
Joaquin Ossa
c4f87d9403 Applied changes according to comments 2024-06-12 15:11:07 +02:00
Joaquin Ossa
33aac0be1a Added core__unified_user to reporting with the documentation 2024-06-12 15:11:07 +02:00
Oriol Roqué Paniagua
328723b9ab Merged PR 2003: Business KPIs first draft
This PR aims to provide a first draft for business KPIs, at this stage **quite minimal**.

It mostly contains a MTD and Monthly display approach. No dimensions are created.

The models created are:
- **int_dates_mtd**: mainly it reads from int_dates to retrieve those days needed for a MTD/monthly display
- **int_core__mtd_booking_metrics**: it contains the booking metrics, ending in a format of date|value|value last year|increment
--> here we could add, in the future, additional metrics from other sources (ex: guest journey, etc)
- **int_core__mtd_aggregated_metrics**: it transforms the data coming from the different mtd intermediate sources to be easily displayed in the dashboard. This is a good candidate for macros :)
- **core__mtd_aggregated_metrics**: copy-paste of the its int_core version, including a bit of model documentation

The dashboard is functional but in another PR. I can show you how it looks like at the moment you are going to check the PR

Related work items: #17214
2024-06-11 15:45:57 +00:00
Pablo Martín
366aa7d1ac Merged PR 2005: Replace Guest Details in CheckIn Cover models with details coming from User table
Fixes https://guardhog.visualstudio.com/Data/_boards/board/t/Data%20Team/Stories/?workitem=17240

Related work items: #17240
2024-06-10 15:30:26 +00:00
Pablo Martín
d18b47f597 Merged PR 2001: Add phone number to unified user
Includes the phone number field in unified user.

Also added basic tests on the PK.

Also improved upstream models traceability in the model.

Related work items: #17240
2024-06-10 14:30:56 +00:00
Pablo Martin
2ea2817627 add tests 2024-06-10 16:23:45 +02:00
Pablo Martin
723bbf1ebe add phone number 2024-06-10 16:14:07 +02:00
Pablo Martin
8b99d9babd add table aliases to track col origin 2024-06-10 15:51:40 +02:00
Joaquin Ossa
06e5112cfc Merged PR 1986: Created verification_requests model in report
Created verification_requests model in report for check-in hero report including the description to check

Related work items: #17067
2024-06-10 09:38:48 +00:00
Joaquin Ossa
1bb4229dce updated docs for core__verification_requests from Pablo's comments 2024-06-10 11:32:04 +02:00
Joaquin Ossa
5e7504499f Added description document for core__verification_requests 2024-06-06 12:00:07 +02:00
Joaquin Ossa
a5074a1545 Created verification_requests model in report 2024-06-06 10:11:34 +02:00
Pablo Martín
8ba2ece28b Merged PR 1985: Accommodation and AccommodationToUser to staging
Ingesting from Core into Staging.

Related work items: #16919
2024-06-05 15:54:48 +00:00
Pablo Martin
7aa100d115 add tests 2024-06-05 17:39:53 +02:00
Pablo Martin
85a299da96 staging accommodation to user 2024-06-05 17:38:02 +02:00
Pablo Martin
cd8fc9893d add accommodationtouser in sources 2024-06-05 17:31:19 +02:00
Pablo Martin
21f9a63db2 add test 2024-06-05 17:30:19 +02:00
Pablo Martin
26ce452a0c accommodation staging model 2024-06-05 17:24:59 +02:00
Pablo Martin
f216e7708a add accommodation to sources 2024-06-05 17:24:39 +02:00
Pablo Martin
60063b5455 propagate fix 2024-06-05 17:15:35 +02:00
Pablo Martin
c87efc7d1d low-hanging fruit refactor. Fix name 2024-06-05 16:50:14 +02:00
Pablo Martín
42a3190f50 Merged PR 1969: Integration models
This PR brings two tables from Core's `integration` schema into `staging`.
- `integration`
- `integration_type`

Related work items: #16919
2024-06-04 16:24:32 +00:00
Pablo Martin
bfd05a6410 add missing _utc suffix 2024-06-04 18:21:56 +02:00
Pablo Martin
f5ae39e443 add integration type model 2024-06-04 15:05:26 +02:00