From ae3ad750733121b6711d6f35c1ecee8620d0c9fc Mon Sep 17 00:00:00 2001 From: Pablo Martin Date: Thu, 13 Jun 2024 19:24:57 +0200 Subject: [PATCH] more readme instructions --- README.md | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 30db8c2..89f0769 100644 --- a/README.md +++ b/README.md @@ -145,10 +145,12 @@ This tool was made specifically to feed our DWH. These are the steps to perform - `How to Use the tool > Set up credentials` - `How to Use the tool > DWH pre-requisites` - Schedule - - Finally, schedule the execution in the Linux VM to fit your needs. + - Up next, schedule the execution in the Linux VM to fit your needs. - Specifics are up to you and your circunstances. - - A general pattern would be to create a little bash script that calls the tool with the right parameters on it. You can find an example that I like in the root of this repo named `run_xexe.sh`, but that's opinionated and adjusted to my needs at the time of writing this. Adapt it to your environment or start from scratch if necessary. + - A general pattern would be to create a little bash script that calls the tool with the right parameters on it. You can find an example that I like in the root of this repo named `run_xexe.sh`, but that's opinionated and adjusted to my needs at the time of writing this. Adapt it to your environment or start from scratch if necessary. The script is designed to be placed in`~/run_xexe.sh`. - Remember to use the `--ignore-warnings` flag if necessary to allow large, automated runs without manually interaction. + - The script is designed to send both success and failure messages to slack channels upon completion. To properly set this up, you will need to place a file called `slack_webhook_urls.txt` on the same path you drop `run_xexe.sh`. The file should have two lines: `SLACK_ALERT_WEBHOOK_URL=` and `SLACK_RECEIPT_WEBHOOK_URL=`. Setting up the slack channels and webhooks is outside of the scope of this readme. + - Create a cron entry with `crontab -e` that runs the script. For example: `0 2 * * * /bin/bash /home/azureuser/run_xexe.sh` to run xexe models every day at 2AM. - Backfilling - If you are loading rates for the first time, you might need to backfill long periods of time manually at first. - The tool is flexible enough. You can probably figure out the right commands by taking a look at `How to Use the tool > General Usage`