counterweight/data-xexe
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

suggested bash script

Browse source
This commit is contained in:
Pablo Martin 2024-06-13 18:21:18 +02:00
parent 55ef7ab273
commit 4626152379
2 changed files with 62 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

3
README.md
View file

@ -147,14 +147,13 @@ This tool was made specifically to feed our DWH. These are the steps to perform
- Schedule
- Finally, schedule the execution in the Linux VM to fit your needs.
- Specifics are up to you and your circunstances.
- A general pattern would be to create a little bash script that calls the tool with the right parameters on it.
- A general pattern would be to create a little bash script that calls the tool with the right parameters on it. You can find an example that I like in the root of this repo named `run_xexe.sh`, but that's opinionated and adjusted to my needs at the time of writing this. Adapt it to your environment or start from scratch if necessary.
- Remember to use the `--ignore-warnings` flag if necessary to allow large, automated runs without manually interaction.
- Backfilling
- If you are loading rates for the first time, you might need to backfill long periods of time manually at first.
- The tool is flexible enough. You can probably figure out the right commands by taking a look at `How to Use the tool > General Usage`
- Be careful since you might hit consumption limits set by xe.com.
## Testing
This CLI app has three groups of automatic tests: