counterweight/data-dwh-dbt-project
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

switch to requirements

Browse source
This commit is contained in:
Pablo Martin 2024-02-02 16:21:58 +01:00
parent c5b0e040a1
commit 422c985cce
4 changed files with 5 additions and 1343 deletions
Download patch file Download diff file Expand all files Collapse all files

5
README.md
View file

@ -6,15 +6,16 @@ Welcome to Superhog's DWH dbt project. Here we model the entire DWH.
- Pre-requisites
- You need a Linux environment. That can be Linux, macOS or WSL.
- You need to install Python `>=3.10` and `poetry`.
- You need to have Python `>=3.10` installed.
- All docs will assume you are using VSCode.
- Prepare networking
- You must be able to reach the DWH server through the network. There are several ways to do this.
- The current recommended route is to use the data VPN. You can ask Pablo to help you set it up.
- Set up
- Create a virtual environment for the project with `python3 -m venv venv`.
- Activate the virtual environment and run `pip install requirements.txt`
- Create an entry for this project `profiles.yml` file at `~/.dbt/profiles.yml`. You have a suggested template at `profiles.yml.example`
- Make sure that the `profiles.yml` host and port settings are consistent with whatever networking approach you've taken.
- Use `poetry install` to get dependencies in place.
- Check
- Ensure you are running in the project venv, either by setting VSCode Python interpreter to the one created by `poetry`, or by running `poetry shell` in the console when in the root dir.
- Turn on your tunnel to `dev` and run `dbt debug`. If it runs well, you are all set. If it fails, there's something wrong with your set up. Grab the terminal output and pull the thread.