switch to requirements

This commit is contained in:
Pablo Martin 2024-02-02 16:21:58 +01:00
parent c5b0e040a1
commit 422c985cce
4 changed files with 5 additions and 1343 deletions

View file

@ -6,15 +6,16 @@ Welcome to Superhog's DWH dbt project. Here we model the entire DWH.
- Pre-requisites - Pre-requisites
- You need a Linux environment. That can be Linux, macOS or WSL. - You need a Linux environment. That can be Linux, macOS or WSL.
- You need to install Python `>=3.10` and `poetry`. - You need to have Python `>=3.10` installed.
- All docs will assume you are using VSCode. - All docs will assume you are using VSCode.
- Prepare networking - Prepare networking
- You must be able to reach the DWH server through the network. There are several ways to do this. - You must be able to reach the DWH server through the network. There are several ways to do this.
- The current recommended route is to use the data VPN. You can ask Pablo to help you set it up. - The current recommended route is to use the data VPN. You can ask Pablo to help you set it up.
- Set up - Set up
- Create a virtual environment for the project with `python3 -m venv venv`.
- Activate the virtual environment and run `pip install requirements.txt`
- Create an entry for this project `profiles.yml` file at `~/.dbt/profiles.yml`. You have a suggested template at `profiles.yml.example` - Create an entry for this project `profiles.yml` file at `~/.dbt/profiles.yml`. You have a suggested template at `profiles.yml.example`
- Make sure that the `profiles.yml` host and port settings are consistent with whatever networking approach you've taken. - Make sure that the `profiles.yml` host and port settings are consistent with whatever networking approach you've taken.
- Use `poetry install` to get dependencies in place.
- Check - Check
- Ensure you are running in the project venv, either by setting VSCode Python interpreter to the one created by `poetry`, or by running `poetry shell` in the console when in the root dir. - Ensure you are running in the project venv, either by setting VSCode Python interpreter to the one created by `poetry`, or by running `poetry shell` in the console when in the root dir.
- Turn on your tunnel to `dev` and run `dbt debug`. If it runs well, you are all set. If it fails, there's something wrong with your set up. Grab the terminal output and pull the thread. - Turn on your tunnel to `dev` and run `dbt debug`. If it runs well, you are all set. If it fails, there's something wrong with your set up. Grab the terminal output and pull the thread.

1325
poetry.lock generated

File diff suppressed because it is too large Load diff

View file

@ -1,16 +0,0 @@
[tool.poetry]
name = "data-dwh-dbt-project"
version = "0.1.0"
description = ""
authors = ["Pablo Martin <pablo.martin@superhog.com>"]
readme = "README.md"
[tool.poetry.dependencies]
python = "^3.10"
dbt-core = "^1.7.4"
dbt-postgres = "^1.7.4"
[build-system]
requires = ["poetry-core"]
build-backend = "poetry.core.masonry.api"

2
requirements.txt Normal file
View file

@ -0,0 +1,2 @@
dbt-core=="1.7.*"
dbt-postgres=="1.7.*"