switch to requirements
This commit is contained in:
parent
c5b0e040a1
commit
422c985cce
4 changed files with 5 additions and 1343 deletions
|
|
@ -6,15 +6,16 @@ Welcome to Superhog's DWH dbt project. Here we model the entire DWH.
|
||||||
|
|
||||||
- Pre-requisites
|
- Pre-requisites
|
||||||
- You need a Linux environment. That can be Linux, macOS or WSL.
|
- You need a Linux environment. That can be Linux, macOS or WSL.
|
||||||
- You need to install Python `>=3.10` and `poetry`.
|
- You need to have Python `>=3.10` installed.
|
||||||
- All docs will assume you are using VSCode.
|
- All docs will assume you are using VSCode.
|
||||||
- Prepare networking
|
- Prepare networking
|
||||||
- You must be able to reach the DWH server through the network. There are several ways to do this.
|
- You must be able to reach the DWH server through the network. There are several ways to do this.
|
||||||
- The current recommended route is to use the data VPN. You can ask Pablo to help you set it up.
|
- The current recommended route is to use the data VPN. You can ask Pablo to help you set it up.
|
||||||
- Set up
|
- Set up
|
||||||
|
- Create a virtual environment for the project with `python3 -m venv venv`.
|
||||||
|
- Activate the virtual environment and run `pip install requirements.txt`
|
||||||
- Create an entry for this project `profiles.yml` file at `~/.dbt/profiles.yml`. You have a suggested template at `profiles.yml.example`
|
- Create an entry for this project `profiles.yml` file at `~/.dbt/profiles.yml`. You have a suggested template at `profiles.yml.example`
|
||||||
- Make sure that the `profiles.yml` host and port settings are consistent with whatever networking approach you've taken.
|
- Make sure that the `profiles.yml` host and port settings are consistent with whatever networking approach you've taken.
|
||||||
- Use `poetry install` to get dependencies in place.
|
|
||||||
- Check
|
- Check
|
||||||
- Ensure you are running in the project venv, either by setting VSCode Python interpreter to the one created by `poetry`, or by running `poetry shell` in the console when in the root dir.
|
- Ensure you are running in the project venv, either by setting VSCode Python interpreter to the one created by `poetry`, or by running `poetry shell` in the console when in the root dir.
|
||||||
- Turn on your tunnel to `dev` and run `dbt debug`. If it runs well, you are all set. If it fails, there's something wrong with your set up. Grab the terminal output and pull the thread.
|
- Turn on your tunnel to `dev` and run `dbt debug`. If it runs well, you are all set. If it fails, there's something wrong with your set up. Grab the terminal output and pull the thread.
|
||||||
|
|
|
||||||
1325
poetry.lock
generated
1325
poetry.lock
generated
File diff suppressed because it is too large
Load diff
|
|
@ -1,16 +0,0 @@
|
||||||
[tool.poetry]
|
|
||||||
name = "data-dwh-dbt-project"
|
|
||||||
version = "0.1.0"
|
|
||||||
description = ""
|
|
||||||
authors = ["Pablo Martin <pablo.martin@superhog.com>"]
|
|
||||||
readme = "README.md"
|
|
||||||
|
|
||||||
[tool.poetry.dependencies]
|
|
||||||
python = "^3.10"
|
|
||||||
dbt-core = "^1.7.4"
|
|
||||||
dbt-postgres = "^1.7.4"
|
|
||||||
|
|
||||||
|
|
||||||
[build-system]
|
|
||||||
requires = ["poetry-core"]
|
|
||||||
build-backend = "poetry.core.masonry.api"
|
|
||||||
2
requirements.txt
Normal file
2
requirements.txt
Normal file
|
|
@ -0,0 +1,2 @@
|
||||||
|
dbt-core=="1.7.*"
|
||||||
|
dbt-postgres=="1.7.*"
|
||||||
Loading…
Add table
Add a link
Reference in a new issue