lolamarket-notes/notes/Ideas.md
2023-11-17 15:13:27 +01:00

434 B

Ideas

  • Partnership with buynomics to provide data for pricing engine.
  • Automate the documentation of ETL flows
  • Automate the documentation of DW schema
  • Set up a git server, pypi server and use proper packages and software re-usage to have high software quality in ETLs and prevent a collapse down the line.
  • Set up automated Data Quality checks with great-expectations on datasources and ETL staging areas