ETL to QE, Update 9, Wrote an ETL Class
Date: 2023-10-13
See Discord Binding for project context
Wrote an ETL Class
commit: 657cb36b6ab06b3be9860d3753258ba2fa2c123e
My run_dag.py file was much more verbose than it needed to be. For example it all the functions inside ETLFunctions.pywere separately inside run_dag.py as well as manually configuring logging resulting in 167 lines of code. I took all those functions and logging and turned it into a class which results in [run_dag.py] being reduced to 23 lines and being much more readable.