Tasks for ETL to Question Engine

Phase 1

• Infrastructure
  • Get all raw data in one location - ETLtoQE
  • Get a dedicated Postgres server - ETLtoQE
• ETL
  • Decide on ETL procedure and document it - ETLtoQE
  • Create a single script for managing all ETL steps - ETLtoQE
• Raw Analytics
  • Publish the first generalised report using a Jupyter notebook - ETLtoQE
  • Generate Guild Specific Reports - ETLtoQE
• Front end
  • Get the Dashboard up and running with Basic Auth - ETLtoQE

Phase 2

• Add JSON Web Token Authentication to Dashboard App - ETLtoQE
• Data Contextualization
  • Decide on a Graph Database and write a Blog Post about it - ETLtoQE
  • Design and decide on Graph schema for Discord Data Annotation
  • Design API endpoints for annotating Graph Data

In Update 12 I got feedback recommending I look for key words within the Discord Dataset. Now I need to come up with a narrow question or problem that involves key word queries.

Backlinks

• Project Update Posts