We should set up a database table that we populate with the following columns:
- environment - e.g. 'local',
development, 'production', shinyapps.io (can set environment variables to control)
- data_filename - pulled from the csv data file
- file_size - we should just track the raw bytes so it's easier to analyse, rather than the
dfeR::pretty_filesize() output
- rows_ count - same thing we put in the UI
- cols_count - same thing we put in the UI
- stage - what stage of the checks the file got to
- pass - boolean, did it pass
- warnings - string of the checks that had a warning (take the name from the test col of the screening output table, e.g. "ethnicity_values, total, ob_unit_meta" (we can then parse this if we want to splitting by commas if we want to analyse what warnings are happening a lot)
- time_started - time recorded at start of screening
- time_ended - time recorded at end of screening
- screening_time - count of time taken to screen in raw seconds calculated from above two cols, I think we'd want a raw value like seconds that we can ees-ily average / aggregate
We then add code into the server side of the app that will write a new row into the database table after each screening.
Example UI output now

Example screening output table (where we can use the test column to pull from and populate with what warnings are present (as will be interesting thinking of API standards), also shows the 'stages' we have

Probable tasks
Easy-ish first tasks
Main tasks
We should set up a database table that we populate with the following columns:
development, 'production',shinyapps.io(can set environment variables to control)dfeR::pretty_filesize()outputWe then add code into the server side of the app that will write a new row into the database table after each screening.
Example UI output now

Example screening output table (where we can use the test column to pull from and populate with what warnings are present (as will be interesting thinking of API standards), also shows the 'stages' we have

Probable tasks
Easy-ish first tasks
dfeR::pretty_time_taken()Main tasks