List view

• Use of Pandera Schemas for Schema Definitions

  Objectives: * Replace schema-definitions (currently yaml) with schema classes as supported by pandera. * This will enable static type checking of column types * As part of this work, validations need to be delegated to pandera too but examples of using them must be provided in the demo and in tests. * Finally, we need to wrap pandera schemas within something to capture metrics as well as we need to maintain the metrics generation functionality. Suggested way of working: Create Issues associated to the delivery of this milestone to be refined and estimated.

  No due date

  •0/1 issues closed
  0% complete1 open0 closed