MVP to support Frictionless Data v1.0

[Stephen-Gates]

Suggested minimum viable product for this extension to support Frictionless Data v1.0, for a datapackage.zip that may contain:

• datapackage.json (including schemas and csv dialect)
• README.md
• one or more data resources

... the extension should:

• Store all elements in the .zip in CKAN (i.e. no data or metadata loss)
• Download a datapackage.zip that contains all data that was uploaded

What's missing?

Upload:

• README.md is dropped on upload README.md included in a data package not added as a resource in CKAN #60
• Schemas are dropped on upload Schema included in a data package not added to CKAN #61
• Data is not stored in Data Store to provide a data API Support import/export to DataStore #44
• Metadata in Frictionless Data v1 format is not ingested correctly Licenses not imported correctly  #62

Download:

• Downloaded datapackage.zip does not comply with Frictionless Data v1 specification Incorrect properties in datapackage.json download  #59
• Downloaded datapackage.zip is not equivalent to uploaded datapackage.zip #49
• README.md not downloaded (related to README.md included in a data package not added as a resource in CKAN #60)
• Schemas not downloaded MIssing metadata fields when exporting data package #49
• Data resources at URI not in .zip Export data (resources) and metadata (datapackage.json) in zip file #52 (tolerable but prefer they're included)

[dkelsey]

I'm interested in contributing.

[Stephen-Gates]

Thanks @dkelsey - hope to get started in the new year.

[Stephen-Gates]

I've given this some more thought and you can read about it at https://hackmd.io/s/rkYHnQYQf

I'd be interested in any feedback, especially regarding ckanext-validation

[dkelsey]

will do.