data-govt-nz / schema Goto Github PK

Suggestion that we might include the "accessLevel" property to the data.govt.nz data.json schema.

See https://project-open-data.cio.gov/v1.1/schema/#accessLevel

If we did this, how might this manifest itself on the data.govt.nz open data portal? Some ideas:

• A clear and visual "unreleased" ribbon across the dataset in data.govt.nz in place of the dataset resources section.
• A dedicated section on data.govt.nz for these (they don't show up in search results).
• Add these to a CKAN group

Interested in hearing thoughts on this and I think this feeds into the data requests (users knowing what is knowingly not released may help more targeted approach to requests).

See https://github.com/data-govt-nz/schema#how-to-generate-your-datajson-file

Hi, I see in the README it says the json schema is based on an international standard. Can you please link to that standard? I'd be keen to create one of these but use exisiting libraries and tools if they exist. But not sure what standard this is based on, so hard to research that.

Excel is good at messing up data files, doubly when encoding are involved!

Before converting to data.json it would be good to add a check for the strcuture and consistency of the CSV to find bad encoded characters, line breaks etc.

This tool is useful https://csvlint.io/

It has an API too...