Coder Social home page Coder Social logo

cmungall / dasher Goto Github PK

View Code? Open in Web Editor NEW
1.0 3.0 0.0 106 KB

Base framework for creating semantic QC dashboards

Home Page: http://cmungall.github.io/dasher

License: Creative Commons Zero v1.0 Universal

Makefile 2.25% Python 97.54% Shell 0.21%
qc semantic semweb kg knowledge-graph quality-control obo owl

dasher's Introduction

Dasher: Semantic QC Framework

Base framework for running QC checks over multiple knowledge sources. Potential examples include:

  • OBO Dashboard
  • GO Rules
  • Monarch
  • KG frameworks

See https://docs.google.com/document/d/1ld73pVz_BIH22jRBZuV0RVDeSiuGyQpD1u_F9Yv9gg0/edit#

The core components:

  • a schema for representing both metrics themselves and the results of evaluating them
  • TODO: code for downloading sources and loading them into a database
  • TODO: code for executing these metrics on these sources
  • TODO: lightweight view layer to generate an HTML grid summary

Schema

Browse the schema here: http://cmungall.github.io/dasher

See the schema/ folder

The source is in YAML (biolinkml)

Currently the main derived artefacts of interest are:

Download/Preparation

TODO

The idea is to use blazegraph-runner here.

Assume each source is trivially convertable to RDF

Executing Metrics

TODO

Assumption that a number of generic mechanisms can be used:

  • OWL: Reasoning
  • Shapes/ShEx
  • JSON-Schema validation (requires JSON-LD framing)
  • SPARQL (e.g. robot checks)

Additionally, each implementation using this framework is free to add in their own procedural checks, e.g. in Python, although declarative is preferred

The code will generate json/yaml-ld conforming to the schema above

Implementing pipelines e.g Jenkins can choose to do things like fail-fast based on queries of result set

Display

TODO

Something simple such as mustache / liquid templates over the above json-ld

dasher's People

Contributors

cmungall avatar

Stargazers

 avatar

Watchers

 avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.