A continuous integration pipeline for ontology development in project StahlDigital (2021-2024). Uses spreadsheets as input, converts and validates the input and publishes the resulting ontology.
Workflow is defined using Nextflow (version 22.04.5) and depends on a docker container runtime.
Main Steps executed are
- translating spreadsheets to RDF via xlsx2owl for several spreadsheets and mappings
- transformations using e.g. RPT and jena/riot
- validate RDF via shacl rules and PySHACL
- generate documentation via JOD and Jekyll RDF
- upload documentation to DSMS and git repos
Please see CHANGELOG.md for the list of changes.
- add file
secrets
with credentials (e.g.CI_STAHL_REGISTRY_TOKEN
,CI_STORE_TOKEN
,XLSX_MOCK_COMMIT_TOKEN
,GITLAB_TEST_TOKEN
,ARTIFACT_REPOSITORY_TOKEN
,DSMS_USER
,DSMS_PASSWORD
) $ nextflow run main.nf
- to override parameter defaults add them to commandline, e.g. to use local spreadsheets:
$ nextflow run main.nf --xlsxUrl="$PWD/xlsx2owl-StahlDigital.xlsx" --xlsxTestsUrl="$PWD/xlsx2owl-StahlDigital-tests.xlsx"