Skip to content

Commit

Permalink
v2.0.0 (#54)
Browse files Browse the repository at this point in the history
- [x] introduce new simplified mapping file schema
- [x] introduce qudt and csvw for table annotation
- [x] introduce pydantic into the package
- [x] make method graph optional
- [x] introduce new standard method graph using provo
- [x] general package maintainance
- [x] refactor modules
- [x] add utility to read qudt-mapping from unit-symbols
- [x] add utility to generate subgraph for quantity description using qudt
- [x] support json files as input for mapping files
- [x] drop unneeded intermediate file outputs
- [x] update excel parser with new parsing logic
- [x] add json parser
- [x] add TBox mode for writing ontology classes
- [x] update documentation
  • Loading branch information
MBueschelberger authored Aug 12, 2024
1 parent 8f36003 commit 9e93f9f
Show file tree
Hide file tree
Showing 171 changed files with 17,960 additions and 5,216 deletions.
2 changes: 1 addition & 1 deletion .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ jobs:
strategy:
fail-fast: false
matrix:
python-version: ['3.8', '3.9', '3.10']
python-version: ['3.9', '3.10', '3.11', '3.12']

steps:

Expand Down
2 changes: 1 addition & 1 deletion .pre-commit-config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ repos:
rev: 6.0.0
hooks:
- id: flake8
args: [--count, --show-source, --statistics, '--ignore', 'E501,E203,W503']
args: [--count, --show-source, --statistics, '--ignore', 'E501,E203,W503,E201,E202,E221,E222,E231,E241,E271,E272,E702,E713']
# additional_dependencies: [flake8-bugbear==21.3.1, pep8-naming]
log_file: flake8.log

Expand Down
26 changes: 12 additions & 14 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,9 +1,12 @@
# data2rdf

A pipeline for generating data representation in RDF out of raw data given in ASCII, CSV or EXCEL format.
A pipeline for generating data representation in RDF out of raw data given in ASCII, CSV, JSON or EXCEL format.

https://data2rdf.readthedocs.io/en/latest/

<!-- Pytest Coverage Comment:Begin -->
<!-- Pytest Coverage Comment:End -->

# Installation

## Install for using the package
Expand All @@ -23,24 +26,19 @@ cd data2rdf
pip install -e .
```

## Windows specific
# Unit tests

In windows it might be necessary to install curses manually. This can be done with:
Before running the unit tests, please install the needed packages:

```{bash}
pip install data2rdf[tests]
```
pip install windows-curses
```

## Debug a Chowlk XML File

In some cases when the syntax of the draw.io file is not correct (e.g.: missing label on arrow, bracket in class file) chowlk crashes. The only (pretty annoying but working) way to find the wrong syntax is to execute chowlk with the command line for that file and inclemently remove elements from the draw.io diagram. This way you can find the wrong syntax by process of elimination.
Afterwards, run the unittest with:

# Version Updates

* Chowlk is installed via pip through the dependencies
* Running csv and excel pipeline
* Abox pipeline CLI
* Unnittest for csv and excel pipeline and abox pipeline
```{bash}
pytest
```

# Building the docs locally
### HTML
Expand Down
22 changes: 22 additions & 0 deletions data2rdf/__init__.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
"""Data2RDF"""

from .config import Config
from .parsers import Parser
from .pipelines import Data2RDF

from .models import ( # isort:skip
ABoxBaseMapping,
BasicConceptMapping,
PropertyGraph,
QuantityGraph,
)

__all__ = [
"Data2RDF",
"Config",
"QuantityGraph",
"PropertyGraph",
"ABoxBaseMapping",
"BasicConceptMapping",
"Parser",
]
206 changes: 0 additions & 206 deletions data2rdf/abox_template_generation.py

This file was deleted.

24 changes: 0 additions & 24 deletions data2rdf/annotation_confs.py

This file was deleted.

Loading

0 comments on commit 9e93f9f

Please sign in to comment.