Skip to content

Commit

Permalink
Updateschangelogv3 (#100)
Browse files Browse the repository at this point in the history
* changes toRdf and triplydB > triplyDB

* adjustedments order items under
Changed, toRdf

* updated docs

---------

Co-authored-by: Elena <[email protected]>
  • Loading branch information
tiptup10 and Elena authored Oct 13, 2023
1 parent 2632dea commit 29cda3f
Showing 1 changed file with 34 additions and 33 deletions.
67 changes: 34 additions & 33 deletions docs/triply-etl/changelog/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -29,43 +29,19 @@ const nde = new NDE({etl, accountName, datasetname})
nestedPairs(S, P, [a, sdo.Person])
```

4\. TriplyETL supports transformations using [RDF mapping language](https://rml.io/docs/rml/introduction/).
4\. TriplyETL supports transformations using [RDF mapping language](https://rml.io/docs/rml/introduction/) (RML).

5\. Manually specified and standard prefixes are automatically added to TriplyDb when [toRdf()](../publish/#local-data-destinations) is used. The middleware `uploadPrefixes()` is removed.
5\. Manually specified and standard prefixes are automatically added to TriplyDB when [toRdf()](../publish/#local-data-destinations) is used. The middleware `uploadPrefixes()` is removed.


### Changed
1\. A new flag now bypasses generating the trace for very large records: `---skip-error-trace`. Thus, no trace file is created.

2\. The [loadRdf()](../extract/formats/#function-loadrdf) middleware is able to parse known RDF serilaizations (`Turtle`, `TriG`, `n-triples`, `n-quads`) provided as a string without specifying mimetype.

1\. Prefixes are no longer defined as function that concatenates a value to an Iri. The Iri is a new type of Object in TriplyETL, that has a `concat()` method which allows you to add a value to the first part of an Iri. For example:
```ts
const data = Source.string('...')
loadRdf(data)
```

3\. The output of the logfile and terminal output is changed. It contains more information to help users debugging ETL's. The format of time representation is now `H:i:s.u` where:

- **H**: 24-hour format of an hour with leading zeros (00 through 23)
- **i**: Minutes with leading zeros (00 to 59)
- **s**: Seconds with leading zeros (00 through 59)
- **u**: Microseconds (example: 654321)

4\. The [toRdf()](../publish/#local-data-destinations) middleware now accepts `"me"` as account name based on the token.

5\. The `resetStore()` middleware is now moved from `ratt` to the `generic` namespace . The `randomKey()` middleware moved from `generic` to `ratt`.

6\. You can now use `--offset` and `--limit` instead of `--from-record-id` and `--head`, e.g. `LIMIT=1 OFFSET=8 npx etl`. The old arguments can still be used for backwards compatibility.

7\. Middleware `mapQuads()` is removed.

8\. If the users Node.JS version is older that the recommendend version (currently \>=18.0.0) a warning is shown.

9\. A SHACL Validation Engine improved performance.

10\. We support XSLT processing in the [fromXml()](../extract/formats/#extractor-fromxml) and [loadRdf()](../extract/formats/#function-loadrdf) middlewares by providing an optional `Source.file()` to the `stylesheet` parameter.
const johnDoe = declarePrefix('http://ex.com/').concat('John').concat('/Doe')
```

11\. The vocabularies and languages are no longer part of `@triplyetl/etl package`. A new module has been released: `@triplyetl/vocabularies`:
2\. The vocabularies and languages are no longer part of `@triplyetl/etl` package. A new module has been released: `@triplyetl/vocabularies`:

- Individual imports:

Expand Down Expand Up @@ -108,10 +84,35 @@ import { region, language } from '@triplyetl/vocabularies'
const nl_BE = language.nl.addRegion(region.BE)
```

12\. Prefixes are no longer defined as function that concatenates a value to an Iri. The Iri is a new type of Object in TriplyETL, that has a `concat()` method which allows you to add a value to the first part of an Iri. For example:
3\. The [loadRdf()](../extract/formats/#function-loadrdf) middleware is able to parse known RDF serilaizations (`Turtle`, `TriG`, `N-Triples`, `N-Quads`) provided as a string without specifying mimetype.

```ts
const johnDoe = declarePrefix('http://ex.com/').concat('John').concat('/Doe')
```
const data = Source.string('...')
loadRdf(data)
```

4\. The output of the logfile and terminal output is changed. It contains more information to help users debugging ETL's. The format of time representation is now `H:i:s.u` where:

- **H**: 24-hour format of an hour with leading zeros (00 through 23)
- **i**: Minutes with leading zeros (00 to 59)
- **s**: Seconds with leading zeros (00 through 59)
- **u**: Microseconds (example: 654321)

5\. The [toRdf()](../publish/#local-data-destinations) middleware now accepts `"me"` as account name based on the token.

6\. The `resetStore()` middleware is now moved from `ratt` to the `generic` namespace . The `randomKey()` middleware moved from `generic` to `ratt`.

7\. You can now use `--offset` and `--limit` instead of `--from-record-id` and `--head`, e.g. `LIMIT=1 OFFSET=8 npx etl`. The old arguments can still be used for backwards compatibility.

8\. Middleware `mapQuads()` is removed.

9\. If the users Node.JS version is older that the recommendend version (currently \>=18.0.0) a warning is shown.

10\. A SHACL Validation Engine improved performance.

11\. We support XSLT processing in the [fromXml()](../extract/formats/#extractor-fromxml) and [loadRdf()](../extract/formats/#function-loadrdf) middlewares by providing an optional `Source.file()` to the `stylesheet` parameter.

12\. A new flag now bypasses generating the trace for very large records: `---skip-error-trace`. Thus, no trace file is created.

13\. Developers notes:

Expand Down

0 comments on commit 29cda3f

Please sign in to comment.