Releases: jkminder/data2neo
Fixed issue with pandas dataframe iterator
Fixed bug with pandasdataframeiterator: df was indexed by custom index, instead of index (.loc->.iloc)
Improved Dynamic Buffer
Dynamic Buffer now regularly randomly checks whether small buffer sizes improve throughput. This is especially usefull for relations that can have a low throughput and non-linear performance behavior in comparison to buffer size.
Performance Improvements
This update brings big performance improvements by adding two main improvements:
- Resources that do not produce a node or a relation are bypassed which resolves a large bottleneck in the old code
- Intermediate subgraphs that are produces for each resource are now newly buffered. The size of the buffer is dynamically updated based on the throughput of resources.
These improvements bring significant performance benefits (1.5-3 times faster processing)
Further the py2neo_extensions
now provide a wrapper that enables matching of relations with no primary key between the same two nodes.
New Converter API
The converter newly only accepts schemas as a string. This allows the schema string to be generically generated. Futher the library provides a load_file
function under rel2graph.utils
to make switching to the new api as easy as possible.
Old way:
converter = Converter(path_to_file, my_iterator, my_graph)
New way:
from rel2graph.utils import load_file
converter = Converter(load_file(path_to_file), my_iterator, my_graph)
ResourceIterators are now based on native python iterators
v0.6.0 Release v0.6.0
Fixes bug with primary key parsing.
This release fixes a bug where primary keys were not correctly parsed if the primary attribute was wrapped.
Complete refactor of schema compiler
This release fixes all known issues with the schema compiler, further the compiler gives know much more meaningful error messages.
Fixed bug occuring when no node/relation is specified for an entity
v0.4.6 release 0.4.6
Fixed bug with attribute and None values
Fixed bug where attributes with value None of NoneType are converted automatically into a string "None".
Fixed bug in config parser
Fixed bug that was raise when the config schema file had a space after a wrapper of a dynamic attribute in relations.
E.g. RELATION(node, WRAPPER(entity.attribute)SPACE, node):