speed up neuprint_get_synapses

[jefferis]

• speed up by chunking while avoid time outs
• improve processing of the results
• also columns are all character vector

[jefferis]

Also I see that there are currently two separate calls for pre/post

neuprintr/R/synapses.R

Lines 66 to 85 in b456d41

	cypher.post = sprintf(paste("WITH %s AS bodyIds UNWIND bodyIds AS bodyId",
	"MATCH (a:`%s`)-[:Contains]->(c:SynapseSet)-[:Contains]->(s:Synapse)<-[:SynapsesTo]-(:Synapse)<-[:Contains]-(:SynapseSet)<-[:Contains]-(b:`%s`)",
	"WHERE a.bodyId=bodyId AND (s.type='post') %s",
	"RETURN DISTINCT id(s) AS connector_id,",
	"s.type AS prepost, s.location.x AS x ,s.location.y AS y, s.location.z AS z,",
	"s.confidence AS confidence, a.bodyId AS bodyid, b.bodyId AS partner"),
	id2json(bodyids),
	"Segment",
	"Segment",
	roi)
	cypher.pre = sprintf(paste("WITH %s AS bodyIds UNWIND bodyIds AS bodyId",
	"MATCH (a:`%s`)-[:Contains]->(c:SynapseSet)-[:Contains]->(s:Synapse)-[:SynapsesTo]->(:Synapse)<-[:Contains]-(:SynapseSet)<-[:Contains]-(b:`%s`)",
	"WHERE a.bodyId=bodyId AND (s.type='pre') %s",
	"RETURN DISTINCT id(s) AS connector_id,",
	"s.type AS prepost, s.location.x AS x ,s.location.y AS y, s.location.z AS z,",
	"s.confidence AS confidence, a.bodyId AS bodyid, b.bodyId AS partner"),
	id2json(bodyids),
	"Segment",
	"Segment",
	roi)

@alexanderbates / @schlegelp do you know if this is actually necessary because of the DISTINCT(ids) clause or could we fetch in one go?

[jefferis]

Closed by #96

[jefferis]

Note to self that this should do both at once:

cypher.both = sprintf(paste("WITH %s AS bodyIds UNWIND bodyIds AS bodyId",
                            "MATCH (a:`%s`)-[:Contains]->(c:SynapseSet)-[:Contains]->(s:Synapse)-[:SynapsesTo]-(:Synapse)-[:Contains]-(:SynapseSet)<-[:Contains]-(b:`%s`)",
                            "WHERE a.bodyId=bodyId %s",
                            "RETURN DISTINCT id(s) AS connector_id,",
                            "s.type AS prepost, s.location.x AS x ,s.location.y AS y, s.location.z AS z,",
                            "s.confidence AS confidence, a.bodyId AS bodyid, b.bodyId AS partner"),
                      id2json(bodyids),
                      "Segment",
                      "Segment",
                      roi)

modulo some reordering to ensure results match.