SOF-8 First re-factor to accomodate UNFCCC

[diversemix]

Description

• Refactor to split out different types of validate and ingest for CCLW/UNFCCC

Type of change

Please select the option(s) below that are most relevant:

• Bug fix
• New feature
• Breaking change

How Has This Been Tested?

Please describe the tests that you added to verify your changes.

Reviewer Checklist

• The PR represents a single feature (small driveby fixes are also ok)
• The PR includes tests that are sufficient for the level of risk
• The code is sufficiently commented, particularly in hard-to-understand areas
• Any required documentation updates have been made
• Any TODOs added are captured in future tickets
• No FIXMEs remain

[linear]

SOF-8 New ingest endpoint for GST

Similar to that for CCLW - but this will read the new input CSV schema and create the necessary data and structure in the database

[joel-wright]

This seems like a decent path to go down so we learn more about writing generic ingest, the general structure seems to be shared, but there are a lot of subtle differences we'll need to handle on import for UNFCCC. e.g. separate collection creation, linking families to multiple collections during ingest, no events file (rather a single event per family).... I'm sure we could find more...

[joel-wright]

Nothing too controversial in here (although obviously, same as you, the amount of copy-pasta makes me a little sad). Unavoidable given the constraints though.... ONWARDS!!!

[joel-wright]

let's get this in & fix as required