ci: add GitHub action that automatically creates the derivative databases #76
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds the '.github/workflows/create_db_derivatives.yaml'GitHub action that is used to automatically create the derivative databases (i.e. 'category', 'images' and 'extended') based on the 'plane-alert-db.csv', 'plane_images.txt' and 'blacklist.txt' files.
Files explained
plane-alert-db.csv
,plane_images.txt
andblacklist.txt
files.plane-alert-db.csv
,plane_images.txt
andblacklist.txt
files.plane_images.txt
file. This file can be removed when we are sure that this file is correct.planepix.txt
file. I kept the file extension astxt
to distinguish it from the main database and the derivative databases.See the action in action
How to test
Before switching to this automatic workflow, we have to ensure that the generated databases are equal to the ones already in the repository. I compared them using VScodes compare feature, and the implementation looks correct to me. However, please double-check.
create_images_reference.py
script to generate the database of the new image.create_db_derivatives.py
script to generate the derivative databases.Things that could cause problems
My script currently replaces
N/a
withnp.nan
. I don't know how this field is read in the https://github.com/kx1t/docker-planefence repository, but otherwise, we have to add those values back in.Things that were not yet automated
I did not know what was in the following databases: