Add load/save benchmarks (SciTools#132)

* add benchmark

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* handle cases where files don't exist

* add benchmark

* Proposal for fixed generation of benchmark data. (SciTools#124)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* post merge fixes

* refactor _gridlike_mesh

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix benchmarks

* turn on debugging

* turn on debugging

* fix data generation

* fix benchmarks

* try saving with unique address

* Synthetic file generation - re-use files and ensure uniqueness.

* try saving with unique address

* fix benchmarks

* fix nox

* refactor long benchmarks

* refactor long benchmarks

* move DATA_GEN_PYTHON setup to nox

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* avoid python name "type"

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* changes to test infrastructure

* lint fix

* complete "type" refactor

* fix benchmarks

* toggle ci benchmark debugging off

* make codecov more lenient

* parameterise load/save benchmarks

* address review comments

* lint fix

* review actions

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Martin Yeo <[email protected]>
Co-authored-by: Martin Yeo <[email protected]>

.cirrus.yml

@@ -135,6 +135,8 @@ test_task:
 benchmark_task:
   only_if: ${SKIP_BENCHMARK_TASK} == ""
   auto_cancellation: true
+  env:
+    PY_VER: "3.8"
   name: "${CIRRUS_OS}: performance benchmarking"
   # Custom clone behaviour to enable ASV to access the PR base branch (if on a
   #  PR).
@@ -154,6 +156,13 @@ benchmark_task:
     fingerprint_script:
       - echo "${CIRRUS_TASK_NAME}"
       - if [ -n "${IRIS_SOURCE}" ]; then echo "${IRIS_SOURCE}"; fi
+  nox_cache:
+    folder: ${CIRRUS_WORKING_DIR}/.nox
+    reupload_on_changes: true
+    fingerprint_script:
+      - echo "${CIRRUS_TASK_NAME}"
+      - echo "${NOX_CACHE_BUILD}"
+      - if [ -n "${IRIS_SOURCE}" ]; then echo "${IRIS_SOURCE}"; fi
   benchmarks_script:
     - export CONDA_OVERRIDE_LINUX="$(uname -r | cut -d'+' -f1)"
     - nox --session="benchmarks(ci compare)"

.gitignore

@@ -51,6 +51,7 @@ coverage.xml
 .hypothesis/
 .pytest_cache/
 benchmarks/.asv*
+benchmarks/.data
 
 # Translations
 *.mo