Remove use primitives and everything that depends on it #538

austingmhuang · 2024-05-16T21:00:35Z

This story is one of many stories related to no longer providing backwards support for Qiskit 0.46 and upgrading to Qiskit 1.0.

Going forward, use_primitives will always be True since we will not be providing support for using the old primitives-less backend.run() function (Qiskit's support for that will be discontinued around mid October). Thus, the keyword argument use_primitives is not necessary and should be deleted.

As a result, the backend.run() function is also removed from this PR, since setting use_primitives=False is just a way to access this soon-to-be-defunct function. However, certain functionalities relied on the raw samples that the backend.run() function provided (e.g. measuring qml.Hadamard()), which means simply removing backend.run() will cause these tests to fail. In the interim, we will skip these tests for now and address the functionality in a separate PR where we upgrade to V2 primitives and implement all the functionality using those.

Additionally, split_execution_types, by necessity, is also modified to no longer have a no_prim array where we put measurements that needed to use the backend.run() function. We now put everything that is NOT covered by the Estimator directly to the Sampler. Using SamplerV2, we should be able to access the raw samples and get the same functionality that we had from backend.run().

TLDR
backend.run() removed
use_primitives removed
split_execution_types changed; no_prim taken over by sampler
execute changed; uses sampler
Functionality tests skipped here, addressed in #539

codecov · 2024-05-16T21:16:47Z

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 100.00%. Comparing base (9027131) to head (7f0a4df).

Additional details and impacted files

@@                     Coverage Diff                     @@
##           new_device_feature_branch      #538   +/-   ##
===========================================================
  Coverage                     100.00%   100.00%           
===========================================================
  Files                              8         8           
  Lines                            835       788   -47     
===========================================================
- Hits                             835       788   -47

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

austingmhuang · 2024-05-16T21:46:22Z

[sc-63542]

austingmhuang · 2024-05-24T13:42:38Z

tests/test_base_device.py

+    @pytest.mark.skip(
+        reason="The functionality of using sampler to get the accurate answer is not yet implemented"
+    )
    def test_no_pauli_observable_gives_accurate_answer(self, mocker, observable):


We're skipping this until we implement the method in the Sampler where we use raw samples to compute the expval for things like qml.Hadamard() (no pauli_rep)

Addressed in #539

austingmhuang · 2024-05-24T13:43:21Z

tests/test_base_device.py

-@pytest.mark.skipif(
-    Version(qiskit.__version__) < Version("1.0.0"),
-    reason="Session initialization is not supported for local simulators for Qiskit version < 1.0/qiskit_ibm_runtime version < 0.22.0",
-    ## See https://docs.quantum.ibm.com/api/migration-guides/local-simulators for additional details
-)


Not needed now that version will always be >1.0

austingmhuang · 2024-05-24T13:44:40Z

tests/test_base_device.py

-    @patch("pennylane_qiskit.qiskit_device2.transpile")
-    def test_execute_runtime_service_mocked(self, mocked_transpile):
-        """Test the _execute_sampler function using a mocked version of Sampler
-        that returns a meaningless result."""
-
-        dev = QiskitDevice2(wires=5, backend=backend, use_primitives=True)


We will write a replacement test for this one using Sampler instead for a separate PR.

austingmhuang · 2024-05-24T13:47:34Z

tests/test_base_device.py

+    @pytest.mark.skip(
+        reason="The functionality of using sampler to get an accurate answer is not yet implemented"


Skipping this since we haven't implemented the functionality of using Sampler with raw samples. This is done in this PR #539

austingmhuang · 2024-05-24T15:37:21Z

tests/test_base_device.py

-                    [qml.probs(wires=[2])],
-                    [qml.counts()],
+                    [qml.counts(), qml.probs(wires=[2])],


No longer separate and now both go into the same Sampler array.

austingmhuang · 2024-05-24T15:41:46Z

tests/test_base_device.py

@@ -1176,6 +1055,7 @@ def test_process_estimator_job(self, measurements, expectation):

    @pytest.mark.parametrize("num_wires", [1, 3, 5])
    @pytest.mark.parametrize("num_shots", [50, 100])
+    @pytest.mark.skip(reason="Need to replace this with using SamplerV2.")


Works as is without skipping but it calls backend.run which we don't really care about anymore.

lillian542

Looks good to me 🎉

pennylane_qiskit/qiskit_device2.py

tests/test_base_device.py

Co-authored-by: lillian542 <[email protected]>

obliviateandsurrender

tests/test_base_device.py

Co-authored-by: Utkarsh <[email protected]>

* New Qiskit device prototype (#350) * initial prototype device * add use_primitives kwarg * reorganize circuit conversion part 1 * move circuit translation out of device * estimator execution * some small improvements for codefactor * allow circuits with mixed MP types * move translation functions * add support for broadcast_expand and session * add kwargs for options * tidy up options and session * warn if using non-primitive measurements * remove context manager for device session * refactor handling of Options and kwargs * cleaning up * fix 'c register already exists' hardware error * change Options update interface * don't allow options to override shots * don't use classical reg in estimator circuits * update docstring * add conversion tests * add observable conversion test * fix bug in PauliOps converter * add more conversion test functions * remove Adjoint from supported ops and tidy up * tests and little fixes * add tests and black formatting * fix wire order bug for Estimator returns * add tests * remove error if device doesn't initialize * try to get CI to run * more CI stuff * try a thing * black formatting * fix typo * add missing skip-if-no-account * update converter tests * add mockers to allow tests to run in CI * temporarily comment out integration tests * get service from backend * add mock service to mock backend * mock calls to Session in unit testing * uncomment the other tests again * black formatting * newer black formatting * add mocked tests for main execute method * add MockSession to mocked execution tests * pylint * add backend to MockSession calls * mock tests for _execute methods * black formatting * mock transpile for execute_runtime_service * add name to MockedBackend * Apply suggestions from code review Co-authored-by: Matthew Silverman <[email protected]> Co-authored-by: Astral Cai <[email protected]> * Add barrier to ops list * apply suggestion from code review Co-authored-by: Astral Cai <[email protected]> * revert adding barrier for now * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Matthew Silverman <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Matthew Silverman <[email protected]> * Small performance change * Revert * pin qiskit for now * Pin qiskit-ibm-runtime * Move function in init to update_kwargs * Delete print statement lol * fix for shot information * name property change * fixes * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Matthew Silverman <[email protected]> * Edited docstrings * Function signature * Shots are now with context manager * black reformat * black reformat * test changes * tests * fixed conflicts * Change mp_to_pauli to accept mps that affect more than 1 qubit * Revert to fix CI tests * black reformat * Update setup.py Co-authored-by: lillian542 <[email protected]> * Update requirements-ci.txt Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/converter.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/converter.py Co-authored-by: lillian542 <[email protected]> * tests * Fixed a test * maybe this works? * placeholder settings * fixed CI tests, bandaid fix * gitignore for 1.0 qiskit versioning * delete venv1 * tests, shots information, shot vector case, ibm_run_time compatibility * woops * docstring for operation_to_qiskit * black * appease codecov * mock test * Deleted comment * remove some notebooks * Update .gitignore Co-authored-by: Astral Cai <[email protected]> * tests and docstrings --------- Co-authored-by: Matthew Silverman <[email protected]> Co-authored-by: Astral Cai <[email protected]> Co-authored-by: Austin Huang <[email protected]> Co-authored-by: Austin Huang <[email protected]> Co-authored-by: Astral Cai <[email protected]> * Add compile_backend kwarg (#398) Adds the compile_backend kwarg to the Qiskit device. It is useful when you want to do circuit transpilation when using the old Qiskit API (e.g. use_primitives = False). * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> --------- Co-authored-by: Austin Huang <[email protected]> Co-authored-by: Austin Huang <[email protected]> Co-authored-by: Utkarsh <[email protected]> * Support both V1 and V2 (#399) * add name to MockedBackend * support both V1 and V2 syntax for retrieving backend name and num_qubits * test relevant methods with both V1 and V2 MockBackends * tests updated for old device api as per other PR * tests * Update tests/test_base_device.py Co-authored-by: Utkarsh <[email protected]> * Apply suggestions from code review Co-authored-by: Utkarsh <[email protected]> * merge conf --------- Co-authored-by: Austin Huang <[email protected]> Co-authored-by: Austin Huang <[email protected]> Co-authored-by: Utkarsh <[email protected]> * Scalar tests passing * Change mp_to_pauli to be more general * Hamiltonian testing * tests * Revert "tests" This reverts commit 4f21e7ddf354cc36efee55c5d50e4f978c3d2729. * Revert "Hamiltonian testing" This reverts commit 17c3e674235709a7c5e1baf037ebf37b42f3efbf. * Revert "Change mp_to_pauli to be more general" This reverts commit a1ff60638f19d302a802f46a4d586a616e0be95c. * revert * Install PL dev intead of PL stable on CI (#516) (#518) * install PL dev intead of PL stable on CI * trigger ci * also a couple of other places Co-authored-by: lillian542 <[email protected]> * Delete ds store * import change * black * some changes * linters * black * pylinting * black * small change * change conftest * black linter * fix * Generalize mp_to_pauli so that it can work with any observable that has a Pauli Rep (#517) * tests * converter * fixes to tests * refactor * delete print * black * pylint changes * deleted tests/pylintrc * one additional test * black * tests * redo commits * clean up * black * formatting * black * Update pennylane_qiskit/converter.py Co-authored-by: Utkarsh <[email protected]> * rewrite tests to all manual cases * [skip-ci] black * single qubit operations * value error for no pauli rep * list comprehension * removed one list comprehension * ehh honestly this is fine too * delete some useless lines * [skip-ci] refactor * [skip ci] accidentally deleted something...? * Update tests/test_converter.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/converter.py Co-authored-by: lillian542 <[email protected]> * remove parametrize * [skip ci] black * [skip ci] docstring * [skip ci] added assert statement * [skip-ci] linear comb changes * additional more complicated integration tests * undo some formatting * formats * integration tests * tests * deleted unsupported observables * remove sparsehamiltonian for now * rollback pylint * revert observable stopping condition * black * just a commit * black * fm * Update tests/test_base_device.py Co-authored-by: Utkarsh <[email protected]> * linter errors * linter * linter * linters * try finally block better? * revert * let's just do this... * trailing whitespace * linter * black * formats * black * black * clean up commits * reformatting fixed * clean up commit --------- Co-authored-by: Utkarsh <[email protected]> Co-authored-by: lillian542 <[email protected]> * Use old _execute_runtime_service for observables that are not compatible with SPO representation (#525) * Functionality * syntax error * additional test * additional test cases * edit comment * comment * additional comments * added a warning * added a warning * delete print statement * warning test * delete a test * black * Minor adjustment to sort observables. Modified tests to accomodate. Doc strings edit * Modified tests and warning * edit * fixes * moved test to mocked * mockedbackend update * black * changes * test * uncomment * docstring * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * black * fix --------- Co-authored-by: lillian542 <[email protected]> Co-authored-by: Utkarsh <[email protected]> * Move off of "ibmq_qasm_simulator" and towards using AerSimulator for qiskit tests (#521) * import aersimulator * commit * black * added functionality for local simulators when use_primitves = False * [skip ci] changes to AerSim * removal of ibm service * tests * woops * temp fixes * unfinished changes * ignore tests due to version errors * ignore tests due to version errors * black * cleanup * delete comment * revert a change * replaced a test case * shouldn't need to skip if no acc anymore * added comments * delete comment * minor refactor * Added additional comments * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * [skip ci] delete comment * add comment --------- Co-authored-by: Utkarsh <[email protected]> * Update reqs to 1.0 (#536) * removed legacy ci * Delete .github/workflows/tests.yml * naming and 0.46 test * rename * update qiskit device * dep warnings * pylint * removed devices * pylint * pylint * docs fix * setup.py changes * delete * revert * reqs change * setup * change to reqs to match ci * removed a test * pylint * put ibmq.rst back * delete ibmq * remove ibmq * deletion * codecov * lint * changes to tests * Revert "Remove devices that will not be supported in the new release" (#544) * changelogs * Remove basicaer (#546) * removed legacy ci * Delete .github/workflows/tests.yml * naming and 0.46 test * rename * update qiskit device * dep warnings * pylint * removed devices * pylint * pylint * docs fix * setup.py changes * delete * revert * reqs change * setup * change to reqs to match ci * removed a test * pylint * put ibmq.rst back * delete ibmq * remove ibmq * deletion * codecov * lint * changes to tests * Revert "Remove devices that will not be supported in the new release" (#544) * docs * remove basicaer * reqs to build docs * docs * pylint * tests fix * path change * Changelog and doc * changelogs * Update CHANGELOG.md * deleted a test file * removed error * basic sim pylint * Update CHANGELOG.md Co-authored-by: lillian542 <[email protected]> * remove ifelse block * pylint --------- Co-authored-by: lillian542 <[email protected]> * Remove use primitives and everything that depends on it (#538) * removed legacy ci * Delete .github/workflows/tests.yml * Deleted use_primitives from tests * remove use_primitive kwarg and things that depend on it * fix tests and split_exec * fixed test * pylint * naming and 0.46 test * rename * update qiskit device * dep warnings * pylint * changes to tests * removed backend.run() and _execute_runtime * remove additional stuff * linter * docstring changes * skip additional test * docstrings * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: Utkarsh <[email protected]> --------- Co-authored-by: lillian542 <[email protected]> Co-authored-by: Utkarsh <[email protected]> * Remove ibmq devices (#550) * Removing ibmq devices from the docs and relevant files * missed something in docs * Changelog updates * Update CHANGELOG.md Co-authored-by: Utkarsh <[email protected]> --------- Co-authored-by: Utkarsh <[email protected]> * Migrate to v2 primitives (#539) * removed legacy ci * Delete .github/workflows/tests.yml * Deleted use_primitives from tests * remove use_primitive kwarg and things that depend on it * fix tests and split_exec * fixed test * pylint * change to v2 prims, del Options * del Options * temp changes to options * naming and 0.46 test * rename * update qiskit device * dep warnings * pylint * changes to tests * deleted options for now * small changes * access sampler results * Sampler tests and functionality * estimator multi measurement works * estimator now gives variances * comments * removed backend.run() and _execute_runtime * remove additional stuff * linter * docstring changes * skip additional test * [skip ci] format is correct, checks probs as well * [skip ci] docstring * docstrings * un did confusing change that didnt do anything * rerun ci * Syntax changes due to version change * Delete for codecov * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * docstrings * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * finishing touches * comments * [skip ci] formatting * [skip ci] refactor * deleting unused tests * line change * pylint * yay * docstring * refactoring of estimator and sampler * process_estimator_job tests * comment for clarity --------- Co-authored-by: lillian542 <[email protected]> Co-authored-by: Utkarsh <[email protected]> * pylint * Process kwargs (#547) * removed legacy ci * Delete .github/workflows/tests.yml * Deleted use_primitives from tests * remove use_primitive kwarg and things that depend on it * fix tests and split_exec * fixed test * pylint * change to v2 prims, del Options * del Options * temp changes to options * naming and 0.46 test * rename * update qiskit device * dep warnings * pylint * changes to tests * deleted options for now * small changes * access sampler results * Sampler tests and functionality * estimator multi measurement works * estimator now gives variances * comments * removed backend.run() and _execute_runtime * remove additional stuff * linter * docstring changes * skip additional test * [skip ci] format is correct, checks probs as well * [skip ci] docstring * docstrings * We delete the Options Handling class because there are no more Options() to handle. Additionally, process_kwargs is left as a stub as a temporary measure while we figure out what to do with kwargs * changed warnings due to difference in UI for setting shots between Qiskit and Pennylane. Tracking shots has also been updated due to estimatorV2 syntax change * un did confusing change that didnt do anything * rerun ci * Syntax changes due to version change * Delete for codecov * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * docstrings * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * finishing touches * comments * [skip ci] formatting * [skip ci] refactor * due to the fact that shots are not tracked in the estimator's metadata anymore, variances are calculated a different way using the precision instead * black * lint * docstring changes * backend options? * deleting unused tests * line change * [skip ci] changed test to be more readable * New tests for options functionality and edge case * pylint * We make sure that transpilation options are not passed to the primitive and that no errors are raised as a result * Due to changing the signature of get_transpile_args(), we need to fix one of the tests * warning message for default_shots was unclear. changed to be more clear * add more comments * yay * docstring * Testing to ensure that options and kwargs combine properly * edit tests for pylint * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * edit test regex matching due to changes earlier * refactoring of estimator and sampler * generate samples tested * process_estimator_job tests * comment for clarity * pylint * pylint * [skip ci] minor formatting * Fix unintended additonal dimensionality and added test for res != 1 testcase * fix to transpiles * comments to explain some stuff * merge conflicts * docstring * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * clean up * refactor * pylint * formatting of docstring * revert to tuple(res) * [skip ci] fix to dimensions of sampler * docstrings * some docstrings changes * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * black * linter --------- Co-authored-by: lillian542 <[email protected]> Co-authored-by: Utkarsh <[email protected]> * Docstrings for converter functions and new qiskit device (#552) * removed legacy ci * Delete .github/workflows/tests.yml * Deleted use_primitives from tests * remove use_primitive kwarg and things that depend on it * fix tests and split_exec * fixed test * pylint * change to v2 prims, del Options * del Options * temp changes to options * naming and 0.46 test * rename * update qiskit device * dep warnings * pylint * changes to tests * deleted options for now * small changes * access sampler results * Sampler tests and functionality * estimator multi measurement works * estimator now gives variances * comments * removed backend.run() and _execute_runtime * remove additional stuff * linter * docstring changes * skip additional test * [skip ci] format is correct, checks probs as well * [skip ci] docstring * docstrings * We delete the Options Handling class because there are no more Options() to handle. Additionally, process_kwargs is left as a stub as a temporary measure while we figure out what to do with kwargs * changed warnings due to difference in UI for setting shots between Qiskit and Pennylane. Tracking shots has also been updated due to estimatorV2 syntax change * un did confusing change that didnt do anything * rerun ci * Syntax changes due to version change * Delete for codecov * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * docstrings * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * finishing touches * comments * [skip ci] formatting * [skip ci] refactor * due to the fact that shots are not tracked in the estimator's metadata anymore, variances are calculated a different way using the precision instead * black * lint * docstring changes * backend options? * deleting unused tests * line change * [skip ci] changed test to be more readable * New tests for options functionality and edge case * pylint * We make sure that transpilation options are not passed to the primitive and that no errors are raised as a result * Due to changing the signature of get_transpile_args(), we need to fix one of the tests * warning message for default_shots was unclear. changed to be more clear * add more comments * yay * docstring * Testing to ensure that options and kwargs combine properly * edit tests for pylint * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * edit test regex matching due to changes earlier * refactoring of estimator and sampler * generate samples tested * process_estimator_job tests * comment for clarity * pylint * pylint * [skip ci] minor formatting * [skip ci] docstrings for converter functions * Fix unintended additonal dimensionality and added test for res != 1 testcase * fix to transpiles * comments to explain some stuff * merge conflicts * [skip ci] examples of QiskitDevice2 added to docstring * docstring changes * docstring * more docstrings * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * clean up * refactor * pylint * formatting of docstring * docstrings * docstrings * formatting * changes * some examples * Update pennylane_qiskit/converter.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * examples and links * change inheritance for remote device * build docs * better docs * fix docs a little * remove redundant docstrings * revert * import fix * build sphinx * revert change to QiskitDev2 * Update pennylane_qiskit/remote.py Co-authored-by: Utkarsh <[email protected]> * reformat to within 100 chars --------- Co-authored-by: lillian542 <[email protected]> Co-authored-by: Utkarsh <[email protected]> * Diagonalize gates (#558) * removed legacy ci * Delete .github/workflows/tests.yml * Deleted use_primitives from tests * remove use_primitive kwarg and things that depend on it * fix tests and split_exec * fixed test * pylint * change to v2 prims, del Options * del Options * temp changes to options * naming and 0.46 test * rename * update qiskit device * dep warnings * pylint * changes to tests * deleted options for now * small changes * access sampler results * Sampler tests and functionality * estimator multi measurement works * estimator now gives variances * comments * removed backend.run() and _execute_runtime * remove additional stuff * linter * docstring changes * skip additional test * [skip ci] format is correct, checks probs as well * [skip ci] docstring * docstrings * We delete the Options Handling class because there are no more Options() to handle. Additionally, process_kwargs is left as a stub as a temporary measure while we figure out what to do with kwargs * changed warnings due to difference in UI for setting shots between Qiskit and Pennylane. Tracking shots has also been updated due to estimatorV2 syntax change * un did confusing change that didnt do anything * rerun ci * Syntax changes due to version change * Delete for codecov * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * docstrings * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * finishing touches * comments * [skip ci] formatting * [skip ci] refactor * due to the fact that shots are not tracked in the estimator's metadata anymore, variances are calculated a different way using the precision instead * black * lint * docstring changes * backend options? * deleting unused tests * line change * [skip ci] changed test to be more readable * New tests for options functionality and edge case * pylint * We make sure that transpilation options are not passed to the primitive and that no errors are raised as a result * Due to changing the signature of get_transpile_args(), we need to fix one of the tests * warning message for default_shots was unclear. changed to be more clear * add more comments * yay * docstring * Testing to ensure that options and kwargs combine properly * edit tests for pylint * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * edit test regex matching due to changes earlier * refactoring of estimator and sampler * generate samples tested * process_estimator_job tests * comment for clarity * pylint * pylint * [skip ci] minor formatting * Fix unintended additonal dimensionality and added test for res != 1 testcase * fix to transpiles * comments to explain some stuff * merge conflicts * docstring * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * clean up * refactor * pylint * formatting of docstring * revert to tuple(res) * [skip ci] fix to dimensions of sampler * docstrings * some docstrings changes * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * black * [skip ci] import split_non_commuting * diagonalize tests for Hadamard * changed stopping condition to reflect reality of what's supported and added tests and changed tests to fit new stopping condition * [skip ci] added comment about qml.var not providing matching answers * some tests * [skip ci] linter * interesting changes * linter * split non commuting test cases * sprod * sampler tested as well * linter * black * docstrings and comments * docstrings and comments black * comment regarding magic number * todo * add np * more concise way of testing * Update tests/test_base_device.py Co-authored-by: Utkarsh <[email protected]> * Update tests/test_base_device.py Co-authored-by: Utkarsh <[email protected]> * fix black * diagonalize for edge case * linter * pylint * clean up * fix docstring --------- Co-authored-by: lillian542 <[email protected]> Co-authored-by: Utkarsh <[email protected]> * Qiskit session (#551) * functionality implemented * minor adjustments to tests * [skip-ci] Qiskit Sessions now test many warnings since you can set session options on device initialization and when using the session manager. We use the options in the device for things that are generally not updateable for the device e.g. backends; we use session options for everything else * [skip-ci] tests that we are passing on kwargs to Qiskit's session constructor, and verifying that an error is raised due to such behavior * [skip ci] pylint * small comments * Generalization of the session options * delicious docstrings * [skip ci] tests and clarification * [skip ci] better session options * comments for clarity * changes to the tests & the warning message * docstrings * type error changes * docstrings * add qiskit_session to docs * a little more consistency in comments * for docs * fix ci * black * revert * revert * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update tests/test_base_device.py Co-authored-by: Utkarsh <[email protected]> * Qiskit Session update * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * docstring update --------- Co-authored-by: Utkarsh <[email protected]> Co-authored-by: lillian542 <[email protected]> * Tests with fakehardware (#553) * removed legacy ci * Delete .github/workflows/tests.yml * Deleted use_primitives from tests * remove use_primitive kwarg and things that depend on it * fix tests and split_exec * fixed test * pylint * change to v2 prims, del Options * del Options * temp changes to options * naming and 0.46 test * rename * update qiskit device * dep warnings * pylint * changes to tests * deleted options for now * small changes * access sampler results * Sampler tests and functionality * estimator multi measurement works * estimator now gives variances * comments * removed backend.run() and _execute_runtime * remove additional stuff * linter * docstring changes * skip additional test * [skip ci] format is correct, checks probs as well * [skip ci] docstring * docstrings * We delete the Options Handling class because there are no more Options() to handle. Additionally, process_kwargs is left as a stub as a temporary measure while we figure out what to do with kwargs * changed warnings due to difference in UI for setting shots between Qiskit and Pennylane. Tracking shots has also been updated due to estimatorV2 syntax change * un did confusing change that didnt do anything * rerun ci * Syntax changes due to version change * Delete for codecov * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * docstrings * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * finishing touches * comments * [skip ci] formatting * [skip ci] refactor * due to the fact that shots are not tracked in the estimator's metadata anymore, variances are calculated a different way using the precision instead * black * lint * docstring changes * backend options? * deleting unused tests * line change * [skip ci] changed test to be more readable * New tests for options functionality and edge case * pylint * We make sure that transpilation options are not passed to the primitive and that no errors are raised as a result * Due to changing the signature of get_transpile_args(), we need to fix one of the tests * warning message for default_shots was unclear. changed to be more clear * add more comments * yay * docstring * Testing to ensure that options and kwargs combine properly * edit tests for pylint * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * edit test regex matching due to changes earlier * refactoring of estimator and sampler * generate samples tested * process_estimator_job tests * comment for clarity * pylint * pylint * [skip ci] minor formatting * Fix unintended additonal dimensionality and added test for res != 1 testcase * fix to transpiles * comments to explain some stuff * merge conflicts * docstring * [skip ci] some tests with fakehardware * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * clean up * refactor * pylint * formatting of docstring * revert to tuple(res) * [skip ci] fix to dimensions of sampler * docstrings * some docstrings changes * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * black * [skip ci] import split_non_commuting * diagonalize tests for Hadamard * changed stopping condition to reflect reality of what's supported and added tests and changed tests to fit new stopping condition * [skip ci] added comment about qml.var not providing matching answers * some tests * [skip ci] linter * interesting changes * linter * split non commuting test cases * sprod * sampler tested as well * linter * black * docstrings and comments * docstrings and comments black * comment regarding magic number * todo * add np * more concise way of testing * Update tests/test_base_device.py Co-authored-by: Utkarsh <[email protected]> * Update tests/test_base_device.py Co-authored-by: Utkarsh <[email protected]> * fix black * diagonalize for edge case * linter * pylint * clean up * fix docstring * flaky * flaky and fake * rename bakcend to aer_backend --------- Co-authored-by: lillian542 <[email protected]> Co-authored-by: Utkarsh <[email protected]> * fix merge conf * fix setup.py * reqs.txt * changelog changes * Use new qiskit device as the base for remote (#566) * import changes * Added TODOs for tests * changes * this should pass * pylint * circular import * observables update * remerge * import from qiskitdevice2 * Delete unnecessary tests and mocks * black/pylint * Add tests back in for codecov. * refactor tests * delete legacy device only functionality * change around imports * add assertion * fix * fix * fix setup * clean up * fix reqs.txt * fix * changelog changed * maybe this works? * a docstring? * a docstring? * reverts * does this break * revert * fix * fix * attempt a doc fix * Update tests/test_integration.py Co-authored-by: Utkarsh <[email protected]> * some docstrings --------- Co-authored-by: obliviateandsurrender <[email protected]> * Plugin page update (#563) * removed legacy ci * Delete .github/workflows/tests.yml * Deleted use_primitives from tests * remove use_primitive kwarg and things that depend on it * fix tests and split_exec * fixed test * pylint * change to v2 prims, del Options * del Options * temp changes to options * naming and 0.46 test * rename * update qiskit device * dep warnings * pylint * changes to tests * deleted options for now * small changes * access sampler results * Sampler tests and functionality * estimator multi measurement works * estimator now gives variances * comments * removed backend.run() and _execute_runtime * remove additional stuff * linter * docstring changes * skip additional test * [skip ci] format is correct, checks probs as well * [skip ci] docstring * docstrings * We delete the Options Handling class because there are no more Options() to handle. Additionally, process_kwargs is left as a stub as a temporary measure while we figure out what to do with kwargs * changed warnings due to difference in UI for setting shots between Qiskit and Pennylane. Tracking shots has also been updated due to estimatorV2 syntax change * un did confusing change that didnt do anything * rerun ci * Syntax changes due to version change * Delete for codecov * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * docstrings * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * finishing touches * comments * [skip ci] formatting * [skip ci] refactor * due to the fact that shots are not tracked in the estimator's metadata anymore, variances are calculated a different way using the precision instead * black * lint * docstring changes * backend options? * deleting unused tests * line change * [skip ci] changed test to be more readable * New tests for options functionality and edge case * pylint * We make sure that transpilation options are not passed to the primitive and that no errors are raised as a result * Due to changing the signature of get_transpile_args(), we need to fix one of the tests * warning message for default_shots was unclear. changed to be more clear * add more comments * yay * docstring * Testing to ensure that options and kwargs combine properly * edit tests for pylint * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * edit test regex matching due to changes earlier * refactoring of estimator and sampler * generate samples tested * process_estimator_job tests * comment for clarity * pylint * pylint * [skip ci] minor formatting * [skip ci] docstrings for converter functions * Fix unintended additonal dimensionality and added test for res != 1 testcase * fix to transpiles * comments to explain some stuff * merge conflicts * [skip ci] examples of QiskitDevice2 added to docstring * docstring changes * docstring * more docstrings * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * clean up * refactor * pylint * formatting of docstring * docstrings * docstrings * formatting * changes * some examples * Update pennylane_qiskit/converter.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * examples and links * change inheritance for remote device * build docs * better docs * fix docs a little * remove redundant docstrings * revert * import fix * prelim changes to aer * changes to build sphinx * revert change * delete section on ibmq devices * add examples for remote.rst * plugin updates to the remote device and basicsim * doc fixes for sphinx build * docs * small fi * fix weird spacing * [skip ci] small fix * [skip ci] error in codeblock * delete extra the * [skip ci] changelog * merge confs * formatting * black * Update doc/devices/remote.rst Co-authored-by: Utkarsh <[email protected]> * Update doc/devices/remote.rst Co-authored-by: Utkarsh <[email protected]> * Update doc/devices/remote.rst Co-authored-by: Utkarsh <[email protected]> * Update doc/devices/remote.rst Co-authored-by: Utkarsh <[email protected]> * Update doc/devices/remote.rst Co-authored-by: Utkarsh <[email protected]> * address comments * undo * readme * plugin page fixes * fixed documentation * fix * Update doc/index.rst Co-authored-by: lillian542 <[email protected]> * doc changes * typo * weird change didn't go through * change to doc * small change * Update doc/devices/remote.rst Co-authored-by: Utkarsh <[email protected]> * Update doc/devices/remote.rst Co-authored-by: Utkarsh <[email protected]> * change name of iqp token * small fix --------- Co-authored-by: lillian542 <[email protected]> Co-authored-by: Utkarsh <[email protected]> * Tracker functionality (#533) * is this all? * doc strings * tests for tracker * trackers * trackers * fixed tests * removed legacy ci * Delete .github/workflows/tests.yml * Deleted use_primitives from tests * remove use_primitive kwarg and things that depend on it * fix tests and split_exec * fixed test * pylint * change to v2 prims, del Options * del Options * temp changes to options * naming and 0.46 test * rename * update qiskit device * dep warnings * pylint * changes to tests * deleted options for now * small changes * access sampler results * Sampler tests and functionality * estimator multi measurement works * estimator now gives variances * comments * removed backend.run() and _execute_runtime * remove additional stuff * linter * docstring changes * skip additional test * [skip ci] format is correct, checks probs as well * [skip ci] docstring * docstrings * We delete the Options Handling class because there are no more Options() to handle. Additionally, process_kwargs is left as a stub as a temporary measure while we figure out what to do with kwargs * changed warnings due to difference in UI for setting shots between Qiskit and Pennylane. Tracking shots has also been updated due to estimatorV2 syntax change * un did confusing change that didnt do anything * rerun ci * Syntax changes due to version change * Delete for codecov * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * docstrings * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * finishing touches * comments * [skip ci] formatting * [skip ci] refactor * due to the fact that shots are not tracked in the estimator's metadata anymore, variances are calculated a different way using the precision instead * black * lint * docstring changes * backend options? * deleting unused tests * line change * [skip ci] changed test to be more readable * New tests for options functionality and edge case * pylint * We make sure that transpilation options are not passed to the primitive and that no errors are raised as a result * Due to changing the signature of get_transpile_args(), we need to fix one of the tests * warning message for default_shots was unclear. changed to be more clear * add more comments * yay * docstring * Testing to ensure that options and kwargs combine properly * edit tests for pylint * woops * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * Update pennylane_qiskit/qiskit_device2.py Co-authored-by: Utkarsh <[email protected]> * edit test regex matching due to changes earlier * print out some stuff for tests * refactoring of estimator and sampler * generate samples tested * process_estimator_job tests * comment for clarity * pylint * pylint * [skip ci] temp * [skip ci] There is a bug due to the post processing of results that is causing some of the assertion statements to fail. We can ignore these assertions for now and address how to rework reorder_fn to avoid this bug * [skip ci] * [skip ci] minor formatting * Fix unintended additonal dimensionality and added test for res != 1 testcase * fix to transpiles * comments to explain some stuff * merge conflicts * pylint * formatting * tracker comments * black * comments about the tracker * bet * fix to imports * black * temp * baller implementation * increase shot number to reduce error * edit function * black * better tests * refactor * black * delete print statement * refactor * Delete unneeded import * fix assertion * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * Update tests/test_base_device.py Co-authored-by: lillian542 <[email protected]> * new tests * removed simulations keyword * some xfails pending discussion --------- Co-authored-by: lillian542 <[email protected]> Co-authored-by: Utkarsh <[email protected]> * Update CHANGELOG.md Co-authored-by: lillian542 <[email protected]> * CHANGELOG --------- Co-authored-by: lillian542 <[email protected]> Co-authored-by: Matthew Silverman <[email protected]> Co-authored-by: Astral Cai <[email protected]> Co-authored-by: Astral Cai <[email protected]> Co-authored-by: Utkarsh <[email protected]>

austingmhuang and others added 4 commits May 16, 2024 15:52

removed legacy ci

20be42a

Delete .github/workflows/tests.yml

a2dade8

Deleted use_primitives from tests

2c9ca56

remove use_primitive kwarg and things that depend on it

f25d567

austingmhuang changed the base branch from master to new_device_feature_branch May 16, 2024 21:00

austingmhuang added 3 commits May 16, 2024 17:09

fix tests and split_exec

6e743f8

fixed test

ca52cd0

pylint

76e011e

austingmhuang changed the base branch from new_device_feature_branch to update_reqs May 16, 2024 21:15

Merge branch 'update_reqs' into remove_use_primitives

cc9eb07

austingmhuang added 8 commits May 17, 2024 09:48

naming and 0.46 test

61b866f

rename

78a7131

update qiskit device

fd87f82

dep warnings

1b0d3af

pylint

7f13512

Merge branch 'update_reqs' into remove_use_primitives

00337ee

changes to tests

17325a2

Merge branch 'update_reqs' into remove_use_primitives

05b346f

austingmhuang changed the base branch from update_reqs to remove_basicaer May 22, 2024 18:53

Base automatically changed from remove_basicaer to new_device_feature_branch May 23, 2024 13:22

austingmhuang added 4 commits May 23, 2024 09:36

Merge branch 'new_device_feature_branch' into remove_use_primitives

b09755d

removed backend.run() and _execute_runtime

261d7c2

remove additional stuff

7a40f1c

linter

e41cd3d

austingmhuang commented May 24, 2024

View reviewed changes

austingmhuang requested review from lillian542 and obliviateandsurrender May 24, 2024 13:49

austingmhuang added 2 commits May 24, 2024 10:32

docstring changes

b7447e2

skip additional test

cfffed2

austingmhuang commented May 24, 2024

View reviewed changes

docstrings

d6dd44b

lillian542 approved these changes May 24, 2024

View reviewed changes

pennylane_qiskit/qiskit_device2.py Outdated Show resolved Hide resolved

tests/test_base_device.py Outdated Show resolved Hide resolved

tests/test_base_device.py Outdated Show resolved Hide resolved

austingmhuang and others added 3 commits May 27, 2024 15:34

Update tests/test_base_device.py

b704207

Co-authored-by: lillian542 <[email protected]>

Update pennylane_qiskit/qiskit_device2.py

1f84aec

Co-authored-by: lillian542 <[email protected]>

Update tests/test_base_device.py

1d5370a

Co-authored-by: lillian542 <[email protected]>

obliviateandsurrender approved these changes May 28, 2024

View reviewed changes

tests/test_base_device.py Outdated Show resolved Hide resolved

tests/test_base_device.py Show resolved Hide resolved

Update tests/test_base_device.py

7f0a4df

Co-authored-by: Utkarsh <[email protected]>

austingmhuang merged commit 83c9483 into new_device_feature_branch May 28, 2024
9 checks passed

austingmhuang deleted the remove_use_primitives branch May 28, 2024 17:47

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Remove use primitives and everything that depends on it #538

Remove use primitives and everything that depends on it #538

austingmhuang commented May 16, 2024 •

edited

Loading

codecov bot commented May 16, 2024 •

edited

Loading

austingmhuang commented May 16, 2024

austingmhuang May 24, 2024 •

edited

Loading

austingmhuang May 24, 2024

austingmhuang May 24, 2024

austingmhuang May 24, 2024 •

edited

Loading

austingmhuang May 24, 2024

austingmhuang May 24, 2024

lillian542 left a comment

obliviateandsurrender left a comment

		@pytest.mark.skip(
		reason="The functionality of using sampler to get an accurate answer is not yet implemented"

Remove use primitives and everything that depends on it #538

Remove use primitives and everything that depends on it #538

Conversation

austingmhuang commented May 16, 2024 • edited Loading

codecov bot commented May 16, 2024 • edited Loading

Codecov Report

austingmhuang commented May 16, 2024

austingmhuang May 24, 2024 • edited Loading

Choose a reason for hiding this comment

austingmhuang May 24, 2024

Choose a reason for hiding this comment

austingmhuang May 24, 2024

Choose a reason for hiding this comment

austingmhuang May 24, 2024 • edited Loading

Choose a reason for hiding this comment

austingmhuang May 24, 2024

Choose a reason for hiding this comment

austingmhuang May 24, 2024

Choose a reason for hiding this comment

lillian542 left a comment

Choose a reason for hiding this comment

obliviateandsurrender left a comment

Choose a reason for hiding this comment

austingmhuang commented May 16, 2024 •

edited

Loading

codecov bot commented May 16, 2024 •

edited

Loading

austingmhuang May 24, 2024 •

edited

Loading

austingmhuang May 24, 2024 •

edited

Loading