feature: Introduce Validating Emulators with Noise Models to the SDK #1017

Altanali · 2024-07-10T23:19:25Z

Issue #, if available:

Description of changes:

This PR introduces the notion of device emulators and emulation passes to the BDK; device emulators provide some form of program compilation and validation and may apply a noise model to the program before simulating the program on the BDK LocalSimulator.

AwsDevice specific emulators are created based on the device properties and capabilities; noise models for gate-based QPUs are created based on calibration data retrieved from Braket service when creating an AwsDevice.

Testing done:

Unit testing covers 99% of emulator passes and noise model generation based on AwsDevice calibration data. (TODO: Complete unit tests for 100% coverage).

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

General

I have read the CONTRIBUTING doc
I used the PR title format described in CONTRIBUTING
I have updated any necessary documentation, including READMEs and API docs (if appropriate)

Tests

I have added tests that prove my fix is effective or that my feature works (if appropriate)
I have checked that my tests are not configured for a specific region or account (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

…OpenQASM3.0 sources

…f attribute strings; introduce PyTket-to-QASM translations

…nherit from EmulatorPass

…nstead of gate name strings in GateFidelity data class.

…s using QPU device properties

…l inside AwsDevice

speller26

Still reviewing; great work though!

speller26 · 2024-07-22T03:47:50Z

src/braket/emulators/emulator_interface.py

+            task_specification = emulator_pass(task_specification)
+        return task_specification
+
+    def run_validation_passes(self, task_specification: ProgramType) -> None:


Might be better to call this validate

speller26 · 2024-07-22T03:48:06Z

src/braket/emulators/emulator_interface.py

+    def __init__(self, emulator_passes: Iterable[EmulatorPass] = None):
+        self._emulator_passes = emulator_passes if emulator_passes is not None else []
+
+    def run_program_passes(self, task_specification: ProgramType) -> ProgramType:


May just run_passes?

speller26 · 2024-07-22T03:49:48Z

src/braket/aws/aws_emulator_helpers.py

+)
+
+
+def create_qubit_count_criterion(properties: DeviceCapabilities) -> QubitCountCriterion:


Just qubit_count_criterion is fine; same goes for other create methods

speller26 · 2024-07-22T05:19:50Z

src/braket/aws/aws_emulator_helpers.py

+    return GateCriterion(supported_gates=supported_gates, native_gates=native_gates)
+
+
+@singledispatch


singledispatch produces really ugly documentation when used on public functions; only use it on private methods, like so:

def connectivity_criterion(...): return _connectivity_criterion(...) @singledispatch def _connectivity_criterion(...): ...

Updated! Thank you for this callout, I wasn't aware of that interaction!

speller26 · 2024-07-22T05:22:36Z

src/braket/aws/aws_emulator_helpers.py

+    return GateConnectivityCriterion(gate_connectivity_graph)
+
+
+def get_qpu_gate_translation(


Are the names not already standardized across QPUs? This shouldn't be necessary.

There are a few places where translation to a Braket gate name was necessary, i.e. gate names in Rigetti calibration data ("CPHASE" is used instead of the standard "cphaseshift") or in IonQs native gate set (translating "GPI"/"GPI2" to "GPi"/"GPi2"). I felt this was a little cleaner than doing translations in each place required.

speller26 · 2024-07-22T05:23:36Z

src/braket/aws/aws_noise_models.py

+ The following gate duration values are not available through Braket device
+ calibration data and must be hardcoded.
+"""
+QPU_GATE_DURATIONS = {


Make this private; in fact, make things private whenever possible.

speller26 · 2024-07-22T05:23:59Z

src/braket/aws/aws_noise_models.py

+        self._validate_two_qubit_specs()
+
+
+def create_device_noise_model(properties: DeviceCapabilities, arn: str) -> NoiseModel:


device_noise_model is sufficient

speller26 · 2024-07-22T05:24:42Z

src/braket/emulators/emulator_passes/emulator_pass.py

+        """Runs the emulator pass on the provided program.
+        Args:
+            program (ProgramType): The program to run the emulator pass on.
+        Returns:
+            ProgramType: The program after the emulator pass has been applied.


nit

Suggested change

"""Runs the emulator pass on the provided program.

Args:

program (ProgramType): The program to run the emulator pass on.

Returns:

ProgramType: The program after the emulator pass has been applied.

"""Runs the emulator pass on the provided program.

Args:

program (ProgramType): The program to run the emulator pass on.

Returns:

ProgramType: The program after the emulator pass has been applied.

src/braket/emulators/emulator_passes/criteria/connectivity_criterion.py

speller26 · 2024-07-22T05:26:02Z

src/braket/emulators/emulator_passes/criteria/connectivity_criterion.py

+        Args:
+            circuit (Circuit): The Braket circuit whose gate operations to
+                validate.
+        """


Should also add a Raises section

Added a Raises section to all methods where an exception is raised!

…e in aws_emulator_helpers; general documentation cleanup.

src/braket/emulators/emulator_passes/criteria/connectivity_criterion.py

speller26 · 2024-07-29T07:39:52Z

src/braket/emulators/emulator_passes/criteria/connectivity_criterion.py

+            or a valid DiGraph or dict representation of a connectivity graph is not provided.
+        """
+
+        if not (connectivity_graph or fully_connected):


Maybe also raise an error if both are provided?

speller26 · 2024-07-29T07:54:14Z

src/braket/emulators/emulator_passes/emulator_pass.py

+ProgramType = TypeVar("ProgramType")
+
+
+class EmulatorPass(ABC):


Should be EmulatorPass(ABC, Generic[ProgramType]); also, how about EmulationPass?

Updated in b698648!

speller26 · 2024-07-29T07:54:34Z

src/braket/emulators/emulator_passes/emulator_pass.py

+from abc import ABC, abstractmethod
+from typing import TypeVar
+
+ProgramType = TypeVar("ProgramType")


For generics, it's fine to use just T = TypeVar("T")

I've opted to use "ProgramType" just as it makes it clearer throughout code/documentation that an EmulatorPass expects some generic program as input - let me know if this approach makes sense!

src/braket/emulators/emulator_passes/criteria/emulator_criterion.py

src/braket/emulators/emulator_passes/criteria/gate_connectivity_criterion.py

src/braket/emulators/emulator_passes/criteria/connectivity_criterion.py

speller26 · 2024-07-29T08:15:37Z

src/braket/emulators/emulator_passes/criteria/connectivity_criterion.py

+from braket.registers.qubit_set import QubitSet
+
+
+class ConnectivityCriterion(EmulatorCriterion):


ConnectivityCriterion(EmulatorCriterion[Circuit]); also, how about naming all the Criterion subclasses __Validators?

src/braket/emulators/__init__.py

src/braket/emulators/emulator_passes/criteria/gate_criterion.py

src/braket/emulators/emulator.py

src/braket/emulators/emulator_interface.py

src/braket/aws/aws_emulator_helpers.py

… program type in EmulatorPasses

…n a designated directory.

…lar dependencies

…Emulator._get_local_simulator_backend overwriting user provided backend name.

…dk-python into only_validation

…exception raised by an EmulatorPass in order to modify the message with the Emulator name.

…unsupported device capabilities

speller26 · 2024-08-01T06:42:56Z

src/braket/emulation/emulation_passes/gate_device_passes/gate_validator.py

+        supported_gates: Optional[Iterator[str]] = None,
+        native_gates: Optional[Iterator[str]] = None,


Suggested change

supported_gates: Optional[Iterator[str]] = None,

native_gates: Optional[Iterator[str]] = None,

supported_gates: Optional[Iterable[str]] = None,

native_gates: Optional[Iterable[str]] = None,

🤦‍♂️ Thanks for catching this, fixed!

src/braket/aws/aws_device.py

speller26 · 2024-08-01T16:36:53Z

src/braket/aws/aws_emulation.py

+    return GateConnectivityValidator(gate_connectivity_graph)
+
+
+def _get_qpu_gate_translations(


I'll be very happy when this is no longer needed

speller26 · 2024-08-01T16:53:16Z

src/braket/emulation/emulation_passes/gate_device_passes/gate_validator.py

+            self._supported_gates = set(BRAKET_GATES[gate.lower()] for gate in supported_gates)
+        except KeyError as e:
+            raise ValueError(f"Input {str(e)} in supported_gates is not a valid Braket gate name.")
+
+        try:
+            self._native_gates = set(BRAKET_GATES[gate.lower()] for gate in native_gates)


nit: frozenset instead of set

Changed to frozenset!

speller26 · 2024-08-02T00:24:50Z

src/braket/emulation/emulation_passes/emulation_pass.py

This is general enough that it perhaps belongs in its own module (maybe passes or transpilation)? The class itself might even be named just Pass; at the very least, EmulationPass is to specific for what it's actually capable of.

I've moved it to a module called "passes" under the name "BasePass" (to try and avoid collisions with the pass keyword even if the casing is different). Now, ValidationPass inherits directly from BasePass!

speller26 · 2024-08-02T00:40:33Z

Looking good to me, let's see if @krneta has any feedback!

ltnln added 30 commits June 2, 2024 23:35

feat: Introduce emulator criterion

ea85675

feat: Introduce NativeGateCriterion + Unit Tests

28ec84e

feat: Introduce SupportedGateCriterion + Unit Tests

f41c52b

feat: Introduce Connectivity Criterion + Unit Tests

fee7888

feat: Add __init__.py to emulators/criteria module

6f216ab

feat: Add OpenQASM3.0-to-Pytket translations

4e909e5

feat: Introduce PytketProgramContext to generate PytketCircuits from …

e3e4593

…OpenQASM3.0 sources

feat: Begin emulator pass implementation

eda10b7

feat: Change gate translations to use pytket OpType objects instead o…

096aae7

…f attribute strings; introduce PyTket-to-QASM translations

Merge branch 'add_pytket_context' into add_tket_mapping_pass

0483fb9

feat: Introduce Pytket-to-Openqasm Translators

a801ad4

fix: Covert from radians to Tket half-turns in PytketContext

36eff02

feat: add MEASUREMENT_REGISTER_NAME to translation constants

a328916

feat: Introduce EmulatorPass abstraction and have EmulatorCriterion i…

94b4226

…nherit from EmulatorPass

fix: Update __init__.pys for emulator_pass and criteria directories

1d37b0a

fix: Correct import paths in emulator_passes source and tests

52e0465

feat: Introduce Gate Connectivity Criterion

467c27c

fix: Correct qubit order in error print statement

5dca87d

feat: Add GateConnectivityCriterion tests

4c92658

feat: Basic AWS Noise Model

88c9530

fix: Discard IonQ Single Qubit Gate Fidelities and use Gate classes i…

1ff8cfa

…nstead of gate name strings in GateFidelity data class.

Merge branch 'emulation_criteria_basic' into end_to_end_prototype

3355759

fix: Include EmulatorCriterion in __init__.py for emulator_passes module

edef55d

feat: Introduce Emulator Interface and AwsEmulator

14d09e8

fix: Fix gate device noise model file name typo

c229adc

Merge branch 'add_gate_connectivity' into end_to_end_prototype

362ef45

fix: Remove stray print statement

74fecd0

feat: Introduce emulators and instantiate emulators within AWS device…

28e79bc

…s using QPU device properties

feat: Introduce Qubit Count Criteria

dc4a9cf

feat: Move NoiseModel generation to a set of helper functions and cal…

56e730e

…l inside AwsDevice

speller26 reviewed Jul 22, 2024

View reviewed changes

change: Add Raises documentation and make dispatched functions privat…

34b94ae

…e in aws_emulator_helpers; general documentation cleanup.

speller26 reviewed Jul 29, 2024

View reviewed changes

src/braket/emulators/emulator.py Outdated Show resolved Hide resolved

src/braket/emulators/emulator_interface.py Outdated Show resolved Hide resolved

src/braket/aws/aws_emulator_helpers.py Outdated Show resolved Hide resolved

Altanali and others added 7 commits July 29, 2024 11:56

Merge branch 'amazon-braket:main' into only_validation

70881c6

change: Use 'validator' in place of 'criterion', fix usage of generic…

b698648

… program type in EmulatorPasses

change: Reorganize modules to place all gate-device emulator passes i…

e1cb307

…n a designated directory.

fix: Correct __init__.pys for emulator_passes module and remove circu…

3b500a3

…lar dependencies

change: Rename emulator_passes directory to emulation_passes

7d7279e

change: Remove outdated connectivity_criterion.py file

8c63da6

Merge branch 'main' into only_validation

df11f66

speller26 requested a review from mbeach-aws July 30, 2024 19:47

ltnln added 4 commits July 30, 2024 13:15

fix: Use deepcopy before applying emulation passes to a program, fix …

a79e07d

…Emulator._get_local_simulator_backend overwriting user provided backend name.

Merge branch 'only_validation' of github.com:Altanali/amazon-braket-s…

96e917a

…dk-python into only_validation

fix: Fix Emulator raising a new Exception instance from the original …

f30379c

…exception raised by an EmulatorPass in order to modify the message with the Emulator name.

change: Change error message when trying to create a NoiseModel from …

9bddfbc

…unsupported device capabilities

speller26 reviewed Aug 2, 2024

View reviewed changes

ltnln and others added 11 commits August 2, 2024 12:27

feat: Replace 'EmulationPass' with more general BasePass class

4626332

change: Remove mentions of 'emulation' from the BasePass module.

e3ca8a5

change: Fix style in BasePass.py

baccbb1

Merge branch 'main' into only_validation

371fc8f

Update aws_noise_models.py

5aaa69c

Merge branch 'main' into only_validation

6f04be3

Rearranging classes

565f03d

extract internal constants

99f4e09

Merge branch 'main' into only_validation

77ef794

linters

0eeb4ee

moving modules

77e4c0a

speller26 marked this pull request as draft February 3, 2025 21:46

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feature: Introduce Validating Emulators with Noise Models to the SDK #1017

feature: Introduce Validating Emulators with Noise Models to the SDK #1017

Altanali commented Jul 10, 2024 •

edited

Loading

speller26 left a comment

speller26 Jul 22, 2024

speller26 Jul 22, 2024

speller26 Jul 22, 2024

Altanali Jul 22, 2024

speller26 Jul 22, 2024

Altanali Jul 22, 2024

speller26 Jul 22, 2024

Altanali Jul 22, 2024

speller26 Jul 22, 2024

speller26 Jul 22, 2024

Altanali Jul 22, 2024

speller26 Jul 22, 2024

Altanali Jul 22, 2024

speller26 Jul 22, 2024

Altanali Jul 22, 2024

speller26 Jul 29, 2024

speller26 Jul 29, 2024

Altanali Jul 30, 2024 •

edited

Loading

speller26 Jul 29, 2024

Altanali Jul 30, 2024

speller26 Jul 29, 2024

speller26 Aug 1, 2024

Altanali Aug 2, 2024

speller26 Aug 1, 2024

speller26 Aug 1, 2024

Altanali Aug 2, 2024

speller26 Aug 2, 2024

Altanali Aug 2, 2024

speller26 commented Aug 2, 2024

		)


		def create_qubit_count_criterion(properties: DeviceCapabilities) -> QubitCountCriterion:

		return GateCriterion(supported_gates=supported_gates, native_gates=native_gates)


		@singledispatch

		return GateConnectivityCriterion(gate_connectivity_graph)


		def get_qpu_gate_translation(

		self._validate_two_qubit_specs()


		def create_device_noise_model(properties: DeviceCapabilities, arn: str) -> NoiseModel:

		ProgramType = TypeVar("ProgramType")


		class EmulatorPass(ABC):

		from braket.registers.qubit_set import QubitSet


		class ConnectivityCriterion(EmulatorCriterion):

		supported_gates: Optional[Iterator[str]] = None,
		native_gates: Optional[Iterator[str]] = None,

		return GateConnectivityValidator(gate_connectivity_graph)


		def _get_qpu_gate_translations(

feature: Introduce Validating Emulators with Noise Models to the SDK #1017

Are you sure you want to change the base?

feature: Introduce Validating Emulators with Noise Models to the SDK #1017

Conversation

Altanali commented Jul 10, 2024 • edited Loading

Merge Checklist

General

Tests

speller26 left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Altanali Jul 30, 2024 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

speller26 commented Aug 2, 2024

Altanali commented Jul 10, 2024 •

edited

Loading

Altanali Jul 30, 2024 •

edited

Loading