Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Qubes-4.2.202403091511-x86_64.iso fails to boot via UEFI in CI #9028

Closed
marmarek opened this issue Mar 10, 2024 · 3 comments
Closed

Qubes-4.2.202403091511-x86_64.iso fails to boot via UEFI in CI #9028

marmarek opened this issue Mar 10, 2024 · 3 comments
Assignees
Labels
affects-4.2 This issue affects Qubes OS 4.2. C: installer diagnosed Technical diagnosis has been performed (see issue comments). P: blocker Priority: blocker. Prevents release or would have prevented release if known prior to release.

Comments

@marmarek
Copy link
Member

Observation

openQA test in scenario qubesos-4.2-install-iso-x86_64-install_keyboard_layout@uefi fails in
install_startup

All tests of UEFI installation failed, installed didn't boot (black screen). Applies to both kernel and kernel-latest tests.

Test suite description

Reproducible

Fails since (at least) Build 4.2.202403091511

Expected result

Last good: 4.2.202402240833 (or more recent)

Further details

Always latest result in this scenario: latest

@marmarek marmarek added T: bug C: installer P: blocker Priority: blocker. Prevents release or would have prevented release if known prior to release. labels Mar 10, 2024
@marmarek marmarek self-assigned this Mar 10, 2024
@marmarek marmarek moved this to In progress in Current team tasks Mar 10, 2024
@marmarek
Copy link
Member Author

Xen hypervisor allocated kernel memory conflicts with E820 map

@marmarek
Copy link
Member Author

Full boot messages (including memory map):

Details

 Xen 4.17.3
(XEN) Xen version 4.17.3 (mockbuild@[unknown]) (gcc (GCC) 12.3.1 20230508 (Red Hat 12.3.1-1)) debug=n Tue Feb  6 03:30:44 GMT 2024
(XEN) Latest ChangeSet: 
(XEN) build-id: a3ce2d077c63b407f6df481100efc647c9571ad7
(XEN) Bootloader: GRUB 2.06
(XEN) Command line: loglvl=all console=com1 com1=115200,8n1 loglvl=all guest_loglvl=all
(XEN) Xen image load base address: 0xbda00000
(XEN) Video information:
(XEN)  VGA is graphics mode 2048x2048, 32 bpp
(XEN) Disc information:
(XEN)  Found 0 MBR signatures
(XEN)  Found 1 EDD information structures
(XEN) CPU Vendor: Intel, Family 6 (0x6), Model 79 (0x4f), Stepping 1 (raw 000406f1)
(XEN) EFI RAM map:
(XEN)  [0000000000000000, 000000000009ffff] (usable)
(XEN)  [0000000000100000, 00000000007fffff] (usable)
(XEN)  [0000000000800000, 0000000000807fff] (ACPI NVS)
(XEN)  [0000000000808000, 000000000080afff] (usable)
(XEN)  [000000000080b000, 000000000080bfff] (ACPI NVS)
(XEN)  [000000000080c000, 000000000080ffff] (usable)
(XEN)  [0000000000810000, 00000000008fffff] (ACPI NVS)
(XEN)  [0000000000900000, 00000000bf8ecfff] (usable)
(XEN)  [00000000bf8ed000, 00000000bfb6cfff] (reserved)
(XEN)  [00000000bfb6d000, 00000000bfb7efff] (ACPI data)
(XEN)  [00000000bfb7f000, 00000000bfbfefff] (ACPI NVS)
(XEN)  [00000000bfbff000, 00000000bff4ffff] (usable)
(XEN)  [00000000bff50000, 00000000bff6ffff] (reserved)
(XEN)  [00000000bff70000, 00000000bfffffff] (ACPI NVS)
(XEN)  [00000000feffc000, 00000000feffffff] (reserved)
(XEN)  [00000000ffe00000, 00000000ffffffff] (reserved)
(XEN)  [0000000100000000, 000000023fffffff] (usable)
(XEN) ACPI: RSDP BFB7E014, 0024 (r2 BOCHS )
(XEN) ACPI: XSDT BFB7D0E8, 004C (r1 BOCHS  BXPC            1       1000013)
(XEN) ACPI: FACP BFB7A000, 0074 (r1 BOCHS  BXPC            1 BXPC        1)
(XEN) ACPI: DSDT BFB7B000, 1AF2 (r1 BOCHS  BXPC            1 BXPC        1)
(XEN) ACPI: FACS BFBDD000, 0040
(XEN) ACPI: APIC BFB79000, 0080 (r3 BOCHS  BXPC            1 BXPC        1)
(XEN) ACPI: HPET BFB78000, 0038 (r1 BOCHS  BXPC            1 BXPC        1)
(XEN) ACPI: WAET BFB77000, 0028 (r1 BOCHS  BXPC            1 BXPC        1)
(XEN) ACPI: BGRT BFB76000, 0038 (r1 INTEL  EDK2            2       1000013)
(XEN) System RAM: 8186MB (8383380kB)
(XEN) No NUMA configuration found
(XEN) Faking a node at 0000000000000000-0000000240000000
(XEN) Domain heap initialised
(XEN) SMBIOS 3.0 present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0xb008 (24 bits)
(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:b004,1:0], pm1x_evt[1:b000,1:0]
(XEN) ACPI:             wakeup_vec[bfbdd00c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ5 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) ACPI: IRQ10 used by override.
(XEN) ACPI: IRQ11 used by override.
(XEN) ACPI: HPET id: 0x8086a201 base: 0xfed00000
(XEN) ACPI: BGRT: invalidating v1 image at 0xbe3d5018
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 2 CPUs (0 hotplug CPUs)
(XEN) IRQ limits: 24 GSI, 392 MSI/MSI-X
(XEN) Switched to APIC driver x2apic_mixed
(XEN) xstate: size: 0x340 and states: 0x7
(XEN) CPU0: Intel machine check reporting enabled
(XEN) Mitigating GDS by disabling AVX while virtualised - protections are best-effort
(XEN) Speculative mitigation facilities:
(XEN)   Hardware hints:
(XEN)   Hardware features: IBPB IBRS STIBP SSBD L1D_FLUSH MD_CLEAR
(XEN)   Compiled-in support: INDIRECT_THUNK
(XEN)   Xen settings: BTI-Thunk RETPOLINE, SPEC_CTRL: IBRS- STIBP+ SSBD-, Other: IBPB-ctxt L1D_FLUSH VERW BRANCH_HARDEN
(XEN)   L1TF: believed vulnerable, maxphysaddr L1D 46, CPUID 46, Safe address 300000000000
(XEN)   Support for HVM VMs: MSR_SPEC_CTRL MSR_VIRT_SPEC_CTRL RSB EAGER_FPU
(XEN)   Support for PV VMs: MSR_SPEC_CTRL EAGER_FPU MD_CLEAR
(XEN)   XPTI (64-bit PV only): Dom0 enabled, DomU enabled (with PCID)
(XEN)   PV L1TF shadowing: Dom0 disabled, DomU enabled
(XEN) Using scheduler: SMP Credit Scheduler rev2 (credit2)
(XEN) Initializing Credit2 scheduler
(XEN)  load_precision_shift: 18
(XEN)  load_window_shift: 30
(XEN)  underload_balance_tolerance: 0
(XEN)  overload_balance_tolerance: -3
(XEN)  runqueues arrangement: socket
(XEN)  cap enforcement granularity: 10ms
(XEN) load tracking window length 1073741824 ns
(XEN) Platform timer is 100.000MHz HPET
(XEN) Detected 2099.959 MHz processor.
(XEN) Freed 1016kB unused BSS memory
(XEN) EFI memory map:
(XEN)  0000000000000-0000000000fff type=3 attr=000000000000000f
(XEN)  0000000001000-0000000004fff type=2 attr=000000000000000f
(XEN)  0000000005000-0000000086fff type=7 attr=000000000000000f
(XEN)  0000000087000-0000000087fff type=4 attr=000000000000000f
(XEN)  0000000088000-000000008ffff type=7 attr=000000000000000f
(XEN)  0000000090000-000000009ffff type=2 attr=000000000000000f
(XEN)  0000000100000-00000007fffff type=7 attr=000000000000000f
(XEN)  0000000800000-0000000807fff type=10 attr=000000000000000f
(XEN)  0000000808000-000000080afff type=7 attr=000000000000000f
(XEN)  000000080b000-000000080bfff type=10 attr=000000000000000f
(XEN)  000000080c000-000000080ffff type=7 attr=000000000000000f
(XEN)  0000000810000-00000008fffff type=10 attr=000000000000000f
(XEN)  0000000900000-00000015fffff type=4 attr=000000000000000f
(XEN)  0000001600000-0000008505fff type=2 attr=000000000000000f
(XEN)  0000008506000-000008ca0dfff type=7 attr=000000000000000f
(XEN)  000008ca0e000-00000bbeeefff type=1 attr=000000000000000f
(XEN)  00000bbeef000-00000bbf0efff type=4 attr=000000000000000f
(XEN)  00000bbf0f000-00000bdbfffff type=7 attr=000000000000000f
(XEN)  00000bdc00000-00000bdfb3fff type=2 attr=000000000000000f
(XEN)  00000bdfb4000-00000be03efff type=7 attr=000000000000000f
(XEN)  00000be03f000-00000be206fff type=1 attr=000000000000000f
(XEN)  00000be207000-00000be32ffff type=7 attr=000000000000000f
(XEN)  00000be330000-00000be3c8fff type=4 attr=000000000000000f
(XEN)  00000be3c9000-00000be3c9fff type=2 attr=000000000000000f
(XEN)  00000be3ca000-00000be678fff type=4 attr=000000000000000f
(XEN)  00000be679000-00000be722fff type=3 attr=000000000000000f
(XEN)  00000be723000-00000be7a2fff type=4 attr=000000000000000f
(XEN)  00000be7a3000-00000be7dcfff type=3 attr=000000000000000f
(XEN)  00000be7dd000-00000be7dffff type=4 attr=000000000000000f
(XEN)  00000be7e0000-00000be7edfff type=3 attr=000000000000000f
(XEN)  00000be7ee000-00000be7f1fff type=4 attr=000000000000000f
(XEN)  00000be7f2000-00000be84dfff type=3 attr=000000000000000f
(XEN)  00000be84e000-00000be84ffff type=4 attr=000000000000000f
(XEN)  00000be850000-00000be87efff type=3 attr=000000000000000f
(XEN)  00000be87f000-00000be883fff type=4 attr=000000000000000f
(XEN)  00000be884000-00000be8bcfff type=3 attr=000000000000000f
(XEN)  00000be8bd000-00000be8befff type=4 attr=000000000000000f
(XEN)  00000be8bf000-00000be8dcfff type=3 attr=000000000000000f
(XEN)  00000be8dd000-00000be8dffff type=4 attr=000000000000000f
(XEN)  00000be8e0000-00000be8e1fff type=7 attr=000000000000000f
(XEN)  00000be8e2000-00000be8e7fff type=4 attr=000000000000000f
(XEN)  00000be8e8000-00000be8f2fff type=3 attr=000000000000000f
(XEN)  00000be8f3000-00000be8f6fff type=4 attr=000000000000000f
(XEN)  00000be8f7000-00000be90ffff type=3 attr=000000000000000f
(XEN)  00000be910000-00000be912fff type=4 attr=000000000000000f
(XEN)  00000be913000-00000be924fff type=3 attr=000000000000000f
(XEN)  00000be925000-00000be928fff type=4 attr=000000000000000f
(XEN)  00000be929000-00000be93dfff type=3 attr=000000000000000f
(XEN)  00000be93e000-00000be944fff type=4 attr=000000000000000f
(XEN)  00000be945000-00000be9fffff type=3 attr=000000000000000f
(XEN)  00000bea00000-00000bec04fff type=4 attr=000000000000000f
(XEN)  00000bec05000-00000bec15fff type=3 attr=000000000000000f
(XEN)  00000bec16000-00000bec17fff type=4 attr=000000000000000f
(XEN)  00000bec18000-00000bec1afff type=3 attr=000000000000000f
(XEN)  00000bec1b000-00000bec1bfff type=4 attr=000000000000000f
(XEN)  00000bec1c000-00000bec4bfff type=3 attr=000000000000000f
(XEN)  00000bec4c000-00000bec4ffff type=4 attr=000000000000000f
(XEN)  00000bec50000-00000bec64fff type=3 attr=000000000000000f
(XEN)  00000bec65000-00000bec65fff type=4 attr=000000000000000f
(XEN)  00000bec66000-00000bec6efff type=3 attr=000000000000000f
(XEN)  00000bec6f000-00000bec74fff type=4 attr=000000000000000f
(XEN)  00000bec75000-00000bec88fff type=3 attr=000000000000000f
(XEN)  00000bec89000-00000bec8afff type=4 attr=000000000000000f
(XEN)  00000bec8b000-00000beccffff type=3 attr=000000000000000f
(XEN)  00000becd0000-00000becd0fff type=4 attr=000000000000000f
(XEN)  00000becd1000-00000becd5fff type=3 attr=000000000000000f
(XEN)  00000becd6000-00000becdafff type=4 attr=000000000000000f
(XEN)  00000becdb000-00000becf2fff type=3 attr=000000000000000f
(XEN)  00000becf3000-00000becf6fff type=4 attr=000000000000000f
(XEN)  00000becf7000-00000becfdfff type=3 attr=000000000000000f
(XEN)  00000becfe000-00000bed04fff type=4 attr=000000000000000f
(XEN)  00000bed05000-00000bed23fff type=3 attr=000000000000000f
(XEN)  00000bed24000-00000bed24fff type=4 attr=000000000000000f
(XEN)  00000bed25000-00000bed27fff type=3 attr=000000000000000f
(XEN)  00000bed28000-00000bed2cfff type=4 attr=000000000000000f
(XEN)  00000bed2d000-00000bed34fff type=3 attr=000000000000000f
(XEN)  00000bed35000-00000bed37fff type=4 attr=000000000000000f
(XEN)  00000bed38000-00000bed3cfff type=3 attr=000000000000000f
(XEN)  00000bed3d000-00000bf13cfff type=4 attr=000000000000000f
(XEN)  00000bf13d000-00000bf1f9fff type=3 attr=000000000000000f
(XEN)  00000bf1fa000-00000bf1fafff type=4 attr=000000000000000f
(XEN)  00000bf1fb000-00000bf205fff type=3 attr=000000000000000f
(XEN)  00000bf206000-00000bf209fff type=4 attr=000000000000000f
(XEN)  00000bf20a000-00000bf21bfff type=3 attr=000000000000000f
(XEN)  00000bf21c000-00000bf222fff type=4 attr=000000000000000f
(XEN)  00000bf223000-00000bf251fff type=3 attr=000000000000000f
(XEN)  00000bf252000-00000bf253fff type=4 attr=000000000000000f
(XEN)  00000bf254000-00000bf256fff type=3 attr=000000000000000f
(XEN)  00000bf257000-00000bf259fff type=4 attr=000000000000000f
(XEN)  00000bf25a000-00000bf265fff type=3 attr=000000000000000f
(XEN)  00000bf266000-00000bf268fff type=4 attr=000000000000000f
(XEN)  00000bf269000-00000bf26bfff type=3 attr=000000000000000f
(XEN)  00000bf26c000-00000bf26efff type=4 attr=000000000000000f
(XEN)  00000bf26f000-00000bf28bfff type=3 attr=000000000000000f
(XEN)  00000bf28c000-00000bf28cfff type=4 attr=000000000000000f
(XEN)  00000bf28d000-00000bf28dfff type=3 attr=000000000000000f
(XEN)  00000bf28e000-00000bf2a8fff type=4 attr=000000000000000f
(XEN)  00000bf2a9000-00000bf2b2fff type=3 attr=000000000000000f
(XEN)  00000bf2b3000-00000bf2b6fff type=4 attr=000000000000000f
(XEN)  00000bf2b7000-00000bf2bbfff type=3 attr=000000000000000f
(XEN)  00000bf2bc000-00000bf2bcfff type=4 attr=000000000000000f
(XEN)  00000bf2bd000-00000bf2c8fff type=3 attr=000000000000000f
(XEN)  00000bf2c9000-00000bf2c9fff type=4 attr=000000000000000f
(XEN)  00000bf2ca000-00000bf2cffff type=3 attr=000000000000000f
(XEN)  00000bf2d0000-00000bf8ecfff type=4 attr=000000000000000f
(XEN)  00000bf8ed000-00000bf9ecfff type=6 attr=800000000000000f
(XEN)  00000bf9ed000-00000bfaecfff type=5 attr=800000000000000f
(XEN)  00000bfaed000-00000bfb6cfff type=0 attr=000000000000000f
(XEN)  00000bfb6d000-00000bfb7efff type=9 attr=000000000000000f
(XEN)  00000bfb7f000-00000bfbfefff type=10 attr=000000000000000f
(XEN)  00000bfbff000-00000bfdfffff type=4 attr=000000000000000f
(XEN)  00000bfe00000-00000bfe9dfff type=7 attr=000000000000000f
(XEN)  00000bfe9e000-00000bfebdfff type=4 attr=000000000000000f
(XEN)  00000bfebe000-00000bff0bfff type=3 attr=000000000000000f
(XEN)  00000bff0c000-00000bff24fff type=4 attr=000000000000000f
(XEN)  00000bff25000-00000bff4ffff type=3 attr=000000000000000f
(XEN)  00000bff50000-00000bff6ffff type=6 attr=800000000000000f
(XEN)  00000bff70000-00000bfffffff type=10 attr=000000000000000f
(XEN)  0000100000000-000023fffffff type=7 attr=000000000000000f
(XEN)  00000feffc000-00000feffffff type=0 attr=0000000000000000
(XEN) Unknown cachability for MFNs 0xfeffc-0xfefff
(XEN)  00000ffe00000-00000ffffffff type=11 attr=8000000000000001
(XEN) alt table ffff82d04041c390 -> ffff82d0404270a6
(XEN) I/O virtualisation disabled
(XEN) nr_sockets: 1
(XEN) Enabling APIC mode.  Using 1 I/O APICs
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) TSC deadline timer enabled
(XEN) Allocated console ring of 16 KiB.
(XEN) HWP disabled: cpuid_level 14 < 0x16 lacks CPU freq info
(XEN) mwait-idle: Please enable MWAIT in BIOS SETUP
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Extended Page Tables (EPT)
(XEN)  - Virtual-Processor Identifiers (VPID)
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN)  - Unrestricted Guest
(XEN)  - APIC Register Virtualization
(XEN)  - Virtual Interrupt Delivery
(XEN)  - Posted Interrupt Processing
(XEN)  - VMCS shadowing
(XEN)  - VM Functions
(XEN)  - Page Modification Logging
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) detected
(XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB
(XEN) alt table ffff82d04041c390 -> ffff82d0404270a6
(XEN) Brought up 2 CPUs
(XEN) Scheduling granularity: cpu, 1 CPU per sched-resource
(XEN) Initializing Credit2 scheduler
(XEN)  load_precision_shift: 18
(XEN)  load_window_shift: 30
(XEN)  underload_balance_tolerance: 0
(XEN)  overload_balance_tolerance: -3
(XEN)  runqueues arrangement: socket
(XEN)  cap enforcement granularity: 10ms
(XEN) load tracking window length 1073741824 ns
(XEN) Adding cpu 0 to runqueue 0
(XEN)  First cpu on runqueue, activating
(XEN) Adding cpu 1 to runqueue 0
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) NX (Execute Disable) protection active
(XEN) Dom0 has maximum 416 PIRQs
(XEN) *** Building a PV Dom0 ***
(XEN)  Xen  kernel: 64-bit, lsb
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x200000 -> 0x3800000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000228000000->000000022c000000 (1006513 pages to be allocated)
(XEN)  Init. ramdisk: 0000000239bb1000->000000023ffff16c
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff80200000->ffffffff83800000
(XEN)  Phys-Mach map: 0000008000000000->0000008000800000
(XEN)  Start info:    ffffffff83800000->ffffffff838004b8
(XEN)  Page tables:   ffffffff83801000->ffffffff83822000
(XEN)  Boot stack:    ffffffff83822000->ffffffff83823000
(XEN)  TOTAL:         ffffffff80000000->ffffffff83c00000
(XEN)  ENTRY ADDRESS: ffffffff8273e360
(XEN) Dom0 has maximum 2 VCPUs
(XEN) Initial low memory virq threshold set at 0x4000 pages.
(XEN) Scrubbing Free RAM in background
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) *** Serial input to DOM0 (type 'CTRL-a' three times to switch input)
(XEN) Freed 648kB init memory
mapping kernel into physical memory
about to get started...
Xen hypervisor allocated kernel memory conflicts with E820 map
(XEN) Hardware Dom0 halted: halting machine

@marmarek
Copy link
Member Author

Relevant lines from the above:

(XEN)  0000000100000-00000007fffff type=7 attr=000000000000000f
(XEN)  0000000800000-0000000807fff type=10 attr=000000000000000f
(XEN)  0000000808000-000000080afff type=7 attr=000000000000000f
(XEN)  000000080b000-000000080bfff type=10 attr=000000000000000f
(XEN)  000000080c000-000000080ffff type=7 attr=000000000000000f
(XEN)  0000000810000-00000008fffff type=10 attr=000000000000000f
(XEN)  0000000900000-00000015fffff type=4 attr=000000000000000f
...
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x200000 -> 0x3800000

So, there are a couple of reserved (EfiACPIMemoryNVS) areas around 0x800000. This conflicts with 0x200000 -> 0x3800000. Before QubesOS/qubes-linux-kernel@3e8be4a, the kernel used to be loaded at 0x1000000 - this conflicts 0000000900000-00000015fffff type=4, but since it's after ExitBootServices(), the EfiBootServiceData region is available.

@andrewdavidwong andrewdavidwong added diagnosed Technical diagnosis has been performed (see issue comments). affects-4.2 This issue affects Qubes OS 4.2. labels Mar 11, 2024
@github-project-automation github-project-automation bot moved this from In progress to Done in Current team tasks Mar 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects-4.2 This issue affects Qubes OS 4.2. C: installer diagnosed Technical diagnosis has been performed (see issue comments). P: blocker Priority: blocker. Prevents release or would have prevented release if known prior to release.
Projects
Archived in project
Development

No branches or pull requests

2 participants