Code

feat: async shuffling refactor#6938

Code

Merged

twoeths merged 81 commits intounstableChainSafe/lodestar:unstablefrom mkeil/shuffling-refactorChainSafe/lodestar:mkeil/shuffling-refactorCopy head branch name to clipboardSep 23, 2024

Commits

Commits on Aug 12, 2024

• feat: add ShufflingCache to EpochCache

  matthewkeil

  committed
  46b6b3f

  Copy full SHA for 46b6b3f

• fix: implementation in state-transition for EpochCache with ShufflingCache

  matthewkeil

  committed
  99269ce

  Copy full SHA for 99269ce

• feat: remove shufflingCache.processState

  matthewkeil

  committed
  52187c9

  Copy full SHA for 52187c9

• feat: implement ShufflingCache changes in beacon-node

  matthewkeil

  committed
  b6b2f20

  Copy full SHA for b6b2f20

• feat: pass shufflingCache when loading cached state from db

  matthewkeil

  committed
  4110dc0

  Copy full SHA for 4110dc0

• test: fix state-transition tests for EpochCache changes

  matthewkeil

  committed
  04e4a7b

  Copy full SHA for 04e4a7b

• feat: Pass shufflingCache to EpochCache at startup

  matthewkeil

  committed
  ff2d520

  Copy full SHA for ff2d520

• test: fix slot off by one for decision root in perf test

  matthewkeil

  committed
  53ed72e

  Copy full SHA for 53ed72e

• chore: use ?. syntax

  

  wemeetagain

  authored and

  matthewkeil

  committed
  8faee3f

  Copy full SHA for 8faee3f

• chore: refactoring

  

  wemeetagain

  authored and

  matthewkeil

  committed
  d69c8b1

  Copy full SHA for d69c8b1

• feat: add comments and clean up afterProcessEpoch

  matthewkeil

  committed
  cfa97ad

  Copy full SHA for cfa97ad

• fix: perf test slot incrementing

  matthewkeil

  committed
  78a60a2

  Copy full SHA for 78a60a2

• fix: remove MockShufflingCache

  matthewkeil

  committed
  9b0ffe2

  Copy full SHA for 9b0ffe2

• Revert "chore: refactoring"

  Show description for 13f5996
  matthewkeil

  committed
  13f5996

  Copy full SHA for 13f5996

• refactor: shufflingCache getters

  matthewkeil

  committed
  d8d69c9

  Copy full SHA for d8d69c9

• refactor: shufflingCache setters

  matthewkeil

  committed
  89798a5

  Copy full SHA for 89798a5

• refactor: build and getOrBuild

  matthewkeil

  committed
  81449e4

  Copy full SHA for 81449e4

• docs: add comments to ShufflingCache methods

  matthewkeil

  committed
  5799676

  Copy full SHA for 5799676

• chore: lint issues

  matthewkeil

  committed
  9a0ca70

  Copy full SHA for 9a0ca70

• test: update tests in beacon-node

  matthewkeil

  committed
  10dd105

  Copy full SHA for 10dd105

• chore: lint

  matthewkeil

  committed
  bb3fd1c

  Copy full SHA for bb3fd1c

• feat: get shufflings from cache for API

  matthewkeil

  committed
  59f6d3f

  Copy full SHA for 59f6d3f

• feat: minTimeDelayToBuildShuffling cli flag

  matthewkeil

  committed
  bae40cc

  Copy full SHA for bae40cc

• test: fix shufflingCache promise insertion test

  matthewkeil

  committed
  b8269ef

  Copy full SHA for b8269ef

• fix: rebase conflicts

  matthewkeil

  committed
  a0e7e60

  Copy full SHA for a0e7e60

• fix: changes from debugging sim tests

  matthewkeil

  committed
  ff7df85

  Copy full SHA for ff7df85

Commits on Aug 13, 2024

• refactor: minimize changes in afterProcessEpoch

  matthewkeil

  committed
  7468419

  Copy full SHA for 7468419

• chore: fix lint

  matthewkeil

  committed
  9e5e4b0

  Copy full SHA for 9e5e4b0

• chore: fix check-types

  matthewkeil

  committed
  1988568

  Copy full SHA for 1988568

• chore: fix check-types

  matthewkeil

  committed
  955c66c

  Copy full SHA for 955c66c

Commits on Aug 15, 2024

• feat: add diff utility

  matthewkeil

  committed
  389be49

  Copy full SHA for 389be49

• fix: bug in spec tests from invalid nextActiveIndices

  matthewkeil

  committed
  529d85c

  Copy full SHA for 529d85c

• refactor: add/remove comments

  matthewkeil

  committed
  dbf8ff1

  Copy full SHA for dbf8ff1

• Merge branch 'unstable' into mkeil/shuffling-refactor

  matthewkeil

  committed
  dea45b2

  Copy full SHA for dea45b2

Commits on Aug 16, 2024

• refactor: remove this.activeIndicesLength from EpochCache

  matthewkeil

  committed
  5540ce1

  Copy full SHA for 5540ce1

• refactor: simplify shufflingCache.getSync

  matthewkeil

  committed
  eb30b75

  Copy full SHA for eb30b75

• refactor: remove unnecessary undefined's

  matthewkeil

  committed
  6388a15

  Copy full SHA for 6388a15

• refactor: clean up ShufflingCache unit test

  matthewkeil

  committed
  b2a7aa2

  Copy full SHA for b2a7aa2

• feat: add metrics for ShufflingCache

  matthewkeil

  committed
  a8c0a6d

  Copy full SHA for a8c0a6d

• feat: add shufflingCache metrics to state-transition

  matthewkeil

  committed
  40bb572

  Copy full SHA for 40bb572

• chore: lint

  matthewkeil

  committed
  dbe25c9

  Copy full SHA for dbe25c9

• fix: metric name clash

  matthewkeil

  committed
  70dc683

  Copy full SHA for 70dc683

Commits on Aug 21, 2024

• refactor: add comment about not having ShufflingCache in EpochCache

  matthewkeil

  committed
  27081b2

  Copy full SHA for 27081b2

• refactor: rename shuffling decision root functions

  matthewkeil

  committed
  600acae

  Copy full SHA for 600acae

• refactor: remove unused comment

  matthewkeil

  committed
  8945e03

  Copy full SHA for 8945e03

• feat: async add nextShuffling to EpochCache after its built

  matthewkeil

  committed
  635d74c

  Copy full SHA for 635d74c

• feat: make ShufflingCache.set private

  matthewkeil

  committed
  a2ad1ed

  Copy full SHA for a2ad1ed

• feat: chance metrics to nextShufflingNotOnEpochCache instead of positive case

  matthewkeil

  committed
  db86883

  Copy full SHA for db86883

• refactor: move diff to separate PR

  matthewkeil

  committed
  7114aa5

  Copy full SHA for 7114aa5

• chore: fix tests using shufflingCache.set method

  matthewkeil

  committed
  4555604

  Copy full SHA for 4555604

• feat: remove minTimeDelayToBuild

  matthewkeil

  committed
  d49bfee

  Copy full SHA for d49bfee

Commits on Aug 22, 2024

• feat: return promise from insertPromise and then through build

  matthewkeil

  committed
  923addb

  Copy full SHA for 923addb

• fix: update metrics names and help field

  matthewkeil

  committed
  1613d8f

  Copy full SHA for 1613d8f

• feat: move build of shuffling to beforeProcessEpoch

  matthewkeil

  committed
  0a64e36

  Copy full SHA for 0a64e36

• feat: allow calc of pivot slot before slot increment

  matthewkeil

  committed
  ed850ee

  Copy full SHA for ed850ee

• fix: calc of pivot slot before slot increment

  matthewkeil

  committed
  5e65f7e

  Copy full SHA for 5e65f7e

• Revert "fix: calc of pivot slot before slot increment"

  Show description for 2c1100c
  matthewkeil

  committed
  2c1100c

  Copy full SHA for 2c1100c

• Revert "feat: allow calc of pivot slot before slot increment"

  Show description for d5317ec
  matthewkeil

  committed
  d5317ec

  Copy full SHA for d5317ec

• feat: allow getting current block root for shuffling calculation

  matthewkeil

  committed
  82ac512

  Copy full SHA for 82ac512

• fix: get nextShufflingDecisionRoot directly from state.blockRoots

  matthewkeil

  committed
  aa9ab9c

  Copy full SHA for aa9ab9c

• fix: convert toRootHex

  matthewkeil

  committed
  ca8445a

  Copy full SHA for ca8445a

• docs: add comment about pulling decisionRoot directly from state

  matthewkeil

  committed
  19ae447

  Copy full SHA for 19ae447

Commits on Aug 23, 2024

• feat: add back metrics for regen attestation cache hit/miss

  matthewkeil

  committed
  ff6694d

  Copy full SHA for ff6694d

Commits on Aug 28, 2024

• docs: fix docstring on shufflingCache.build

  matthewkeil

  committed
  1a7ab44

  Copy full SHA for 1a7ab44

• refactor: change validatorIndices to Uint32Array

  matthewkeil

  committed
  85a9ae1

  Copy full SHA for 85a9ae1

• refactor: remove comment and change variable name

  matthewkeil

  committed
  ee1256e

  Copy full SHA for ee1256e

• fix: use toRootHex instead of toHexString

  matthewkeil

  committed
  eff10c4

  Copy full SHA for eff10c4

• refactor: deduplicate moved function computeAnchorCheckpoint

  matthewkeil

  committed
  4d06deb

  Copy full SHA for 4d06deb

• fix: touch up metrics per PR comments

  matthewkeil

  committed
  1ab811c

  Copy full SHA for 1ab811c

Commits on Sep 3, 2024

• Merge branch 'unstable' into mkeil/shuffling-refactor

  matthewkeil

  committed
  0e8eeb7

  Copy full SHA for 0e8eeb7

• fix: merge conflict

  matthewkeil

  committed
  fd8196e

  Copy full SHA for fd8196e

• chore: lint

  matthewkeil

  committed
  4f777c8

  Copy full SHA for 4f777c8

Commits on Sep 6, 2024

• refactor: add scope around activeIndices to GC arrays

  matthewkeil

  committed
  222908c

  Copy full SHA for 222908c

• feat: directly use Uint32Array instead of transcribing number array to Uint32Array

  matthewkeil

  committed
  ffbbfea

  Copy full SHA for ffbbfea

• refactor: activeIndices per tuyen comment

  matthewkeil

  committed
  7f6d420

  Copy full SHA for 7f6d420

Commits on Sep 9, 2024

• refactor: rename to epochAfterNext

  matthewkeil

  committed
  afc03f2

  Copy full SHA for afc03f2

Commits on Sep 16, 2024

• chore: review PR

  twoeths

  committed
  d1d0e22

  Copy full SHA for d1d0e22

Commits on Sep 19, 2024

• feat: update no shuffling ApiError to 500 status

  matthewkeil

  committed
  c5c5772

  Copy full SHA for c5c5772

• fix: add back unnecessary eslint directive. to be remove under separate PR

  matthewkeil

  committed
  88d3105

  Copy full SHA for 88d3105

Commits on Sep 20, 2024

• feat: update no shuffling ApiError to 500 status

  matthewkeil

  committed
  b857d6e

  Copy full SHA for b857d6e

• docs: add comment about upcomingEpoch

  matthewkeil

  committed
  af5c989

  Copy full SHA for af5c989