Weekly Update 10/04/2022

[mzhangmzz]

Chain:

• Moving ShardsManager out to its own actor in progress. Remove DBCol::ChunkPerHeightShard (#7671) · near/nearcore@e1dbcc2 [chunks] Move ChainStore use out of ShardsManager and into the Client… · near/nearcore@73de01b

Storage:

• Submitted FlatStorage NEP PR Flat Storage by mzhangmzz · Pull Request #399 · near/NEPs

• Merged Implement FlatStorageState by mzhangmzz · Pull Request #7663 · near/nearcore

• FlatStorage fixes: fix: create FlatStorageState inside RuntimeAdapter by Longarithm · Pull Request #7710 · near/nearcore , fix: don't panic if new flat head is not reachable by Longarithm · Pull Request #7724 · near/nearcore , feat: discard non-finalizable blocks by Longarithm · Pull Request #7746 · near/nearcore

• New article about handling state refcounts How state is stored in DB

• Discussions on FlatStorage costs

• Helping SRE with task "utilize archival node RAM better", giving overview of our state storage and in-memory caching

Network:

• Merged Merged network-primitives into network package by pompon0 · Pull Request #7722 · near/nearcore

• Working on fix: disallowed loop connections by pompon0 · Pull Request #7719 · near/nearcore , which still requires some extra tests

Other:

• Canary nodes failed after the rand version upgrade Update rand dependency to latest 0.8.5 version by mina86 · Pull Request #7705 · near/nearcore . Fixed at Use the underlying reproducible random impls instead of StdRng. (#7717) · near/nearcore@a10b5d7

• Debugged why validators missed chunks for the first epoch after the protocol upgrade. Not sure why. The issue disappeared after the first epoch. We had discussions on what debugging tools can be added to help with future debugging.

• Team OKR drafted and discussed, follow up discussion next week to finalize Core Team Q4 OKRs