I've been doing reading. Though probably not understanding. Switching GC to Workstation mode, rather than Server may decrease memory usage.

Adam Warner · Adam Warner · commit 41df1317e480 · 2017-12-12T19:57:35.000Z
diff --git a/Matterhook.NET/Matterhook.NET.csproj b/Matterhook.NET/Matterhook.NET.csproj
@@ -3,6 +3,7 @@
   <PropertyGroup>
     <TargetFramework>netcoreapp2.0</TargetFramework>
     <DockerComposeProjectPath>..\docker-compose.dcproj</DockerComposeProjectPath>
+    <ServerGarbageCollection>false</ServerGarbageCollection>
   </PropertyGroup>
 
   <ItemGroup>
