feat(@aws-amplify/datastore): configurable sync pagination limit

[polymath-shpetim]

Allow user to configure sync pagination limit due to limit reach of 1MB if dynamodb documents are bigger. By reducing pagination limit it's possible to overcome following issue:

{
  "data": {
    "syncDocuments": null
  },
  "errors": [
    {
      "path": [
        "syncDocuments"
      ],
      "data": null,
      "errorType": "MappingTemplate",
      "errorInfo": null,
      "locations": [
        {
          "line": 2,
          "column": 5,
          "sourceName": null
        }
      ],
      "message": "Transformation too large"
    }
  ]
}

This pull request allow users to add such configuration as following:

DataStore.configure({
    syncPageSize: number
})

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[codecov]

Codecov Report

Merging #5181 into master will decrease coverage by 0.04%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##           master    #5181      +/-   ##
==========================================
- Coverage   73.22%   73.17%   -0.05%     
==========================================
  Files         193      193              
  Lines       11442    11449       +7     
  Branches     2302     2221      -81     
==========================================
  Hits         8378     8378              
- Misses       2900     2923      +23     
+ Partials      164      148      -16     

Impacted Files	Coverage Δ
packages/datastore/src/datastore/datastore.ts	70.15% <0.00%> (-0.66%)	⬇️
packages/datastore/src/sync/index.ts	15.34% <0.00%> (-0.09%)	⬇️
packages/datastore/src/sync/processors/sync.ts	17.33% <0.00%> (-0.73%)	⬇️
packages/datastore/src/types.ts	83.92% <ø> (ø)
packages/auth/src/OAuth/OAuth.ts	48.12% <0.00%> (ø)
packages/datastore/src/sync/outbox.ts	25.00% <0.00%> (ø)
packages/datastore/src/storage/storage.ts	67.59% <0.00%> (ø)
packages/core/src/OAuthHelper/GoogleOAuth.ts	31.25% <0.00%> (ø)
packages/xr/src/Providers/SumerianProvider.ts	47.55% <0.00%> (ø)
packages/core/src/OAuthHelper/FacebookOAuth.ts	34.09% <0.00%> (ø)
... and 6 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c9c020d...42501e2. Read the comment docs.

[manueliglesias]

Thank you so much for the contribution @polymath-shpetim , it looks great 😄

I do have one change request though, can you rename paginationLimit to syncPageSize ?

[polymath-shpetim]

Thank you so much for the contribution @polymath-shpetim , it looks great 😄

I do have one change request though, can you rename paginationLimit to syncPageSize ?

Updated code, thanks for feedback.

Cheers

[manueliglesias]

Looks great! thanks! 👍

[github-actions]

This pull request has been automatically locked since there hasn't been any recent activity after it was closed. Please open a new issue for related bugs.

Looking for a help forum? We recommend joining the Amplify Community Discord server *-help channels or Discussions for those types of questions.