Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hubspot: Support incremental sync on all possible streams #8344

Closed
sherifnada opened this issue Nov 30, 2021 · 2 comments · Fixed by #8699
Closed

Hubspot: Support incremental sync on all possible streams #8344

sherifnada opened this issue Nov 30, 2021 · 2 comments · Fixed by #8699
Assignees
Labels
area/connectors Connector related issues type/enhancement New feature or request

Comments

@sherifnada
Copy link
Contributor

Tell us about the problem you're trying to solve

The Hubspot API supports incremental sync for many more objects than we currently offer via our connector. Many streams (e.g: products) are using full refresh sync when they could be doing incremental.

Describe the solution you’d like

  1. Find which streams can support incremental sync
  2. Support incremental sync for as many as possible
@lgomezm
Copy link
Contributor

lgomezm commented Dec 17, 2021

Hello! I've been exercising this solution as we need incremental updates to handle one of our use cases, but I think the current solution won't scale for big Hubspot accounts. That is because it iterates over the the complete dataset (say contacts) and outputs only those that were created/updated after the given state.

I would be more than happy to take on the task of updating this connector and, in fact, I already have a branch in which I am applying a different approach on some of the available streams. If that's okay with you guys, I can create a draft PR (will add tests shortly and update all other necessary files).

@sherifnada
Copy link
Contributor Author

@lgomezm nothing we love more than a contribution! let us know how we can be helpful, @lazebnyi can work with you to get it into master :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues type/enhancement New feature or request
Projects
No open projects
Archived in project
Development

Successfully merging a pull request may close this issue.

3 participants