Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Airbyte Cron really does re-fetch new connector definitions every 30s #21401

Closed
evantahler opened this issue Jan 13, 2023 · 0 comments · Fixed by #21410
Closed

Airbyte Cron really does re-fetch new connector definitions every 30s #21401

evantahler opened this issue Jan 13, 2023 · 0 comments · Fixed by #21410
Assignees

Comments

@evantahler
Copy link
Contributor

evantahler commented Jan 13, 2023

Details in this thread 🧵

This PR seems to be the culprit #21073

Previously we had been instantiating a new RemoteDefinitionsProvider on each cron invocation, but now we're injecting the dependency so it's only ever instantiated once. Definitions are loaded from the remote source when instantiating the class, so in practice we only load the new values once, when cron boots. (diff)

A fix could be to change this back to instantiate on each call, or the right solution is probably to make fetching the catalog an explicit method call rather than only doing it on the constructor - this way it's more clear when the fetching happens.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants