Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cleanup airbyte_configs table #9437

Merged
merged 7 commits into from
Feb 1, 2022
Merged

cleanup airbyte_configs table #9437

merged 7 commits into from
Feb 1, 2022

Conversation

subodh1810
Copy link
Contributor

@subodh1810 subodh1810 commented Jan 12, 2022

@subodh1810 subodh1810 self-assigned this Jan 12, 2022
@subodh1810 subodh1810 temporarily deployed to more-secrets January 12, 2022 16:05 Inactive
Copy link
Contributor

@cgardens cgardens left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

great!

@subodh1810 subodh1810 temporarily deployed to more-secrets January 12, 2022 16:25 Inactive
import java.util.function.Function;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;

public class ConfigsDatabaseInstance extends BaseDatabaseInstance implements DatabaseInstance {

private static final Logger LOGGER = LoggerFactory.getLogger(ConfigsDatabaseInstance.class);

private static final Set<String> INITIAL_EXPECTED_TABLES = Collections.singleton("airbyte_configs");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why do we still need this?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@davinchia So the way Flyway is setup is that first we launch a fresh instance of Airbyte, we first create airbyte_configs table and then run all the migrations and eventually reach the latest state. So thats why this is required, we expect this table to be present to determine if the DB has been initialised

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

aye, I get it. annoying. can you leave a comment then? it's not obvious from someone reading code. thanks.

Copy link
Contributor

@davinchia davinchia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

One small comment.

Other than that, should we also update the migration version in the docker and kube env files?

@subodh1810 subodh1810 temporarily deployed to more-secrets January 14, 2022 12:09 Inactive
@subodh1810 subodh1810 temporarily deployed to more-secrets January 14, 2022 12:16 Inactive
@subodh1810
Copy link
Contributor Author

@davinchia regarding this, we can not update the migration version in this PR. It should be done as part of Airbyte release cause if we do it in this PR, if someone does a git pull in airbtye repo and tries to launch Airbyte, it wont work

Other than that, should we also update the migration version in the docker and kube env files?

@subodh1810 subodh1810 requested a review from davinchia January 14, 2022 12:19
@subodh1810 subodh1810 temporarily deployed to more-secrets January 14, 2022 13:57 Inactive
@davinchia
Copy link
Contributor

@subodh1810 got it! are you going to release after we merge this in?

@subodh1810 subodh1810 temporarily deployed to more-secrets January 18, 2022 11:30 Inactive
@subodh1810 subodh1810 temporarily deployed to more-secrets January 18, 2022 12:22 Inactive
# Conflicts:
#	airbyte-config/persistence/src/main/java/io/airbyte/config/persistence/DeprecatedDatabaseConfigPersistence.java
#	airbyte-config/persistence/src/test/java/io/airbyte/config/persistence/DeprecatedDatabaseConfigPersistenceTest.java
@subodh1810 subodh1810 temporarily deployed to more-secrets January 31, 2022 07:16 Inactive
@subodh1810 subodh1810 temporarily deployed to more-secrets January 31, 2022 08:51 Inactive
@subodh1810 subodh1810 merged commit 91fd734 into master Feb 1, 2022
@subodh1810 subodh1810 deleted the cleanup-airbyte-configs branch February 1, 2022 08:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants