Skip to content

Commit

Permalink
Similar to how things were done in airbytehq/airbyte#9163
Browse files Browse the repository at this point in the history
overrite config if sequence of 2 characters '\' an 't' is found in the delimeter config, then convert it into a \t [TAB] character. Then, proceed with standard validation
  • Loading branch information
david.ashirov committed Nov 11, 2023
1 parent 17a70b7 commit 5099afe
Showing 1 changed file with 2 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,8 @@ def read_config(self, config_path: str) -> Mapping[str, Any]:
validate the config against the new spec.
"""
config = super().read_config(config_path)
if config.get("format", {}).get("delimiter") == r"\t":
config["format"]["delimiter"] = "\t"
if not self._is_v4_config(config):
parsed_legacy_config = SourceS3Spec(**config)
converted_config = LegacyConfigTransformer.convert(parsed_legacy_config)
Expand Down

0 comments on commit 5099afe

Please sign in to comment.