2021-12-16 15:57:59 INFO () WorkerRun(call):62 - Executing worker wrapper. Airbyte version: 0.29.22-alpha 2021-12-16 15:57:59 INFO () TemporalAttemptExecution(get):114 - Executing worker wrapper. Airbyte version: 0.29.22-alpha 2021-12-16 15:57:59 WARN () Databases(createPostgresDatabaseWithRetry):58 - Waiting for database to become available... 2021-12-16 15:57:59 INFO () JobsDatabaseInstance(lambda$static$2):45 - Testing if jobs database is ready... 2021-12-16 15:57:59 INFO () Databases(createPostgresDatabaseWithRetry):75 - Database available! 2021-12-16 15:57:59 INFO () DefaultReplicationWorker(run):102 - start sync worker. job id: 2035 attempt id: 0 2021-12-16 15:57:59 INFO () DefaultReplicationWorker(run):111 - configured sync modes: {null.Orders=full_refresh - append} 2021-12-16 15:57:59 INFO () DefaultAirbyteDestination(start):78 - Running destination... 2021-12-16 15:57:59 INFO () LineGobbler(voidCall):85 - Checking if airbyte/destination-snowflake:0.3.14 exists... 2021-12-16 15:57:59 INFO () LineGobbler(voidCall):85 - airbyte/destination-snowflake:0.3.14 was found locally. 2021-12-16 15:57:59 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/2035/0 --network host --log-driver none airbyte/destination-snowflake:0.3.14 write --config destination_config.json --catalog destination_catalog.json 2021-12-16 15:57:59 INFO () LineGobbler(voidCall):85 - Checking if airbyte/source-amazon-seller-partner:0.2.6 exists... 2021-12-16 15:57:59 INFO () LineGobbler(voidCall):85 - airbyte/source-amazon-seller-partner:0.2.6 was found locally. 2021-12-16 15:57:59 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/2035/0 --network host --log-driver none airbyte/source-amazon-seller-partner:0.2.6 read --config source_config.json --catalog source_catalog.json --state input_state.json 2021-12-16 15:57:59 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):210 - Replication thread started. 2021-12-16 15:57:59 INFO () DefaultReplicationWorker(run):139 - Waiting for source thread to join. 2021-12-16 15:57:59 INFO () DefaultReplicationWorker(lambda$getDestinationOutputRunnable$3):246 - Destination output thread started. 2021-12-16 15:58:00 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Starting syncing SourceAmazonSellerPartner 2021-12-16 15:58:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:01 INFO i.a.i.d.s.SnowflakeDestination(main):81 - {} - starting destination: class io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2021-12-16 15:58:01 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: Orders 2021-12-16 15:58:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:01 INFO i.a.i.b.IntegrationRunner(run):96 - {} - Running integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2021-12-16 15:58:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:01 INFO i.a.i.b.IntegrationCliParser(parseOptions):135 - {} - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2021-12-16 15:58:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:01 INFO i.a.i.b.IntegrationRunner(run):100 - {} - Command: WRITE 2021-12-16 15:58:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:01 INFO i.a.i.b.IntegrationRunner(run):101 - {} - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2021-12-16 15:58:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:01 WARN c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2021-12-16 15:58:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:01 WARN c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2021-12-16 15:58:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:01 WARN c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2021-12-16 15:58:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:01 WARN c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2021-12-16 15:58:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:01 INFO i.a.i.d.j.c.SwitchingDestination(getConsumer):83 - {} - Using destination type: INSERT 2021-12-16 15:58:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:01 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=16Dec2Updated-Orders, namespace=null, outputSchemaName=PUBLIC, tmpTableName=_airbyte_tmp_nwu_16Dec2Updated_Orders, outputTableName=_airbyte_raw_16Dec2Updated_Orders, syncMode=append} 2021-12-16 15:58:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:01 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):143 - {} - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2021-12-16 15:58:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:01 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):139 - {} - Preparing tmp tables in destination started for 1 streams 2021-12-16 15:58:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:01 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream 16Dec2Updated-Orders. schema: PUBLIC, tmp table name: _airbyte_tmp_nwu_16Dec2Updated_Orders 2021-12-16 15:58:04 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:04 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):149 - {} - Preparing tables in destination completed. 2021-12-16 15:58:05 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Read 100 records from Orders stream 2021-12-16 15:58:05 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Finished syncing SourceAmazonSellerPartner 2021-12-16 15:58:05 INFO () DefaultAirbyteStreamFactory(internalLog):110 - SourceAmazonSellerPartner runtimes: 2021-12-16 15:58:05 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Finished syncing SourceAmazonSellerPartner 2021-12-16 15:58:05 INFO () DefaultReplicationWorker(run):141 - Source thread complete. 2021-12-16 15:58:05 INFO () DefaultReplicationWorker(run):142 - Waiting for destination thread to join. 2021-12-16 15:58:05 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:05 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):80 - {} - Airbyte message consumer: succeeded. 2021-12-16 15:58:05 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:05 INFO i.a.i.d.b.BufferedStreamConsumer(close):212 - {} - executing on success close procedure. 2021-12-16 15:58:05 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:05 INFO i.a.i.d.s.SnowflakeSqlOperations(insertRecordsInternal):57 - {} - actual size of batch: 100 2021-12-16 15:58:06 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:06 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):176 - {} - Finalizing tables in destination started for 1 streams 2021-12-16 15:58:06 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:06 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream 16Dec2Updated-Orders. schema PUBLIC, tmp table _airbyte_tmp_nwu_16Dec2Updated_Orders, final table _airbyte_raw_16Dec2Updated_Orders 2021-12-16 15:58:06 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:06 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):194 - {} - Executing finalization of tables. 2021-12-16 15:58:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):196 - {} - Finalizing tables in destination completed. 2021-12-16 15:58:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):199 - {} - Cleaning tmp tables in destination started for 1 streams 2021-12-16 15:58:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream 16Dec2Updated-Orders. schema PUBLIC, tmp table name: _airbyte_tmp_nwu_16Dec2Updated_Orders 2021-12-16 15:58:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):208 - {} - Cleaning tmp tables in destination completed. 2021-12-16 15:58:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:08 INFO i.a.i.b.IntegrationRunner(run):153 - {} - Completed integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2021-12-16 15:58:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-12-16 15:58:08 INFO i.a.i.d.s.SnowflakeDestination(main):83 - {} - completed destination: class io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2021-12-16 15:58:09 INFO () DefaultReplicationWorker(run):144 - Destination thread complete. 2021-12-16 15:58:09 INFO () DefaultReplicationWorker(run):172 - sync summary: io.airbyte.config.ReplicationAttemptSummary@f334295[status=completed,recordsSynced=100,bytesSynced=85177,startTime=1639670279669,endTime=1639670289456] 2021-12-16 15:58:09 INFO () DefaultReplicationWorker(run):181 - Source did not output any state messages 2021-12-16 15:58:09 WARN () DefaultReplicationWorker(run):189 - State capture: No new state, falling back on input state: io.airbyte.config.State@6d0a9b0[state={}] 2021-12-16 15:58:09 INFO () TemporalAttemptExecution(get):135 - Stopping cancellation check scheduling... 2021-12-16 15:58:09 INFO () SyncWorkflow$ReplicationActivityImpl(replicate):184 - sync summary: io.airbyte.config.StandardSyncOutput@d52df26[standardSyncSummary=io.airbyte.config.StandardSyncSummary@5326bdb1[status=completed,recordsSynced=100,bytesSynced=85177,startTime=1639670279669,endTime=1639670289456],state=io.airbyte.config.State@6d0a9b0[state={}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@5d0bdbba[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@12ac6051[stream=io.airbyte.protocol.models.AirbyteStream@91c26cd[name=16Dec2Updated-Orders,jsonSchema={"type":"object","title":"Orders","$schema":"http://json-schema.org/draft-07/schema#","properties":{"IsISPU":{"type":["null","boolean"]},"IsPrime":{"type":["null","boolean"]},"OrderType":{"type":["null","string"]},"seller_id":{"type":"string","title":"seller_id"},"IsSoldByAB":{"type":["null","boolean"]},"OrderTotal":{"type":["null","object"],"properties":{"Amount":{"type":["null","string"]},"CurrencyCode":{"type":["null","string"]}}},"OrderStatus":{"type":["null","string"]},"PurchaseDate":{"type":["null","string"]},"SalesChannel":{"type":["null","string"]},"AmazonOrderId":{"type":["null","string"]},"MarketplaceId":{"type":["null","string"]},"PaymentMethod":{"type":["null","string"]},"SellerOrderId":{"type":["null","string"]},"IsPremiumOrder":{"type":["null","boolean"]},"LastUpdateDate":{"type":["null","string"]},"LatestShipDate":{"type":["null","string"]},"IsBusinessOrder":{"type":["null","boolean"]},"EarliestShipDate":{"type":["null","string"]},"ShipServiceLevel":{"type":["null","string"]},"FulfillmentChannel":{"type":["null","string"]},"IsReplacementOrder":{"type":["null","string"]},"NumberOfItemsShipped":{"type":["null","integer"]},"PaymentMethodDetails":{"type":["null","array"],"items":{"type":["null","string"]}},"IsGlobalExpressEnabled":{"type":["null","boolean"]},"NumberOfItemsUnshipped":{"type":["null","integer"]},"ShipmentServiceLevelCategory":{"type":["null","string"]}},"description":"All orders that were updated after a specified date"},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[LastUpdateDate],sourceDefinedPrimaryKey=[[AmazonOrderId]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[LastUpdateDate],destinationSyncMode=append,primaryKey=[[AmazonOrderId]],additionalProperties={}]],additionalProperties={}]] 2021-12-16 15:58:09 INFO () TemporalAttemptExecution(get):114 - Executing worker wrapper. Airbyte version: 0.29.22-alpha 2021-12-16 15:58:09 WARN () Databases(createPostgresDatabaseWithRetry):58 - Waiting for database to become available... 2021-12-16 15:58:09 INFO () JobsDatabaseInstance(lambda$static$2):45 - Testing if jobs database is ready... 2021-12-16 15:58:09 INFO () Databases(createPostgresDatabaseWithRetry):75 - Database available! 2021-12-16 15:58:09 INFO () DefaultNormalizationWorker(run):63 - Running normalization. 2021-12-16 15:58:09 INFO () LineGobbler(voidCall):85 - Checking if airbyte/normalization:0.1.46 exists... 2021-12-16 15:58:09 INFO () LineGobbler(voidCall):85 - airbyte/normalization:0.1.46 was found locally. 2021-12-16 15:58:09 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/2035/0/normalize --network host --log-driver none airbyte/normalization:0.1.46 run --integration-type snowflake --config destination_config.json --catalog destination_catalog.json 2021-12-16 15:58:09 INFO () LineGobbler(voidCall):85 - Running: transform-config --config destination_config.json --integration-type snowflake --out /data/2035/0/normalize 2021-12-16 15:58:10 INFO () LineGobbler(voidCall):85 - Namespace(config='destination_config.json', integration_type=, out='/data/2035/0/normalize') 2021-12-16 15:58:10 INFO () LineGobbler(voidCall):85 - transform_snowflake 2021-12-16 15:58:10 INFO () LineGobbler(voidCall):85 - Running: transform-catalog --integration-type snowflake --profile-config-dir /data/2035/0/normalize --catalog destination_catalog.json --out /data/2035/0/normalize/models/generated/ --json-column _airbyte_data 2021-12-16 15:58:10 INFO () LineGobbler(voidCall):85 - Processing destination_catalog.json... 2021-12-16 15:58:10 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/PUBLIC/16Dec2Updated_Orders_ab1.sql from 16Dec2Updated-Orders 2021-12-16 15:58:10 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/PUBLIC/16Dec2Updated_Orders_ab2.sql from 16Dec2Updated-Orders 2021-12-16 15:58:10 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/PUBLIC/16Dec2Updated_Orders_ab3.sql from 16Dec2Updated-Orders 2021-12-16 15:58:10 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/PUBLIC/16Dec2Updated_Orders.sql from 16Dec2Updated-Orders 2021-12-16 15:58:10 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/PUBLIC/16Dec2Updated_Orders_OrderTotal_ab1.sql from 16Dec2Updated-Orders/OrderTotal 2021-12-16 15:58:10 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/PUBLIC/16Dec2Updated_Orders_OrderTotal_ab2.sql from 16Dec2Updated-Orders/OrderTotal 2021-12-16 15:58:10 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/PUBLIC/16Dec2Updated_Orders_OrderTotal_ab3.sql from 16Dec2Updated-Orders/OrderTotal 2021-12-16 15:58:10 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/PUBLIC/16Dec2Updated_Orders_OrderTotal.sql from 16Dec2Updated-Orders/OrderTotal 2021-12-16 15:58:10 INFO () LineGobbler(voidCall):85 - Ignoring stream 'PaymentMethodDetails' from 16Dec2Updated-Orders/PaymentMethodDetails because properties list is empty 2021-12-16 15:58:10 ERROR () LineGobbler(voidCall):85 - cat: /data/2035/0/normalize/ssh.json: No such file or directory 2021-12-16 15:58:10 ERROR () LineGobbler(voidCall):85 - cat: /data/2035/0/normalize/ssh.json: No such file or directory 2021-12-16 15:58:10 ERROR () LineGobbler(voidCall):85 - cat: /data/2035/0/normalize/ssh.json: No such file or directory 2021-12-16 15:58:10 ERROR () LineGobbler(voidCall):85 - cat: /data/2035/0/normalize/ssh.json: No such file or directory 2021-12-16 15:58:10 ERROR () LineGobbler(voidCall):85 - cat: /data/2035/0/normalize/ssh.json: No such file or directory 2021-12-16 15:58:10 ERROR () LineGobbler(voidCall):85 - cat: /data/2035/0/normalize/ssh.json: No such file or directory 2021-12-16 15:58:10 INFO () LineGobbler(voidCall):85 - Running with dbt=0.19.0 2021-12-16 15:58:12 INFO () LineGobbler(voidCall):85 - [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2021-12-16 15:58:12 INFO () LineGobbler(voidCall):85 - There are 1 unused configuration paths: 2021-12-16 15:58:12 INFO () LineGobbler(voidCall):85 - - models.airbyte_utils.generated.airbyte_views 2021-12-16 15:58:12 INFO () LineGobbler(voidCall):85 - 2021-12-16 15:58:12 INFO () LineGobbler(voidCall):85 - Found 8 models, 0 tests, 0 snapshots, 0 analyses, 410 macros, 0 operations, 0 seed files, 1 source, 0 exposures 2021-12-16 15:58:12 INFO () LineGobbler(voidCall):85 - 2021-12-16 15:58:14 INFO () LineGobbler(voidCall):85 - 15:58:14 | Concurrency: 32 threads (target='prod') 2021-12-16 15:58:14 INFO () LineGobbler(voidCall):85 - 15:58:14 | 2021-12-16 15:58:14 INFO () LineGobbler(voidCall):85 - 15:58:14 | 1 of 2 START table model PUBLIC.16Dec2Updated_Orders......................................................... [RUN] 2021-12-16 15:58:15 INFO () LineGobbler(voidCall):85 - 15:58:15 | 1 of 2 OK created table model PUBLIC.16Dec2Updated_Orders.................................................... [SUCCESS 1 in 1.26s] 2021-12-16 15:58:15 INFO () LineGobbler(voidCall):85 - 15:58:15 | 2 of 2 START table model PUBLIC.16Dec2Updated_Orders_OrderTotal.............................................. [RUN] 2021-12-16 15:58:17 INFO () LineGobbler(voidCall):85 - 15:58:17 | 2 of 2 OK created table model PUBLIC.16Dec2Updated_Orders_OrderTotal......................................... [SUCCESS 1 in 1.43s] 2021-12-16 15:58:17 INFO () LineGobbler(voidCall):85 - 15:58:17 | 2021-12-16 15:58:17 INFO () LineGobbler(voidCall):85 - 15:58:17 | Finished running 2 table models in 4.92s. 2021-12-16 15:58:17 INFO () LineGobbler(voidCall):85 - 2021-12-16 15:58:17 INFO () LineGobbler(voidCall):85 - Completed successfully 2021-12-16 15:58:17 INFO () LineGobbler(voidCall):85 - 2021-12-16 15:58:17 INFO () LineGobbler(voidCall):85 - Done. PASS=2 WARN=0 ERROR=0 SKIP=0 TOTAL=2 2021-12-16 15:58:17 INFO () DefaultNormalizationWorker(run):85 - Normalization executed in 0. 2021-12-16 15:58:17 INFO () TemporalAttemptExecution(get):135 - Stopping cancellation check scheduling...