Skip to content

Commit

Permalink
Docs updates for destinations affected by per-stream state (#15578)
Browse files Browse the repository at this point in the history
* Docs updates for destinations affected by per-stream state

* adding -alpha tag
  • Loading branch information
andyjih authored Aug 11, 2022
1 parent 611ef03 commit e8a0d5c
Show file tree
Hide file tree
Showing 14 changed files with 42 additions and 2 deletions.
3 changes: 3 additions & 0 deletions docs/integrations/destinations/azureblobstorage.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,9 @@ This destination writes data to Azure Blob Storage.

The Airbyte Azure Blob Storage destination allows you to sync data to Azure Blob Storage. Each stream is written to its own blob under the container.

## Prerequisites
- For Airbyte Open Source users using the [Postgres](https://docs.airbyte.com/integrations/sources/postgres) source connector, [upgrade](https://docs.airbyte.com/operator-guides/upgrading-airbyte/) your Airbyte platform to version `v0.40.0-alpha` or newer and upgrade your AzureBlobStorage connector to version `0.1.6` or newer

## Sync Mode

| Feature | Support | Notes |
Expand Down
1 change: 1 addition & 0 deletions docs/integrations/destinations/bigquery.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@ This page guides you through setting up the BigQuery destination connector.

## Prerequisites

- For Airbyte Open Source users using the [Postgres](https://docs.airbyte.com/integrations/sources/postgres) source connector, [upgrade](https://docs.airbyte.com/operator-guides/upgrading-airbyte/) your Airbyte platform to version `v0.40.0-alpha` or newer and upgrade your BigQuery connector to version `1.1.14` or newer
- [A Google Cloud project with BigQuery enabled](https://cloud.google.com/bigquery/docs/quickstarts/query-public-dataset-console)
- [A BigQuery dataset](https://cloud.google.com/bigquery/docs/quickstarts/quickstart-web-ui#create_a_dataset) to sync data to.

Expand Down
4 changes: 4 additions & 0 deletions docs/integrations/destinations/cassandra.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,9 @@
# Cassandra

## Prerequisites
- For Airbyte Open Source users using the [Postgres](https://docs.airbyte.com/integrations/sources/postgres) source connector, [upgrade](https://docs.airbyte.com/operator-guides/upgrading-airbyte/) your Airbyte platform to version `v0.40.0-alpha` or newer and upgrade your Cassandra connector to version `0.1.3` or newer


## Sync overview

### Output schema
Expand Down
3 changes: 3 additions & 0 deletions docs/integrations/destinations/dynamodb.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,9 @@ This destination writes data to AWS DynamoDB.

The Airbyte DynamoDB destination allows you to sync data to AWS DynamoDB. Each stream is written to its own table under the DynamoDB.

## Prerequisites
- For Airbyte Open Source users using the [Postgres](https://docs.airbyte.com/integrations/sources/postgres) source connector, [upgrade](https://docs.airbyte.com/operator-guides/upgrading-airbyte/) your Airbyte platform to version `v0.40.0-alpha` or newer and upgrade your DynamoDB connector to version `0.1.5` or newer

## Sync overview

### Output schema
Expand Down
4 changes: 4 additions & 0 deletions docs/integrations/destinations/kafka.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,10 @@

The Airbyte Kafka destination allows you to sync data to Kafka. Each stream is written to the corresponding Kafka topic.

## Prerequisites
- For Airbyte Open Source users using the [Postgres](https://docs.airbyte.com/integrations/sources/postgres) source connector, [upgrade](https://docs.airbyte.com/operator-guides/upgrading-airbyte/) your Airbyte platform to version `v0.40.0-alpha` or newer and upgrade your Kafka connector to version `0.1.10` or newer


### Sync overview

#### Output schema
Expand Down
4 changes: 4 additions & 0 deletions docs/integrations/destinations/keen.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,10 @@ description: >-

The Airbyte Keen destination allows you to stream data from any Airbyte Source into [Keen](https://keen.io?utm_campaign=Airbyte%20Destination%20Connector&utm_source=Airbyte%20Hosted%20Docs&utm_medium=Airbyte%20Hosted%20Docs&utm_term=Airbyte%20Hosted%20Docs&utm_content=Airbyte%20Hosted%20Docs) for storage, analysis, and visualization. Keen is a flexible, fully managed event streaming and analytics platform that empowers anyone to ship custom, embeddable dashboards in minutes, not months.

## Prerequisites
- For Airbyte Open Source users using the [Postgres](https://docs.airbyte.com/integrations/sources/postgres) source connector, [upgrade](https://docs.airbyte.com/operator-guides/upgrading-airbyte/) your Airbyte platform to version `v0.40.0-alpha` or newer and upgrade your Keen connector to version `0.2.4` or newer


### Sync overview

#### Output schema
Expand Down
3 changes: 3 additions & 0 deletions docs/integrations/destinations/kinesis.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,8 @@
# Kinesis

## Prerequisites
- For Airbyte Open Source users using the [Postgres](https://docs.airbyte.com/integrations/sources/postgres) source connector, [upgrade](https://docs.airbyte.com/operator-guides/upgrading-airbyte/) your Airbyte platform to version `v0.40.0-alpha` or newer and upgrade your Kinesis connector to version `0.1.4` or newer

## Sync overview


Expand Down
4 changes: 4 additions & 0 deletions docs/integrations/destinations/mongodb.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,10 @@
| Incremental - Deduped History | No | As this connector does not support dbt, we don't support this sync mode on this destination. |
| Namespaces | Yes | |

## Prerequisites
- For Airbyte Open Source users using the [Postgres](https://docs.airbyte.com/integrations/sources/postgres) source connector, [upgrade](https://docs.airbyte.com/operator-guides/upgrading-airbyte/) your Airbyte platform to version `v0.40.0-alpha` or newer and upgrade your MongoDB connector to version `0.1.6` or newer


## Output Schema for `destination-mongodb`

Each stream will be output into its own collection in MongoDB. Each collection will contain 3 fields:
Expand Down
3 changes: 3 additions & 0 deletions docs/integrations/destinations/mqtt.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,9 @@

The Airbyte MQTT destination allows you to sync data to any MQTT system compliance with version 3.1.X. Each stream is written to the corresponding MQTT topic.

## Prerequisites
- For Airbyte Open Source users using the [Postgres](https://docs.airbyte.com/integrations/sources/postgres) source connector, [upgrade](https://docs.airbyte.com/operator-guides/upgrading-airbyte/) your Airbyte platform to version `v0.40.0-alpha` or newer and upgrade your MQTT connector to the latest version

### Sync overview

#### Output schema
Expand Down
3 changes: 3 additions & 0 deletions docs/integrations/destinations/pubsub.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,9 @@ description: >-

The Airbyte Google PubSub destination allows you to send/stream data into PubSub. Pub/Sub is an asynchronous messaging service provided by Google Cloud Provider.

## Prerequisites
- For Airbyte Open Source users using the [Postgres](https://docs.airbyte.com/integrations/sources/postgres) source connector, [upgrade](https://docs.airbyte.com/operator-guides/upgrading-airbyte/) your Airbyte platform to version `v0.40.0-alpha` or newer and upgrade your PubSub connector to version `0.1.6` or newer

### Sync overview

#### Output schema
Expand Down
3 changes: 3 additions & 0 deletions docs/integrations/destinations/pulsar.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,9 @@

The Airbyte Pulsar destination allows you to sync data to Pulsar. Each stream is written to the corresponding Pulsar topic.

## Prerequisites
- For Airbyte Open Source users using the [Postgres](https://docs.airbyte.com/integrations/sources/postgres) source connector, [upgrade](https://docs.airbyte.com/operator-guides/upgrading-airbyte/) your Airbyte platform to version `v0.40.0-alpha` or newer and upgrade your Pulsar connector to version `0.1.3` or newer

### Sync overview

#### Output schema
Expand Down
2 changes: 2 additions & 0 deletions docs/integrations/destinations/rockset.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,7 @@
# Rockset

## Prerequisites
- For Airbyte Open Source users using the [Postgres](https://docs.airbyte.com/integrations/sources/postgres) source connector, [upgrade](https://docs.airbyte.com/operator-guides/upgrading-airbyte/) your Airbyte platform to version `v0.40.0-alpha` or newer and upgrade your Rockset connector to version `0.1.4` or newer
## Features

| Feature | Support |
Expand Down
4 changes: 3 additions & 1 deletion docs/integrations/destinations/scylla.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,9 @@
# Scylla

## Sync overview
## Prerequisites
- For Airbyte Open Source users using the [Postgres](https://docs.airbyte.com/integrations/sources/postgres) source connector, [upgrade](https://docs.airbyte.com/operator-guides/upgrading-airbyte/) your Airbyte platform to version `v0.40.0-alpha` or newer and upgrade your Scylla connector to version `0.1.3` or newer

## Sync overview
### Output schema

The incoming airbyte data is structured in keyspaces and tables and is partitioned and replicated across different nodes
Expand Down
3 changes: 2 additions & 1 deletion docs/integrations/sources/postgres.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@ If your dataset is small and you just want a snapshot of your table in the desti

## Prerequisites

- For Airbyte OSS users, [upgrade](https://docs.airbyte.com/operator-guides/upgrading-airbyte/) your Airbyte platform to version `v0.40.0-alpha` or newer
- Use Postgres v9.3.x or above for non-CDC workflows and Postgres v10 or above for CDC workflows
- Allowlist the IP address `34.106.109.131` to enable access to Airbyte
- For Airbyte Cloud (and optionally for Airbyte OSS), ensure SSL is enabled in your environment
Expand Down Expand Up @@ -374,7 +375,7 @@ Possible solutions include:
| 1.0.2 | 2022-08-11 | [15538](https://github.com/airbytehq/airbyte/pull/15538) | Allow additional properties in db stream state |
| 1.0.1 | 2022-08-10 | [15496](https://github.com/airbytehq/airbyte/pull/15496) | Fix state emission in incremental sync |
| | 2022-08-10 | [15481](https://github.com/airbytehq/airbyte/pull/15481) | Fix data handling from WAL logs in CDC mode |
| 1.0.0 | 2022-08-05 | [15380](https://github.com/airbytehq/airbyte/pull/15380) | Change connector label to generally_available |
| 1.0.0 | 2022-08-05 | [15380](https://github.com/airbytehq/airbyte/pull/15380) | Change connector label to generally_available (requires [upgrading](https://docs.airbyte.com/operator-guides/upgrading-airbyte/) your Airbyte platform to `v0.40.0-alpha`) |
| 0.4.44 | 2022-08-05 | [15342](https://github.com/airbytehq/airbyte/pull/15342) | Adjust titles and descriptions in spec.json |
| 0.4.43 | 2022-08-03 | [15226](https://github.com/airbytehq/airbyte/pull/15226) | Make connectionTimeoutMs configurable through JDBC url parameters |
| 0.4.42 | 2022-08-03 | [15273](https://github.com/airbytehq/airbyte/pull/15273) | Fix a bug in `0.4.36` and correctly parse the CDC initial record waiting time |
Expand Down

0 comments on commit e8a0d5c

Please sign in to comment.