Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add how to copy files from Kubernetes pods. #7238

Merged
merged 6 commits into from
Nov 18, 2021
Merged

Add how to copy files from Kubernetes pods. #7238

Changes from 1 commit
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
1de988f
Add how to copy files from Kubernetes pods.
davinchia Oct 21, 2021
7c8005e
Add instructions on how to browse.
davinchia Oct 21, 2021
43bf253
Format.
davinchia Oct 21, 2021
3d19e6a
OAuth implementation factory.
davinchia Oct 26, 2021
2cce261
This is needed.
davinchia Oct 26, 2021
1a1c22b
Merge remote-tracking branch 'origin/master' into update-command-to-r…
ChristopheDuong Nov 18, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 11 additions & 0 deletions docs/operator-guides/browsing-output-logs.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -93,6 +93,17 @@ docker cp airbyte-server:/tmp/workspace/9/2/catalog.json .
cat catalog.json
```

### Extract the catalog.json file from a Kubernetes pod

Or if you are running Airbyte on Kubernetes and want to copy it out from the normalisation pod:
```bash
kubectl cp <namespace pods are in>/<normalisation-pod-name>:/config/destination_catalog.json ./catalog.json
e.g.
kubectl cp jobs/normalization-worker-3605-0-sxtox:/config/destination_catalog.json ./catalog.json
cat ./catalog.json
```


## CSV or JSON local Destinations: Check local data folder

If you setup a pipeline using one of the local File based destinations \(CSV or JSON\), Airbyte is writing the resulting files containing the data in the special `/local/` directory in the container. By default, this volume is mounted from `/tmp/airbyte_local` on the host machine. So you need to navigate to this [local folder](file:///tmp/airbyte_local/) on the filesystem of the machine running the Airbyte deployment to retrieve the local data files.
Expand Down