Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🎉 Source Zendesk: sync rate improvement #9456

Merged
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
2a3c1f8
Update Source Zendesk request execution with future requests.
htrueman Jan 12, 2022
d639545
Merge remote-tracking branch 'origin/master' into htrueman/source-zen…
htrueman Jan 18, 2022
dec8094
Merge remote-tracking branch 'origin/master' into htrueman/source-zen…
htrueman Jan 19, 2022
7d23a81
Revert "Update Source Zendesk request execution with future requests."
htrueman Jan 20, 2022
6b7f2b4
Add futures stream logics.
htrueman Jan 26, 2022
be7e0d1
Fix stream
htrueman Jan 26, 2022
0d98ac5
Fix full refresh streams.
htrueman Jan 26, 2022
4199e21
Merge remote-tracking branch 'origin/master' into htrueman/source-zen…
htrueman Feb 7, 2022
9d45cdd
Update streams.py.
htrueman Feb 9, 2022
6ab6bc9
Add future request unit tests
htrueman Feb 11, 2022
851001e
Merge remote-tracking branch 'origin/master' into htrueman/source-zen…
htrueman Feb 22, 2022
02748fc
Post review fixes.
htrueman Feb 22, 2022
25f3061
Merge remote-tracking branch 'origin/master' into htrueman/source-zen…
htrueman Feb 23, 2022
7896dbd
Merge remote-tracking branch 'origin/master' into htrueman/source-zen…
htrueman Feb 23, 2022
0e746f2
Merge remote-tracking branch 'origin/master' into htrueman/source-zen…
htrueman Feb 23, 2022
cf5c07f
Merge remote-tracking branch 'origin/master' into htrueman/source-zen…
htrueman Feb 27, 2022
1188e82
Fix broken incremental streams.
htrueman Feb 28, 2022
8b2a786
Comment few unit tests
htrueman Feb 28, 2022
df2d555
Bump docker version
htrueman Feb 28, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -829,7 +829,7 @@
- name: Zendesk Support
sourceDefinitionId: 79c1aa37-dae3-42ae-b333-d1c105477715
dockerRepository: airbyte/source-zendesk-support
dockerImageTag: 0.1.12
dockerImageTag: 0.2.0
documentationUrl: https://docs.airbyte.io/integrations/sources/zendesk-support
icon: zendesk.svg
sourceType: api
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -8757,7 +8757,7 @@
path_in_connector_config:
- "credentials"
- "client_secret"
- dockerImage: "airbyte/source-zendesk-support:0.1.12"
- dockerImage: "airbyte/source-zendesk-support:0.2.0"
spec:
documentationUrl: "https://docs.airbyte.io/integrations/sources/zendesk-support"
connectionSpecification:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -25,5 +25,5 @@ COPY source_zendesk_support ./source_zendesk_support
ENV AIRBYTE_ENTRYPOINT "python /airbyte/integration_code/main.py"
ENTRYPOINT ["python", "/airbyte/integration_code/main.py"]

LABEL io.airbyte.version=0.1.12
LABEL io.airbyte.version=0.2.0
LABEL io.airbyte.name=airbyte/source-zendesk-support
Original file line number Diff line number Diff line change
@@ -1,41 +1,41 @@
{
"users": {
"updated_at": "2022-07-19T22:21:37Z"
"updated_at": "2222-07-19T22:21:37Z"
},
"groups": {
"updated_at": "2022-07-15T22:19:01Z"
"updated_at": "2222-07-15T22:19:01Z"
},
"organizations": {
"updated_at": "2022-07-15T19:29:14Z"
"updated_at": "2222-07-15T19:29:14Z"
},
"satisfaction_ratings": {
"updated_at": "2022-07-20T10:05:18Z"
"updated_at": "2222-07-20T10:05:18Z"
},
"tickets": {
"generated_timestamp": 1816817368
"updated_at": "2222-07-20T10:05:18Z"
},
"group_memberships": {
"updated_at": "2022-04-23T15:34:20Z"
"updated_at": "2222-04-23T15:34:20Z"
},
"ticket_fields": {
"updated_at": "2022-12-11T19:34:05Z"
"updated_at": "2222-12-11T19:34:05Z"
},
"ticket_forms": {
"updated_at": "2022-12-11T20:34:37Z"
"updated_at": "2222-12-11T20:34:37Z"
},
"ticket_metrics": {
"updated_at": "2022-07-19T22:21:26Z"
"updated_at": "2222-07-19T22:21:26Z"
},
"ticket_metric_events": {
"time": "2022-07-19T22:21:26Z"
"time": "2222-07-19T22:21:26Z"
},
"macros": {
"updated_at": "2022-12-11T19:34:06Z"
"updated_at": "2222-12-11T19:34:06Z"
},
"ticket_comments": {
"created_at": "2022-07-19T22:21:26Z"
"created_at": "2222-07-19T22:21:26Z"
},
"ticket_audits": {
"created_at": "2022-07-19T22:21:26Z"
"created_at": "2222-07-19T22:21:26Z"
}
}

This file was deleted.

Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@

from setuptools import find_packages, setup

MAIN_REQUIREMENTS = ["airbyte-cdk~=0.1.36", "pytz"]
MAIN_REQUIREMENTS = ["airbyte-cdk~=0.1.36", "pytz", "requests-futures~=1.0.0", "pendulum~=2.1.2"]

TEST_REQUIREMENTS = ["pytest~=6.1", "source-acceptance-test", "requests-mock==1.9.3"]

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -144,7 +144,10 @@
"type": ["null", "integer"]
},
"value": {
"type": ["null", "string"]
"type": ["null", "string", "array"],
"items": {
"type": ["null", "string"]
}
},
"author_id": {
"type": ["null", "integer"]
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@
from airbyte_cdk.sources import AbstractSource
from airbyte_cdk.sources.streams import Stream
from airbyte_cdk.sources.streams.http.requests_native_auth import TokenAuthenticator
from source_zendesk_support.streams import SourceZendeskException

from .streams import (
Brands,
Expand All @@ -20,7 +21,6 @@
SatisfactionRatings,
Schedules,
SlaPolicies,
SourceZendeskException,
Tags,
TicketAudits,
TicketComments,
Expand Down Expand Up @@ -68,7 +68,7 @@ def check_connection(self, logger, config) -> Tuple[bool, any]:
auth = self.get_authenticator(config)
settings = None
try:
settings = UserSettingsStream(config["subdomain"], authenticator=auth).get_settings()
settings = UserSettingsStream(config["subdomain"], authenticator=auth, start_date=None).get_settings()
except requests.exceptions.RequestException as e:
return False, e

Expand Down
Loading