Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add probe to upgrade test #4211

Merged
merged 3 commits into from
Jun 6, 2019

Conversation

jonjohnsonjr
Copy link
Contributor

Fixes #2786

@knative-prow-robot knative-prow-robot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label May 31, 2019
@googlebot googlebot added the cla: yes Indicates the PR's author has signed the CLA. label May 31, 2019
@knative-prow-robot knative-prow-robot added the size/M Denotes a PR that changes 30-99 lines, ignoring generated files. label May 31, 2019
Copy link
Contributor

@knative-prow-robot knative-prow-robot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jonjohnsonjr: 0 warnings.

In response to this:

Fixes #2786

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@knative-prow-robot knative-prow-robot added the area/test-and-release It flags unit/e2e/conformance/perf test issues for product features label May 31, 2019
@jonjohnsonjr jonjohnsonjr force-pushed the upgrade-prober branch 4 times, most recently from 27d6527 to 831f082 Compare May 31, 2019 22:45
@jonjohnsonjr
Copy link
Contributor Author

/test pull-knative-serving-upgrade-tests

@jonjohnsonjr jonjohnsonjr force-pushed the upgrade-prober branch 6 times, most recently from fa1999d to b5091db Compare June 4, 2019 16:55
@jonjohnsonjr
Copy link
Contributor Author

It's alive!

I0604 17:43:19.962] --- FAIL: TestProbe (392.34s)
I0604 17:43:19.962]     probe_test.go:38: Creating a new Service
I0604 17:43:19.962]     service.go:106: Creating a new Service upgrade-probe.
I0604 17:43:19.967]     util.go:34: resource {<nil> <nil> <*>{&TypeMeta{Kind:,APIVersion:,} &ObjectMeta{Name:upgrade-probe,GenerateName:,Namespace:,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,} {0 <nil> <nil> <nil> <nil> {0 <nil> <nil> <*>&ObjectMeta{Name:,GenerateName:,Namespace:,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,}} {0 [{ {   <*>true 100 <nil>}}]}} {{0 <nil>} {<nil>   <nil> <nil>} { }}} <nil>}
I0604 17:43:19.979]     service.go:121: Waiting for Service "upgrade-probe" to transition to Ready.
I0604 17:43:19.983]     service.go:126: Checking to ensure Service Status is populated for Ready service upgrade-probe
I0604 17:43:19.983]     service.go:132: Getting latest objects Created by Service upgrade-probe
I0604 17:43:19.986]     service.go:135: Successfully created Service upgrade-probe
I0604 17:43:19.989]     probe_test.go:44: Starting to probe upgrade-probe.serving-tests.35.238.17.192.xip.io
I0604 17:43:19.992]     prober.go:158: Starting Route prober for route domain upgrade-probe.serving-tests.35.238.17.192.xip.io.
I0604 17:43:19.993]     prober.go:112: "upgrade-probe.serving-tests.35.238.17.192.xip.io" status = 404, want: 200
I0604 17:43:19.994]     prober.go:113: response: status: 404, body: , headers: map[Content-Length:[0] Date:[Tue, 04 Jun 2019 17:36:57 GMT] Location:[http://upgrade-probe.serving-tests.35.238.17.192.xip.io/] Server:[istio-envoy] Zipkin_trace_id:[2a4f9f2fa3afdf8dbaf93ff58978f880]]
I0604 17:43:19.999]     prober.go:112: "upgrade-probe.serving-tests.35.238.17.192.xip.io" status = 404, want: 200
I0604 17:43:20.000]     prober.go:113: response: status: 404, body: , headers: map[Content-Length:[0] Date:[Tue, 04 Jun 2019 17:36:58 GMT] Location:[http://upgrade-probe.serving-tests.35.238.17.192.xip.io/] Server:[istio-envoy] Zipkin_trace_id:[0118a2bfa6870e54661c967919a0e451]]
I0604 17:43:20.000]     prober.go:204: Stopping all probers
I0604 17:43:20.000]     probe_test.go:50: CheckSLO() = SLI for "TestProbe" = 0.994764, wanted >= 1.000000
I0604 17:43:20.000] FAIL
I0604 17:43:20.000] FAIL	github.com/knative/serving/test/upgrade	392.628s
I0604 17:43:20.477] ERROR: Prober failed

@jonjohnsonjr jonjohnsonjr force-pushed the upgrade-prober branch 2 times, most recently from dcea24d to b48b59c Compare June 4, 2019 20:19
@knative-prow-robot knative-prow-robot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Jun 4, 2019
This will ensure that we don't drop requests while upgrading the serving
controllers.
@knative-prow-robot knative-prow-robot added size/M Denotes a PR that changes 30-99 lines, ignoring generated files. and removed size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Jun 4, 2019
@jonjohnsonjr
Copy link
Contributor Author

/retest

@jonjohnsonjr jonjohnsonjr marked this pull request as ready for review June 4, 2019 22:21
@knative-prow-robot knative-prow-robot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jun 4, 2019
@jonjohnsonjr
Copy link
Contributor Author

/assign @vagababov

@greghaynes
Copy link
Contributor

Neat! What do you think about either having the test own the pipe completely or at least perform the cleanup? Setting trap's in bash are a bit of a maintenance pain (since they overwrite any existing ones globally) and are a pain to reason about IME, this would get rid of that.

@jonjohnsonjr
Copy link
Contributor Author

Neat! What do you think about either having the test own the pipe completely or at least perform the cleanup? Setting trap's in bash are a bit of a maintenance pain (since they overwrite any existing ones globally) and are a pain to reason about IME, this would get rid of that.

Great idea

@knative-prow-robot knative-prow-robot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Jun 5, 2019
Copy link
Contributor

@adrcunha adrcunha left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is so cool. :)

@jonjohnsonjr
Copy link
Contributor Author

This is ready for another look.

@greghaynes
Copy link
Contributor

/lgtm

@knative-prow-robot knative-prow-robot added the lgtm Indicates that a PR is ready to be merged. label Jun 6, 2019
Copy link
Contributor

@adrcunha adrcunha left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@knative-prow-robot knative-prow-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jun 6, 2019
Copy link
Contributor

@vagababov vagababov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@vagababov
Copy link
Contributor

/hold
just in case you want to do the flag

@knative-prow-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: adrcunha, jonjohnsonjr, vagababov

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@knative-prow-robot knative-prow-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jun 6, 2019
@jonjohnsonjr
Copy link
Contributor Author

/hold cancel

just in case you want to do the flag

Took a stab at it but was thwarted by this and don't care to fix it yet.

@knative-prow-robot knative-prow-robot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jun 6, 2019
@knative-prow-robot knative-prow-robot merged commit 158b04d into knative:master Jun 6, 2019
@jonjohnsonjr jonjohnsonjr deleted the upgrade-prober branch June 6, 2019 21:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. area/test-and-release It flags unit/e2e/conformance/perf test issues for product features cla: yes Indicates the PR's author has signed the CLA. lgtm Indicates that a PR is ready to be merged. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

upgrade tests: add probe to generate load across versions
7 participants