Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Block dimension analyses from firing significance events #3061

Merged
merged 1 commit into from
Oct 3, 2024

Conversation

lukesonnet
Copy link
Collaborator

@lukesonnet lukesonnet commented Oct 2, 2024

Features and Changes

Do not fire experiment.info.significance or experiment.warning events for dimensional analyses.

Testing

  • On main, get an experiment with a stat sig metric

  • Delete all snapshots so it will notify

  • If I do a dimension analysis, it notifies

  • Switch to this branch, delete that old snapshot from mongo

  • Run dimension analysis, no notification

  • Non-dimension analysis notifies!

Screenshots

Copy link

github-actions bot commented Oct 3, 2024

Your preview environment pr-3061-bttf has been deployed.

Preview environment endpoints are available at:

Copy link
Contributor

@romain-growthbook romain-growthbook left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Go for it!

@lukesonnet lukesonnet merged commit deaf952 into main Oct 3, 2024
3 checks passed
@lukesonnet lukesonnet deleted the ls/significance-dimension branch October 3, 2024 00:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants