Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Plans: A/B test displaying features list vs. description in Plan v2 #3316

Merged
merged 5 commits into from
Feb 16, 2016

Conversation

danhauk
Copy link
Contributor

@danhauk danhauk commented Feb 15, 2016

This is a second iteration on #2924 with a more focused hypothesis. Testing by adding a third variation to remove a few features from the list.

Hypothesis

eCommerce and Google Analytics are key drivers toward Business plan signups.

Variations

description list andMore
683c9b2c-c366-11e5-88fa-ede8ee793b88 68747470733a2f2f7472656c6c6f2d6174746163686d656e74732e73332e616d617a6f6e6177732e636f6d2f3536393665643735646265313533373830616163303239392f373437783634372f65333566386563353232323436306533 image

Testing

With description text

  • Visit http://calypso.localhost:3000/start in a new browsing session.
  • Run localStorage.setItem( 'ABTests', '{"plansFeatureList_20160215":"description"}' ); in your browser.
  • Proceed through signup to the plans step.
  • Assert that you see a sentence as the description for each plan.
  • Assert that you see the same description on /plans/:site after signing up.

With full features list

  • Visit http://calypso.localhost:3000/start in a new browsing session.
  • Run localStorage.setItem( 'ABTests', '{"plansFeatureList_20160215":"list"}' ); in your browser.
  • Proceed through signup to the plans step.
  • Assert that you see a list of features (like in the screenshot above) for each plan.
  • Assert that you see the same list of features on /plans/:site after signing up.

With truncated features list

  • Visit http://calypso.localhost:3000/start in a new browsing session.
  • Run localStorage.setItem( 'ABTests', '{"plansFeatureList_20160215":"andMore"}' ); in your browser.
  • Proceed through signup to the plans step.
  • Assert that you see a truncated list of features with "And more" link (like in the screenshot above) for Business plan.
  • Assert that you see the same list of features on /plans/:site after signing up.

@danhauk danhauk added [Feature] Plans & Upgrades All of the plans on WordPress.com and flow for upgrading plans. [Status] In Progress labels Feb 15, 2016
@danhauk danhauk self-assigned this Feb 15, 2016
@breezyskies
Copy link
Contributor

Added the "And more" link to the plan comparison and updated the a/b test start date.

cc: @drewblaisdell for testing and review.

@breezyskies breezyskies added [Status] Needs Review The PR is ready for review. This also triggers e2e canary tests and wp-desktop tests automatically. and removed [Status] In Progress labels Feb 15, 2016
@danhauk
Copy link
Contributor Author

danhauk commented Feb 15, 2016

👍 Product review - works as expected

@@ -40,8 +40,14 @@ module.exports = React.createClass( {
}
},

getComparePlansUrl: function() {
const { site } = this.props;
var siteSuffix = site ? site.slug : '';
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Super minor, but we're trying to avoid ES6 syntax (like const or object destructuring) in files that haven't been fully rewritten in ES6 (there is another erroneous instance of this on line 51). This should be:

var site = this.props.site,
  siteSuffix = site ? site.slug : '';

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed!

@drewblaisdell drewblaisdell added [Status] Ready to Merge [Type] Task and removed [Status] Needs Review The PR is ready for review. This also triggers e2e canary tests and wp-desktop tests automatically. labels Feb 15, 2016
@drewblaisdell
Copy link
Contributor

👍

@breezyskies breezyskies force-pushed the add/plans-features-list-test-i2 branch from 67507fd to b9d4711 Compare February 16, 2016 00:01
breezyskies added a commit that referenced this pull request Feb 16, 2016
Plans: A/B test displaying features list vs. description in Plan v2
@breezyskies breezyskies merged commit a239478 into master Feb 16, 2016
@breezyskies breezyskies deleted the add/plans-features-list-test-i2 branch February 16, 2016 00:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
[Feature] Plans & Upgrades All of the plans on WordPress.com and flow for upgrading plans. [Type] Task
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants