Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Empty Stats: AB test the nudges order #17328

Merged
merged 3 commits into from
Oct 15, 2021

Conversation

leandroalonso
Copy link
Contributor

Only merge after #17313

To test

  1. Do a fresh install
  2. Go to Stats
  3. Notice the order in which the first card appears to you
  4. Check in the nudge events that a property called first_nudge is fired with the correct value

Regression Notes

  1. Potential unintended areas of impact
  1. What I did to test those areas of impact (or what existing automated tests I relied on)
  1. What automated tests I added (or what prevented me from doing so)

PR submission checklist:

  • I have completed the Regression Notes.
  • I have considered adding unit tests for my changes.
  • I have considered adding accessibility improvements for my changes.
  • I have considered if this change warrants user-facing release notes and have added them to RELEASE-NOTES.txt if necessary.

@peril-wordpress-mobile
Copy link

peril-wordpress-mobile bot commented Oct 15, 2021

You can trigger an installable build for these changes by visiting CircleCI here.

@peril-wordpress-mobile
Copy link

peril-wordpress-mobile bot commented Oct 15, 2021

You can trigger optional UI/connected tests for these changes by visiting CircleCI here.

@momo-ozawa momo-ozawa force-pushed the feature/empty-stats-phase-1 branch from 9efabd9 to 347263c Compare October 15, 2021 15:45
Copy link
Contributor

@momo-ozawa momo-ozawa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Works as described!

social appears first. Do you think we should call it publicize instead?

2021-10-15 17:30:42:672 WordPress[17788:664620] 🔵 Tracked: stats_publicize_nudge_shown <blog_id: 198007634, first_nudge: social, site_type: blog>
2021-10-15 17:30:57:995 WordPress[17788:664620] 🔵 Tracked: stats_publicize_nudge_tapped <blog_id: 198007634, first_nudge: social, site_type: blog>
2021-10-15 17:31:05:610 WordPress[17788:664620] 🔵 Tracked: stats_publicize_nudge_dismissed <blog_id: 198007634, first_nudge: social, site_type: blog>

@leandroalonso
Copy link
Contributor Author

social appears first. Do you think we should call it publicize instead?

Definitely! I'll change it.

Base automatically changed from feature/empty-stats-phase-1 to develop October 15, 2021 16:35
@leandroalonso leandroalonso force-pushed the task/add_ab_test_for_nudges_order branch from def7bad to 5610947 Compare October 15, 2021 16:43
@leandroalonso leandroalonso added this to the 18.5 milestone Oct 15, 2021
Copy link
Contributor

@momo-ozawa momo-ozawa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀

@@ -9,7 +9,6 @@
* [**] Block editor: Embed block: Detect when an embeddable URL is pasted into an empty paragraph. [https://github.com/wordpress-mobile/gutenberg-mobile/pull/4048]
* [**] Block editor: Pullquote block - Added support for text and background color customization [https://github.com/WordPress/gutenberg/pull/34451]
* [**] Block editor: Preformatted block - Added support for text and background color customization [https://github.com/wordpress-mobile/gutenberg-mobile/pull/4071]
* [**] Stats: added Publicize and Blogging Reminders nudges for sites with low traffic in order to increase it.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! 🙏

@@ -652,9 +652,11 @@ extension SiteStatsInsightsTableViewController: NoResultsViewHost {
private extension SiteStatsInsightsTableViewController {

func trackNudgeEvent(_ event: WPAnalyticsEvent) {
let firstNudge: String = EmptyStatsAB.shared.variant == .control ? "publicize" : "bloggingReminder"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants