Monitor errors as you roll out features or run experiments and A/B tests.
If you practice progressive delivery by using feature flags and experiments (including A/B tests) to manage rollout of new features, you can use BugSnag to monitor the impact of the rollouts on your app’s stability.
BugSnag can be used to monitor the impact on your app’s stability as you roll out features and run experiments. By declaring active feature flag and experiment usage in your notifier you can:
What are feature flags and experiments?
Feature flags and experiments can be implemented in-house or for more control you can use a 3rd-party provider like Split.io or LaunchDarkly. We give instructions on how to integrate with these libraries within the platform guides.
Feature flag and experiment usage is declared through your BugSnag notifier. See the documentation for your platform for details:
The features dashboard is available on Enterprise plans.
The features dashboard is used to monitor errors impacting feature flags and experiments that you are running in your app.
The feature details page shows errors that occurred when a feature flag or experiment was active:
Additionally, Exclusive errors to a variant have only impacted members of a single variant. Exclusive errors to a variant are by definition exclusive to the feature flag or experiment overall, but errors exclusive to a feature flag or experiment overall are not necessarily exclusive to a variant; they may have occurred in multiple or all variants.
In order to get value from Exclusive errors, you should only record feature flag or experiment usage when they are having an impact on functionality. In other words do not record the “off” or “control” type variants. This will allow Exclusive errors to highlight those feature flags or experiments that have actually caused the error.
Feature and experiment filtering is available on Enterprise plans.
You can search for errors that occurred while a feature flag or experiment variant was active using the “Releases and Features” filter from the search bar.
By saving the filter as a bookmark, you can then create notifications and issue tracker automations for errors occurring while a feature flag or experiment variant is active.
By default there is a limit on the number of features and experiments per event. There is no limit on the number of different variant values that can be used.
If the active features and experiments limit is exceeded for an event:
To increase the number of active features and experiments available to your organization, please get in touch with us.