A/B tests interfering with metrics and alerts
Turn off your A/B tests or pick one variation.
If you're using an A/B testing framework like Optimizely or Visual Website Optimizer on your site, it can lead a lot of variation in metrics as the SpeedCurve test agents will end up in random test buckets. This can lead to alerts being sent more often and increased noise in your test results.
Unless you want to test a specific A/B test variation, it's better to tell your framework to not run any tests at all. You can usually do this with a simple change to the URL adding a parameter like optimizely_disabled=true.
Updated about 1 year ago