Skip to content

Spotify Launches New Tool to Aid Developers with A/B Testing

Confidence, Spotify's innovative product for A/B testing, is all set to transform software development. Explore how Spotify is branching out to revolutionize optimization and experimentation.

Confidence: Spotify's Solution for Optimized A/B Testing

Say goodbye to your A/B testing woes! Spotify has introduced its newest creation - Confidence, a commercial product designed to empower software development teams with hassle-free user tests. Currently in private beta, Confidence is the brainchild of Spotify’s seasoned data scientists and engineers who have been refining product testing methods for years.

Confidence is more than just a tool, it’s your gateway to efficient and effective experimentation. From coordinating simultaneous A/B tests to rolling out AI recommendation systems across platforms, this experimentation platform is all about speed, reliability, and above all, confidence.

Taking its first experimental steps in the early 2010s, Spotify began its journey with small internal A/B tests conducted by a select group of data scientists and engineers. Even though these initial tests were manual and prone to errors, Spotify recognized the power of experimentation. This led to the birth of their very own A/B testing platform, ABBA.

ABBA was the key that unlocked a wave of experimentation within Spotify. From fewer than 20 priority experiments per year, the company scaled up to hundreds of tests annually, engaging multiple squads in the process.

But Spotify didn’t stop there. Building on ABBA's success, Confidence was born. Available as a managed service, a Backstage plugin, or integrated into your infrastructure via APIs, Confidence offers versatility that’s rare in the market.

Excited to give Confidence a spin? You can now join the waitlist to get an exclusive invite to this groundbreaking tool. Though there’s no confirmed date for its wider availability, Spotify is already paving the way for its second commercial product to support developers - Spotify Backstage.

Backstage is an open-source project that aims to bring structure to your company’s infrastructure. It enables the creation of custom "developer portals", where all your apps, tools, data, services, APIs, and documents can be accessed in one place.

While Spotify is popular for its music streaming service, today's announcement marks a strategic shift. With products like Confidence and Backstage, Spotify is clearly eyeing the broader tech landscape, with ambitions beyond music streaming. Get ready for a wave of innovation as Spotify brings its own brand of 'confidence' to software development!