Skip to content

YouTube Studio

YouTube A/B Testing

YouTube A/B testing shows up to three thumbnails or titles to different viewers and keeps the one that earns the most watch time.

By Aymane Senhaji · checked against YouTube's own help pages ·

What is YouTube A/B testing?

YouTube A/B testing is the test built into YouTube Studio that shows different thumbnails or titles to different viewers of the same video. You upload up to three options, YouTube splits the audience between them, and at the end it keeps the option with the highest watch time for everyone. When no option clearly wins, the first one you uploaded stays. The feature was first called Test & Compare; YouTube's help now calls it A/B testing for titles and thumbnails.

How a test works

  1. Upload up to three thumbnails, three titles, or combinations of both.
  2. YouTube shows each option to a different share of viewers at the same time.
  3. The test takes from a few days to two weeks, depending on the video's impressions and how recently it was published.
  4. The option with the highest watch time becomes the one every viewer sees. If there is no strong difference, the first option you uploaded becomes the default.

Who can use it

YouTube's help sets four limits, as of October 2026:

  • on a computer only, from YouTube Studio
  • advanced features must be enabled on the channel
  • not on Shorts, scheduled lives or Premieres
  • not on videos made for kids, for mature audiences, or set to private

A/B testing vs swapping thumbnails by hand

YouTube A/B testingSwapping the thumbnail yourself
Who sees each versionDifferent viewers in the same periodEveryone, one version after the other
What changes between versionsOnly the thumbnail or titleThe thumbnail, plus the week, the audience and the traffic sources
How the winner is pickedWatch timeWhatever number you happen to look at
What YouTube says about itThe built-in way to compareIts help warns the differences may come from traffic sources, not the thumbnail

Where you see it

The test is set up from the video's details in YouTube Studio on a computer, and its result appears there once it ends: the winning option, or a note that there was no clear winner and the first option was kept.

Why A/B testing matters

It is the only clean comparison a creator has. Swapping a thumbnail on Tuesday and comparing it with Monday mixes the thumbnail with everything else that changed, which YouTube's own help warns about.

The choice of metric matters as much as the test. Watch time, not click-through rate, picks the winner, so a clickbait version that gets clicks and loses viewers does not win. The useful way to use it is to test three genuinely different ideas, an emotion, an object and a contrast, rather than three versions of the same image in different colours.

Questions about YouTube A/B Testing

How many thumbnails can I test at once?

Up to three. YouTube's A/B test accepts up to three thumbnails, titles or title and thumbnail combinations on the same video.

How long does a YouTube A/B test take?

From a few days to two weeks, according to YouTube's help, depending on the video's impressions, how recently it was published and other factors. When it ends, the option with the highest watch time is shown to all viewers.

Can I A/B test a Short?

No. YouTube's help says Shorts, scheduled lives and Premieres can't be A/B tested for now, and neither can videos made for kids, for mature audiences or set to private. The test is for regular uploads, from YouTube Studio on a computer.

Why does YouTube pick the winner by watch time and not by CTR?

Because a thumbnail that gets clicks and then loses the viewer is not doing its job. Measuring watch time rewards the thumbnail that brings in people who actually want the video, which is also what YouTube's recommendations reward.

Sources

What a good click-through rate isYouTube's own benchmark, by traffic source, and what to do when yours is low.

Make the thumbnail

Paste your video's link: the brief is written for you, the text is read back and the image is checked at feed size. 60 free credits, no card.

60 free credits, four to six thumbnails. No card, no watermark.