{"id":1094,"date":"2020-10-02T15:47:00","date_gmt":"2023-10-18T15:47:08","guid":{"rendered":"https:\/\/www.salesforce.com\/?p=1094"},"modified":"2023-10-18T17:35:32","modified_gmt":"2023-10-18T17:35:32","slug":"what-is-a-b-testing","status":"publish","type":"post","link":"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/","title":{"rendered":"What Is A\/B Testing?"},"content":{"rendered":"\n

You may not be able to argue with statistics, but you should always be able to act on them. Even as you\u2019re reading these words, your business is generating data that is worthy of analysis. <\/p>\n

Your website is converting visitors into active prospects . . . or not.<\/p>\n

Your social media posts are driving traffic back to your site . . . or not. <\/p>\n

Your email newsletter signup box is growing your subscriber list . . . or not. <\/p>\n

Of course, no one wants to be in the \u201cor not,\u201d category, which is why you need to make A\/B testing a standard part of everything you do. <\/p>\n

A\/B testing in a nutshell<\/h2>\n

With scarce resources and never enough time, small and medium-sized businesses often feel the need to develop a strategy or course of action and then stick to it, no matter what. That might make sense when you\u2019re developing a product or service, but it\u2019s a risky way to pursue the marketing of your products and services. <\/p>\n

Marketing often involves elements of creativity in terms of the copy you write, the graphics or artwork you include on an ad or landing page, or even videos you shoot. Creative work is always a little subjective. You make what you think will work, often after scrapping a number of your initial ideas. A\/B testing recognizes the fact that sometimes, the ideas or actions you don\u2019t pursue might actually be the better choice. <\/p>\n

When you A\/B test, you expose your audience (or even just segments of it) to multiple variations of creative work. You change up the frequency at which you publish content, the nature of how you promote something or other aspects of your marketing plan. <\/p>\n

The results of A\/B tests can often help you see what\u2019s really working among your target market, and what\u2019s not. It allows you to refine your strategy so that you don\u2019t waste your budget and maximize the return on the investment you\u2019re making. <\/p>\n

There are plenty of technologies, like marketing automation<\/a>, and tools<\/a> to assist with A\/B testing, but these are the basic principles you should know to get started: <\/p>\n

1. Pick the metric an A\/B test could influence <\/h2>\n

Let\u2019s say you want to use a landing page to collect leads for your sales team. The landing page might have a form site visitors have to fill out in order to download some valuable content, like an eBook or buyer\u2019s guide. The design of that landing page will obviously be key to your success, but before you A\/B test different versions of it, think of what you\u2019ll be measuring in the test. <\/p>\n

Do you want to simply track how many people visit the page, or how many people fill out the form and download? The first metric might be affected not only by the design but the keywords you\u2019ve included that get found in search results. The latter metric might have more to do with the number of fields in the form, as well as how the asset is described. <\/p>\n

Create an A\/B test knowing in advance if you\u2019re primarily aiming for awareness, engagement, indications of purchase intent or some combination of metrics. <\/p>\n

2. Pick your test sample<\/h2>\n

It can be confusing if your entire audience finds themselves looking at different versions of the same marketing assets or creative campaign materials. The usual route is to create a subset of your audience that will give you statistically relevant data you can use to make a decision about your market as a whole. <\/p>\n

The exact size of your sample might depend on your audience, but let\u2019s use an email newsletter as an example. You might want to do an A\/B test of different subject lines to see which one caused more people to open up the message and click through to any links you\u2019ve included. <\/p>\n

An A\/B test could involve sending out one subject line to five per cent of your distribution list, and the other could go to another five per cent. Even if one of the subject lines falls flat, you still have a good sense of what will likely resonate for the remaining 90 per cent of your list. <\/p>\n

3. Pick your testing time frame<\/h2>\n

Some A\/B test results will be apparent right away, but others might require a little more patience. <\/p>\n

The impact of a new version of an online ad, for instance, might need to factor in the time it has been available online and the number of sites on which you\u2019ve placed it. <\/p>\n

If you\u2019re A\/B testing content for social media, you might need to try posting multiple times, or at different times of the day, to truly gauge the effectiveness of different versions. <\/p>\n

Much like your sample size, the time frame can be dependent on a number of factors, but generally you need to be able to gather enough data to feel confident in choosing your \u201cwinner.\u201d<\/p>\n

Conclusion: Turn your A\/B test results into better business results<\/h2>\n

Although they\u2019re called A\/B tests, you might test more than simply two variables. Use as many as you need based on the goal you\u2019re trying to reach. <\/p>\n

Once you have your test results, meanwhile, the next step might need to go beyond settling for whichever variation performed the best. You might want to continue tweaking the \u201cwinner\u201d based on language, imagery or many other different factors. In that sense, the A\/B test could be the first of many as you optimize your marketing. <\/p>\n

Not all A\/B tests will be based on a marketing campaign, either. You should also use them for marketing assets that tend to be created for long-term use, such as product pages or even your \u201cAbout Us\u201d and \u201cContact Us\u201d pages on your website. <\/p>\n

Some A\/B tests will also involve looking at whether you stop doing something. For example, you could A\/B test what happens when you don\u2019t run an ad during a specific period, or if you turn off a social promotion in favour of sharing other kinds of content. <\/p>\n

Whatever the approach, A\/B testing will make you a more data-driven marketer \u2014 in other words, the kind of marketer who achieves the most ambitious business objectives. <\/p>\n

<\/span> <\/p>\n","protected":false},"excerpt":{"rendered":"

You may not be able to argue with statistics, but you should always be able to act on them. Even as you\u2019re reading these words, your business is generating data that is worthy of analysis.
\nYour website is converting visitors into active prospects . . . or not.
\nYour social media posts are driving<\/p>\n","protected":false},"author":1,"featured_media":1096,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"sf_justforyou_enable_alt":true,"optimizely_content_id":"","post_meta_title":"","ai_synopsis":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"sf_topic":[3],"sf_content_type":[],"coauthors":[2],"class_list":["post-1094","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","sf_topic-marketing"],"yoast_head":"\nWhat Is A\/B Testing? - Salesforce<\/title>\n<meta name=\"description\" content=\"You may not be able to argue with statistics, but you should always be able to act on them. Even as you\u2019re reading these words, your business is generating data that is worthy of analysis. Your website is converting visitors into active prospects . . . or not. Your social media posts are driving\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What Is A\/B Testing?\" \/>\n<meta property=\"og:description\" content=\"You may not be able to argue with statistics, but you should always be able to act on them. Even as you\u2019re reading these words, your business is generating data that is worthy of analysis. Your website is converting visitors into active prospects . . . or not. Your social media posts are driving\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/\" \/>\n<meta property=\"og:site_name\" content=\"Salesforce\" \/>\n<meta property=\"article:published_time\" content=\"2023-10-18T15:47:08+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-10-18T17:35:32+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.salesforce.com\/ca\/blog\/wp-content\/uploads\/sites\/12\/2023\/10\/what-is-a-b-testing.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"724\" \/>\n\t<meta property=\"og:image:height\" content=\"482\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Salesforce Canada\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Salesforce Canada\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/\"},\"author\":[{\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/#\/schema\/person\/image\/67746feea2d6a73653ce0c10f94077a5\"}],\"headline\":\"What Is A\/B Testing?\",\"datePublished\":\"2023-10-18T15:47:08+00:00\",\"dateModified\":\"2023-10-18T17:35:32+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/\"},\"wordCount\":1060,\"commentCount\":0,\"image\":{\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.salesforce.com\/ca\/blog\/wp-content\/uploads\/sites\/12\/2023\/10\/what-is-a-b-testing.jpg\",\"inLanguage\":\"en-CA\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/\",\"url\":\"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/\",\"name\":\"What Is A\/B Testing? - Salesforce\",\"isPartOf\":{\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.salesforce.com\/ca\/blog\/wp-content\/uploads\/sites\/12\/2023\/10\/what-is-a-b-testing.jpg\",\"datePublished\":\"2023-10-18T15:47:08+00:00\",\"dateModified\":\"2023-10-18T17:35:32+00:00\",\"author\":{\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/#\/schema\/person\/601f410a2801f4ddcf6f00cb182e69d3\"},\"description\":\"You may not be able to argue with statistics, but you should always be able to act on them. Even as you\u2019re reading these words, your business is generating data that is worthy of analysis. Your website is converting visitors into active prospects . . . or not. Your social media posts are driving\",\"breadcrumb\":{\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#breadcrumb\"},\"inLanguage\":\"en-CA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-CA\",\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#primaryimage\",\"url\":\"https:\/\/www.salesforce.com\/ca\/blog\/wp-content\/uploads\/sites\/12\/2023\/10\/what-is-a-b-testing.jpg\",\"contentUrl\":\"https:\/\/www.salesforce.com\/ca\/blog\/wp-content\/uploads\/sites\/12\/2023\/10\/what-is-a-b-testing.jpg\",\"width\":724,\"height\":482,\"caption\":\"What Is A\/B Testing?\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.salesforce.com\/ca\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"What Is A\/B Testing?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/#website\",\"url\":\"https:\/\/www.salesforce.com\/ca\/blog\/\",\"name\":\"Salesforce\",\"description\":\"News, tips, and insights from the global cloud leader\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.salesforce.com\/ca\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-CA\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/#\/schema\/person\/image\/67746feea2d6a73653ce0c10f94077a5\",\"name\":\"Salesforce Canada\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-CA\",\"@id\":\"https:\/\/www.salesforce.com\/ca\/blog\/#\/schema\/person\/image\/c206078faacfae202082d59bddc16cc4\",\"url\":\"https:\/\/www.salesforce.com\/ca\/blog\/wp-content\/uploads\/sites\/12\/2023\/11\/Salesforce-300x300-1.png?w=150&h=150&crop=1\",\"contentUrl\":\"https:\/\/www.salesforce.com\/ca\/blog\/wp-content\/uploads\/sites\/12\/2023\/11\/Salesforce-300x300-1.png?w=150&h=150&crop=1\",\"width\":\"150\",\"height\":\"150\",\"caption\":\"Salesforce Canada\"},\"url\":\"https:\/\/www.salesforce.com\/ca\/blog\/author\/salesforce-canada\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"What Is A\/B Testing? - Salesforce","description":"You may not be able to argue with statistics, but you should always be able to act on them. Even as you\u2019re reading these words, your business is generating data that is worthy of analysis. Your website is converting visitors into active prospects . . . or not. Your social media posts are driving","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/","og_locale":"en_US","og_type":"article","og_title":"What Is A\/B Testing?","og_description":"You may not be able to argue with statistics, but you should always be able to act on them. Even as you\u2019re reading these words, your business is generating data that is worthy of analysis. Your website is converting visitors into active prospects . . . or not. Your social media posts are driving","og_url":"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/","og_site_name":"Salesforce","article_published_time":"2023-10-18T15:47:08+00:00","article_modified_time":"2023-10-18T17:35:32+00:00","og_image":[{"width":724,"height":482,"url":"https:\/\/www.salesforce.com\/ca\/blog\/wp-content\/uploads\/sites\/12\/2023\/10\/what-is-a-b-testing.jpg","type":"image\/jpeg"}],"author":"Salesforce Canada","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Salesforce Canada","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#article","isPartOf":{"@id":"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/"},"author":[{"@id":"https:\/\/www.salesforce.com\/ca\/blog\/#\/schema\/person\/image\/67746feea2d6a73653ce0c10f94077a5"}],"headline":"What Is A\/B Testing?","datePublished":"2023-10-18T15:47:08+00:00","dateModified":"2023-10-18T17:35:32+00:00","mainEntityOfPage":{"@id":"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/"},"wordCount":1060,"commentCount":0,"image":{"@id":"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#primaryimage"},"thumbnailUrl":"https:\/\/www.salesforce.com\/ca\/blog\/wp-content\/uploads\/sites\/12\/2023\/10\/what-is-a-b-testing.jpg","inLanguage":"en-CA","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/","url":"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/","name":"What Is A\/B Testing? - Salesforce","isPartOf":{"@id":"https:\/\/www.salesforce.com\/ca\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#primaryimage"},"image":{"@id":"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#primaryimage"},"thumbnailUrl":"https:\/\/www.salesforce.com\/ca\/blog\/wp-content\/uploads\/sites\/12\/2023\/10\/what-is-a-b-testing.jpg","datePublished":"2023-10-18T15:47:08+00:00","dateModified":"2023-10-18T17:35:32+00:00","author":{"@id":"https:\/\/www.salesforce.com\/ca\/blog\/#\/schema\/person\/601f410a2801f4ddcf6f00cb182e69d3"},"description":"You may not be able to argue with statistics, but you should always be able to act on them. Even as you\u2019re reading these words, your business is generating data that is worthy of analysis. Your website is converting visitors into active prospects . . . or not. Your social media posts are driving","breadcrumb":{"@id":"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#breadcrumb"},"inLanguage":"en-CA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/"]}]},{"@type":"ImageObject","inLanguage":"en-CA","@id":"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#primaryimage","url":"https:\/\/www.salesforce.com\/ca\/blog\/wp-content\/uploads\/sites\/12\/2023\/10\/what-is-a-b-testing.jpg","contentUrl":"https:\/\/www.salesforce.com\/ca\/blog\/wp-content\/uploads\/sites\/12\/2023\/10\/what-is-a-b-testing.jpg","width":724,"height":482,"caption":"What Is A\/B Testing?"},{"@type":"BreadcrumbList","@id":"https:\/\/www.salesforce.com\/ca\/blog\/what-is-a-b-testing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.salesforce.com\/ca\/blog\/"},{"@type":"ListItem","position":2,"name":"What Is A\/B Testing?"}]},{"@type":"WebSite","@id":"https:\/\/www.salesforce.com\/ca\/blog\/#website","url":"https:\/\/www.salesforce.com\/ca\/blog\/","name":"Salesforce","description":"News, tips, and insights from the global cloud leader","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.salesforce.com\/ca\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-CA"},{"@type":"Person","@id":"https:\/\/www.salesforce.com\/ca\/blog\/#\/schema\/person\/image\/67746feea2d6a73653ce0c10f94077a5","name":"Salesforce Canada","image":{"@type":"ImageObject","inLanguage":"en-CA","@id":"https:\/\/www.salesforce.com\/ca\/blog\/#\/schema\/person\/image\/c206078faacfae202082d59bddc16cc4","url":"https:\/\/www.salesforce.com\/ca\/blog\/wp-content\/uploads\/sites\/12\/2023\/11\/Salesforce-300x300-1.png?w=150&h=150&crop=1","contentUrl":"https:\/\/www.salesforce.com\/ca\/blog\/wp-content\/uploads\/sites\/12\/2023\/11\/Salesforce-300x300-1.png?w=150&h=150&crop=1","width":"150","height":"150","caption":"Salesforce Canada"},"url":"https:\/\/www.salesforce.com\/ca\/blog\/author\/salesforce-canada\/"}]}},"jetpack_featured_media_url":"https:\/\/www.salesforce.com\/ca\/blog\/wp-content\/uploads\/sites\/12\/2023\/10\/what-is-a-b-testing.jpg","jetpack_sharing_enabled":true,"distributor_meta":false,"distributor_terms":false,"distributor_media":false,"distributor_original_site_name":"Salesforce","distributor_original_site_url":"https:\/\/www.salesforce.com\/ca\/blog","push-errors":false,"_links":{"self":[{"href":"https:\/\/www.salesforce.com\/ca\/blog\/wp-json\/wp\/v2\/posts\/1094","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.salesforce.com\/ca\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.salesforce.com\/ca\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.salesforce.com\/ca\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.salesforce.com\/ca\/blog\/wp-json\/wp\/v2\/comments?post=1094"}],"version-history":[{"count":2,"href":"https:\/\/www.salesforce.com\/ca\/blog\/wp-json\/wp\/v2\/posts\/1094\/revisions"}],"predecessor-version":[{"id":5861,"href":"https:\/\/www.salesforce.com\/ca\/blog\/wp-json\/wp\/v2\/posts\/1094\/revisions\/5861"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.salesforce.com\/ca\/blog\/wp-json\/wp\/v2\/media\/1096"}],"wp:attachment":[{"href":"https:\/\/www.salesforce.com\/ca\/blog\/wp-json\/wp\/v2\/media?parent=1094"}],"wp:term":[{"taxonomy":"sf_topic","embeddable":true,"href":"https:\/\/www.salesforce.com\/ca\/blog\/wp-json\/wp\/v2\/sf_topic?post=1094"},{"taxonomy":"sf_content_type","embeddable":true,"href":"https:\/\/www.salesforce.com\/ca\/blog\/wp-json\/wp\/v2\/sf_content_type?post=1094"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.salesforce.com\/ca\/blog\/wp-json\/wp\/v2\/coauthors?post=1094"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}