Cookie Permission: Should You Test That?
|
| ||||||||
| Compare: | Web Design Calculator | Web Design Cost Guidelines |
Are you an E-Commerce Web Designer? Add a Free Listing
Last post we looked at the European Union’s Privacy and Electronic Communications Directive and what that means for businesses in the EU, and the UK in particular in light of new regulations surrounding disclosure of the use of tracking cookies, and gaining permission from site visitors.
To recap, to comply with new and impending regulations, websites must gain explicit consent to set most cookies (especially those deemed non-essential and potentially invasive, like web analytics, personalization and third party advertising cookies), or face possible consequences. Asking for permission is most likely done through pop-up / lightbox windows or accordion strips at the top or bottom of web pages. This not only adds an extra layer of friction to the user experience (user must make a decision when faced with the prompt), it also creates anxiety (what are cookies, and why is this a privacy risk) and confusion (what happens if I accept or don’t accept cookies).
Ultimately, we can expect site abandonment to rise, at least in the near term until EU residents get used to sites asking all-the-time. This means lower conversions, revenue and site loyalty. Most of the time, when a site element has such potential to harm user experience, web optimization experts will tell you to “test it.”
Why AB test now?
Testing tools depend on cookies to serve the right content to the right bucket of test visitors. Once new laws are enforceable in your jurisdiction, you cannot test without being de facto non-compliant by setting analytics cookies without explicit consent. You may workaround this problem by setting analytics/testing cookies initially upon site arrival, disclosing in the prompt and linking to information how to opt out of tracking. (The ICO itself sets an essential cookie at the beginning with the option to delete all cookies). Technically, since an analytics cookie is not essential to the functioning of the website, you may be walking the fine line of non-compliance.
That means to be above board, testing must occur while there is still grace time.
Secondly, testing now allows you to measure the impact on performance metrics with and without asking for permission. Once the grace period is over, you can no longer use a control group that does not see your popup/accordion prompt to accept cookies without being non-compliant, and you’ll never be able to quantify the negative impact on your business. You will know what to expect when it’s rolled out fully to your site.
More importantly, consider testing variables such as the clarity and persuasion of your request’s copy. Learning what converts best now means you will be able to reduce your risk long-term. Again, you will not be able to properly split test without cookies being set upon visitor arrival in one year’s time.
But testing your opt-in requests today also has many caveats.
Why testing cookie permission is a challenge
The big problems are:
- Testing something you know is going to slaughter conversions is usually not pushed to the front of the queue
- Allowing test users to opt out of testing and analytics cookies means no tracking after the conversion event (in this case opt in, out or abandonment)
- If users opt out, you are expected to honor their request forever. Allowing them to opt out before you absolutely have to ask means losing out on data and disabling site features that could improve conversion rates
- If running a cookie permission test concurrently with other tests, it’s not guaranteed the tests will play nicely together.
- This type of test may have a short half-life, meaning that consumer behavior is expected to change over time. As people get used to encountering permission requests, they are likely to become more tolerant, and respond to prompts differently than today.
Like all quantitative analytics, AB tests can only tell you the what, not the why. When you optimize your permission process, it’s important to identify why users abandon a site. What anxieties do they have? What are their attitudes toward cookies? Do they even understand what the prompt is asking? Would they abandon a site to look for alternatives? These are questions traditional user testing can answer.
However, user testing as we know it is also an imperfect solution. Recruiting users, bringing them in for a test and crunching the data takes time and money. If you want to test the clarity and persuasiveness of your permission request across a number of alternative versions, you will need to perform several rounds of user testing. Likely not worth the effort.
A hybrid approach
An alternative that combines the qualitative benefits of user testing with the multi-version, hands-off approach of AB testing is using a service like FiveSecondTest.com, EasyUsability, 3rdPartyFeedback.com or Feedback Army, which allow you to upload an image to be tested by a panel of user testers. (See Bryan Eisenberg’s smokin’ list of low-cost testing tools for a description of each). With FiveSecondTest, for example, the testers see the image for 5 seconds and must answer a question you create. You could run 4 tests with 4 different combinations of copy/design and ask testers what they understood the site to be asking, and what action they would take at that point. You would only need to use a screen shot of what your prompt would look like, with no changes made to your website at all (a digital version of the “paper prototype.”)
What to test
You may test any variable that may impact the “conversion rate” for accepting cookies, including:
- Presentation (popup/lightbox vs accordion)
- Copy (tone, length, motivators / value props for accepting cookies, headline)
- Calls to action (label, size, style, color, placement)
- Point-of-action assurance (copy, motivators)

ICO’s prompt uses an accordion presentation at the top of the page

A lightbox presentation in the center of the page
The lightbox example is courtesy of David Naylor. Check out the rest of his satirical permission requests for a good laugh.
When optimizing your copy, it’s critical that your message is informative, persuasive and eases the visitor’s anxiety about cookies and your use of them. Next post we’ll look at tips for writing your “permission slip.”
Looking for help with ecommerce? Contact the Elastic Path consulting team at consulting@elasticpath.com to learn how our ecommerce strategy and conversion optimization services can improve your business results.
Source http://www.getelastic.com/?p=11940Wed, 13 Jul 2011 08:03:27 GMT
Tags: Site Testing,
Scottsdale E-Commerce | Provo-Orem E-Commerce | Ann Arbor E-Commerce | Auburn Hills E-Commerce | Clovis E-Commerce | Katy E-Commerce | Navi Mumbai E-Commerce | Golden E-Commerce | Fredericksburg E-Commerce | Pleasant Prairie E-Commerce |
Site Testing
6 Tips for Ecommerce Testing
If there’s one thing you can 100%, hands down be sure of in ecommerce, it’s you can never rely on your gut feel for web design, marketing, copywriting, etc. There are very few sacred cows in conversion optimization. “Best practices”
Testing Checkout Sign-In Pages: Inspiration Gallery
The checkout process is a popular area of your site to test, and for good reason. When a visitor has added items to cart and clicks the “proceed to checkout” button, it’s a good indication of purchase intent! But often carts are abandone
Why You Should Test PPC Landing Pages First
Are you testing PPC landing pages? With all the hype of testing your website, we sometimes forget about paid search landing pages because we’re so focused on checkout, home pages and what color our Add to Cart button should be. “But Linda, did
Need E-commerce Design? Check out our member profiles:
There are millions of e-commerce sites on the web. The thing that separates successful shopping sites from the poor, less converting sites are appealing graphics, multiple and detailed descriptions.
Bremerton, Washington US
We are a Panama City Beach Web Site Design company offering world-class web site design & promotion for small and large businesses. We also offer Search Engine Optimization & Social Media Management.
Panama City Beach, Florida US
Muse Media specialists are enthusiastic about custom website designing. We look forward to the having the chance to work with your organization.
St Louis, Missouri US
Strategic design, marketing and promotional solutions for this increasingly digital world. We specialize in website design & development, graphic design, social media, search engine optimization &more
Ann Arbor, Michigan US
Hi, my name is Lisa Ewing. I am a freelance website designer who is passionate about website design! My goal, create a custom virtual store front that conveys my clients passion for their business.
Haddon Heights, New Jersey US
Work Order Management and Dispatching System.Our online service software is customizable, flexible and affordable for any type or size service business.
New York, New York US
B. Woods Design is a Twin Cities-based firm focused on working with small businesses. We create sites that do more than look good--they also mean BUSINESS.
Maplewood, Minnesota USBreaking the Shopping Cart [Infographic]
The recurring revenue business model has been referred to as the 8220 best business model in the w
5 Great Games On Google Plus That You MUST Play
Google is still trying to find its place in the social media hierarchy with a definite feeling of
Cool Websites and Tools [August 15th, 2011]
Check out some of the latest MakeUseOf discoveries Most of the listed websites are FREE or come wit
Will Tablets Eventually Replace Laptops? [MakeUseOf Poll]
Up until less than 2 years ago most people had never even heard of tablets With the historical rel
Be A Comment Snob & Filter Out Undesirable YouTube & Web Comments
Sharp tongues and foul mouths are the staple of comment boxes This is one of those little tips that
The 11 Best Questions From You [MakeUseOf Answers]
Every Friday MakeUseOf Answers honors the Best Answer of the Week to reward the skill and time inves
FormatMatch, Mou, MarkdownMail: Awesome Text Apps For Mac & iOS
When it comes to writing and manipulating text on a computer I think we can never have enough tools
Article Tags
E-commerce Design Articles
Web Apps & Internet (374)
News (291)
Web Apps (129)
Inspiration (128)
Music (119)
iPhone / iPad / iPod (116)
cool web apps (108)
Google Android (101)
Mobile Tips (100)
Announcements (99)
deals (88)
Games & Gaming Tips (84)
Tech Deals (82)
Opinion & Polls (76)
Cool Software Apps (76)
Social Media (66)
iOS (66)
Browser Tips & Tricks (66)
iPhone Apps (59)
Freebies (58)
geeky fun (58)
Photography (58)
iphone (55)
Google (53)
troubleshoot (53)
android (52)
Photoshop (52)
Graphics (51)
facebook (50)
How-To Articles (50)
Friends:
E-Commerce Website Pricing
Web Design Quote
Website Design
Graphic Designers