VWO Testing

Vorteile

The ease of which it enabled me to enact AB tests to different segments of website traffic without much input from IT beyond the initial tagging.

Nachteile

At first I didn't find the surveys tool as easy to use as I would have liked, but subsquent updates streamlined this and it's now FANTASTIC

Vorteile

It's super-easy to set up tests, whether they're tests using the built-in editor to edit individual pages or spilt tests where the test redirects the control page to a different url. Both are good, and the results are easy to understand. The only thing that's funky is you might start a test and get to 95% right off the bat, then later it drops way less than that and you're like "well gosh, you were a lot more sure back then!" But I guess that's the stats talking, not VWO. Overall in testing I've done with VWO, I've discovered that there is way more variance/luck than you might think, and it really is best to run tests a long time, even if it seems like you have a winner quick.

Nachteile

While goals are easy to set up, it can be pretty tough to analyze certain things, like aggregating lifetime revenue for version A versus version B... You have to manage all the cookies yourself using a third party platform, so we eventually gave up on it because it was so complicated. If you just want to compare revenue at time of conversion, though, you can do it, just need a little help from developer to pass the checkout amount to the VWO tracking code so that it gets recorded by VWO for that version of test.

Vorteile

I like how easy it is to set up a test. It is also easy to see reports.

Nachteile

The calculations aren't always right so I don't trust the lift numbers. I also wish the statistical significance was two tailed.

Vorteile

We run some fairly complex tests with VWO and have always had excellent support from their team, when it comes to implementing custom solutions. The software is very easy to use, well within reasonable pricing, and is so much cheaper than the competition that it's a no-brainer.

Nachteile

Over the years, there have been a few changes to the site interface. Most of these have been great improvements, however, there have been some changes to the results dashboard that we just weren't a fan of. This isn't to say that it's bad - not by any means. It was just a personal preference.

Vorteile

The core functionalists of this software are valuable however read the cons.

Nachteile

We have been using VWO for years and one day they decided to rip features out and separate them meaning if you were doing an Observation test on a webpage and it included, heat map, scroll map, and form data all the data was lost when they decided to separate all those features and charge more. Not only losing the functionality but the data with zero notice. If this is there map for how they choose to run their software I'd beware. A good software doesn't suddenly charge separate for features that were included in a plan. AND WORSE lose all the data associated with it!

Vorteile

VWO is easy to use and setup for performing AB test on your website to bring about incremental improvements. One can run simple AB tests comparing amongst two different URLs or run two variations and also execute multi variate tests wherein multiple changes and their impact can be attributed to the changes.

Nachteile

The integration and data benchmarking with analytics tool is something which can be improved. Results on VWO dashboards and on integration analytics tools may vary on occasions leading to confusion on the outcomes.

Vorteile

Once setup it's a plug and play growth hacking tool that allows validation of theories.

Nachteile

Very hard to get running without a developer if you are using React.

Vorteile

Compared to other AB testing tools, VWO succeeds in a more reactive visual interface.
Many core features are available with some of their starter plans, which only happens with more expensive plans on other AB testing softwares, like user segmentation and geo targeting.

Nachteile

Still expensive for the value it can provide, many of the really useful tests you can apply require complex behaviors which can be done through VWO but need technical knowledge.

Vorteile

It's very user friendly and makes it easy to set up any kind of website test with very little code knowledge.

Nachteile

There is a slight "flicker" on some of the testing. This can skew your testing slightly.

Vorteile

It was super easy to use. Setting up an A/B test or a split URL test takes a very short amount of time and often needs know developer time.

Nachteile

We experienced some issues with the tool causing a flashing affect on our website, since it runs as javascript over the page.

Vorteile

Using VWO you're able to run more sophisticated tests than other, free software.
Support is helpful.

Nachteile

Some of the features in their reporting don't work very well, ie reports with old data and bad graphs for data over time.
Seems to have more negative affects on site speed than other platforms.

Vorteile

The examples of things to test is like a marketing mentorship program. Some great ideas. Split testingtext changes is easy to setup

Nachteile

The coolest ideas for testing require some web development time. Very cool stuff, but you need a team (designer, developer, marketer) to work together to really take advantage of what the software offers.

Vorteile

This tool allows users to dive very deep into what they're trying to research or gather data on. It can do a ton and get very granular, but is still user friendly at the same time. The results it provides are very detailed and helpful.

Nachteile

It doesn't work quite as well for smaller websites that don't get a ton of traffic.

Vorteile

The program is very user friendly, specifically the visual editor in the A/B testing tool. It makes it easy for people who don't know coding and web dev to create an A/B test. Additionally, it is great that you can segment traffic very thoroughly throughout all the heatmaps, visitor recordings, and A/B tests.

Nachteile

The thing that is most frustrating is that we can't store data forever. For example, if we are running a heatmap it only will store data for the last 60-90 days.

Vorteile

VWO Testing is a great tool for businesses looking to optimize their website and improve their conversion rates. With A/B and multivariate testing, heat maps, and user recordings, businesses can identify what works and what doesn't on their website. It gives businesses valuable insights into how their website is performing and make data-driven decisions to improve their online performance. It can help businesses to increase their conversion rate and revenue.

Nachteile

VWO is a must-have for any business, with no cons to weigh against its benefits.

Vorteile

I like the ability to utilize this software in order to show our clients the interactions on their website. It is very helpful when testing new Landing Pages which allows our client to see their customers interact with the website and observe decisions they make once getting to the website. Very cool tool!

Nachteile

I dislike the limitation of real time data. In some cases we are unable to see all of the traffic going to the pages we are observing, it makes collecting data a slower process.

Vorteile

Ease of use and its overall capabilities.

Nachteile

It's a bit pricy compred to Optimizely and Google Optimize.

Vorteile

This is an affordable software which allows you to track user behavior and run some A/B testing with Wordpress sites. I like the interface and it does help us gain some useful information about the way people are interacting with the websites we design.

Nachteile

I think the concept of goals, especially those tied to form fills/other conversion points, are not well explained and don't seem to behave as one might expect. This software definitely has limitations, and I wouldn't recommend it to someone looking to get really in-depth data about user behavior or split testing. But it is good for those that are dabbling in it or just looking for an overview.

Vorteile

Anyone could start a new experiment. The system is very simple to use and will allow anyone to start their own experiment (if it is a simple one).

Nachteile

I have never managed to use the visual editor because it doesn't work fine with responsiveness (at least for me) so I have always needed to get a developer and a designer to do javascript and css on top of it to make the experiments work.

This is not a big limitation because we actually have that skillsets in our team but then it just means that for any experiment we do we need that resources because what we can do without developers is very limited.

Vorteile

Pretty easy to set up tests and see results.

Nachteile

It's not an intuitive software, so it did take quite a bit of training for me to understand how to set up tests.

Vorteile

My tests were quick and easy for the team to set up and quick for me to jump in and see the results clearly.

Nachteile

It sets a high bar to choose a winner, so the test took a little bit more time than I had hoped.

Vorteile

Very easy to use, just copy/paste the script and create the test in the WYSYWYG, and that works
Some special features, like heatmaps, are great too.

Nachteile

The stats are sometimes hard to understand (especially the real difference between quick learning and the other options).

Vorteile

Easy to use. Very intuitive for me. Everything I want to do is easy to find and use—even on the first try.

Nachteile

Some of the features on how test length is predicted doesn't work quite the way I'd expect it to work. But it's a workflow issue (or rather a mismatch in how I think about things vs how VWO is built).

Vorteile

VWO is simple to implement and use. It truly helps you understand your user's behaviors and usage patterns on your web pages.

Nachteile

My only challenge is that we haven't used all of it's capabilities yet! VWO offers a lot of features that we haven't dug into.

Vorteile

The most advantageous feature for me is that you can customised traffic to different variables and have more control over segmenting the audience; you can customise a new segment yourself should you wish to. Another cool feature is that when setting the parameters for the campaign, VWP takes into account the number of visitors that would be exposed to the campaign, your current conversion rate for the original version of the page and the minimal conversion rate that you care about.

Nachteile

Overall I'm well impressed with VWO, but for my small business I find it to be quite pricey. I understand that they have a certain audience in mind, I wish there was a smaller package for a more affordable price.

Vorteile

VWO is a reliable A/B testing tool that I've been using for mid-sized clients for about 15 years. They were among the first platforms in the space and over the years, they've grown and added functionality based on user feedback. For example, you can get heatmaps on each variation in your test and VWO integrates with a ton of important platforms, such as call tracking, CMS, etc. And their customer service has remained very responsive.

If you're a developer, you can build complex experiments with javascript. But if you're not technical, you can run simple (yet impactful) experiments using the WYSIWYG editor.

Nachteile

I honestly don't have anything that I don't like about it. It's more user friendly and affordable than Adobe and Optimizely. But it's just as powerful. They also know their place in the market and are priced accordingly. VWO supports CRO agencies with partner agreements and additional tech support and doesn't try to take over consulting, like some competitors.

Vorteile

VWO Testing stands out for its ease of use, making it accessible to both beginners and experienced marketers. The platform features an intuitive interface that simplifies navigation through test creation, reporting, and analysis. Its step-by-step setup process guides users from selecting what to test to defining target audiences, ensuring confidence in creating tests. With pre-defined templates and a visual editor, users can implement changes directly on the website preview without coding, enhancing their understanding of modifications. Clear analytics and visual reporting make it easy to interpret results and draw actionable insights. VWO’s extensive documentation and customer support further assist users, allowing them to focus on improving their websites efficiently.

Nachteile

The main drawbacks of VWO Testing include its high price relative to its features, occasional bugs in the editor, and code that can significantly slow down website performance.

Vorteile

VWO offers many of the enterprise features you would expect in a larger tool, for a much lower price tag. As a user of Optimizely and Adobe Target, I have been pleasantly surprised by the features I have been able to use with VWO.

The reporting update (probably density, box plotting, etc.) has been especially useful in data analysis.

Nachteile

VWO definitely breaks more often than the more expensive tools out there. Breakage doesn't really affect the split tests themselves, just the reporting...but still, it's not great when I go to report for a client and have to wait a day or 2 for things to get back online.

Vorteile

1. Deep segmentation: Ability to segment traffic in terms of devices, locations, and campaigns
2. Variant percentage segmentation: One thing that basic AB Testing tools lack is their ability to segment traffic beyond 50-50% division. VWO allows to allocate traffic as per our requirement.
3. Heat maps included within AB Tests

Nachteile

There are a "lot" of backend issues in this tool. Without the help of a developer, it would not be possible for a person to set up tracking properly. Even after considering all the conditions and implementing tracking code as per the implementation guide, VWO did not allocate the traffic correctly and we lost days of experimentation due to this error. Unfortunately, even after trying the customer support was not able to help us in resolving the issue.

Vorteile

I liked that I can connect the goals to traffic segments in google analytics and see how the tests affected the conversion journey further down the funnel, I like the UI and functionality of setting up tests, as well as how the tool visualises data from running and completed tests

Nachteile

I think within a test the multi-layers of a menu could be simplified to focus on tasks that would be relevant to the stage at which a test is running

In Betracht gezogene Alternativen

Warum VWO Testing gewählt wurde

Vorteile

I love VWO! This software is excellent for split testing landing pages, which is extremely important for a new product launch where we want to optimize and get the most bang for our buck with the highest converting landing pages. This tool makes it easy to set up split tests and analyze.

Nachteile

Sometimes I question the split testing ability and have had multiple discussions with VWO about changes some things to make it better for the user / more optimized and haven't seen any changes go into effect.

Vorteile

Really low barrier to entry, if you're starting out doing testing, this is definitely the tool for you. It's lightweight and easy to use. They're based out, which means they are used to dealing with server call times, so you likely won't see any flickering issues. This is also one of the cheapest products out there, and definitely on par with the beginner versions of any other brand out there.

Nachteile

After you do consistent testing for at least 2 years, you'll notice that there will be issues with more advanced testing (ie, if you want to show a test for only logged-in users, etc.), you may have to rely on some help with customization with their customer support team, which isn't very experienced, so basically you're on your own.

Vorteile

VWO started off as a typical website testing tool, with visual selection tools (i.e. no coding required) to create a range of dynamic A/B and multivariate tests. They started to implement some new functionality and now, they have an advanced and fully comprehensive testing and optimization solution. You can create hypothesis and theories for each test with the top-tier of their product, whilst making observations along the way (during the life of each test). This can help you to better understand what you're doing, what's working and how future tests could be conducted to better the outcomes.

Nachteile

The basic solution is good but feels somewhat limited in comparison to their top-tier optimization product. However, their pricing for all products is expensive. Their optimization product (full suite of tools) is far too expensive for most businesses and requires a lot of management time - it's not a case of switching on a button and seeing results, the tools only enable you to create tests and track their progress. It's an ideal tool for a larger team of marketers and website testers.

Vorteile

I liked the dashboard and the overall ease of use of getting my tests started. I also love the fact that you can do a split test and see the differences side-by-side. What's also nice is that it does an amazing job of telling you about the statistical significance of your data (we tend to have clients with lower search volumes d/t the nature of their businesses, so being able to adjust our setting to focus on the conversion % change that we want is a great feature.

Nachteile

It can be expensive if you don't use it very often. Every once in a while I had trouble getting the code to be recognized on my site, but support was always fast and helpful. It was also my fault once b/c they tell you not to use GTM to add the code, but that's exactly what I did.

Vorteile

The fact that with just one variation, I can test multiple landing pages. It reduces the effort of making the same change to different pages and is really time saving. Another thing that I liked about the product is its features. There are a lot of features including custom targeting and heatmap availability that eliminates dependency on tools like Mouseflow and Hotjar.

Nachteile

Its testing threshold. While I do understand that a web page need to have certain number of sessions to enable fair testing but VWO threshold does not consider a monthly traffic of 2000 sessions good enough, which I think would work negative in case, small and midsize businesses go on to try it. This particular issue can restrict someone to try AB testing and make them resort to Analytics, which is definitely not a reliable tool.

Vorteile

I am using this tool for last 3 years and have very good feedback on this. It's easy to use and help us to increase the conversion.

Nachteile

Conversion tracking options.
It tracks only one visiter for a campaign i.e a visiter come 4 times via a campaign it tracks only one time.

Vorteile

I actually think, that the very best property of this item, is the client relationship. You can depend on a terrific group at any point, there is no doubt their will address you, no bug or issue you can have they will not want to assist you and brief it out.

Nachteile

Demands of some functions, that are basic in other platforms, however tailored to more intricate platforms, are not as rapidly focused on and carried out, as i would have preferred to.

Vorteile

I've been using VWO for months now, and I like it very much. It is easy to set up and there are a lot of different testing options available (A/B, multivariate, split URL, etc.). Their editor is also very powerful and their support was always quick to response and was really helpful.

Nachteile

I don't like that the script you need to include on your site aren't hosted on some known CDN, which gives your site lower score on sites like WebPageTest. Also, their editor doesn't work well all the time - if you are making some big change on the page, you will sometimes see in the editor that your change is applied correctly, but in the preview the change isn't there - so you need to find a way how to insert it correctly.

Vorteile

VWO has come along ways over the years. Setting up VWO through GTM was pretty easy . There were no hassles in creating the campaigns. I also like the way the it handle my split test distribution to my visitors. Support was helpful when requested.

Nachteile

There are a couple of things that can get tricky with VMO. First, Comparing Google Analytics Data with VWO data didn't even come close to matching. When running our latest test I had to use three different sources for measuring my results. Second, Setting up scheduling can be a little difficult if your business is open on different days/hours of the week. Finally, we have a couple of accounts under our profile. Its sometimes tough to tell which account I'm in. There are no visuals outside the grey box to let me know what account I'm in.

Vorteile

There are a lot of functions and tools, some tests are very easy to set, the tool is quite easy to implement and results are quite accurate.

Nachteile

Sometimes it bugs on some pages, depending on page content and files included, making the results not accurate, and we cannot test to be 100% sure that's going to work.

Vorteile

Easy to use, intuitive solution that makes testing scenarios quick and easy, regardless of technical skill level.

Nachteile

We want to use the platform lots but the incremental pricing options are confusing - we get alerts to big “top up packages” but these don’t seem to exist.

Vorteile

Easy to use and quickly get tests up and running. The support is good.

Nachteile

Running tests across multiple pages or the entire website is very time-consuming to set up.

Vorteile

The WYSIWYG editor makes it super fast and simple to setup A/B split-testing.
I also like that it displays the significance of the split-test results right away : You don't have to mess with a calculator on the side.

Nachteile

The tool became too expensive for people getting started.
It was $49/months a few years ago for basic use and now you can't do anything for less than $299/month.
So we don't recommend it anymore to our average customers.

Vorteile

The ease! And sometimes when we don't have time for a technical release we can use VWO for the visual changes.

Nachteile

It can make your website more slow, but not too much to worry about.

Vorteile

The set up and ease of integration was easy. The interpretation of the results is well laid out as well. Overall it is a very productive acquisition and an essential piece of software to improve performance.

Nachteile

It's not the cheapest and I know of other reputable products on the market that also do a good job for less but as this was recommended and I haven't used any other CRO / A/B testing software I can only speak of this which is very good. There has been a couple of limitations around more complex testing but that may be down to our understanding of the product to date.

Vorteile

VWO has a visual editor so no coding skills are required. Set up is simple, paste code on the website and you are good to start testing. You can set up hypothesis and test them with an A/B, multivariate or split URL test and evaluate the results. Very easy to use and suitable for any technical skill level.

Nachteile

Need to subscribe to one of the higher tier plans to create user segments for targeting and reporting

Vorteile

VWO is the best software for setting up A/B tests. It has great features that make it easy to split test headlines/copy/images without needing to get a developer involved. It will also estimate how long your test will take to complete based on incoming traffic. This makes it easy to give ETAs for results. I also appreciate the fact that you can test certain things on mobile vs desktop. Their customer support is also excellent.

Nachteile

VWO can be tricky to learn at first, but has great documentation available for its many features. Their support team is very helpful as well if you have any questions. There is not much to dislike about VWO.

Vorteile

Its a very intuitive, clean and feature rich software for AB testing. Within a day my team was able to pick up the software and we were already running experiments and seeing data coming in. The data provided are quite wide ranging as well, so that's one area you don't have to worry too much about - just get the experiments set up and wait for the results to come in.

Nachteile

I especially didn't like their pricing threshold. .

Vorteile

The BEST part about VWO is how quickly their Customer Service team responds on chat. I can get really quick feedback on an experiment I was planning to launch that same day.

Nachteile

Sometimes the features are confusing. Usually the service team or help pages clarify things easily.

Vorteile

I think the software is incredibly robust but at the same time very easy to use.

Nachteile

I wish the pricing was a bit more affordable for us.