Leapwork

Vorteile

1. Scriptless framework
2. Easy version tracking
3. Very good support in their website.
4. Reusable sub flow created by anyone in team can be resued by anyone else.

Nachteile

1. Image recognition can be improved.
2. Sending email using attachment can be made easier rather than using powershell.

Vorteile

I think that the codeless interface is a brilliant idea and increases the efficiency of the testing team significantly. For my team, where testing is just one of the responsibilities we have when upgrading and patching the product, we don't want to start training people up on programming languages so that they could start writings tests. With Leapwork the learning curve is very shallow and people can get started right away.
I am impressed with the selection of blocks that have been included and haven't required any functionality so far that there wasn't either a block for or a could make a simple sub-flow for.
The strategy editor, which is used to decide how to identify the GUI elements being manipulated, is really really clever!

Nachteile

The debugging functionality needs to be improved. When running complicated flows with mutiple sub-flows inside, when a bug occurs it is difficult to dig down into the sub-flow where the problem occured, and even when you've reached it there is no context specific data on the variables feeding into or out of the trouble making block.
I don't think that their approach to customer support is correct, and I have spent hours spinning my wheels as I carried out long conversations with their support stuff via a chat window on their homepage.
Some of the initial steps that are required, like making a test flow to log onto the Leapwork agent server, were not clearly explained.

In Betracht gezogene Alternativen

Gründe für den Wechsel zu Leapwork

Vorteile

The functionality of the platform was as expected. We chose to engage with Leapwork to help us automate some web-based processes, and admittedly that's not their bread and butter.

Nachteile

Lack of communication and customer service.

Vorteile

- Ability to create automated tests for a thick client
- User friendly views for creating tests from a flowchart
- The ability to scheduled tests

Nachteile

- Scheduled tests couldn't deliver notifications to multiple emails
- Email validation was very strict.
- Electronic signature image recognition was slow and timed out frequently

In Betracht gezogene Alternativen

Gründe für den Wechsel zu Leapwork

Vorteile

Leapwork is a visual object oriented tool for creating flows that automate repetitive actions in the operation of software, both for desktop apps and for websites, ideal for testing! No matter how simple or complex the flow, there are actually little restrictions because the set of building blocks is very complete where each block also has a rich set of options to specify its actual behaviour. Better yet, the set may be expanded with custom made reusable subflows as blocks for commonly executed general actions such as logging into an environment or application or opening specific web pages, ensuring that the flows remain easy to understand at each level and easier to maintain. An extensive set of examples makes it very easy to give it a go and when I do then encounter a problem in applying Leapwork, the helpdesk helps me out using a very efficient chat. Flows may be executed interactively on a desktop or laptop or on a server, on BrowserStack or on a Selenium Grid, but also may be scheduled to run automatically at specific moments. Also, these schedules may be started from DevOps or by calling the REST API from e.g. Powershell scripts.

Nachteile

Leapwork is a very flexible and versatile tool that is fun to use. But when you flip that coin, it turns out it also is easy to make flows that are difficult to maintain. And yes, it takes some self-control not to step into this trap. But then, I made flows for adaptive websites that run on various window sizes and on test, acceptance and production sites ... all in the same flow! The reason why complex flows sometimes are not easy to maintain is because Leapwork has only limited options to execute flows step-by-step. This makes it difficult to pinpoint the exact location in the flows where things go wrong and therefore need some tweaking. The tweaking itself is easy and straightforward, but finding out where and when and why is a challenge. Also, it is not easy to output specific information without the need to go through the complete log that the flow creates.

In Betracht gezogene Alternativen

Vorteile

For the last 8 months I've been using Leaptest, and so far I've not been disapointed, the basic functionalities are easy to use and the ability to create custom buildingblocks and implement my test cases in a 3rd party programs is great (the cases is running up against our Bamboo server)
The support is very helpfull and take every request/question I make seriously. I do find bugs in the system, but these are getting fixed quite fast, updates comes regularly.

What I like most about it is the fact that its easy to explain to non it workers how it works, this makes it a great tool for automated test, you dont need to understand code to be able to use it.

Nachteile

A desktop testcase tends to run slow when running it up against my own server.
Using Selenium is great, but the same testcase can give different results when I run it up against Chrome, FF and IE , when a bug like this is found, support cant always fix it since they are dependant on a 3rd party program( ex. we must wait for Modzilla to release a new webdriver version)

Also that lack of a proper debugging tool when debugging your test is really annoying, ex. when I use custom building blocks within a test case and it fails, I can only see what custom block failed, but not within it the specific location.

Vorteile

We've been able to scale the solution effectively and without requiring a lot of development expertise thanks to its configurability.

Nachteile

Without the use of image and text recognition, I want to automate my mobile apps using Browserstack or another mobile lab provider.

Value inputs in sub-flows should be able to be sorted like folders in the asset tree, and value inputs should be categorized.

Vorteile

It's very convenient and cost-efficient when we can automate the bottleneck areas of our processes that require a lot of repetition such as product testing or business verification.

It's so easy to use because of the flowchart-based method that even those in our team without a technical/specialist knowledge of coding can build cases and execute them with just the click of a button.

Leapwork allows for highly customizable building blocks with virtually no limits on architecture, protocol, application type or age. This makes it so exciting because the possibilities for its applications are limitless.

Nachteile

I used to occasionally find bugs in the system, but they have been becoming fewer and fewer with each regular software update from the developers. Their CS is just incredible.

Vorteile

Don't need any knowledge of coding.
Easy to learn, also for non-developers.
It is compatible for web and desktop applications.
Great customer service and support.

Nachteile

Desktop flows are slow
Not for small companies

In Betracht gezogene Alternativen

Vorteile

It was very easy to use, there are many features, and customer support was helpful.

Nachteile

The cost was out of our budget, so we had to go with something else.

Vorteile

L'outil de capture est vraiment puissant

Nachteile

- très cher, à ce prix autant former les testeurs "manuels" sur du Cypress ou Playwright
- courbe d'apprentissage longue
- pas adapté aux petites équipes agiles
- très difficile d'exploiter le potentiel de toutes les fonctionnalités
- l'approche low-code s'est avérée être un problème et non un atout

Vorteile

LEAPWORK does not require any coding. The business analysts are doing the test flows without much technical support. We have flows covering new features in progress as soon as the first implementation sprints start. This makes it quick to have good coverage of new feature fast.

Additionally we have a good coverage of the browsers our customers use in production. The ability to run with BrowserStack is also a plus.

Nachteile

The CI integration TeamCity is incomplete and not supported by LEAPWORK directly.
The agile development process is not supported too good with the folder structure and move/copy features.
Execution speed could be faster - could common blocks be precompiled or similar as they don't change apart from parameters?

Vorteile

The best part is that it is very easy to script TCs without having the knowledge of coding. This feature works best for beginners.

Nachteile

Sometimes the feature blocks not working efficiently and get struck.

Vorteile

Benefits with the product:
- Very easy to use. Able to allow junior team members to begin applying knowledge and skills in an automated environment.

- Intuitive. There are blocks for many different applications.

- Cost effective. Lowers TCO and overhead.

- Effective increase in ROI. With lower TCO, ROI is gained by freeing up person cycles to work on more productive tasks.

- Customizable. The product allows for creating unique blocks specific to your user environment.

- Good value. The product cost is low compared to the cost of hiring additional bodies that are specifically dedicated to automation. The need to hire in a specific skill arena is diminished greatly with LeapTest. Tester skillsets are still needed but can be more broadly focused in many discipline arenas now.

Nachteile

Challenges with the product:
- Customer care. The team is great but resources are limited. My team is working with a member of the LeapTest team but they are on vacation. This has slowed response time considerably.

- Limitations in recognizing text in different applications. One noted example. Putty an application that allows you to connect to Linux systems cannot recognize text that is returned on the putty console.

- Certified training. Video training is fine but limited. Being able to have a team member certified adds to team competency when working with others and company partnerships.

- Bug tracking integration. Limited integration between different bug trackers.

Vorteile

Leaptest is infinitely customizable. I've made large scale product automations, process automations, and small scale validations, and for each there is a functionality. I try every day to reach the edge of customizability, and as far as testing tactics and creativity goes, haven't found it yet.

Nachteile

Integrating Leaptest into our system has been a bit of a hassle. For an independent tester this is no problem, but if you want your tests to be used by other users on a network you're going to have to sit with some security and network experts and figure out how to keep the connection to Leatest alive on a virtual or shared space. We're still working out the kinks on our side, with a lot of great help form the folks at LT

Vorteile

No coding skills needed. Never pull a programmer away from their task to help the tester. Selenium feature is nice, but I actually love the superb image recognition feature. I need to compare documents-every character, color shade, etc. There are a lot of image recognition tools out there, but none that can double as an automated testing tool.

Nachteile

The only complaint I have is that updates come without much warning and no bulletin explaining what was updated/changed.

Vorteile

Leapwork is developed for all the organizations who wants to improve their speed and quality without writing complex code. It's very easy to use and offers many features like automated testing, drag-and-drop and no-code environment.

Nachteile

Personally, I'm not getting any issues with the software to perform my tasks of automated testing. It will be great if they provides more stability and performance.

Vorteile

Very easy to get started with this tool, even without any previous instruction. The e-learning videos and Q&A section are very good and helped me a long way.
It is very easy to create new test cases, edit existing ones and set up scheduled test runs.
Customer service is very, very good! If I submitted a question via the chat function, I received an answer almost immediately and any problem I have reported has always been solved to my satisfaction.

Nachteile

Experienced too many situations where my scheduled test runs failed without any obvious reason. If I then ran the same test manually, it passed without any problems.
Also, if I log on Leaptest from another pc than my own, I can't see my test cases etc.

Vorteile

Leapwork is very intuitive to use and helps in all sorts of automation tasks.
It's easy to get started and the knowledge base has lots of articles to help in case you're stuck.

Nachteile

Because of the non-coding setup the functionality falls short in customization of for instances logs and other nice-to-have features which can make the experience somewhat rigid.

Vorteile

Working with Leapwork is - in all my experience - on of the easiest tools to learn and handle in the test automation process. Having a "new tester" up and running in under a day tells the best story!

Leapwork supports and listen to the customers in a direct manor.

Nachteile

Problems in letting support getting acces to legacy systems under Leapwork test is not easy.

Vorteile

It's a User-friendly and easy to use software that provides a perfect solution for automation of your repetitive tasks. It has great features like No-code development, drag and drop, security testing, etc.

Nachteile

I can't found any least about the software as it's works smoothly for me.

Vorteile

- extremely fast timeframe from buying process to full enterprise testing
- ease of use (code free for everyone)
- easy to learn (everyone)
- easy setup
- collaboration features
- selenium is very robust
- image recognition can be adjusted and extended (collection, crosshair)
- replay features (HD video)

Nachteile

From our point of view the most important missing feature is the cross-project availability of custom blocks and an admin module for read/write priveleges on project and case level.
Additional debug features are nice to have

Vorteile

LeapTest can be used to automate absolutely anything. Virtually no limits on protocol, architecture, application type or age - it just works. It is easy to learn - gone are the days of a logjam when it comes to test cases getting automated, many test cases can be scripted almost as fast as you can execute them manually. Finally, their customer support is INCREDIBLE.

Nachteile

The Web tools are a bit finicky and I think they released them a little soon. However, from what I have seen of LeapTest, they will improve rapidly.

Vorteile

How easy it is for automating desktop- and web applications. No coding or scripting knowledge is required.

Nachteile

No functionality for testing web services (or I haven't figured out yet on how to do this). And it would be nice to have a option on the website to report bugs in the software.

Vorteile

Easy to use
Serves the purpose
Easy maintenance

Nachteile

Upgrades always impact test cases which are already up and running

Vorteile

The ease os use of Leapwork is what makes this product a win. Our staff is able to create automation without the knowledge needed from other products on the market. With the ease of creation and maintenance, we traded the license cost for what would be multiple employees manually exercising the same tests, for an obvious cost savings.

Nachteile

We have not found many negatives to the Leapwork solution. We are anxiously awaiting the SQL Enterprise database implementation, but other than that we are pleased with the offering.

Vorteile

I am able to do everything I use to do with Selenium in a much shorter time without writing any code

Nachteile

It is difficult to store tests in a code repository. The check-in process shows conflicts in the test files that are not easy to recognize. We worked around this by storing tests (assets) in a shared network drive

Vorteile

Its very easy to use and its easy to get started. It supports any environment and UI because it can run entirely on GUI recognition. By using only a few functions you can create sophisticated testing logic as well. Its easy to understand anyone from a normal end-user to a programmer could make great use of this tool for testing purposes.

Nachteile

Its still new on the market and their is lots of new features being added all the time. It can from time to time create a slight instability when new versions are applied but usually help desk works really fast to address the issue and apply a fix

Vorteile

Our team uses Leapwork for regression testing because it is easily integrated in Microsoft Azure DevOps. We decided to go with Leapwork because our testers are non-developers with limited knowledge of coding. Creating tests is a simple task because of building blocks.

Nachteile

Working Leaptest into our current system was not so easy. If you want tests to be used by other users on a network, it's going to require network experts to help figure out how to keep the connection to Leaptest alive on a virtual server.

Vorteile

Pathing functionality and its ease of use without sacrificing features. The ability to schedule (even remotely!) test cases. I was able to schedule our entire Procure to Pay process! Leaptest logs out/in at each step in the process to ensure roles correctly permit access to certain functionality

Nachteile

The price of the software is steep and their was a small learning curve to understand Leaptests 'syntax'.

Vorteile

Creation of test cases via GUI without coding. Reliable running test cases. Easy installation and setup.

Nachteile

Difficult troubleshooting, as logging quickly becomes confusing. Product updates must always be tested intensively.

Vorteile

The primary reason we chose it for our company was the ease of use for our non technical testers. It allows our testers to focus on creating test cases, not fiddling with software.

Nachteile

Leaptest is still young and is not really good for anything but web testing. The image recognition blocks for app automation are too flaky to be used without great care and expertise, which negates the "ease of use" value of using leaptest. There is also not any support for mobile app testing.

Vorteile

The ease of use and make test cases. Even without much knowledge and interest in coding; a tester can make complex test cases to automate.

Nachteile

There is less possibility to debug. If we use a customized building block; we cannot run the case from there and cannot see inside that block what went wrong in which step.

Vorteile

With a rich interface and multiple functionalities to define configurable tests, this tool effectively simulates users and saves test time.
Scheduling complex tests also enables active application monitoring

Nachteile

It would be useful to extend the functionality to load tests

Vorteile

intuitve usability, fast and reliable support via website, chat and e-mail, "human" approach in searching for images, texts instead of objects (-ids) and internal structures

Nachteile

leaptest controller somethimes consume a lot of resources, caching of controller in collaborative work, no action (like tearup, teardown) for each testcase, for the testrun itself (e.g. reseting DBs,...)

Vorteile

I like the ease of use. I love the ability to create blocks. I like the API it is very user friendly. I like the video in the reports. I love the ability to work remotely on an agent to build tests.

Nachteile

It has a tendency to crash. In on particular instance an adhoc schedule got stuck running and filled up the HDD. I was forced to restore the server from backup.

Vorteile

Very intuitive software; no coding skills required; you can stick to basic functionality but also do more advanced tasks.
The image recognition really exceeded our expectations and is very fast.
Very good and fast online support. Excellent tutorials, really helps you getting started.
Scheduling cases and getting reports works perfect for our needs.

Nachteile

Getting the information on how to set it all up and how the entities work together is a bit hard to find. You can find the information, but it's a bit hidden on their site.
Text recognition is pretty slow.

Vorteile

Easy to create and run test scenarios. Can be used both for testing desktop and web application. Easy to scheduling and run test cases

Nachteile

Cannot add environment for windows server 2008. Test Cases failed if i import test cases on new pc and run with different screen resolution.

Vorteile

You don't need to know how to code to automate test cases. LW helps you to do it in a very simple and straightforward way. What I like best is a great customer service it provided. Anytime you need help, they are ready to support to you. They are also willing to provide you with ready-to-use flow so you can apply to your test case.

Nachteile

There are some situations that it is difficult for LW to handle. For example, DOM sites are heavy for LW to work with. Additionally, this is a built software so it definitely has some bugs. When using it, you will know what they are.

Vorteile

- Easy to use: making a testcase by adding and connecting building blocks
- All the goodness of Selenium build in the building blocks
- The possibility to make data driven testcases (excel, database, ect)
- To set Leaptest up in CI (for instance: Jenkins)

Nachteile

At this point the Leaptest Studio is a bit heavy on the RAM, but I understand there will be a fix soon.

Vorteile

- User with no experience in software development can use the software
- Quick is easy creation of test scenarios

Nachteile

- sometimes the OCR isn't accurate
- maybe a function to exctract text or position of controls via window handle would be nice

Vorteile

All of my team can create, run and troubleshoot automated cases without having a development degree. It's ease of use was what attracted me, the application is what sealed the deal.

Nachteile

I feel there could better documentation on setup for use in environments that you are not running the application locally. However, the customer support is unparalleled and has always gone above and beyond when we have had a question.

Vorteile

Ease of use. Very informative documentation and tutorials. Excellent response to inquiries. Support that could and should set the standard.

Nachteile

We experience the occasional slowness when creating / designing test scenarios while in the designer and running them repeatedly whilst making necessary adjustments.

Vorteile

Very easy to create test cases with out being a programmer. Able to review the test as you go. Schedule allow you to have different tests for different deployments. Works great with jenkins and test rails.

Nachteile

This thing is a memory hog. It cause test to fail because the server become un responsive. I fixed it by have it do a auto reboot ever morning but very annoying.

Vorteile

It is very easy to use. The tool can work on most kind of applications. I got fast results and it seams to be easy to maintain.

Nachteile

When I create large scripts/sequens it can be hard to get the grafic to work. Furter it is a shame that I need a grafic interface to run the script. It would be nice if the tool could run without a GPU

Vorteile

The expressivity, always possible to find a solution.
Easy to use and find the right way to create the test

Nachteile

Some elements of user interface reactivity (to open a case or a block).
The tests are really slow, especially when caharacters are types in textbox!
Missing structre to organise the blocks

Vorteile

Very simple to use. Was able to give to a non developer to create tests for a software system that we do customized scripts with but do not develop on our selves.

Nachteile

Has this on our Jenkins box and it kept locking up because of resourse being used by leaptest. We are working on having a stand alone machine for this.

Vorteile

Easy installation and setup. Many features are simple to use yet powerful. The learning curve isn't too steep. Technical support is very helpful and responsive.

Nachteile

Lack of robust mobile device automation. More comprehensive mobile support would be a huge benefit to our testing capabilities.

Vorteile

Great support, new features are delivered very often, very good localization of web elements, a big plus is that you can also use leaptest to desktop apps

Nachteile

Custom blocks don't change their names in list on the left hand site when you change it on block label

Vorteile

Modular and powerful tool for testing web and desktop applications. The support team responds quickly

Nachteile

Lacking capabilities for a whole product suite (testing of mobile apps). Some of the UI elements are somewhat cumbersome to navigate in