mabl

Vorteile

This is one of the simplest tools for software testing purpose.
It helps to automate web browsers like Selenium IDE and Selenium WebDriver and other such automation tools.
mabl is a really great platform as it is lightweight and a simple browser plugin that does the work. No heavy sized software download, even though a great tool.
It is the only automation tool recently built that has an outstanding feature that I personally love the most and can benefit most organizations if used in the correct manner. The feature of auto-healing using machine learning concepts, as it helps the automation scripts to run even if there is a big UI change in the product code.
This tool doesn't require any tester or developer to know to code and can write scriptless code by simply fetching data based on the user's actions performed.
Once the journey and plans are ready, it is really simple to execute them and trigger them in a timely fashion.
It provide great visuals and monitors anomalies too! It keeps a track of network spikes and tracks performance of the platform.
It has the functionality to trigger mails to concerned people via Slack and mail integrations.
Any bugs encountered can be easily handled and can be synced with tools like Bamboo, JIRA, Jenkins, etc.
I would personally recommend people to use this as it is THE CUTTING EDGE TOOL for future generations.
I signed up for the product and got an instant demo from Preston, a test automation specialist at mabl, who did a wonderful job!

Nachteile

No cons presently, just loving the tool. I would really prefer if the tool was free of cost (open source) like Selenium and other automation tools. Life would be in our pockets and we would be called the AUTOMATION BOSSES of mabl using Machine learning.

Vorteile

The Tutorial should help you create all your needed basic tests and is helping you run them periodically with suggestions.
A fresh UI and design approach.

Nachteile

At first everything was a bit overwhelming, even though there was a tutorial. I wanted to check something so i exited one exercise and wasnt able to get back into it later.
Getting the local tunnel to work was really stressfull, i didnt find or overlook the info that java11 was needed and the support people didnt have a clue that you need a specific version so we wasted almost our whole trial with getting that to work. To be fair it was prolonged after i contacted them though!

In Betracht gezogene Alternativen

Gründe für den Wechsel zu mabl

Vorteile

I tried using mabl for a week and I found it useful in below way
- easy to record, playback user scenarios
- can do complex user interactions
- cloud based execution
- built in AI
- great customer support from all the members in company

Nachteile

- support for only few browsers
- slowness in test execution
- customization and scripting of recorded user scenarios
- many usability issues

Vorteile

I love the low code and ease of use when creating tests. With the addition of Generative AI, the ease of use is now even easier. Non-technical QA Testers will find mabl to be so beneficial. And technical QA Testers will also find mabl to be fun and easy to use.

Nachteile

The mabl trainer can be very resource intensive. If the user's computer has low RAM, mabl may not run very well on their computer.

Vorteile

I love the ability to capture journeys with the Trainer... it's a brilliant tool that makes setup incredibly fast. Also love the automatic regression testing, though that's created some "false alarms" for us in the past.

Nachteile

1) It still requires a bit of web engineering background to set up *proper* tests. A tech-minded product manager may be able to create some basic "is the site up"-type tests, but nothing involving variables, authentication, etc.
2) Unless I'm missing something, variables don't seem to persist across journeys... which would be very useful. We create users on one web application, and then process them in another - so it'd be good to "follow" them through the entire workflow.

Vorteile

So easy to use. Simple record and playback
Has the option to go into more advanced assertions
Great cross browser support
Extremely stable tests
The AI approach to adaptive assertions on tests

Nachteile

Still quite new so some features are not there yet.
Otherwise they are faultless for me

Vorteile

Insights are given on each test that is ran, the UI is nice on the eyes and easy to navigate. Getting up and running tests on mabl is painless and quick. The customization of tests and trainer is fairly easy to use. Test metrics are reported in a beautiful layout, and issues are easy to spot.

Nachteile

Like any automation software, once you start building out a test plan in their system, you become locked in and dependent on them for running tests. But the time that it saves compared to building up an automation suite from scratch using open source software might be worth the price.

Vorteile

Very easy to setup and use; Management and reporting of tests are very intuitive. The system allows for easy alterations to existing tests and branching.

Nachteile

Does not work on all browsers and multiple view ports. The price is increasing in May, but it is still very affordable

Vorteile

There is training that is provided to enable the new user learn more about the product
The customer service is excellent

Nachteile

The user interface needs to be updated and i hope the next versions of the software will accommodate that concern

Vorteile

What it tries to accomplish is wonderful, and the ease of use could potentially save my QA team a lot of time.

Nachteile

First it broke when I tried to edit a journey (500 message). Then it worked but moving steps around was impossible and it never added new steps in the right place. Finally, I ran a test and it could not find the field in my webpage.

Vorteile

Mabl has become the go-to for our e2e testing needs. Creation and maintenance of tests has become a breeze. Test failure investigation is quicker than before with detailed screenshots and HAR captures.

Nachteile

Mabl is not always able to handle tricker elements in our UI, which requires us to write custom JS steps or reach to to their support. Also, run-time of our tests is slower than our previous selenium-based tests.

Vorteile

Mabl provides a very straightforward user interface to set up an automated test which can perform smoke tests like checking all of the links on a page and report back all of the broken links. The learning curve is very small, so you can set up a new test in production in less than 10 minutes having never used the app before. It will send out a report by e-mail at your preferred interval with the test execution status, time, run time, pages checked, links checked and broken links.

Nachteile

It is quite bare bones as it is, if you already have complex API tests in Postman, Selenium IDE and Java/C# tests Jenkins, then Using Mabl in addition to these would really be nothing more than a novelty. Because your current unit tests and CI smoke tests probably provide ample code coverage. I would imagine the value from the mabl tests are aimed at a novice user with zero development background who needs basic website monitoring. Because you could probably get this data and more details on page exceptions from a tool like Datadog, Bugsnag or Kibana or Kubernetes. I would imagine that future iterations of the product will probably be more feature rich in these areas.

Vorteile

Overall, mabl is enabling our QA team to keep up with the product delivery pace of our dev and devops teams in the world of CI/CD (continuous integration/delivery). With the mabl trainer browser plug-in we are able to set up functional tests against our web application in minutes. Later, if we want to modify or enhance the tests, it's easy to make changes. Test capabilities are robust, including the ability to use javascript within the test. mabl is providing actionable insights about how the application is behaving, and we can see trends in failures or performance. We also like the image comparison capability which allows us to 'see' quickly why a test might have failed. New features are delivered at a rapid pace.

Nachteile

There are still some tests we can not port into mabl due to reliance on external systems (the ability to reach out from the system and affect an event outside of our application). For example, verify the receipt and contents of an email sent FROM our web application out to a test recipient inbox. We've given feedback to mabl to get our desired features onto the roadmap.

Vorteile

MABL is very easy to use and you can easily integrate other tools with the software. They provides many features to speed-up your development process and improves testing quality.

Nachteile

It's quite expensive compared to other software and needs to improve their customer support. Overall, It's Great Software to use without any doubt.

Vorteile

Easiest end-to-end machine learning driven test automation solution available which got us up and running on all of our apps. We just love getting the daily and informative emails keeping us all up to date on any new findings. Just an awesome app and I highly recommend anyone and everyone to quickly install mabl and let mabl run it's magic for your apps.

Nachteile

The only con we have seen so far is that the reported bad links includes a small subset of links that are not currently relevant, i.e. the links were valid at one time, but are not currently valid. But the report picks them up as broken which they are so it would be great if such links could easily be masked until they are re-used at some point in the future.

Vorteile

Personally, I hate writing test automation and this makes it way easier. Tests no longer become brittle over time and Mabl adapts to changing UIs. It's also super easy to implement into your CI/CD pipeline.

Nachteile

Initially I struggled with getting it to test web apps behind corporate firewalls but this was fixed when I could whitelist the Mabl IP addresses. The UI takes a bit of getting used to as well in terms of navigation.

Vorteile

One of the ways by which I use mabl is for crawling pages, to look for broken links. mabl does an outstanding job of doing that, as well as reporting what it finds.

I also like the mabl staff. They are very forthcoming in touching base with their user base to solicit feedback, answer questions, etc. Super responsive as well, which is huge for me, as when I evaluate tools for consideration, no matter how good they may be, if the customer service is bad, it's a deal breaker. You will not have that bad experience with mabl.

Very solid documentation as well, which is not always the case with new companies. They are constantly updating it, as things change and/or new features are added.

Nachteile

I would love to see the ability to schedule runs at selected days, times, etc. Also, what I hope is forthcoming from mabl, is the ability to tunnel into private test environments.

Vorteile

Business user friendly interface and low barrier of entry. Easy integration into CI process. The monitoring capabilities are detailed and easy to understand.

Nachteile

I'd like to have more options on asserting conditions during a test. Other than that, I have have nothing much to complain.

Vorteile

I like that a number of tests start running right away when you add a new app. I like the customer service, they are professional, friendly and helpful

Nachteile

It is time-consuming to set up the tests and often you must run the journeys over and over to see if they will work or not.

Vorteile

The automated nature of it. This takes away the very expensive part of maintaining a UI automation suite.
Intuitive UI that is easy to understand with minimal instruction.

Nachteile

There are still a few gaps in functionality.
Does Not work with all websites, especially older GUI's
Can only train in Chrome along with only supporting Chrome and Firefox for now

Vorteile

The ability to set up test cases without writing a single line of code is incredible. Their ML approach is the key.

Nachteile

Haven't found anything to not like as of yet. So far it meets our company's needs, it makes our testing process much quicker and automated.

Vorteile

It is easy to set up use, and get running. Apparently I have to be more wordy in this field, why I dont know.

Nachteile

The problem is that the tool will log its self out and then pass the remaining tests. The chrome pug-in requires a login but then forces the user to log in again to the website in the same browser, after clicking the button in the plug-in. creating tests that would manipulate the data seem easy, with applying some simple coding skills the user is able to create valuable tests. the problem is that mabl cant find the field, button, or part of the page that was selected in the test creation and simply stop running, no error, nothing.
Dont get me wrong I think that this tool is going to be amazing, the problem is that it is simply not there yet.

Vorteile

The auto-heal feature and the ability of the tool to traverse the entire application without much configuration.

Nachteile

The ability to modify and design test scripts. The mabl trainer can be little finicky and it is not very easy to delete and modify steps. Mabl trainer can use some improvements to its user interface.

Vorteile

Easily configurable.
Friendly User Interface.
Auto test case generation.
Test execution scheduling which is hectic job in other automation tools.

Nachteile

Enabling local testing helps lot more partners to join.
Better Test data management will help run the data driven tests

Vorteile

potential to eliminate the need for selenium and other ancient test tools that require high amounts of maintenance

Nachteile

inability to compare prod vs. dev (or across versions of software) for differences - we desperately need this to complete implementation

Vorteile

It was free to try and the demo of automated testing was very promising. It was also extremely easy to set up.

Nachteile

The promise of automated testing is very seductive, but unfortunately, it didn't work as intended. The user interface was also confusing to navigate.

Vorteile

I like that mabl can adapt to changes in content, both letting me know "Hey - this part of the page has changed" and "But I think I adjusted your test correctly - could you check?"

Nachteile

I'd like more flexibility in scripting tests, in particular, the ability to edit them from the keyboard. But I know she's in early days, and there's a roadmap.

Vorteile

1. Didn't break due to minor UI changes
2. Managing journeys, plans and their scheduling was easy
3. IP whitelisting, server authentications were very useful

Nachteile

1. Many of the broken links were found. Again, there were no info about response time, request timeout duration, number of attempts made to open the links and status codes received.
2. There is no exclusion list for links which need not be checked for its correctness
3. It didn't identify the model pop-ups on click of a link as it was expecting a page
4. Not enough info on JS error/exceptions

Vorteile

Good and easy to use environment.
Have major testing functionalities.
Quick feedback and suggestion service.

Nachteile

I din't find any thing yet which seems least liking about this software. At first when it doesn't support multiple browsers that was the thing which hit me that what if I want to test on multi browser. but now it supports multi browsers too.

Vorteile

1.Easy to use , not much complicated workflow.
2.Recording is easy and the errors are highlighted well to followup.
3.help document is thorough

Nachteile

1.Tool is slow to load the scripts
2.Failed cases not explaining exactly why it fails
3.Unable to inter-grate with testcases

Vorteile

- Fresh, new concept
- Interesting approach on integrating machine learning
- Competitive price
- Fantastic customer service

Nachteile

- User interface need some improvements to get your way around
- Still early stage so some bugs may appear but still a great piece of software

Vorteile

The idea using AI for testing is great. The GUI is rich and it is constantly envolving . The startup has funds to make product professional.

Nachteile

Probably does not support ono-english applications. I did not use support on purpose since I expect proactive review of the support and help with the setting.

Vorteile

The potential of the software is the most exciting part. You can see that the product will make things easier for customers. The look and feel of Mabl seemed pretty modern which is important because it makes it seem like it has great support.

Nachteile

There were a few bugs around the product, but I suspect those will be taken care of. Other than that, it was somewhat difficult to work my way around using the product for the first time. This was resolved as the process was explained to me, but it could be easier to understand.

Vorteile

Way how we can easily automate it, for web applications is good. Right now we don't have a real use

Nachteile

Initial learning curve more videos can help on reduction of the effort put out for learning how to make use of it

Vorteile

Set and forget concept when your tests will just run every X hours. Chrome extension to record tests is really good too.

Nachteile

User interface and experience of the main app are not very intuitive. For this reason, Ghost Inspector seems easier to use.

Vorteile

No need to maintain ever changing locators, one of the best part of the machine learning based application.

Nachteile

Less exposure towards writing own code leading to less customisation.

Vorteile

The ease of use for non-technical employees. Our QA team member, who is just learning her craft and does not know how to write JavaScript based tests, has been able to jump in and create a few journeys that help show the power and value mabl will bring to our company.

Nachteile

It is still a young product, and does not have all of teh flexibility and functionality of the more mature options.

Vorteile

Being able to record your actions and then have it learn from those is great. It was easy to have the jobs run on a schedule or on a build

Nachteile

Little iffy on the pricing compared to a lot of open source software in this space plus your choice of CI tool. I think if they can make it easy to apply to complicated products and tie into a larger codebase it could be really interesting

Vorteile

The fact that it is easy to use but still very powerful. Since my main focus is the development of new features - this tool gave a real value when it comes to product quality and that is why I am eager to see how it will improve.

Nachteile

Some of the functionalities doesn't work and sometimes it breaks for no reason. I am not sure why - but it gets really confusing. The categorization of tests is not so clear at some point.

Vorteile

That it can train itself and flow of the product can be taught to it. It is easy to use with minimum specifications for links testing.

Nachteile

It does not work well for drop downs. It somehow goes through the flow wrongly even when I specificed the steps.

Vorteile

It is easy to use and does not require much programming knowledge to start writing test scripts

Nachteile

We faced troubles with flakey tests and implemented hard waits for the application to finish with queries to backend. However, that is not the best solution and can cause unnecessary added execution time to the tests.

Vorteile

Some solid time savers in here. There could definitely be some work done on the UI to distinction between all the other packagaged automation systems to improve usability and intuitiveness but overall a solid start.

Nachteile

It has the same or similar features as many of the other packages out there. Let's see some innovation. Let's see some of the stuff we all wish the other packages had.

Vorteile

I like the learning aspect of Mabl. The fact that I do not have to update where a button moved on a homepage for example, is the key to this software.

Nachteile

I do not like the fact that I cannot test on all browsers. I believe that the point of UI testing is to make sure that everyone has a good experience on your site, no matter the user's browser.

Vorteile

I love the configurability and reuse possibilities. So many possibilities to improve efficiency and productivity for QA. it's a great product!

Nachteile

my office doesn't have it, unfortunately! I really wish I could get a solo license but we have to get it approved.

Vorteile

Pricing is on demand and is based on actual usage. This is good as we're a startup and we haven't starting building our product yet.

Nachteile

Too early today.We are still designing product and will have a better opinion once we start building

Vorteile

The automatic execution is nice - not having to set up triggers and timers manually is appreciated. The ML aspect is interesting, and hopefully I can dig into this a little more in the near future. I would like to use this for service testing as well as UI based scripts.

Nachteile

Nothing so far, all worked well! I would like to dig into the validation rules a little bit more and see what depth of testing is supported, as well as options for custom scripts (import Cucumber script etc.)

Vorteile

mabl allows us to automate a lot of our testing saving time and money. The paths are easy to create.

Nachteile

It can be dificult to manage noisy mabl notifications. It did take some work to get the system to notify only on what is important to team.

Vorteile

I like the naming convention of the journey etc. I like the actual step by step activities. the broken links are helpful.

Nachteile

for UI automation purposes it does not record correctly. Replay on first try does not work. Do not know how to fix the replay when it is broken, No easy way to fix the broken test.

Vorteile

It is very easy to configure new tests. The app is easily integrated with JIRA. It is also simple to add new apps to test.

Nachteile

In the dashboard, the recent test results sometimes take a while to load. In the 'plans' tab the triggers limit is reached only after adding a post-deployment trigger.

Vorteile

Automated scheduling of test executions, which helps me check regularly which links are broken on the site in a handy email sent out to me.

Nachteile

The complexity surrounding the usability of the software, this could be improved with an improved UI