Tricentis Testim

Vorteile

What I like most about Testim is the user interface. This from a developer who is used to hacking around in code. The user interface provided for both recording, creating and editing/maintaining tests is a pleasure to use. It offers a no-code approach to testing, but one that allows a test developer to dive into code when necessary.

The way our test team works is we have two non-coders, one did some code 20 years ago, can manage a bit of javascript to myself a technical developer who deals with anything technical that might come up. Usually writing a shared custom action or shared step to perform a particularly tricky bit of testing, that the non-coders can then use in their test.

I would say 95% of our test development is developed without code because of Testim.

Nachteile

I have yet to find anything that I would consider as disliking. If something isn't working as expected its usually because I am doing something wrong.

Vorteile

Testim did great job investigating and addressing all famous automation pain points.
First, they take care of all the "side work" (environments, code libraries, setups, versions, etc.) allowing companies to fully concentrate on increasing testing coverage of their business flows.
Second, being stable, reliable and intuitive solution, it allows achieving impressive outcome quite fast. Following best practices, it is quite easy to build very scalable automation project. There was nothing I couldn't achieve with Testim using it for almost a year by now.
Next, the Smart Locators mechanism proves itself de-facto: UI changes but tests keeps running identifying the elements by alternative identifiers.
Last but not least, reporting tools are highly self explanatory allowing developers to easily analyze failures and release QA bottle neck.

To summarize, Testim.io is quite a robust tool allowing to establish and maintain effective automation using both codeless and coded techniques. It is important to understand, that technical background is required to achieve success in automation project. Record&Play is a great start, however in order to be scalable, following the concepts of programming basics (such as reusable components, parameters, loops and conditions) is essential in order to be able to always extend the coverage rather than spending time on tests' maintenance upon application changes.
Having the availability (and passion 🙂) is all you need in order to succeed with Testim.

Nachteile

There are always things to improve to any software and I have a list of my "nice to have" enhancement requests which is being addressed in our Product-Customers channel. None of them is a showstopper.

Vorteile

When employing Tricentis Testim I do not have to work on repairing broken tests thus I am able to enhance coverage. It also controls the result of the test that has been done in parallel to different browsers while AI helps to make test automation much more effective for dynamic web applications.

Nachteile

When employing Tricentis Testim I do not have to work on repairing broken tests thus I am able to enhance coverage. It also controls the result of the test that has been done in parallel to different browsers while AI helps to make test automation much more effective for dynamic web applications.

Vorteile

Easily usable and can be used by anyone.

Nachteile

It doesnt look customizable. Suppose I need to add certain if else or loops to it, i cant find a way to do so

Vorteile

The prospect of recording test flows and allowing the AI to manage them could be a plus point. The current test coverage profile stays the same not with standing ever-changing UI and parallel work experienced across browsers also confirms the changes on the fly.

Nachteile

Work with dynamic elements inside one page application can be quite non-uniform sometimes. Some of the elements do not get identified during automation testing and as a result the locator has to be modified manually.

Vorteile

Ease of use, the ability to add almost any validation or action you can think with code integration.

Nachteile

Pricing model is very weird when you start using the product. It's very hard to define how many tests you run if you don't know how to define a single test in a new system you are unfamiliar with.

Vorteile

- Easy of use
- Various great features such as: Branches/Parallel tests/Scheduler runner/API Actions/Email/Custom JavaScript Editor and many more
- Amazing customer & technical support

Nachteile

- Can't copy steps from one project to another
- Lack of a mobile automation

Vorteile

1. It is super easy (and insanely fast) to record tests with little to no technical knowledge.
2. Where technical knowledge is needed, there are a lot of resources and guidance for me to use. The support team on Live Chat has been phenomenal, and they were available at like 11 PM at night.
3. If a test breaks for whatever reason (e.g. construction was done on the page so an element got removed), it's actually not that hard to re-record the test. You can keep whatever steps were working, delete the steps that don't work, and re-record from there.

Nachteile

This is just a wishlist of things I want:

1. The ability to run mobile tests on Safari, Firefox, and Edge
2. A predefined step for validating the comparison of two things (e.g. Text A is numerical and is greater than or equal to the number in Text B)
3. A predefined step of validating a whole div instead of a single element
4. The ability to run tests across multiple browsers without using CL

In Betracht gezogene Alternativen

Gründe für den Wechsel zu Tricentis Testim

Vorteile

The product is easy to use, with intuitive features

Nachteile

Sometimes I can wait for a while for support...

Vorteile

I found that Testim’s ability to perform cross-browser testing was very helpful to check our application for compatibility. Recording and replaying the tests with additional features makes generation of the tests easier even for the most complicated applications.

Nachteile

Test execution logs could also include more information when it comes to the analysis of failures such as the step before a test fail. Debugging may need some extra steps in some occurrences as the error messages only direct me to some locations.

Vorteile

Lo que mas me gusta de esta herramienta es la facilidad que brinda para poder desarrollar automatizaciones de forma sencilla y rapida.

Nachteile

En comparación con herramientas la personalización de pruebas mediante código puede ser más limitada.

Vorteile

Easy and fast to set up simple automated test cases

Nachteile

A little bit difficult to navigate the system in the beginning

Vorteile

The product has excellent documentation which guides you through the onboarding process, in addition the sample project and examples are incredibly helpful. The learning curve was short from start to having a series of tests running and finding bugs was within days and using Testim has helped me get fresh insights in to how our product works. Having predefined test steps is a huge help and shared steps makes reusability a snap. Reusability at cross-environment level is also made easy by Testim projects working with branches: we now have branches of test suites for our Dev, Staging and Production. The next step for us is to add our tests suites to the CI/CD pipeline in Azure Devops which also appears to be well documented and intuitive to enable.

Nachteile

the two major features missing for our needs are integration with Azure Devops at test-case level and copy tests between projects. However, Testim were responsive to the request for integration with ADO and are working with us on this.

Vorteile

Accurately and easily record steps, allows JS execution, re-use of steps and groups of steps, has example practical tutorials readily available, CLI and CI support, has a JavaScript syntax and auto-complete editor, incognito run mode. All test changes and runs are tracked git-style, videos of test runs can be recorded and bugs can be created from the test runs. Baseline screenshots can be compared to see what changed/caused a failure, console logs and network logs available on failure. Warnings and errors are picked up during run, helping trace untracked bugs/errors.

Nachteile

UX for navigating on the platform is confusing. The screen resolutions are limited to 1080p (if you're building your tests on your machine, they might differ when you run them on the test grid since scaling is not customizable). Does not support tablet testing natively. Some really fine-tuning things like dragging and dropping on specific areas of UI don't always work as recorded. The JS editor doesn't know about variables from other steps or from the test data (forces user to go out of the specific step and go search). Reporting is very minimal.

Vorteile

Grouping, Parameterization, Dynamic Locators, Branching and merging, Validation and Assertions, CLI, Test results Screenshots and Labeling test script.
I have used each and every of the above features in all my scripts and it is very easy to implement for any project.

Nachteile

I can only Schedule Run process for any of my scripts only by hour in GMT time zone. It would be nice to schedule run any of my scripts by hour and minutes. During prod deployment if our deployment gets completed lets say around 8:10 am/pm then I have to wait until next hour (i.e. 9:00 am/pm) to run my schedule run process. Also, when any script fails during field validation check. Instead of simply displaying the entire Expected vs Actual results. I would like to see only difference between the two results.

Vorteile

the no/low code, AI driven test creation combined with template test steps, shared (reusable) steps and custom steps (Javascript) make Testim an automated testing solution for testers of all levels of ability. Using the recorder via the browser extension means a tester can record an exploratory session and show active generation / capture of defects by sharing the saves test run with their Dev

Nachteile

1. Mobile responsive testing is supported but only on simulated devices. I would like to be able to connect to live devices thru services like Browserstack.
2. Testim has support for API actions or validations as steps, I would like to import a collection to generate happy path tests for each call or use the recorder to capture each call thru the UI

Vorteile

With Testim, our time from development to Production has decreased to minutes.

It allows us to test new features in no time with full regression test coverage & CI integration.

Test stability is very high, the results are easy to read and diagnose.

Nachteile

we still have some difficult with image verification (on dynamic map).

Vorteile

Automating web apps with a fast start up and little training was the draw for my team. We were able to onboard others that normally would not automate tests to assist us once trained on Testim and our standards. Everyone was excited about the use of Testim with our API integrations for the UI, and the flexibility of using variables and shared steps make an important part of our automation tool set.

Nachteile

The step comments are on the far right and we would like to see them as hover tips. Drag and drop could be included. Once a test fails in the grid, no email alerts are provided until the suite passes again. Scrolling in the app under test has to be worked around.

Vorteile

Testim is extremely accessible for those who are non-technical as tests can be authored without writing a single line of code. Testim also has the flexibility for those who are familiar with code to author personal enhancements to the existing Testim functionality. Customer support is always active and addresses any issues very quickly.

Nachteile

The learning curve for using the software can be both simple and steep. It is simple in the fact that users can simply record their actions and have Testim replay them. It can be complex implementing some of the deeper functionality Testim offers such as grouping test steps, using dynamic test parameters, and dynamic data sets for reusability.

Vorteile

Powerful tests which requires no code
Big variety of functionalities
Intuitive

Nachteile

Could slow down merges if you dont run in parallel

Vorteile

It is very easy to understand. New trainee and people can easly understand it after one time guidance. Do the things in very less time which helps us to makes our productions more faster as well as its customer support is also very good.

Nachteile

As if now we have faced issues with some dynamic testing things else everything is fine with testim as it is a good tool for automation testing for technical and as well as for non technical person

Vorteile

I like the easy of use and the fact it does what it say it does - test UI

Nachteile

The system failling alot and not always working good

Vorteile

Tests and locators are stable
Quick authoring
complete infrastructure including run servers, email, reports, scheduling etc.
Amazing support team

Nachteile

Integration with Azure devops pipeline should be very easy but for some reason it's not working for us yet. still trying to figure this one out.

Vorteile

We find that the available continuous integration support has been quite helpful.

Nachteile

The "self-learning" aspect doesn't seem to do quite as much as what I was thinking/expecting it might do, but overall the tool has still been quite beneficial for us.

Vorteile

it is very easy automation testing tool. Which require no code but gives the best and variety of functionality.it is extremely easy who are non technical. Users can easily record their action and send directly via emails.

Nachteile

Overall it is good tool but seems it doesn’t work on Firefox.

Vorteile

I could record and run a test within 15 minutes of getting into the tool.

Nachteile

The grids are complicated, and we had a hard time learning more with the resources available.

Vorteile

The software runs very reliably and stable. Overall its very easy to use, and I was even able to teach non-technical people to use the system, and write their own test cases.

Nachteile

Unfortunately, it does not work in Firefox that well.

Vorteile

Mostly simple to use but when it's not, support is quick and very helpful.

Nachteile

Sometimes tests fail for unknowns reasons and the pass upon subsequent executions. So the product is mostly stable but slightly unreliable at times.

Vorteile

I like almost everything while trying out Testim that popped up in my search result when I find for web crawling script generator. I personally like using Testim a lot because it can generate codes as you are performing specific actions on a website. It converts into Javascript! That was very cool to see what testim can achieve.

Nachteile

The least thing that I like about Testim is that you have to generate JavaScript codes from the Testim Playground. I hope that they could make it part of the main website function.

Vorteile

Its very simple and quick tool to start automating the product

Nachteile

Did not find something about it. Was very good experience

Vorteile

- Great interface to run and track your tests.
- Simple tests are simple to create.
- By far better then the competition out there.
- Very good, dedicated support people.

Nachteile

- Selectors are not as smart as you initially expected, tests will still break every now and then.
- It's not truly agnostic to your stack.

Vorteile

Easy to use, we can quickly automate test cases using testim, Good tool for non technical users.

Nachteile

Sometimes we see Random issues but testim fixes or check them quickly.

Vorteile

Super easy to use, connect to the CI and discover/fix bugs. You get an indication about very step including screenshots so you can see compare the expected outcome vs. the actual one.

In about 2 hours we authored 12 tests and connect them to our Jenkins. They ran smoothly for a dew days. We actually discovered a number of bugs using the system. Today we have about 80 tests running on every code push testing IE, Chrome, Safari, Edge and Firefox.

We use little custom code (JS). This is much easier than Selenium and much more stable!

By the way their documentation and support are great. If you need assistance they have ppl responding through the chat all the time. In most cases they will point you to the docs, which is find to be very helpful

Nachteile

Organizing the test could be done better. When you're getting to a few dozen tests numbering them in a certain order is required

Vorteile

Testim is a very approachable low-code automation tool that just about anyone in your organization can use.

Nachteile

I haven't come across any issue with this software yet.

Vorteile

It was very easy to use and I didn't have to know how to use selenium or code. Anyone can use it really.

Nachteile

I wish there was some tutorial (pop-ups) or best practices easily displayed

Vorteile

Very flexible and quick
Its nice using shared groups and steps

Nachteile

Would be better if the test start would be faster

Vorteile

Onboarding was smooth, usage is super easy and support is great.

Nachteile

Sometimes there are unexpected bugs, but their support team was very helpful and solved everything.

Vorteile

easy to use and the learning curve is really short, and you can go deep as you can use it for simple automation.

Nachteile

to move multiple steps at once is not possible
sometimes the locator does not work correctly, you to improve the locators manually

Vorteile

Easy to start , intuitive , quick support for cases/queries

Nachteile

Trigger automatic build via Jenkins configuration

Vorteile

great support and product with a lot of features and new features introduced very often

Nachteile

hard to hire people with relevant experience

Vorteile

Best recorder on the market
Dynamic locators reduce flakiness
Root cause analysis is super easy with Testim tooling
Support channel is great

Nachteile

Admin tooling is insufficient for large organisations

Vorteile

Testim is simple enough to put together a quick test with little effort, but has the ability to dive deep into test scenarios and apply complex validations. This allows me to work a wide variety of test cases and not have to always spend extensive amounts of time creating them. Alternatively, Testim is a very capable test suite to allow for intricate testing that suits our needs.

Nachteile

From time to time, recorded steps that are placed into a group will vanish into thin air. Save often!

Vorteile

As a non-technical person, I am able to record tests without writing a single line of code! We do a lot of manual testing before we found Testim. With some recurring bugs, the need to find an automated website testing solution becomes more and more strong. We looked at products like Ghost Inspector, and Screenster, neither of them are as user-friendly as Testim. What really differentiates Testim is their superior customer support. They are super responsive to my questions and always provide a great solution. I really enjoyed using Testim and meeting the people there!

Nachteile

There are a few bugs here and there. But they are always super responsive in recording them and fixing them.
We use pivotal tracker. So if testim can integrate with pivotal, that would be great!

Vorteile

The simplicty of the UI is great, and the customer support is awesome

Nachteile

Sometimes there's small bugs but easily fixed when pointed out

Vorteile

Very easy to identify bugs, simple to complex

Nachteile

Haven't had any issues yet. Everything has worked just fine

Vorteile

Love the ability to create shared steps that be can be incorporated into other test projects. This saves a lot of time.
The tool is very easy to use and didn't require much ramp up time.

Nachteile

We would like to see ability to drag and drop steps and have them numbered.

Vorteile

Easy to use , learn and practice in real world testing, Highly robust and adaptable tool.

Nachteile

User should be skilled in any scripting languages to utilize the full feature of Testim

Vorteile

The customer support team is really fantastic. Responses were always prompt, and they made sure I had the most possible success using the product.

Nachteile

I didn't really have any problems with it.

Vorteile

Very easy to implement after watching the tutorials, give me more security when I launch a new feature on the product.

Nachteile

Sometimes the tests fail because of a minor change.