Search
  • Maxim Chislov

Powerful combination of manual and automated testing we use in Media Buying Systems


The MediaView of Media Buying Systems is a set of unique and fully integrated systems, of apps that allows the customers of the advertising industry to cover the complete process of planning, purchasing, optimizing, reporting of Tv and Radio campaigns.


The MediaView is a fairly complex set of applications and each of them regularly gets updated by adding new features or by changing accordingly with the customer's needs or the requirements that are caused by the external software changes. Therefore MBS, as a market leader, always puts quality assurance first and considers this as the key point in the development and maintenance of our solutions.



Maxim Chislov
Maxim Chislov

Working at MBS as a QA engineer and coordinating all the testing processes for three years, I’d like to share our ideas of testing and explain what advantages we see in a powerful combination of automated and manual testing.

 

Manual testing:

Manual testing is an important part of the whole testing process, which we mainly use to test new functionality, and as soon as a new feature or a fix is deployed to our test environment, it’s checked by manual testing according to two main general criteria: compliance with the requirements described in the specification, and the compatibility and absence of defects.


Manual testing is also used during regression testing when we verify that a code change in the software does not impact the existing functionality of our apps. We run regression tests before each new release.


The main advantages of manual testing:


Since our applications are changing quite often and the high frequency of adding new features or removing old functionality which is no longer relevant for the users, we find it very efficient to use manual testing for many of the situations related to quality assurance.


It’s much faster for a new feature to test it manually than to create an automated test for it, especially considering the fact that the feature likely might be modified after acceptance testing, depending on the user’s feedback.


As another important point, manual testing allows us to combine functional testing with usability testing where we can evaluate the end product from a user experience perspective and check whether the new changes are user-friendly.


One of the main reasons for using manual testing is that it gives us a good opportunity for exploratory testing and gives the answer “what happens if I perform this?” because it is so common for users to escape a “happy path” that a developer was working really hard for, and to start using an app in a very random specific way, like mistakenly double-clicking it, calling the wrong command, etc.


Automated testing:


For the development and execution of the automated scripts for MediaView apps, we use the TestComplete tool together with Cucumber Studio implementing the BDD (Behavior-driven development) software development process. This allows us to design and rapidly maintain the test scripts based on business logic and user requirements.


The main goal of this part of testing is to constantly and consistently check the core and critical parts of the functionality of the application.


That kind of testing allows us to detect the issues at an early stage. Since we run the automated tests on a daily basis and analyze test results, we can identify weaknesses that the new code could have introduced into the current functionality. Hence we have a great opportunity to make sure that all the issues will be fixed before the new version will be delivered to our customers.


Since the MediaView apps provide users with an extensive amount of reports, numbers, and metrics it becomes one of the crucial points of using automated testing, with the ability to check a big amount of data in a short period of time.


At the same time, the creation of automated scripts is also a time-consuming process and does not always pay off if the functionality is not fully developed yet.


The main advantages of automated testing:


  • Automated tests eliminate the human factor during testing, and the presence of an error will always be noticed.

  • Automated tests increase the ability to test large amounts of output data.

  • Automated tests are running constantly, every next build is covered by new checks. (including the weekends and holidays)


Conclusion:


With all our efforts we still can’t guarantee a 100% bug-free application, also due to the fact that we can’t control the external circumstances. Overall by combining manual and automated testing in a deliberate way, we try to stay flexible with our test strategy depending on a certain case to always achieve the best results.




48 views0 comments