Comparative Analysis of Automated Testing Tools (Automation Testing) Using Cypress and Selenium with Testng Framework on Web Portal Testing Performance in A Banking Company
Downloads
The increasing complexity of web-based banking applications has intensified the need for efficient and reliable software testing methods to ensure system quality, security, and operational stability. Traditional manual testing often faces limitations in terms of execution speed, consistency, and scalability, making automated testing an essential approach in modern software development. This study aims to compare the performance of two widely used automated testing tools, Cypress and Selenium WebDriver integrated with the TestNG framework, in testing a banking web portal application. A quantitative experimental approach was employed by executing 104 automated test scenarios, consisting of 41 Login scenarios and 63 Customer Care scenarios, under identical testing conditions. The evaluation focused on execution time, test success rate, stability through repeated testing, and reporting capabilities. The findings reveal that both tools achieved a 100% test success rate across all scenarios. However, Cypress demonstrated significantly better performance in terms of execution efficiency, requiring only 511 seconds to complete all test cases, compared to 2,184 seconds required by Selenium WebDriver with TestNG. Repeated testing also confirmed the stability and consistency of Cypress results. In terms of reporting, Cypress provided a simpler and more user-friendly reporting mechanism, whereas Selenium TestNG with Allure offered more detailed analytical reporting features. In conclusion, Cypress is a more efficient automated testing solution for banking web portal applications, particularly when execution speed, ease of implementation, and testing productivity are prioritized.
Al-Ajily, M. (2022). Automated testing for React web application with Cypress [Bachelor’s thesis]. Computer Applications -koulutus.
Ateşoğulları, D., & Mishra, A. (2020). Automation testing tools: A comparative view. International Journal on Information Technologies & Security, 12.
Bhanushali, A. (2023). Ensuring software quality through effective quality assurance testing: Best practices and case studies. International Journal of Advances in Scientific Research and Engineering, 26(1), 1–18.
Bolgov, S. (2025). The role of test automation in the development of banking systems. Norwegian Journal of Development of the International, 72–75. https://doi.org/10.5281/zenodo.15657632
Chadee, A., Ali, H., Gallage, S., & Rathnayake, U. (2023). Modelling the implications of delayed payments on contractors’ cashflows on infrastructure projects.
Chen, S., Jiang, M., & Luo, X. (2024). Exploring the security issues of real world assets (RWA). In Proceedings of the Workshop on Decentralized Finance and Security (pp. 31–40).
de Brito, A. B., dos Santos, R. M., & de Medeiros, S. N. (2023). Testing tools: A comparative study of Cypress, Playwright and Selenium WebDriver. Instituto Federal de Educação, Ciências e Tecnologia de Pernambuco.
Faisal, M., Alharbi, Y., Alsaffar, M., Hussain, S., Saqib, M., Khan, J., & Lee, Y. (2025). Developing SPIM-TA: A maturity-level framework for systematic process improvement in software testing automation. Ain Shams Engineering Journal. Advance online publication. https://doi.org/10.1016/j.asej.2025.103472
Gangabhathina, P. M. (2025). Enterprise test automation strategy for scalable banking innovation. Journal of Multidisciplinary, 5(7), 756–765.
Garcia, B., Gallego, M., Gortazar, F., & Organero, M. (2020). A survey of the Selenium ecosystem. Electronics, 9(7), Article 1067. https://doi.org/10.3390/electronics9071067
Itkin, I., & Treshcheva, E. (2024). Enhancing the quality of banking technology platforms through a hybrid AI testing approach. Journal of Digital Banking, 9(1), 86–95.
Kermanshachi, S., & Pamidimukkala, A. (2023). Robustness analysis of total project cost and schedule delay and overrun indicators of heavy industrial projects. Journal of Legal Affairs and Dispute Resolution in Engineering and Construction, 15(2), 04523005.
Kolawole, I., Osilaja, A. M., & Essien, V. E. (2024). Leveraging artificial intelligence for automated testing and quality assurance in software development lifecycles. International Journal of Research Publication and Reviews, 5(12), 4386–4401.
Lau, E., Dücker, M., Chaudhary, R., Goh, H. W., Wei, R., Kumar, V., Qunbar, S., Gogia, G., Liu, Y., & Millslagle, S. (2026). BankerToolBench: Evaluating AI agents in end-to-end investment banking workflows (arXiv Preprint No. 2604.11304). arXiv.
Mamede, H., Gonçalves, C. M., & Mira, M. (2023). A lean approach to robotic process automation in banking. Heliyon. https://doi.org/10.1016/j.heliyon.2023.e18041
Morales, A. M. (2023). Automated front-end website testing with Cypress.
Mulyawan, H., & Mauritsius, T. (2025). Bank XYZ case study. In Advances in Smart Knowledge Computing: Towards Post Artificial Intelligence Era (Vol. 2020, p. 179).
Pelivani, E., & Cico, B. (2021). A comparative study of automation testing tools for web applications. In Mediterranean Conference on Embedded Computing (MECO). https://doi.org/10.1109/MECO52532.2021.9460242
Schumacher, A., & Schumacher, M. (2023). The road to project management excellence: Understanding the reasons and impacts of delays within project organizations.
Taky, & Malika, T. (2021). Automated testing with Cypress [Bachelor’s thesis]. Vaasan Ammattikorkeakoulu University of Applied Sciences. https://www.theseus.fi/handle/10024/495908
Viharika Bhimanapati, P. (2024). Leveraging Selenium and Cypress for comprehensive web testing. Journal of Quantum Science and Technology, 1(1), 66–79. https://doi.org/10.36676/jqst.v1.i1.10
Welde, M., & Bukkestein, I. (2022). Over time or on time? A study of delays in large government projects. Procedia Computer Science, 196, 772–781.
Copyright (c) 2026 Agam Aprianto, Gerry Firmansyah, Agung Mulyo Widodo, Habibullah Akbar
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
