Productivity of Technology Optimum Configurations for Automated Testing of Rich Component Systems

Authors

DOI:

https://doi.org/10.15407/intechsys.2026.04.112

Keywords:

optimal configurations, CLI Middleware, Node.js, Pairwise Testing, genetic algorithms, CI/CD, mathematical models

Abstract

Introduction. The transition of the software industry to distributed microservice and cloud-native architectures has significantly increased the flexibility of information systems, but has led to the phenomenon of “environment drift”. Exhaustive testing of such ecosystems causes a “combinatorial explosion”, which, under continuous integration and continuous deployment (CI/CD) pipelines, leads to connection pool exhaustion and critical budget overruns on cloud computing (FinOps), making complete enumeration impossible.

The purpose of the paper. Conducting a performance review, experimental benchmarking, and verifying the computational stability of the developed prototype of information technology (in the format of CLI Middleware) for selecting optimal test configurations of multi-component systems under conditions close to industrial ones.

Methods. An information technology has been developed in the form of CLI Mid dleware based on Node.js using combinatorial methods (Pairwise Testing, Ortho gonal Arrays) and evolutionary computations (genetic algorithms). To completely prevent the blocking of the main execution cycle (Event Loop), strictly deterministic evolutionary search parameters have been implemented (30 generations, population of 50) and the early stopping mechanism (Early Stopping) has been disabled.

Results. Experimental benchmarking on synthetic test suites (108 and 243 configurations) confirmed the system`s ability to automatically compress the configuration space by 70.086.0%. An isolated mathematical validation module proved the preservation of 100% coverage of pairwise (2-wise) interactions. The recorded execution time of the computational core is 612 ms, making it ideally suited for use as a synchronous step in CI/CD pipelines.

Conclusions. The effectiveness of the developed information technology has been proven, successfully solving the “combinatorial explosion” problem and eliminating the risks of blocking the main cycle. Achieving an integral efficiency metric of 0.9725 confirms the absolute readiness of the CLI Middleware architecture for industrial integration into corporate pipelines, allowing significant optimization of infrastructure costs without compromising the quality of interaction defect detection.

References

Grindal M., Offutt J., Andler S.F. Combination Testing Strategies: A Survey. Software Testing, Verification and Reliability, 2005, Vol. 15 (3), 167–199. https://doi.org/10.1002/stvr.319

Nie C., Leung H. A Survey of Combinatorial Testing. ACM Computing Surveys, 2011, Vol. 43 (2), 1–29. https://doi.org/10.1145/1883612.1883618

Raunak M.S., Kuhn D.R., Kacker R.N., Lei Y. Combinatorial Testing for Building Reliable Systems. IEEE Reliability Magazine, 2024, Vol. 1 (1), 15–19. https://doi.org/10.1109/MRL.2024.3355874

Baumann C., Koroglu Y., Wotawa F. On the Impact of Input Models on the Fault Detection Capabilities of Combinatorial Testing. SN Computer Science, 2024, Vol. 5 (7), Article 821. DOI: https://doi.org/10.1007/s42979-024-03134-3

Kokhan K.O., Tkachenko O.M. Review and proposal for optimization of optimal configurations for automated testing of multi-component information systems. Information Technologies and Society, 2025, Vol. 3 (18), 83–87. https://doi.org/10.32689/maup.it.2025.3.11

Kuhn R., Kacker R., Lei Y. Introduction to Combinatorial Testing. CRC Press, Boca Raton, 2013. https://doi.org/10.1201/b14957

Kokhan K.O., Tkachenko O.M. Implementation and testing of the configuration optimization module for automated testing of multi-component information systems. Computer-integrated technologies: education, science, production, 2025, Vol. 61, 18–23. https://doi.org/10.36910/6775-2524-0560-2025-61-03

Lei Y., Tai K. C. In-Parameter-Order: A Test Generation Strategy for Pairwise Testing. 3rd IEEE International High-Assurance Systems Engineering Symposium, 1998, 254–261. https://doi.org/10.1109/HASE.1998.731623

Mandl R. Orthogonal Latin Squares: A Tool for the Design of Experiments in Testing. Communications of the ACM, 1985, Vol. 28 (10), 1054–1058. https://doi.org/10.1145/4372.4375

Published

2026-10-23

How to Cite

Kokhan, K. (2026). Productivity of Technology Optimum Configurations for Automated Testing of Rich Component Systems. Information Technologies and Systems, 10(4), 112–119. https://doi.org/10.15407/intechsys.2026.04.112