Productivity of Technology Optimum Configurations for Automated Testing of Rich Component Systems
DOI:
https://doi.org/10.15407/intechsys.2026.04.112Keywords:
optimal configurations, CLI Middleware, Node.js, Pairwise Testing, genetic algorithms, CI/CD, mathematical modelsAbstract
Introduction. The transition of the software industry to distributed microservice and cloud-native architectures has significantly increased the flexibility of information systems, but has led to the phenomenon of “environment drift”. Exhaustive testing of such ecosystems causes a “combinatorial explosion”, which, under continuous integration and continuous deployment (CI/CD) pipelines, leads to connection pool exhaustion and critical budget overruns on cloud computing (FinOps), making complete enumeration impossible.
The purpose of the paper. Conducting a performance review, experimental benchmarking, and verifying the computational stability of the developed prototype of information technology (in the format of CLI Middleware) for selecting optimal test configurations of multi-component systems under conditions close to industrial ones.
Methods. An information technology has been developed in the form of CLI Mid dleware based on Node.js using combinatorial methods (Pairwise Testing, Ortho gonal Arrays) and evolutionary computations (genetic algorithms). To completely prevent the blocking of the main execution cycle (Event Loop), strictly deterministic evolutionary search parameters have been implemented (30 generations, population of 50) and the early stopping mechanism (Early Stopping) has been disabled.
Results. Experimental benchmarking on synthetic test suites (108 and 243 configurations) confirmed the system`s ability to automatically compress the configuration space by 70.086.0%. An isolated mathematical validation module proved the preservation of 100% coverage of pairwise (2-wise) interactions. The recorded execution time of the computational core is 612 ms, making it ideally suited for use as a synchronous step in CI/CD pipelines.
Conclusions. The effectiveness of the developed information technology has been proven, successfully solving the “combinatorial explosion” problem and eliminating the risks of blocking the main cycle. Achieving an integral efficiency metric of 0.9725 confirms the absolute readiness of the CLI Middleware architecture for industrial integration into corporate pipelines, allowing significant optimization of infrastructure costs without compromising the quality of interaction defect detection.
References
Grindal M., Offutt J., Andler S.F. Combination Testing Strategies: A Survey. Software Testing, Verification and Reliability, 2005, Vol. 15 (3), 167–199. https://doi.org/10.1002/stvr.319
Nie C., Leung H. A Survey of Combinatorial Testing. ACM Computing Surveys, 2011, Vol. 43 (2), 1–29. https://doi.org/10.1145/1883612.1883618
Raunak M.S., Kuhn D.R., Kacker R.N., Lei Y. Combinatorial Testing for Building Reliable Systems. IEEE Reliability Magazine, 2024, Vol. 1 (1), 15–19. https://doi.org/10.1109/MRL.2024.3355874
Baumann C., Koroglu Y., Wotawa F. On the Impact of Input Models on the Fault Detection Capabilities of Combinatorial Testing. SN Computer Science, 2024, Vol. 5 (7), Article 821. DOI: https://doi.org/10.1007/s42979-024-03134-3
Kokhan K.O., Tkachenko O.M. Review and proposal for optimization of optimal configurations for automated testing of multi-component information systems. Information Technologies and Society, 2025, Vol. 3 (18), 83–87. https://doi.org/10.32689/maup.it.2025.3.11
Kuhn R., Kacker R., Lei Y. Introduction to Combinatorial Testing. CRC Press, Boca Raton, 2013. https://doi.org/10.1201/b14957
Kokhan K.O., Tkachenko O.M. Implementation and testing of the configuration optimization module for automated testing of multi-component information systems. Computer-integrated technologies: education, science, production, 2025, Vol. 61, 18–23. https://doi.org/10.36910/6775-2524-0560-2025-61-03
Lei Y., Tai K. C. In-Parameter-Order: A Test Generation Strategy for Pairwise Testing. 3rd IEEE International High-Assurance Systems Engineering Symposium, 1998, 254–261. https://doi.org/10.1109/HASE.1998.731623
Mandl R. Orthogonal Latin Squares: A Tool for the Design of Experiments in Testing. Communications of the ACM, 1985, Vol. 28 (10), 1054–1058. https://doi.org/10.1145/4372.4375
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Copyright Holder is the publisher of the Paper (The Institute of Information Technologies and Systems of the NAS of Ukraine), and/or the publisher of the Paper (PH "Akademperiodika" of the NAS of Ukraine), to that the The Institute of Information Technologies and Systems of the NAS of Ukraine on the basis of a sublicense publishing agreement granted the right to publish the work and the right to indicate the publisher after the copyright sign.

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The paper is an Open Access under the CC BY-NC-ND 4.0 license - Attribution-NonCommercial-NoDerivatives 4.0 International.