- The challenges
Technology refresh involves replacing the end-of-life network components (hardware, middleware, software) and their accompanying services with next generation components on 'All-IP'. Main customer challenges are to make an inventory of all impacted end-to-end services to define the right balance between investment in testing and risk mitigation, and to maximise the test scope for the assigned budget.
- What did we solve?
Devoteam provided a "test as a service" for a Belgian telecommunications operator with a complete automation of about 3,000 test plans starting from injecting traffic in a controlled way in the operator's network. Thanks to this automation, the full scope was tested (real time rating of mobile voice, SMS, MMS and data traffic) for all offered rate plans in combination with the offered promotions. Also expensive ‘roaming tests’ were included in the scope of tariff plan testing. The automated test packages run unattended day/night/weekend. Regression tests on the complete real time rating were performed within a limited time span of a few days, and future tariff plans can be tested before market launch.
All tests were executed in 48 hours, giving our customer an immediate quality-view for newly delivered software updates of the infrastructure vendor. All test results were presented in a visual dashboard, displaying statistical overviews and technical deep-dive in test-logging, message flows, problem reports, etc. To avoid a lot of test investment to setup a complete test environment, Devoteam isolated the test object and replicated the network interfaces in its test platform. Thanks to this fully automated test package, the customer was able to execute a significant test scope for every software application or configuration update in just a few working days.
- What are the key benefits, KPI, main learning points?
- 90% of the functionality covered by automated test packages was executed and analysed within 48 hours
- 70% OPEX reduction on upgrade testing
- More than 70% reduction in defects