Robustness Testing Research On Cloud Services

Nowadays, with the explosive growth of all kinds of cloud services, Users’requirements for stability and robustness of cloud services are also increasing. Thecloud services need to be fully tested by the cloud service providers to ensure thequality of them before they are available to users. In all types of testing cloudservices, the robustness testing is essential.This paper studies the current mainstream robustness testing methods.Depending on the difference of tested targets, we conduct a comparative analysis oftheir test methods. After analyzing the characteristics of the different levels of cloudservices, we propose a method and a robustness testing index for testing therobustness of different cloud services.On the basis of research for different cloud services, we choose the coretechnology of achieving services or a typical service as a testing object forrobustness testing of cloud services. Considering the convenience of the test, weprefer to select the open source technology of cloud services as a test object. In IaaSlayer, we test the open source CloudStack, which we can use to develop IaaS cloudservices. In PaaS layer, we select the Hadoop as the test object, which providestechnical support to other PaaS services. In SaaS layer, we choose the typical SaaSservice Salesforce CRM as the test target.For the convenience and quickness of test, we integrate the tests of differentlevels of cloud services and build a test platform. The platform includes theinterface to interact with testers and the choose of cloud services. It also collects testdata and does some statistical results. The test platform can be well compatible withall types of cloud services robustness testing tools. The robustness testing offollow-up services can be easily added to this test platform.According to the test indicators of different cloud services, we classify theinterfaces provided by the test objects. According to their failure rates, we evaluatethe robustness of cloud services and point out deficiencies that may exist in thedesign. After completion of the test of different services, we summarize therobustness of different cloud services.