Abstract: Web services (WS) and service-oriented architecture (SOA) present a set of unique testing challenges. As services are distributed, it is necessary to test them using a distributed architecture. Furthermore, as these services may keep on changing, testing needs to be adaptive. This paper proposes an adaptive testing framework which can continuously learn and improve the built-in test strategies. The framework allows different test cases to be selected based on the recent test results. The framework also has a windowing mechanism to evaluate and select test cases.

Abstract: The design of distributed, wireless, and embedded system is a tedious and error-prone process. Experiences from previous real-world wireless sensor network (WSN) deployments strongly indicate that it is vital to follow a systematic design approach to satisfy all design requirements including robustness and reliability. Such a design methodology needs to include an end-to-end testing methodology. The proposed framework for WSN testing allows to apply distributed unit testing concepts in the development process. The tool flow decreases test time and allows for monitoring the correctness of the implementation throughout the development process.

Abstract: As tools are maturing rapidly model-based testing is gaining wider attention by industry as a potential replacement for suite-based testing approaches. To use model-based testing tools users however specify often quite detailed test models, at level of the implementation to be tested. We present here a first attempt to generate tests from more abstract implementation models, which we call architecture models. With only little refinement these models can be used to validate implementations up to interaction accuracy. Our technique is applied to validate that the camera application software for Nokia Series 60 mobile devices conforms to its UML2 architecture model, employing the model-based testing tool Conformiq Qtronic

Abstract: To address the challenges of dynamic, distributed and collaborative Web Services (WS) testing, this paper proposes a trustworthy service broker architecture and a dependence-based progressive group testing technique. The new architecture extends the traditional Universal Description, Discovery and Integration (UDDI) service broker by introducing the check-in and check-out testing interfaces, which are associated with a set of automated tools. The design objectives of the trustworthy service broker are to perform rigorous testing and evaluation effectively and to ensure that only quality WS can be registered and released to the public. A group testing technique is applied to reduce the test cost by using a hierarchy of increasingly sophisticated test scripts, which progressively rules out low quality WS. WS are further ranked based on the group testing results using ranking criteria. Experiments show that this approach can effectively test and choose WS in an open environment and in reduced number of tests.

Abstract: This work employs and extends the Gaia methodol- ogy to design a formal open framework based on agent for automatically testing Web applications. In our framework, each test task corresponds to a role and the agent takes this role to achieve its test task or co- operates by interaction with other agent to finish the test tasks. The agent can not only join or leave agent society at will, but also take or release roles at run time dynamically. Our framework can be extended easily by adding new roles to provide much more func- tion. At the same time, agents and roles are loosely coupled; role classes and agent classes can be de- signed at the same time by different teams. The internal design of multi-agent system (MAS) is independent of the Web applications. This framework helps to imple- ment automatically testing of Web applications.

Abstract: Wireless sensor networks are networked embedded computer systems with stringent power, performance, cost and form-factor requirements along with numerous other constraints related to their pervasiveness and ubiquitousness Therefore, only a systematic design methdology coupled with an efficient test approach can enable their conformance to design and deployment specifications We discuss off-line, hierarchical, functional testing of complete wire- less sensor nodes containing configurable logic through a combination of FPGA-based board test and Software-Based Self-Test (SBST) techniques The proposed functional test methodology has been applied to a COTS-based sensor node development platform and can be applied, in general, for testing all types of wireless sensor node designs

Abstract: The paper suggests a VM-based online testing approach in which software testing is piggybacked at runtime on a system that operates to serve actual mission. Online testing in VM is facilitated with a framework that uses persistence service to initialize the testing operation with a consistent system state. The testing operation then runs in an isolated domain which can be scheduled independently of the operating version. Thus, testing operation cannot cause unbounded pause time nor spoil the normal operation. We evaluate the feasibility of schedulable online testing with a prototype developed in MONO CLI (Common Language Infrastructure) and the experiment on the prototype.

Abstract: The performance of software involves efficiency,resource occupied,stability and so on.Load testing can help people to make sure that the software can satisfy all requirements on performance and load increase in future whether or not.It can also tell people why the software unconventionally,and help people to optimize it.As the applications based on Web are more and more widely used,it is very important to test their performances,and many automatic testing tools make the testing easier.With the aid of LoadRunner,the automatic testing tool which is published by MI,implemented automatic testing.

Abstract: The remote software testing system can easily integrate the testing tools and provide the friendly access and operation environment by introducing grid workflow. The grid service constructor of the system architecture can encapsulate the testing tools into as grid service. The grid workflow module handles the modeling, scheduling and monitoring of testing task through the input of web application module. The communication based on SOAP and its relative issues such as security and performance are discussed. The adaptive scheduling algorithm is presented to implement automatically the testing tasks and improve the performance. The new system is scalable to integrate more testing tools, and provides remote automatic testing environment based on Web.

Abstract: Web applications are becoming increasingly complex and yet important for companies. As web applications become more and more prevalent, their testing and quality assurance become more and more important and crucial. Due to the complexity of the underlying technologies of web applications, testing of such softwares is challenging. Applying user sessions data as test cases can reduce the cost of regression testing process. In this paper we provide a multi agent software environment in order to support automatic replay of user sessions. In this environment different agents can perform replay of user sessions by being distributed on various platforms and geographic locations.

Abstract: As mobile services and applications are becoming more pervasive with the increasing adoption of 3G networks and devices, verifying the different quality attributes in all parts of the system is important. The 3G network specifications already address many properties such as security in network communication. However, focusing on the network alone is not enough. This paper describes a testing platform for 3G User Equipment (UE) that allows effective testing of UE devices and applications in a laboratory environment. By simulating parts of the network, the platform provides a realistic yet controlled environment for testing. Using this platform we have executed a number of tests on 3G UE's and applications. Based on our experiences we describe the specific challenges encountered in testing in a 3G network as opposed to testing in a more traditional environment such as a wired LAN.

Abstract: Web application testing is concerned with numerous and complicated testing objects, methods and processes. In order to improve the testing efficiency, we firstly analyze the necessity and feasibility of the automatic and intelligent testing for Web applications; Then, we discuss several scenes of applying agent into Web application testing, such as using agent to obtain users' visiting actions, carry out performance testing, regression testing and usability evolvement; next, we adopt agent to execute the testing, including the testing process and the detailed actions, so as to monitor, manage and handler exceptions during the whole testing execution. Thus, in this way, the Web application testing can be completed more automatically and intelligently.

Abstract: With the growing complexity of web applications, identifying web interfaces that can be used for testing such applications has become increasingly challenging. Many techniques that work effectively when applied to simple web applications are insufficient when used on modern, dynamic web applications, and may ultimately result in inadequate testing of the applications' functionality. To address this issue, we present a technique for automatically discovering web application interfaces based on a novel static analysis algorithm. We also report the results of an empirical evaluation in which we compare our technique against a traditional approach. The results of the comparison show that our technique can (1) discover a higher number of interfaces and (2) help generate test inputs that achieve higher coverage.

Abstract: Accurate web application performance testing relies on the use of loading tests based on a realistic client behaviour load model. Unfortunately developing such load models and associated test plans and scripts is tedious and error-prone with most existing web performance testing tools providing limited client load modelling capabilities. We describe a new approach and toolset that we have developed, MaramaMTE+, which improves the ability to model realistic web client load behaviour, automatically generates complex web application testing plans and scripts, and integrates load behaviour modelling with a generic performance engineering tool. MaramaMTE+ uses a stochastic form chart as its client loading model. A 3rd party web crawler application extracts structural information from a target web site, aggregating the collected data into a crawler database that is then used for form chart model generation. The performance engineer then augments this synthesized form chart with client loading probabilities. Realistic web loading tests for a 3rd party web load testing tool are then automatically generated from this resultant stochastic form chart client load model. We describe the development of our MaramaMTE+ environment, example usage of the tool, and compare and contrast the results obtained from our generated performance load tests against hand-built 3rd party tool load tests