RealProct: Reliable protocol conformance testing with real nodes for wireless sensor networks

Abstract

Despite the various applications of wireless sensor network (WSN), experiences from real WSN deployments show that protocol implementations in sensor nodes are susceptible to software failures, which may cause network failures or even breakdown. Pre-deployment protocol conformance testing is essential to ensure reliable communications for WSNs. Unfortunately, existing solutions with simulators cannot test the exact hardware and implementation environment as real sensors, whereas test beds are expensive and limited to small scale networks and topologies. In this paper, we present Real Proct, a novel and reliable framework for testing protocol implementations against their specifications in WSNs. Real Proct utilizes real sensors for protocol conformance testing to ensure that the results are close to the real deployment. Using different techniques from those in simulations and real deployments, Real Proct virtualizes a large network with any topology and generate non-deterministic events using only a small number of sensors to provide flexibility and to reduce the cost. The framework is carefully designed to support efficient testing in resource-limited sensors. Moreover, test execution and verdict are optimized to minimize the number of runs, while guaranteeing satisfactory false positive and false negative rates. We implement Real Proct and test it with the 1IP TCP/IP protocol stack and a routing protocol developed for WSNs in Contiki-2.4. The results demonstrate the effectiveness of Real Proct by detecting several new bugs and all previously discovered bugs in various versions of the μIP TCP/IP protocol stack. © 2011 IEEE.