File Download
  Links for fulltext
     (May Require Subscription)
Supplementary

Article: Experimental study to compare the use of metamorphic testing and assertion checking

TitleExperimental study to compare the use of metamorphic testing and assertion checking
蛻變測試和斷言檢查的比較與實驗研究
Authors
KeywordsAssertion checking (斷言檢查)
Controlled experiment (控制實驗)
Empirical evaluation (實驗研究)
Metamorphic testing (蛻變測試)
Test oracle (測試預言)
Issue Date2009
PublisherChinese Academy of Sciences, Institute of Software (中國科學院軟件硏究所). The Journal's web site is located at http://www.jos.org.cn
Citation
Journal Of Software, 2009, v. 20 n. 10, p. 2637-2654 How to Cite?
軟件學報, 2009, v. 20 n. 10, p. 2637-2654 How to Cite?
AbstractA test oracle in software testing is a mechanism for checking whether the program under test behaves correctly for any execution. In some practical situations, oracles can be unavailable or too expensive to apply. Metamorphic testing (MT) was proposed to alleviate this problem so that software can be delivered under the time-to-market pressure. However, the effectiveness of MT has not been studied adequately. This paper conducts a controlled experiment to investigate the cost effectiveness of using MT. The fault detection capability and time cost of MT are compared with the standard assertion checking method. The results show that MT has potentials to detect more faults than the assertion checking method. The experimental results also show a trade-off between the two testing methods: MT can be less efficient but more effective, and can be defined at a coarser level of granularity than the assertion checking method. © by Institute of Software, the Chinese Academy of Sciences. All rights reserved.
在軟件測試中,測試預言是一種用于檢查程序在測試中是否正常運行的機制.然而在某些實際情況下,還無法制定測試預言或者難以有效地應用測試預言.針對此類測試預言問題,蛻變測試于近年應運而生,但蛻變測試的效率問題還沒有被充分地加以研究.作者用控制實驗的方法研究了使用蛻變測試的成本及效率,進而將蛻變測試和常用的斷言檢查兩種方法的錯誤檢測率和時間成本進行了比較和分析.實驗結果表明,相比于斷言檢查方法,蛻變測試具有檢測到更多錯誤的潛力.通過分析蛻變測試的效率和性能,與斷言測試相比,蛻變測試的錯誤檢測率更高效而效率有待提高,可適用于較為粗粒度的測試需求.
DescriptionA preliminary version of this paper was presented at the 3rd International Workshop on Software Quality Assurance (SOQUA 2006) in conjunction with the 14th ACM SIGSOFT Symposium on Foundations of Software Engineering (SIGSOFT 2006/FSE-14)
Persistent Identifierhttp://hdl.handle.net/10722/55461
ISSN
2015 SCImago Journal Rankings: 0.288
References

 

DC FieldValueLanguage
dc.contributor.authorZhang, ZYen_HK
dc.contributor.authorChan, WKen_HK
dc.contributor.authorTse, THen_HK
dc.contributor.authorHu, PFen_HK
dc.date.accessioned2009-08-10T04:38:08Z-
dc.date.available2009-08-10T04:38:08Z-
dc.date.issued2009en_HK
dc.identifier.citationJournal Of Software, 2009, v. 20 n. 10, p. 2637-2654en_HK
dc.identifier.citation軟件學報, 2009, v. 20 n. 10, p. 2637-2654-
dc.identifier.issn1000-9825en_HK
dc.identifier.urihttp://hdl.handle.net/10722/55461-
dc.descriptionA preliminary version of this paper was presented at the 3rd International Workshop on Software Quality Assurance (SOQUA 2006) in conjunction with the 14th ACM SIGSOFT Symposium on Foundations of Software Engineering (SIGSOFT 2006/FSE-14)en
dc.description.abstractA test oracle in software testing is a mechanism for checking whether the program under test behaves correctly for any execution. In some practical situations, oracles can be unavailable or too expensive to apply. Metamorphic testing (MT) was proposed to alleviate this problem so that software can be delivered under the time-to-market pressure. However, the effectiveness of MT has not been studied adequately. This paper conducts a controlled experiment to investigate the cost effectiveness of using MT. The fault detection capability and time cost of MT are compared with the standard assertion checking method. The results show that MT has potentials to detect more faults than the assertion checking method. The experimental results also show a trade-off between the two testing methods: MT can be less efficient but more effective, and can be defined at a coarser level of granularity than the assertion checking method. © by Institute of Software, the Chinese Academy of Sciences. All rights reserved.en_HK
dc.description.abstract在軟件測試中,測試預言是一種用于檢查程序在測試中是否正常運行的機制.然而在某些實際情況下,還無法制定測試預言或者難以有效地應用測試預言.針對此類測試預言問題,蛻變測試于近年應運而生,但蛻變測試的效率問題還沒有被充分地加以研究.作者用控制實驗的方法研究了使用蛻變測試的成本及效率,進而將蛻變測試和常用的斷言檢查兩種方法的錯誤檢測率和時間成本進行了比較和分析.實驗結果表明,相比于斷言檢查方法,蛻變測試具有檢測到更多錯誤的潛力.通過分析蛻變測試的效率和性能,與斷言測試相比,蛻變測試的錯誤檢測率更高效而效率有待提高,可適用于較為粗粒度的測試需求.-
dc.description.sponsorshipThis research is supported in part by grants of the Research Grants Council of Hong Kong (project numbers 111107 and 717308) and the Australian Research Council (project number DP0984760).en
dc.language.isoengen
dc.publisherChinese Academy of Sciences, Institute of Software (中國科學院軟件硏究所). The Journal's web site is located at http://www.jos.org.cnen_HK
dc.relation.ispartofJournal of Softwareen_HK
dc.relation.ispartof軟件學報-
dc.rightsCopyright Academy Publisher. 2009-
dc.rightsCreative Commons: Attribution 3.0 Hong Kong License-
dc.subjectAssertion checking (斷言檢查)en_HK
dc.subjectControlled experiment (控制實驗)en_HK
dc.subjectEmpirical evaluation (實驗研究)en_HK
dc.subjectMetamorphic testing (蛻變測試)en_HK
dc.subjectTest oracle (測試預言)en_HK
dc.titleExperimental study to compare the use of metamorphic testing and assertion checkingen_HK
dc.title蛻變測試和斷言檢查的比較與實驗研究-
dc.typeArticleen_HK
dc.identifier.emailTse, TH: thtse@cs.hku.hken_HK
dc.identifier.authorityTse, TH=rp00546en_HK
dc.description.naturepostprinten_HK
dc.identifier.doi10.3724/SP.J.1001.2009.00578en_HK
dc.identifier.scopuseid_2-s2.0-70449725267en_HK
dc.identifier.hkuros167678en
dc.relation.referenceshttp://www.scopus.com/mlt/select.url?eid=2-s2.0-70449725267&selection=ref&src=s&origin=recordpageen_HK
dc.identifier.volume20en_HK
dc.identifier.issue10en_HK
dc.identifier.spage2637en_HK
dc.identifier.epage2654en_HK
dc.publisher.placeBeijing (北京)en_HK
dc.identifier.scopusauthoridZhang, ZY=10639502200en_HK
dc.identifier.scopusauthoridChan, WK=23967779900en_HK
dc.identifier.scopusauthoridTse, TH=7005496974en_HK
dc.identifier.scopusauthoridHu, PF=7201989692en_HK

Export via OAI-PMH Interface in XML Formats


OR


Export to Other Non-XML Formats