File Download

There are no files associated with this item.

  Links for fulltext
     (May Require Subscription)
Supplementary

Article: Automated functional testing of online search services

TitleAutomated functional testing of online search services
Authors
KeywordsInternet search
Metamorphic testing
Software testing
Verification and validation
Issue Date2012
PublisherJohn Wiley & Sons Ltd. The Journal's web site is located at http://www3.interscience.wiley.com/cgi-bin/jhome/13635
Citation
Software Testing Verification And Reliability, 2012, v. 22 n. 4, p. 221-243 How to Cite?
AbstractSearch services are the main interface through which people discover information on the Internet. A fundamental challenge in testing search services is the lack of oracles. The sheer volume of data on the Internet prohibits testers from verifying the results. Furthermore, it is difficult to objectively assess the ranking quality because different assessors can have very different opinions on the relevance of a Web page to a query. This paper presents a novel method for automatically testing search services without the need of a human oracle. The experimental findings reveal that some commonly used search engines, including Google, Yahoo!, and Live Search, are not as reliable as what most users would expect. For example, they may fail to find pages that exist in their own repositories, or rank pages in a way that is logically inconsistent. Suggestions are made for search service providers to improve their service quality. Copyright © 2010 John Wiley & Sons, Ltd. A novel method for automatically testing search services without the need of a human oracle is presented. The experimental findings reveal that some commonly used search engines, including Google, Yahoo!, and Live Search, are not as reliable as what most users would expect. For example, they may fail to find pages that exist in their own repositories, or rank pages in a way that is logically inconsistent. Suggestions are made for search service providers to improve their service quality. Copyright © 2010 John Wiley & Sons, Ltd.
Persistent Identifierhttp://hdl.handle.net/10722/123864
ISSN
2015 Impact Factor: 1.082
2015 SCImago Journal Rankings: 1.105
ISI Accession Number ID
Funding AgencyGrant Number
Microsoft Research
University of Wollongong
Research Grants Council of Hong Kong717308
Australian Research CouncilARC DP0771733
Funding Information:

This project is supported in part by a Virtual Earth Award from Microsoft Research, a Small Grant from University of Wollongong, the General Research Fund of the Research Grants Council of Hong Kong (project no. 717308), and a Discovery Grant of the Australian Research Council (project no. ARC DP0771733). Preliminary results of this research were presented by invitation at the Microsoft Research Virtual Earth and Location Summit, Redmond, WA, U.S.A. held on 30 April-1 May 2008. The techniques presented in this paper are currently in a patent application process.

References

 

DC FieldValueLanguage
dc.contributor.authorZhou, ZQen_HK
dc.contributor.authorZhang, Sen_HK
dc.contributor.authorHagenbuchner, Men_HK
dc.contributor.authorTse, THen_HK
dc.contributor.authorKuo, FCen_HK
dc.contributor.authorChen, TYen_HK
dc.date.accessioned2010-10-06T04:18:59Z-
dc.date.available2010-10-06T04:18:59Z-
dc.date.issued2012en_HK
dc.identifier.citationSoftware Testing Verification And Reliability, 2012, v. 22 n. 4, p. 221-243en_HK
dc.identifier.issn0960-0833en_HK
dc.identifier.urihttp://hdl.handle.net/10722/123864-
dc.description.abstractSearch services are the main interface through which people discover information on the Internet. A fundamental challenge in testing search services is the lack of oracles. The sheer volume of data on the Internet prohibits testers from verifying the results. Furthermore, it is difficult to objectively assess the ranking quality because different assessors can have very different opinions on the relevance of a Web page to a query. This paper presents a novel method for automatically testing search services without the need of a human oracle. The experimental findings reveal that some commonly used search engines, including Google, Yahoo!, and Live Search, are not as reliable as what most users would expect. For example, they may fail to find pages that exist in their own repositories, or rank pages in a way that is logically inconsistent. Suggestions are made for search service providers to improve their service quality. Copyright © 2010 John Wiley & Sons, Ltd. A novel method for automatically testing search services without the need of a human oracle is presented. The experimental findings reveal that some commonly used search engines, including Google, Yahoo!, and Live Search, are not as reliable as what most users would expect. For example, they may fail to find pages that exist in their own repositories, or rank pages in a way that is logically inconsistent. Suggestions are made for search service providers to improve their service quality. Copyright © 2010 John Wiley & Sons, Ltd.en_HK
dc.languageeng-
dc.publisherJohn Wiley & Sons Ltd. The Journal's web site is located at http://www3.interscience.wiley.com/cgi-bin/jhome/13635en_HK
dc.relation.ispartofSoftware Testing Verification and Reliabilityen_HK
dc.rightsSoftware Testing, Verification and Reliability. Copyright © John Wiley & Sons Ltd.-
dc.subjectInternet searchen_HK
dc.subjectMetamorphic testingen_HK
dc.subjectSoftware testingen_HK
dc.subjectVerification and validationen_HK
dc.titleAutomated functional testing of online search servicesen_HK
dc.typeArticleen_HK
dc.identifier.openurlhttp://library.hku.hk:4550/resserv?sid=HKU:IR&issn=0960-0833&volume=&spage=&epage=&date=2010&atitle=Automated+functional+testing+of+online+search+services-
dc.identifier.emailTse, TH: thtse@cs.hku.hken_HK
dc.identifier.authorityTse, TH=rp00546en_HK
dc.description.naturelink_to_subscribed_fulltext-
dc.identifier.doi10.1002/stvr.437en_HK
dc.identifier.scopuseid_2-s2.0-84862066626en_HK
dc.identifier.hkuros203906-
dc.relation.referenceshttp://www.scopus.com/mlt/select.url?eid=2-s2.0-84862066626&selection=ref&src=s&origin=recordpageen_HK
dc.identifier.volume22en_HK
dc.identifier.issue4en_HK
dc.identifier.spage221en_HK
dc.identifier.epage243en_HK
dc.identifier.isiWOS:000304001500002-
dc.publisher.placeUnited Kingdomen_HK
dc.identifier.scopusauthoridZhou, ZQ=15924687500en_HK
dc.identifier.scopusauthoridZhang, S=55247551800en_HK
dc.identifier.scopusauthoridHagenbuchner, M=6602995698en_HK
dc.identifier.scopusauthoridTse, TH=54971059300en_HK
dc.identifier.scopusauthoridKuo, FC=7006690410en_HK
dc.identifier.scopusauthoridChen, TY=35247605500en_HK
dc.identifier.citeulike11169292-

Export via OAI-PMH Interface in XML Formats


OR


Export to Other Non-XML Formats