File Download
There are no files associated with this item.
Links for fulltext
(May Require Subscription)
- Publisher Website: 10.1109/QSIC.2009.26
- Scopus: eid_2-s2.0-77950597207
- WOS: WOS:000306716300017
- Find via
Supplementary
- Citations:
- Appears in Collections:
Conference Paper: Application of metamorphic testing to supervised classifiers
Title | Application of metamorphic testing to supervised classifiers |
---|---|
Authors | |
Issue Date | 2009 |
Citation | Proceedings - International Conference on Quality Software, 2009, p. 135-144 How to Cite? |
Abstract | Many applications in the field of scientific computing - such as computational biology, computational linguistics, and others - depend on Machine Learning algorithms to provide important core functionality to support solutions in the particular problem domains. However, it is difficult to test such applications because often there is no "test oracle" to indicate what the correct output should be for arbitrary input. To help address the quality of such software, in this paper we present a technique for testing the implementations of supervised machine learning classification algorithms on which such scientific computing software depends. Our technique is based on an approach called "metamorphic testing", which has been shown to be effective in such cases. More importantly, we demonstrate that our technique not only serves the purpose of verification, but also can be applied in validation. In addition to presenting our technique, we describe a case study we performed on a real-world machine learning application framework, and discuss how programmers implementing machine learning algorithms can avoid the common pitfalls discovered in our study. We also discuss how our findings can be of use to other areas outside scientific computing, as well. © 2009 IEEE. |
Persistent Identifier | http://hdl.handle.net/10722/262802 |
ISSN | |
ISI Accession Number ID |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Xie, Xiaoyuan | - |
dc.contributor.author | Ho, Joshua | - |
dc.contributor.author | Murphy, Christian | - |
dc.contributor.author | Kaiser, Gail | - |
dc.contributor.author | Xu, Baowen | - |
dc.contributor.author | Chen, Tsong Yueh | - |
dc.date.accessioned | 2018-10-08T02:47:07Z | - |
dc.date.available | 2018-10-08T02:47:07Z | - |
dc.date.issued | 2009 | - |
dc.identifier.citation | Proceedings - International Conference on Quality Software, 2009, p. 135-144 | - |
dc.identifier.issn | 1550-6002 | - |
dc.identifier.uri | http://hdl.handle.net/10722/262802 | - |
dc.description.abstract | Many applications in the field of scientific computing - such as computational biology, computational linguistics, and others - depend on Machine Learning algorithms to provide important core functionality to support solutions in the particular problem domains. However, it is difficult to test such applications because often there is no "test oracle" to indicate what the correct output should be for arbitrary input. To help address the quality of such software, in this paper we present a technique for testing the implementations of supervised machine learning classification algorithms on which such scientific computing software depends. Our technique is based on an approach called "metamorphic testing", which has been shown to be effective in such cases. More importantly, we demonstrate that our technique not only serves the purpose of verification, but also can be applied in validation. In addition to presenting our technique, we describe a case study we performed on a real-world machine learning application framework, and discuss how programmers implementing machine learning algorithms can avoid the common pitfalls discovered in our study. We also discuss how our findings can be of use to other areas outside scientific computing, as well. © 2009 IEEE. | - |
dc.language | eng | - |
dc.relation.ispartof | Proceedings - International Conference on Quality Software | - |
dc.title | Application of metamorphic testing to supervised classifiers | - |
dc.type | Conference_Paper | - |
dc.description.nature | link_to_subscribed_fulltext | - |
dc.identifier.doi | 10.1109/QSIC.2009.26 | - |
dc.identifier.scopus | eid_2-s2.0-77950597207 | - |
dc.identifier.spage | 135 | - |
dc.identifier.epage | 144 | - |
dc.identifier.isi | WOS:000306716300017 | - |
dc.identifier.issnl | 1550-6002 | - |