Automatically learning usage behavior and generating event sequences for black-box testing of reactive systems
dc.contributor.author | Kıraç, Mustafa Furkan | |
dc.contributor.author | Aktemur, Tankut Barış | |
dc.contributor.author | Sözer, Hasan | |
dc.contributor.author | Gebizli, C. Ş. | |
dc.date.accessioned | 2020-07-08T07:50:22Z | |
dc.date.available | 2020-07-08T07:50:22Z | |
dc.date.issued | 2019-06 | |
dc.identifier.issn | 0963-9314 | en_US |
dc.identifier.uri | http://hdl.handle.net/10679/6730 | |
dc.identifier.uri | https://dl.acm.org/doi/10.1007/s11219-018-9439-1 | |
dc.description.abstract | We propose a novel technique based on recurrent artificial neural networks to generate test cases for black-box testing of reactive systems. We combine functional testing inputs that are automatically generated from a model together with manually-applied test cases for robustness testing. We use this combination to train a long short-term memory (LSTM) network. As a result, the network learns an implicit representation of the usage behavior that is liable to failures. We use this network to generate new event sequences as test cases. We applied our approach in the context of an industrial case study for the black-box testing of a digital TV system. LSTM-generated test cases were able to reveal several faults, including critical ones, that were not detected with existing automated or manual testing activities. Our approach is complementary to model-based and exploratory testing, and the combined approach outperforms random testing in terms of both fault coverage and execution time. | en_US |
dc.language.iso | eng | en_US |
dc.publisher | The ACM Digital Library | en_US |
dc.relation.ispartof | Software Quality Journal | |
dc.rights | restrictedAccess | |
dc.title | Automatically learning usage behavior and generating event sequences for black-box testing of reactive systems | en_US |
dc.type | Article | en_US |
dc.peerreviewed | yes | en_US |
dc.publicationstatus | Published | en_US |
dc.contributor.department | Özyeğin University | |
dc.contributor.authorID | (ORCID 0000-0001-9177-0489 & YÖK ID 124619) Kıraç, Furkan | |
dc.contributor.authorID | (ORCID 0000-0002-1414-9338 & YÖK ID 124803) Aktemur, Barış | |
dc.contributor.authorID | (ORCID 0000-0002-2968-4763 & YÖK ID 23178) Sözer, Hasan | |
dc.contributor.ozuauthor | Kıraç, Mustafa Furkan | |
dc.contributor.ozuauthor | Aktemur, Tankut Barış | |
dc.contributor.ozuauthor | Sözer, Hasan | |
dc.identifier.volume | 27 | en_US |
dc.identifier.issue | 2 | en_US |
dc.identifier.startpage | 861 | en_US |
dc.identifier.endpage | 883 | en_US |
dc.identifier.wos | WOS:000470767500014 | |
dc.identifier.doi | 10.1007/s11219-018-9439-1 | en_US |
dc.subject.keywords | Test case generation | en_US |
dc.subject.keywords | Black-box testing | en_US |
dc.subject.keywords | Recurrent neural networks | en_US |
dc.subject.keywords | Long short-term memory networks | en_US |
dc.subject.keywords | Learning usage behavior | en_US |
dc.identifier.scopus | SCOPUS:2-s2.0-85059878995 | |
dc.contributor.authorMale | 3 | |
dc.relation.publicationcategory | Article - International Refereed Journal - Institutional Academic Staff |
Files in this item
Files | Size | Format | View |
---|---|---|---|
There are no files associated with this item. |
This item appears in the following Collection(s)
Share this page