Show simple item record

dc.contributor.authorKıraç, Mustafa Furkan
dc.contributor.authorAktemur, Tankut Barış
dc.contributor.authorSözer, Hasan
dc.date.accessioned2018-09-24T12:48:24Z
dc.date.available2018-09-24T12:48:24Z
dc.date.issued2018-02
dc.identifier.issn0164-1212en_US
dc.identifier.urihttp://hdl.handle.net/10679/5965
dc.identifier.urihttps://dl.acm.org/citation.cfm?id=3174644
dc.description.abstractA test oracle automation approach proposed for systems that produce visual output.Root causes of accuracy issues analyzed for test oracles based on image comparison.Image processing techniques employed to improve the accuracy of test oracles.A fast image processing pipeline developed as an automated test oracle.An industrial case study performed for automated regression testing of Digital TVs. Test oracles differentiate between the correct and incorrect system behavior. Hence, test oracle automation is essential to achieve overall test automation. Otherwise, testers have to manually check the system behavior for all test cases. A common test oracle automation approach for testing systems with visual output is based on exact matching between a snapshot of the observed output and a previously taken reference image. However, images can be subject to scaling and translation variations. These variations lead to a high number of false positives, where an error is reported due to a mismatch between the compared images although an error does not exist. To address this problem, we introduce an automated test oracle, named VISOR, that employs a fast image processing pipeline. This pipeline includes a series of image filters that align the compared images and remove noise to eliminate differences caused by scaling and translation. We evaluated our approach in the context of an industrial case study for regression testing of Digital TVs. Results show that VISOR can avoid 90% of false positive cases after training the system for 4h. Following this one-time training, VISOR can compare thousands of image pairs within seconds on a laptop computer.en_US
dc.language.isoengen_US
dc.publisherThe ACM Digital Libraryen_US
dc.relation.ispartofJournal of Systems and Software
dc.rightsrestrictedAccess
dc.titleVISOR: A fast image processing pipeline with scaling and translation invariance for test oracle automation of visual output systemsen_US
dc.typeArticleen_US
dc.peerreviewedyesen_US
dc.publicationstatusPublisheden_US
dc.contributor.departmentÖzyeğin University
dc.contributor.authorID(ORCID 0000-0001-9177-0489 & YÖK ID 124619) Kıraç, Furkan
dc.contributor.authorID(ORCID 0000-0002-1414-9338 & YÖK ID 124803) Aktemur, Barış
dc.contributor.authorID(ORCID 0000-0002-2968-4763 & YÖK ID 23178) Sözer, Hasan
dc.contributor.ozuauthorKıraç, Mustafa Furkan
dc.contributor.ozuauthorAktemur, Tankut Barış
dc.contributor.ozuauthorSözer, Hasan
dc.identifier.volume136en_US
dc.identifier.startpage266en_US
dc.identifier.endpage277en_US
dc.identifier.wosWOS:000418979100016
dc.identifier.doi10.1016/j.jss.2017.06.023en_US
dc.subject.keywordsBlack-box testingen_US
dc.subject.keywordsTest oracleen_US
dc.subject.keywordsComputer visionen_US
dc.subject.keywordsImage processingen_US
dc.subject.keywordsTest automationen_US
dc.identifier.scopusSCOPUS:2-s2.0-85020844453
dc.contributor.authorMale3
dc.relation.publicationcategoryArticle - International Refereed Journal - Institution Academic Staff


Files in this item

FilesSizeFormatView

There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record


Share this page