Show simple item record

dc.contributor.authorKıraç, Mustafa Furkan
dc.contributor.authorAktemur, Tankut Barış
dc.contributor.authorSözer, Hasan
dc.description.abstractA test oracle automation approach proposed for systems that produce visual output.Root causes of accuracy issues analyzed for test oracles based on image comparison.Image processing techniques employed to improve the accuracy of test oracles.A fast image processing pipeline developed as an automated test oracle.An industrial case study performed for automated regression testing of Digital TVs. Test oracles differentiate between the correct and incorrect system behavior. Hence, test oracle automation is essential to achieve overall test automation. Otherwise, testers have to manually check the system behavior for all test cases. A common test oracle automation approach for testing systems with visual output is based on exact matching between a snapshot of the observed output and a previously taken reference image. However, images can be subject to scaling and translation variations. These variations lead to a high number of false positives, where an error is reported due to a mismatch between the compared images although an error does not exist. To address this problem, we introduce an automated test oracle, named VISOR, that employs a fast image processing pipeline. This pipeline includes a series of image filters that align the compared images and remove noise to eliminate differences caused by scaling and translation. We evaluated our approach in the context of an industrial case study for regression testing of Digital TVs. Results show that VISOR can avoid 90% of false positive cases after training the system for 4h. Following this one-time training, VISOR can compare thousands of image pairs within seconds on a laptop computer.en_US
dc.publisherThe ACM Digital Libraryen_US
dc.relation.ispartofJournal of Systems and Software
dc.titleVISOR: A fast image processing pipeline with scaling and translation invariance for test oracle automation of visual output systemsen_US
dc.contributor.departmentÖzyeğin University
dc.contributor.authorID(ORCID 0000-0001-9177-0489 & YÖK ID 124619) Kıraç, Furkan
dc.contributor.authorID(ORCID 0000-0002-1414-9338 & YÖK ID 124803) Aktemur, Barış
dc.contributor.authorID(ORCID 0000-0002-2968-4763 & YÖK ID 23178) Sözer, Hasan
dc.contributor.ozuauthorKıraç, Mustafa Furkan
dc.contributor.ozuauthorAktemur, Tankut Barış
dc.contributor.ozuauthorSözer, Hasan
dc.subject.keywordsBlack-box testingen_US
dc.subject.keywordsTest oracleen_US
dc.subject.keywordsComputer visionen_US
dc.subject.keywordsImage processingen_US
dc.subject.keywordsTest automationen_US
dc.relation.publicationcategoryArticle - International Refereed Journal - Institution Academic Staff

Files in this item


There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record

Share this page