Variational closed-Form deep neural net inference
dc.contributor.author | Kandemir, Melih | |
dc.date.accessioned | 2019-04-02T10:58:21Z | |
dc.date.available | 2019-04-02T10:58:21Z | |
dc.date.issued | 2018-09 | |
dc.identifier.issn | 0167-8655 | en_US |
dc.identifier.uri | http://hdl.handle.net/10679/6250 | |
dc.identifier.uri | https://www.sciencedirect.com/science/article/pii/S0167865518302861#! | |
dc.description.abstract | We introduce a Bayesian construction for deep neural networks that is amenable to mean field variational inference that operates solely by closed-form update rules. Hence, it does not require any learning rate to be manually tuned. We show that by this virtue it becomes possible with our model to perform effective deep learning on three setups where conventional neural nets are known to perform suboptimally: i) online learning, ii) learning from small data, and iii) active learning. We compare our approach to earlier Bayesian neural network inference techniques spanning from expectation propagation to gradient-based variational Bayes, as well as deterministic neural nets with various activations functions. We observe our approach to improve on all these alternatives in two mainstream vision benchmarks and two medical data sets: diabetic retinopathy screening and exudate detection from eye fundus images. | en_US |
dc.language.iso | eng | en_US |
dc.publisher | Elsevier | en_US |
dc.relation.ispartof | Pattern Recognition Letters | |
dc.rights | restrictedAccess | |
dc.title | Variational closed-Form deep neural net inference | en_US |
dc.type | Article | en_US |
dc.peerreviewed | yes | en_US |
dc.publicationstatus | Published | en_US |
dc.contributor.department | Özyeğin University | |
dc.contributor.authorID | (ORCID 0000-0001-6293-3656 & YÖK ID 258737) Kandemir, Melih | |
dc.contributor.ozuauthor | Kandemir, Melih | |
dc.identifier.volume | 112 | en_US |
dc.identifier.startpage | 145 | en_US |
dc.identifier.endpage | 151 | en_US |
dc.identifier.wos | WOS:000443950800021 | |
dc.identifier.doi | 10.1016/j.patrec.2018.07.001 | en_US |
dc.subject.keywords | Bayesian Neural Networks | en_US |
dc.subject.keywords | Variational Bayes | en_US |
dc.subject.keywords | Online learning | en_US |
dc.subject.keywords | Active learning | en_US |
dc.identifier.scopus | SCOPUS:2-s2.0-85049560836 | |
dc.contributor.authorMale | 1 | |
dc.relation.publicationcategory | Article - International Refereed Journal - Institutional Academic Staff |
Files in this item
Files | Size | Format | View |
---|---|---|---|
There are no files associated with this item. |
This item appears in the following Collection(s)
Share this page