Designing an efficient gradient descent based heuristic for clusterwise linear regression for large datasets
dc.contributor.author | Kayış, Enis | |
dc.date.accessioned | 2023-05-23T07:13:44Z | |
dc.date.available | 2023-05-23T07:13:44Z | |
dc.date.issued | 2021 | |
dc.identifier.isbn | 978-303083013-7 | |
dc.identifier.issn | 1865-0929 | en_US |
dc.identifier.uri | http://hdl.handle.net/10679/8323 | |
dc.identifier.uri | https://link.springer.com/chapter/10.1007/978-3-030-83014-4_8 | |
dc.description.abstract | Multiple linear regression is the method of quantifying the effects of a set of independent variables on a dependent variable. In clusterwise linear regression problems, the data points with similar regression estimates are grouped into the same cluster either due to a business need or to increase the statistical significance of the resulting regression estimates. In this paper, we consider an extension of this problem where data points belonging to the same category should belong to the same partition. For large datasets, finding the exact solution is not possible and many heuristics requires an exponentially increasing amount of time in the number of categories. We propose variants of gradient descent based heuristic to provide high-quality solutions within a reasonable time. The performances of our heuristics are evaluated across 1014 simulated datasets. We find that the comparative performance of the base gradient descent based heuristic is quite good with an average percentage gap of 0.17 % when the number of categories is less than 60. However, starting with a fixed initial partition and restricting cluster assignment changes to be one-directional speed up heuristic dramatically with a moderate decrease in solution quality, especially for datasets with a multiple number of predictors and a large number of datasets. For example, one could generate solutions with an average percentage gap of 2.81 % in one-tenth of the time for datasets with 400 categories. | en_US |
dc.language.iso | eng | en_US |
dc.publisher | Springer | en_US |
dc.relation.ispartof | International Conference on Data Management Technologies and Applications DATA 2020: Data Management Technologies and Applications, Part of the Communications in Computer and Information Science book series (CCIS,volume 1446) | |
dc.rights | restrictedAccess | |
dc.title | Designing an efficient gradient descent based heuristic for clusterwise linear regression for large datasets | en_US |
dc.type | Conference paper | en_US |
dc.publicationstatus | Published | en_US |
dc.contributor.department | Özyeğin University | |
dc.contributor.authorID | (ORCID 0000-0001-8282-5572 & YÖK ID 29747) Kayış, Enis | |
dc.contributor.ozuauthor | Kayış, Enis | |
dc.identifier.volume | 1446 | en_US |
dc.identifier.startpage | 154 | en_US |
dc.identifier.endpage | 171 | en_US |
dc.identifier.doi | 10.1007/978-3-030-83014-4_8 | en_US |
dc.subject.keywords | Clusterwise linear regression | en_US |
dc.subject.keywords | Gradient descent | en_US |
dc.subject.keywords | Heuristics | en_US |
dc.identifier.scopus | SCOPUS:2-s2.0-85113289375 | |
dc.relation.publicationcategory | Conference Paper - International - Institutional Academic Staff |
Files in this item
Files | Size | Format | View |
---|---|---|---|
There are no files associated with this item. |
This item appears in the following Collection(s)
Share this page