Hybrid job scheduling for improved cluster utilization
dc.contributor.author | Arı, İsmail | |
dc.contributor.author | Kocak, Uğur | |
dc.date.accessioned | 2016-02-11T06:46:11Z | |
dc.date.available | 2016-02-11T06:46:11Z | |
dc.date.issued | 2014 | |
dc.identifier.isbn | 978-3-642-54420-0 | |
dc.identifier.uri | http://hdl.handle.net/10679/1955 | |
dc.identifier.uri | http://link.springer.com/chapter/10.1007/978-3-642-54420-0_39 | |
dc.description | Due to copyright restrictions, the access to the full text of this article is only available via subscription. | |
dc.description.abstract | In this paper, we investigate the models and issues as well as performance benefits of hybrid job scheduling over shared physical clusters. Clustering technologies that are currently supported include MPI, Hadoop-MapReduce and NoSQL systems. Our proposed scheduling model is above the cluster-specific middleware and OS-level schedulers and it is complementary to them. First, we demonstrate that we can effectively schedule MPI, Hadoop, NoSQL jobs together by profiling them and then co-scheduling. Second, we find that it is better to schedule cluster jobs with different job characteristics together (CPU vs. I/O intensive) rather than two CPU-intensive jobs. Third, we use the learning outcome of this principle to design of a greedy sort-merge scheduler. Up to 37% savings in total job completion times are demonstrated. These savings are directly proportional to the cluster utilization improvements. | |
dc.language.iso | eng | en_US |
dc.publisher | Springer Science+Business Media | |
dc.relation.ispartof | Euro-Par 2013: Parallel Processing Workshops | |
dc.rights | restrictedAccess | |
dc.title | Hybrid job scheduling for improved cluster utilization | en_US |
dc.type | Book chapter | en_US |
dc.peerreviewed | yes | |
dc.publicationstatus | published | en_US |
dc.contributor.department | Özyeğin University | |
dc.contributor.authorID | (ORCID 0000-0002-6159-0484 & YÖK ID 43541) Arı, İsmail | |
dc.contributor.ozuauthor | Arı, İsmail | |
dc.identifier.volume | 8374 | |
dc.identifier.startpage | 395 | |
dc.identifier.endpage | 405 | |
dc.identifier.wos | WOS:000350859500046 | |
dc.identifier.doi | 10.1007/978-3-642-54420-0_39 | |
dc.identifier.scopus | SCOPUS:2-s2.0-84958528881 | |
dc.contributor.ozugradstudent | Kocak, Uğur | |
dc.contributor.authorMale | 2 | |
dc.relation.publicationcategory | Book Chapter - International - Institutional Academic Staff and Graduate Student |
Files in this item
Files | Size | Format | View |
---|---|---|---|
There are no files associated with this item. |
This item appears in the following Collection(s)
Share this page