Title page for etd-0822111-220155


[Back to Results | New Search]

URN etd-0822111-220155
Author Jun-neng Huang
Author's Email Address No Public.
Statistics This thesis had been viewed 5537 times. Download 117 times.
Department Computer Science and Engineering
Year 2010
Semester 2
Degree Master
Type of Document
Language English
Title Reducing Communication Overhead and Computation Costs in a Cloud Network by Early Combination of Partial Results
Date of Defense 2011-06-29
Page Count 46
Keyword
  • cloud computing
  • MapReduce
  • Hadoop
  • Abstract This thesis describes a method of reducing communication overheads within the MapReduce infrastructure of a cloud computing environment. MapReduce is an framework for parallelizing the processing on massive data systems stored across a
    distributed computer network. One of the benefits of MapReduce is that the computation is usually performed on a computer (node) that holds the data file. Not
    only does this approach achieve parallelism, but it also benefits from a characteristic common to many applications: that the answer derived from a computation is often smaller than the size of the input file.
    Our new method benefits also from this feature. We delay the transmission of individual answers out a given node, so as to allow these answers to be combined locally, first. This combination has two advantages. First, it allows for a further reduction in the amount of data to ultimately transmit. And second, it allows for additional computation across files (such as a merge-sort).
    There is a limit to the benefit of delaying transmission, however, because the reducer stage of MapReduce cannot begin its work until the nodes transmit their answers. We therefore consider a mechanism to allow the user to adjust the amount of delay before data transmission out of each node.
    Advisory Committee
  • Chung-nan Lee - chair
  • CHUN-HUNG RICHARD LIN - co-chair
  • Steve W.Haga - advisor
  • Files
  • etd-0822111-220155.pdf
  • Indicate in-campus at 3 year and off-campus access at 5 year.
    Date of Submission 2011-08-22

    [Back to Results | New Search]


    Browse | Search All Available ETDs

    If you have more questions or technical problems, please contact eThesys