Exploiting Dynamic Resource Allocation for Efficient Parallel Data Processing in the Cloud

Technology Used: Java / J2EE

Parallel and Distributed Systems, 2011

In recent years ad-hoc parallel data processing has emerged to be one of the killer applications for Infrastructure-as-a- Service (IaaS) clouds. Major Cloud computing companies have started to integrate frameworks for parallel data processing in their product portfolio, making it easy for customers to access these services and to deploy their programs. However, the processing frameworks which are currently used have been designed for static, homogeneous cluster setups and disregard the particular nature of a cloud. Consequently, the allocated compute resources may be inadequate for big parts of the submitted job and unnecessarily increase processing time and cost. In this paper we discuss the opportunities and challenges for efficient parallel data processing in clouds and present our research project Nephele. Nephele is the first data processing framework to explicitly exploit the dynamic resource allocation offered by today’s IaaS clouds for both, task scheduling and execution. Particular tasks of a processing job can be assigned to different types of virtual machines which are automatically instantiated and terminated during the job execution. Based on this new framework, we perform extended evaluations of MapReduce-inspired processing jobs on an IaaS cloud system and compare the results to the popular data processing framework Hadoop.

Thanks for installing the Bottom of every post plugin by Corey Salzano. Contact me if you need custom WordPress plugins or website design.

17 thoughts on “Exploiting Dynamic Resource Allocation for Efficient Parallel Data Processing in the Cloud

  • September 12, 2011 at 6:18 am
    Permalink

    please send me abstract & all the development details of this project
    i m an btech student of noida

    Reply
  • September 12, 2011 at 6:31 am
    Permalink

    Enabling Public Auditability and Data Dynamics for Storage Security in Cloud
    Computing
    please send me abstract & all the development details of this project
    i m an btech student of noida

    Reply
  • January 3, 2012 at 5:06 am
    Permalink

    Please send me the abstract n implementation of the project.

    Reply
  • January 25, 2012 at 12:11 am
    Permalink

    Can jus send me the abstract an all the contents of this source an project details

    Reply
  • February 28, 2012 at 4:02 am
    Permalink

    send me price cost and development stage of below poject
    ” Exploiting Dynamic Resource Allocation for Efficient Parallel Data Processing in the Cloud “

    Reply
  • February 28, 2012 at 4:07 am
    Permalink

    hello sir
    do you have the following available project

    “modelling and detection of camouflaging worms”

    Reply
  • May 5, 2012 at 4:16 pm
    Permalink

    please send me the dfd of this project

    Reply
  • June 21, 2012 at 10:06 am
    Permalink

    pls send me the project…………..

    Reply
  • July 4, 2012 at 6:04 am
    Permalink

    are you have the project on”clustering using parallel k-means algorithm”

    Reply
  • July 16, 2012 at 6:56 am
    Permalink

    send me abstarct and related papers of project..

    Reply
  • September 26, 2012 at 8:50 am
    Permalink

    wud u pls send me the abstract,dfd and the implementation of this project

    Reply
  • January 15, 2013 at 2:27 pm
    Permalink

    can u send me the abstract and related uml diagrams to my mail plz

    Reply
  • January 31, 2013 at 12:23 pm
    Permalink

    send me the abstract and uml diagrams of this project

    Reply
  • March 19, 2013 at 4:18 pm
    Permalink

    hello sir ,please send me the flow chart related to this project

    Reply
  • March 25, 2013 at 6:59 am
    Permalink

    can u please let me know weather job scheduling is done through os… i mean can v do through os..

    Reply
  • December 15, 2013 at 7:27 am
    Permalink

    I am student of ME from pune,can u plz send me the abstract and related dfd’s,uml diagrams and flow chart and implementation detials of this project to my mail plz.
    Thanking U!!!

    Reply
  • April 1, 2014 at 11:36 am
    Permalink

    I am student of Msc from iran,can u plz send me the code of this project to my mail plz.
    thank you

    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *