Exploiting Dynamic Resource Allocation for Efficient Parallel Data Processing in the Cloud

Technology Used: Java / J2EE Parallel and Distributed Systems, 2011 In recent years ad-hoc parallel data processing has emerged to be one of the killer applications for Infrastructure-as-a- Service (IaaS) clouds. Major Cloud computing companies have started to integrate frameworks for parallel data processing in their product portfolio, making it easy for customers to access these services and to deploy their programs. However, the processing frameworks which are currently used have been designed for static, homogeneous cluster setups and disregard the particular nature of a cloud. Consequently, the allocated compute…

Read More

Heuristics Based Query Processing for Large RDF Graphs Using Cloud Computing

Technology Used: Java / J2EE Knowledge and Data Engineering, 2011 Download Projects 2011 Basepaper Abstract Semantic Web is an emerging area to augment human reasoning for which various technologies are being developed. These technologies have been standardized by W3C. One such standard is the RDF. With the explosion of semantic web technologies, large RDF graphs are common place. Current frameworks do not scale for large RDF graphs and as a result does not address these challenges. In this paper, we describe a framework that we built using Hadoop to store…

Read More