Aula 01 - Enabling Technologies and Distributed System Models

Aula 01 - Enabling Technologies and Distributed System Models 1 Livro texto 2 Data Deluge Enabling New Challenges (Courtesy of Judy Qiu, Indian...
Author: Ginger Nash
18 downloads 2 Views 2MB Size
Aula 01 - Enabling Technologies and Distributed System Models

1

Livro texto

2

Data Deluge Enabling New Challenges

(Courtesy of Judy Qiu, Indiana University, 2011)

Copyright © 2012, Elsevier Inc. All rights reserved.

1-3

From Desktop/HPC/Grids to Internet Clouds in 30 Years 

HPC moving from centralized supercomputers to geographically distributed desktops, desksides, clusters, and grids to clouds over last 30 years



R/D efforts on HPC, clusters, Grids, P2P, and virtual machines has laid the foundation of cloud computing that has been greatly advocated since 2007



Location of computing infrastructure in areas with lower costs in hardware, software, datasets, space, and power requirements – moving from desktop computing to datacenter-based clouds 4

Interactions among 4 technical challenges : Data Deluge, Cloud Technology, eScience, and Multicore/Pareallel Computing

(Courtesy of Judy Qiu, Indiana University, 2011) Copyright © 2012, Elsevier Inc. All rights reserved.

1-5

Clouds and Internet of Things HPC: HighPerformance Computing

HTC: HighThroughput Computing

P2P: Peer to Peer

MPP: Massively Parallel Source: K. Hwang, G. Fox, and J. Dongarra, Distributed and Cloud Computing,

Processors

Morgan Kaufmann, 2012. Copyright © 2012, Elsevier Inc. All rights reserved.

1-6

Technology Convergence toward HPC for Science and HTC for Business

(Courtesy of Raj Buyya, University of Melbourne, 2011) Copyright © 2012, Elsevier Inc. All rights reserved.

7

2011 Gartner “IT Hype Cycle” for Emerging Technologies 2010 2009

2011

2008

2007

Copyright © 2012, Elsevier Inc. All rights reserved.

8

Copyright © 2012, Elsevier Inc. All rights reserved.

1-9

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 10

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 11

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 12

Architecture of A Many-Core Multiprocessor GPU interacting with a CPU Processor

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 13

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 14

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 15

Datacenter and Server Cost Distribution

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 16

Virtual Machine Architecture

(Courtesy of VMWare, 2010) Copyright © 2012, Elsevier Inc. All rights reserved.

17

Primitive Operations in Virtual Machines:

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 18

Concept of Virtual Clusters

(Source: W. Emeneker, et et al, “Dynamic Virtual Clustering with Xen and Moab, ISPA 2006, Springer-Verlag LNCS 4331, 2006, pp. 440-451) Copyright © 2012, Elsevier Inc. All rights reserved.

19

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 20

A Typical Cluster Architecture

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 21

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 22

A Typical Computational Grid

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 23

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 24

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 25

The Cloud Historical roots in today’s Internet apps •

Search, email, social networks



File storage (Live Mesh, Mobile Me, Flicker, …)

A cloud infrastructure provides a framework to manage scalable, reliable, on-demand access to applications A cloud is the “invisible” backend to many of our mobile applications

A model of computation and data storage based on “pay as you go” access to “unlimited” remote data center capabilities Copyright © 2012, Elsevier Inc. All rights reserved.

26

Basic Concept of Internet Clouds

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 27

The Next Revolution in IT Cloud Computing Classical Computing

Cloud Computing

• Buy & Own

• Subscribe

Every 18 months?

• Hardware, System Software, Applications often to meet peak needs.

• Use

• Install, Configure, Test, Verify, Evaluate • Manage • ..

• Finally, use it • $$$$....$(High CapEx)

• $ - pay for what you use, based on QoS (Courtesy of Raj Buyya, 2012)

Copyright © 2012, Elsevier Inc. All rights reserved.

28

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 29

Cloud Computing Challenges: Dealing with too many issues (Courtesy of R. Buyya) Scalability

Reliability Billing

Utility & Risk Management

Software Eng. Complexity Programming Env. & Application Dev.

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 30

The Internet of Things (IoT) Smart Earth: Internet of Things Smart Earth

Copyright © 2012, Elsevier Inc. All rights reserved.

An IBM Dream

1 - 31

Opportunities of IoT in 3 Dimensions

(courtesy of Wikipedia, 2010)

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 32

System Scalability vs. OS Multiplicity

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 33

System Availability vs. Configuration Size :

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 34

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 35

Transparent Cloud Computing Environment

36

Parallel and Distributed Programming

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 37

Grid Standards and Middleware :

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 38

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 39

Energy Efficiency :

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 40

System Attacks and Network Threads

Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 41

Four Reference Books: 1. K. Hwang, G. Fox, and J. Dongarra, Distributed and Cloud Computing: from Parallel Processing to the Internet of Things Morgan Kauffmann Publishers, 2011 2. R. Buyya, J. Broberg, and A. Goscinski (eds), Cloud Computing: Principles and Paradigms, ISBN-13: 978-0470887998, Wiley Press,

USA, February 2011. 3. T. Chou, Introduction to Cloud Computing: Business and Technology, Lecture Notes at Stanford University and at Tsinghua University, Active Book Press, 2010. 4. T. Hey, Tansley and Tolle (Editors), The Fourth Paradigm : DataIntensive Scientific Discovery, Microsoft Research, 2009. Copyright © 2012, Elsevier Inc. All rights reserved.

1 - 42