Cloud Computing

• Traditional Sever Concept

• Outline
• Pros and Cons
• Virtual Server Concept
• Hypervisors and hosts
• Virtual machines
• Pros and Cons
• Could Computing
• Concept
• The Rise of Cloud
• Examples
• Data centres
• Overview
 Two Technologies for Agility
• Virtualization:
• The ability to run multiple operating
systems on a single physical system and
share the underlying hardware resources*
• Cloud Computing:
• The provisioning of services in a timely
(near on instant), on-demand manner, to
allow the scaling up and down of resources
The Traditional Server Concept

Web App Server DB Server EMail

Server
Linux Linux Windows
Windows
Glassfish MySQL Exchange
IIS GlassFish is an open-source application
server project started by Sun Microsystems for
the Java EE platform and now sponsored
by Oracle Corporation
 The Traditional Server Concept

• System Administrators often talk about servers as a

whole unit that includes the hardware, the OS, the
storage, and the applications.
• Servers are often referred to by their function i.e. the
Exchange server, the SQL server, the File server,
etc.
• If the File server fills up, or the Exchange server
becomes overtaxed, then the System Administrators
must add in a new server.
And if something goes wrong ...

Web Server App Server DB Server EMail

Windows DOWN! Linux Windows
IIS MySQL Exchange
The Traditional Server Concept

• Unless there are multiple servers, if a

service experiences a hardware failure,
then the service is down.
• System Admins can implement clusters of
servers to make them more fault tolerant.
However, even clusters have limits on
their scalability, and not all applications
work in a clustered environment.
 The Traditional Server Concept
• Cons
• Pros
• Expensive to acquire and
• Easy to maintain hardware
conceptualize • Not very scalable
• Fairly easy to deploy • Difficult to replicate
• Easy to backup • Redundancy is difficult to
• Virtually any implement
application/service • Vulnerable to hardware
can be run from this outages
type of setup • In many cases, processor is
under-utilized
 The Virtual Server Concept

• Virtual servers seek to encapsulate the

server software away from the hardware
• This includes the OS, the applications, and the
storage for that server.
• Servers end up as mere files stored on a
physical box, or in enterprise storage.
• One host typically house many virtual
servers (virtual machines or VMs).
• A virtual server can be serviced by one or
more hosts e.g. storage, services, etc
 The Virtual Server Concept

Hypervisor layer between Guest OS and hardware

 Hypervisors And Hosts
• A hypervisor is a piece of computer software, firmware
or hardware that creates and runs virtual machines.
• A computer on which a hypervisor is running one or
more virtual machines is defined as a host machine.
• Each virtual machine has a guest operating
systems, which is managed by the hypervisor.
• Multiple instances of a variety of operating systems
may share the virtualized hardware resources.
Hypervisors and Virtual Machines

Server Server Clustering

1 2
Guest OS Guest OS Service
Console
Hypervisor

x86 Architecture

Intercepts
hardware
requests
 The Virtual Server Concept

• Virtual servers can still be referred to by

their function i.e. email server, database
server, etc.
• If the environment is built correctly, virtual
servers will not be affected by the loss of
a host.
• Hosts may be removed and introduced
almost at will to accommodate
maintenance.
 The Virtual Server Concept
• Virtual servers can be scaled out easily.
• If the administrators find that the resources
supporting a virtual server are being taxed too
much, they can adjust the amount of resources
allocated to that virtual server
• Server templates can be created in a virtual
environment to be used to create multiple,
identical virtual servers
• Virtual servers themselves can be migrated
from host to host almost at will.
 The Virtual Server Concept
• Pros • Cons
• Resource pooling
• Slightly harder to
• Highly redundant
conceptualize
• Highly available
•
• Slightly more costly
Rapidly deploy new servers
• Easy to deploy
(must buy hardware,
•
OS, Apps, and now the
Reconfigurable while
services are running abstraction layer)
• Optimizes physical
resources by doing more
with less
 Cloud Computing?
• The cloud is Internet-based
computing, whereby shared
resources, software, and information
are provided to computers and other
devices on demand – pay per use.

• Cost-effective means of virtualising and making use of

resources more effectively
• Low start-up costs – pay for use helps to kick-start companies
• Scaling is proportional to demand (revenue) so it’s a good
business model
• Vast range of Cloud Computing applications
• Virtual private servers, Web hosting, data servers, fail-over
services, etc
 Basic Cloud Characteristics
• The “no-need-to-know” in terms of the underlying
details of infrastructure, applications interface with
the infrastructure via the APIs.
• The “flexibility and elasticity” allows these systems
to scale up and down at will
• utilising the resources of all kinds
• CPU, storage, server capacity, load balancing, and databases
• The “pay as much as used and needed” type of
utility computing and the “always on, anywhere and
any place” type of network-based computing.

16
 Basic Cloud Characteristics
• Cloud are transparent to users and
applications, they can be built in multiple ways
• branded products, proprietary open source,
hardware or software, or just off-the-shelf PCs.
• In general, they are built on clusters of PC
servers and off-the-shelf components plus
Open Source software combined with in-
house applications and/or system software.

17
Motivation Example: Forbes.com

• You offer on-line real • Why pay for capacity

time stock market weekends, overnight?
data

9 AM - 5 PM,
M-F
Rate of
Server
Accesses
ALL OTHER
TIMES
 Forbes' Solution

• Host the web site in Amazon's EC2

Elastic Compute Cloud
• Provision new servers every day, and
deprovision them every night
• Pay just $0.10* per server per hour
• * more for higher capacity servers
• Let Amazon worry about the hardware!
 Cloud computing takes
virtualization to the next step
• You don’t have to own the hardware
• You “rent” it as needed from a cloud
• There are public clouds
• e.g. Amazon EC2, and now many others
(Microsoft, IBM, Sun, and others ...)
• A company can create a private one
• With more control over security, etc.
 Goal 1 – Cost Control
• Cost
• Many systems have variable demands
• Batch processing (e.g. New York Times)
• Web sites with peaks (e.g. Forbes)
• Startups with unknown demand (e.g. the
Cash for Clunkers program)
• Reduce risk
• Don't need to buy hardware until you need it
Cloud Computing Overview
 SaaS and PaaS
• SaaS is where an application is hosted as a service provided to
customers across the Internet.
• Saas alleviates the burden of software maintenance/support
• but users relinquish control over software versions and
requirements.
• PaaS provides a computing platform and a solution stack as a
service.
• Consumer creates the software using tools and/or libraries from the
provider.
• The consumer also controls software deployment and configuration
settings. The provider provides the networks, servers, storage and
other services.
23
 IaaS

• IaaS providers offer virtual machines, virtual-

machine image libraris, raw (block) and file-
based storage, firewalls, load balancers, IP
addresses, virtual local area networks
(VLANs), and software bundles.
• Pools of hypervisors can scale services up
and down according to customers' varying
requirements
• All infrastructure is provided on-demand
 Cloud Service Models
Software as a Platform as a Infrastructure as a
Service (SaaS) Service (PaaS) Service (IaaS)

SalesForce
CRM
LotusLive

Google
App
Engine

25

Adopted from: Effectively and Securely Using the Cloud Computing Paradigm by peter Mell, Tim Grance
Some Commercial Cloud Offerings

26
 Summary Comments
• Virtualization of servers solves a lot of headaches when
deploying infrastructure and applications
• It allows servers to be backed up and moved around
seamlessly
• Migrating a server might allow an application speed to
increase e.g. move to a faster machine
• Resizing (up or down) keeps costs proportional to
business model
• The model works for both private clouds or public ones
(insourcing or outsourcing)
• The cloud is easy to understand and a convenient way
of accessing infrastructure and services.