Professional Documents
Culture Documents
Amazon Web Services
Amazon Web Services
Nirvikar
Types of Cloud :
A cloud can be private or public. A public cloud sells services to anyone on the Internet. (Currently, Amazon Web Services is the largest public cloud provider). A private cloud is a proprietary network or a datacenter that supplies hosted services to a limited number of people. When a service provider uses public cloud resources to create their private cloud, the result is called a virtual private cloud.
Private or public, the goal of cloud computing is to provide easy, scalable access to computing resources and IT services. requirements change.
Introduction :
Amazon Elastic Compute Cloud (Amazon EC2) is a web service that provides resizable compute capacity in the cloud. Amazon EC2s simple web service interface allows you to obtain and configure capacity with minimal friction. It provides you with complete control of your computing resources and lets you run on Amazons proven computing environment. Amazon EC2 reduces the time required to obtain and boot new server instances to minutes, allowing you to quickly scale capacity, both up and down, as your computing requirements change. Amazon EC2 changes the economics of computing by allowing you to pay only for capacity that you actually use.
Overview of cloud computing including Google, Salesforce, Amazon, Microsoft, Yahoo & Zoho
Amazon Elastic Compute Cloud (also known as "EC2") is a commercial web service that allows customers to rent computers on which to run their own computer applications. A customer can create, launch, and terminate server instances as needed, paying by the hour for active servers, hence the term "elastic". A customer can set up server instances in zones insulated from each other for most failure causes so that one may be a backup for the other and minimize down time
Elastic Completely controlled Flexible Designed for use with Amazon Web services Reliable Secure Inexpensive On Demand instances Reserved instances
Use webservices interface to launch instances with variety of operating systems, load them into your custom application environment, manage your network access permissions and run your image using as many few systems as you desire To use Amazon
Create Amazon Machine Image Upload AMI into Amazon S3 Use Amazon EC2 to configure network security and access Choose instance types and operating system. Start/terminate and monitor your instances using webservice apis Determine whether you want to run in multiple locations, utilize static IP endpoints, or attach a persistent block storage for your instances Pay only for resources you consume, like instance hours and data transfer
Features - EC2
Amazon Elastic Block Store (EBS) offers persistent storage for Amazon EC2 instances. Amazon EBS volumes provide off-instance storage that persists independently from the life of an instance. Amazon EBS volumes are highly available, highly reliable volumes that can be attached to a running Amazon EC2 instance and are exposed as standard block devices. Amazon EBS volumes offer greatly improved durability over local Amazon EC2 instance stores, as Amazon EBS volumes are automatically replicated on the backend (in a single Availability Zone). Amazon EBS provides the ability to create point-in-time consistent snapshots of your volumes that are then stored in Amazon S3, and automatically replicated across multiple Availability Zones.These snapshots can be used as the starting point for new Amazon EBS volumes, and can protect your data for long term durability.
Multiple Locations
Amazon EC2 provides the ability to place instances in multiple locations.Amazon EC2 locations are composed of Regions and Availability Zones. Availability Zones are distinct locations that are engineered to be insulated from failures in other Availability Zones and provide inexpensive, low latency network connectivity to other Availability Zones in the same Region. By launching instances in separate Availability Zones, you can protect your applications from failure of a single location. Regions consist of one or more Availability Zones, are geographically dispersed, and will be in separate geographic areas or countries, Europe and USA.
Elastic IP Addresses
Elastic IP addresses are static IP addresses designed for dynamic cloud computing. An Elastic IP address is associated with your account not a particular instance, and you control that address until you choose to explicitly release it. Unlike traditional static IP addresses, however, Elastic IP addresses allow you to mask instance or Availability Zone failures by programmatically remapping your public IP addresses to any instance in your account. Rather than waiting on a data technician to reconfigure or replace your host, or waiting for DNS to propagate to all of your customers, Amazon EC2 enables you to engineer around problems with your instance or software by quickly remapping your Elastic IP address to a replacement instance.
Amazon CloudFront
Amazon CloudFront is a web service for content delivery. It integrates with other Amazon Web Services to give developers and businesses an easy way to distribute content to end users with low latency, high data transfer speeds, and no commitments. Amazon CloudFront delivers your content using a global network of edge locations. Requests for your objects are automatically routed to the nearest edge location, so content is delivered with the best possible performance. Amazon CloudFront works seamlessly with Amazon Simple Storage Service (Amazon S3) which durably stores the original, definitive versions of your files. Like other Amazon Web Services, there are no contracts or monthly commitments for using Amazon CloudFront you pay only for as much or as little content as you actually deliver through the service.
Store the original versions of your files in an Amazon S3 bucket. Create a distribution to register that bucket with Amazon CloudFront through a simple API call. your distributions domain name in your web pages or application. When end users request
Use
an object using this domain name, they are automatically routed to the nearest edge location for high performance delivery of your content.
Pay only for the data transfer and requests that you actually use.
Auto Scaling
Auto Scaling allows you to automatically scale your Amazon EC2 capacity up or down according to conditions you define. With Auto Scaling, you can ensure that the number of Amazon EC2 instances youre using scales up seamlessly during demand spikes to maintain performance, and scales down automatically during demand lulls to minimize costs. Auto Scaling is particularly well suited for applications that experience hourly, daily, or weekly variability in usage.
Amazon Simple Queue Service (SQS) provides access to the reliable messaging infrastructure used by Amazon. You can send and retrieve messages from anywhere using simple REST-based HTTP requests. You can create an unlimited number of queues and send an unlimited number of messages. The messages are stored by Amazon across multiple servers and data centers to provide the redundancy and reliability you need from a messaging system.Each message can contain up to 8KB of text data. The only Unicode characters that are legal in a message are #x9 | #xA | #xD | [#x20 to #xD7FF] | [#xE000 to #xFFFD] | [#x10000 to #x10FFFF].Each queue can have a configurable visibility timeout, which is used to control access to the queue by multiple readers.Once an application reads a message from the queue, the message will not be visible to any other readers until the timeout period expires.
AWS Dashboard
The AWS Management Console provides a graphical user interface for Amazon EC2, Amazon Elastic MapReduce, and Amazon CloudFront, with additional Amazon infrastructure services
EC2 uses Xen virtualization. Each virtual machine, called an "instance", functions as a virtual private server in one of three sizes; small, large or extra large. Amazon.com sizes instances based on "EC2 Compute Units" the equivalent CPU capacity of physical hardware.One EC2 Compute Unit equals 1.0-1.2 GHz 2007 Opteron or 2007 Xeon processor.
An Amazon Machine Image (AMI) is simply a packaged-up environment that includes all the necessary bits to set up and boot your instance. Your AMIs are your unit of deployment. You might have just one AMI or you might compose your system out of several building block AMIs (e.g., webservers, appservers, and databases).Once you create a custom AMI, you will need to upload it to Amazon S3.
Amazon EBS volumes are created in a particular Availability Zone and can be from 1 GB to 1 TB in size. Once a volume is created, it can be attached to any Amazon EC2 instance in the same Availability Zone. Once attached, it will appear as a mounted device similar to any hard drive or other block device. At that point, the instance can interact with the volume just as it would with a local drive, formatting it with a file system or installing applications on it directly.
The Security Group defines which ports are opened in Amazon's firewall to allow incoming connections to your instance. For sub-accounts, the default group we provide allows ingress on the SSH, HTTP, and HTTPS ports (22, 80 and 443 respectively).Instances within the same security group will be able to communicate with each other. Amazon Security Groups are EC2 region-specific.You cannot use a Security Group that you created in EC2-US for an instance in EC2EU.
Amazon S3 is storage for the Internet. It is designed to make web-scale computing easier for developers.Amazon S3 provides a simple web services interface that can be used to store and retrieve any amount of data, at any time, from anywhere on the web. Store any amount of data inexpensively and securely, while ensuring that the data will always be available when you need it.
Amazon S3 Features
Reliability:It is designed to tolerate failures and repair the system very quickly with minimal or no downtime. Amazon provides a service-level agreement (SLA) to maintain 99.99 percent availability. Simplicity:S3 is built on simple concepts and provides great flexibility for developing your applications. You can build more complex storage schemes, if needed, by layering additional functions on top of S3 components.
Scalability:The design provides a high level of scalability and allows an easy ramp-up in service when a spike in demand hits your Web-scale applications.
Inexpensive:S3 rates are very competitive with other enterprise and personal data-storage solutions on the market.
A valid name can contain only lowercase letters, numbers, periods, underscores, and dashes.Though names can have numbers and periods, they cannot be in the IP address format. You cannot name a bucket 192.168.1.254. The bucket namespace is shared among all buckets from all of the accounts in S3. Your bucket name must be unique across the entire S3.
The name cannot end with a dash. For example, myfavorite.bucket.com is invalid.
2). Objects
Objects contain the data stored within the buckets in S3. Think of an object as the file you want to store. Each object stored is composed of two entities: data and metadata. The data is the actual thing being stored, such as a PDF file, Word document, a video file, etc. The stored data also has associated metadata for describing the object.Some examples of metadata are the content type of the object being stored, the date the object was last modified, and any other metadata specific to you or your application. The metadata for an object is specified by the developer as key-value pairs when the object is sent to S3 for storage.Unlike the limitation on the number of buckets, there are no restrictions on the number of objects. You can store an unlimited number of objects in your buckets, and each object can contain up to 5 GB of data.
3).Keys
Each object stored within an S3 bucket is identified using a unique key. This is similar in concept to the name of a file in a folder on your file system. The file name within a folder on your hard drive must be unique. Each object inside a bucket has exactly one key. The name of the bucket and the key are together used to provide the unique identification for each object stored in S3.
Every object within S3 is addressable using a URL that combines the S3 service URL, bucket name, and unique key. If you store an object with the key my_favorite_video.mov inside the bucket named nirvikar, that object can be addressed using the URL http://nirvikar.s3.amazonaws.com/
Security
Authentication: Ensures that the request is being made by the user that owns the bucket or object. Each S3 request must include the Amazon Web Services access key that uniquely identifies the user. Authorization: Ensures that the user trying to access the resource has the permissions or rights to the resource. Each S3 object has an accesscontrol list (ACL) associated with it that explicitly identifies the grants and permissions for that resource.
Integrity: Each S3 request must be digitally signed by the requesting user with an Amazon Web Services secret key. On receipt of the request, S3 will check the signature to ensure that the request has not been tampered with in transit.
Encryption: You can access S3 through the HTTPS protocol to ensure that the data is transmitted through an encrypted connection. Nonrepudiation: Each S3 request is time-stamped and serves as proof of the transaction.
Equivalent CPU capacity of 1.0-1.2 GHz 2007 opteron or 2007 Xeon processor
1.7 GB RAM, 1 EC2 compute unit, 160 GB instance storage, 32 bit platform 7.5 GB of RAM, 4 EC2 units(2 virtual cores with 2 EC2 compute units each) 850 GB instance storage, 64 bit platform 15GB, 8 EC2 compute units, (4 virual cores with 2 EC2 units each), 1690 GB of instance storage, 64 bit platform
Small Instance
Large Instance
Operating systems
Red Hat Enterprise Linux , openSUSE Linux , Ubuntu Linux , Fedora , Gentoo Linux, Debian Windows Server 2003 Oracle Enterprise Linux OpenSolaris Databases
Software
IBM DB2 , IBM Informix Dynamic Server, Microsoft SQL Server Standard 2005, MySQL Enterprise, Oracle 11g Apache HTTP, IIS/Asp.Net , IBM Lotus Web Content Management IBM WebSphere Portal Server
Web Hosting
Batch Processing
Hadoop, Condor, Open MPI IBM Webspehere, Jboss, Oracle WebLogic Server
Application Servers
Application Development
Usage 0.03 per hour 0.12 per hour 0.24 per hour 0.06 per hour
$4000
Internet data transfer charges All Data Transfer In $0.10 per GB Data Transfer out First 10 TB per Month $0.17 per GB Next 40 TB per Month $0.13 per GB 150 TB per Month $0.10 per GB Amazon EBS volumes $0.10 per GB-month of provisioned storage $0.10 per 1 million I/O requests Amazon EBS snapshots to Amazon S3 $0.15 per GB-month of data stored $0.01 per 1,000 PUT requests (when saving a snapshot) $0.01 per 10,000 GET requests (when loading a snapshot) Elastic IP addresses $0.01 per non-attached Elastic IP address per complete hour $0.00 per Elastic IP address remap first 100 remaps / month $0.10 per Elastic IP address remap additional remap / month over 100 Elastic load balancing $0.025 per Elastic Load Balancer-hour (or partial hour) $0.008 per GB of data processed by an Elastic Load Balancer Amazon Cloud Watch $0.015 per instance-hour (or partial hour)