amazon web services lection 2
TRANSCRIPT
Amazon web serviceEC2 & S3 Overview
EC2EC2 is an instance that is used for all compute work inside AWS.
It can be used as:
●Separate virtual machine with OS
●Load Balancer
●Part of RDC and other clusters
●etc
AMIOperation System + Software = Amazon
Machine Image●Used for app scaling purposes
●Migration between regions and AZ
EC2 instances types
● General purpose● Compute optimized● Memory optimized● Storage optimized
Storage● Elastic Block Storage (EBS)● Instance Store● Elastic File System (EFS)● Simple Storage Service (S3)
Instance StoreInstance store provides temporary block-level
storage for your instance.Instance store is ideal for temporary storage of information that changes
frequently, such as buffers, caches, scratch data, and other temporary content, or for data that is replicated across a fleet of instances, such as a load-balanced pool of web servers.
The data in an instance store persists only during the lifetime of its associated instance. If an instance reboots (intentionally or unintentionally), data in the instance store persists. However, data in the instance store is lost under the following circumstances:
● The underlying disk drive fails
● The instance stops
● The instance terminates
Elastic Block Store
EC2
EBS
Elastic Block Store●EBS volumes are highly available and reliable storage volumes that
can be attached to any running instance that is in the same Availability Zone.
●Encryption available (temp EC2 store -> EBS)
●Volumes are up to 16TiB
●Types: ○ General purpose SSD (3 IOPS/GiB; up to 10,000 IOPS and 160 MB/s of throughput)
○ Provisioned IOPS SSD (up to 20,000 IOPS and 320 MB/s of throughput)
○ Throughput Optimized HDD (throughput of up to 500 MiB/s,)
○ Cold HDD (throughput of up to 250 MiB/s, )
●Can create point-in-time snapshots of EBS volumes, which are persisted to Amazon S3
●EBS volumes are created in a specific Availability Zone, and can then be attached to any instances in that same Availability Zone.
Elastic File SystemAmazon EFS provides scalable file storage
for use with Amazon EC2.
Main feature is to easily customize file system for multiple instances.
VPCINTERNET
AWS
VPC
VPCVPC - logically isolated cloud section in AWS.
Features:●All instances launches inside VPC●Separation for public and private networks●Ability to connect to private network via VPN●Using S3 locally
SUBNET SUBNET
EC2 EC2 EC2 EC2
10.0.0.1 10.0.0.2 10.0.1.1 10.0.1.2
VPC
Network Access Control List
Routing Table
Network Access Control List
Routing Table
Public Subnet
EC2 EC2
EC2
10.0.0.1 10.0.0.2
VPC
NAT Gateway
S3Simple Storage Service - service for storing
files.
S3 stores files in any region you specify.
Maximum object size by single upload 5 Terabytes
S3
FILE
Metadata
Object
File typeModified date
*.*for example: *.jpg; *.png; *.js;
Object Object Object
Object Object Object
Bucket
Bucket features●Bucket names should be unique through all AWS
●Bucket name is used to generate link to get access from browser or app
●Cross-region replication (copy to only one other region)
Uploading to S3
Console
small number of file uploading
CLI
recursive directory uploading
SDK
Dynamic in Code uploading
CORS
Amazon re:Invent 2016
Amazon re:Invent 2016
During 2016 have already been launched or will have
been launched soon ~1000 new services
Amazon re:Invent 2016Computing:
● New Instances:
○ R4 - up to 64 vCPUs and 488 GiB of memory
○ t2.xlarge (16 Gib of memory) and t2.2xlarge(32 Gib of memory)
○ F1 - give you access to FPGA. You can write code that runs on the FPGA and speeds up many types of genomics, seismic analysis, financial risk analysis, big data search, and encryption algorithms by up to 30 times
○ New C5 Instances - Intel’s brand new Xeon “Skylake” processor (up to 72 vCPUs and 144 GiB of memory.)
● Elastic GPUs - EC2 instance types, with your choice of 1 GiB to 8 GiB of GPU memory and compute power to match.
● New I3 Instances - instances will be equipped with fast, low-latency, Non Volatile Memory Express (NVMe) based Solid State Drives. They’ll deliver up to to 3.3 million random IOPS at a 4 KB block size and up to 16 GB/second of disk throughput ( up to 64 vCPUs, 488 GiB of memory, and 15.2 TB of storage ).
Amazon Elastic Beanstalk manages●EC2 instance prefered
●S3 connection
●SNS, Alarms
●Load Balancing
●Auto Scaling
●Application Health Monitoring
You just need to:● Select platform
●Select instance type
●Select additional services to use
Amazon re:Invent 2016Amazon LightSa
il
Amazon re:Invent 2016Amazon Athena - a new serverless query service that makes it
easy to analyze large amounts of data stored in Amazon S3 using Standard SQL.
Features:● You pay only for the queries that you run.
● Behind the scenes, Athena parallelizes your query, spreads it out across hundreds or thousands of cores, and delivers results in seconds
● Queries are expressed in standard ANSI SQL and can use JOINs, window functions, and other advanced features
● Can query data in many different formats including JSON, CSV, log files, text with custom delimiters, Apache Parquet, and Apache ORC.
● You can run your queries from the AWS Management Console or from a SQL clients such as SQL Workbench, and you can use Amazon QuickSight to visualize your data.
Amazon re:Invent 2016Amazon Aurora Update – PostgreSQL Compatibility
Amazon Aurora – Cost-Effective MySQL-Compatible Database Engine for Amazon RDS
Amazon re:Invent 2016Other innovations:
●AWS Snowmobile (Data transferring)
●AWS Greengrass (IoT)
●AI & Machine Learning:○ Amazon Polly – Text to speech (47 Voices and 24 Languages)
○ Amazon Recognition – Image Detection and Recognition Powered by Deep Learning
○ Amazon Lex – Automatic Speech Recognition