seize the cloud
DESCRIPTION
クラウドを掴むような話amazon ec2とかs3とかxenとかhadoopとかTRANSCRIPT
![Page 1: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/1.jpg)
クラウドを掴むような話
Amazon EC2, S3, Xen, Hadoopとか
![Page 2: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/2.jpg)
目次
最近の話題Amazon Web Services Amazon Elastic Compute CloudAmazon Simple Storage ServiceXenHadoop
ほとんどリンク集です
![Page 3: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/3.jpg)
最近の話題
![Page 4: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/4.jpg)
2009/6/5からKDDIもサービス開始
http://www.kddi.com/corporate/news_release/2009/0324/index.html
![Page 5: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/5.jpg)
Amazon Web Services
沢山種類がある
![Page 6: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/6.jpg)
Amazon web services (1/2)
Infrastructure Services Amazon Elastic Compute Cloud (Amazon EC2)Amazon SimpleDBAmazon Simple Storage Service(Amazon S3)Amazon CloudFrontAmazon Simple Queue Service(Amazon SQS)AWS Premium Support
Payments & Billing ServicesAmazon Flexible Payments Sercie(Amazon FPS)Amazon DevPay
On-Demand WorkforceAmazon Mechanical Turk
![Page 7: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/7.jpg)
Amzaon web services (2/2)
Web search & Information ServiceAlexa Web SearchAlexa Web Information ServiceAlexa Top SitesAlexa Site Thumbnail
http://aws.amazon.com/products/Amazon Web Services LLCが提供するサービス
![Page 8: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/8.jpg)
Elastic Compute Cloud
クラウドコンピューティング
![Page 9: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/9.jpg)
Amazon Elastic Computer Cloud(EC2)
ネイティブに近いサーバ環境を提供するサービスxenベースのディスクイメージ(AMI)ユーザがOSを自由に選択することができる
SLA提供Annual Uptime Percentage of at least 99.95% during the Service Year.http://aws.amazon.com/ec2-sla/
Windowsサーバ,ms sql serverサポート(βサービス)Amamzon Elastic Block Store for Amazon EC2(βサービス)
データを永続化データベースとしての利用が一般的
![Page 10: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/10.jpg)
99.95%の信頼性ってどれぐらい?
99.95% 99.995%99.9995%99.99995%
年:4.38時間,停止可 2重障害だとアウト年:26.28分,停止可年:2.628分,停止可年:15.768秒,停止可 キャリアグレード
![Page 11: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/11.jpg)
EC2 Instance Type
Standard InstancesSmall Instance (default)Large InstanceExtra Large Instance
High-CPU InstancesHigh-CPU Medium InstanceHigh-CPU Extra Large Instance
http://aws.amazon.com/ec2/instance-types/
![Page 12: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/12.jpg)
Standard Instances (1/2)
Small Instance1.7GB mem1 EC2 Compute Unit
1 virtual core 10+150GB storage32bit platform$0.10/h$0.125/h (windows)
Large Instance7.5GB mem4 EC2 Compute Units
2 virtual cores x 22x420+10GB storage64bit platform$0.40/h$0.50/h(windows)
![Page 13: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/13.jpg)
Standards Instances (2/2)
Extra Large Instance15GB mem8 EC2 Compute Units
4 virtual cores x 24x420+10GB storage 64bit platform$0.80/h$1.00/h (windows)
![Page 14: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/14.jpg)
High-CPU Instances
High-CPU Medium Instance1.7GB mem5 EC2 Compute Unites
2 virtual cores x 2.5350GB storage 32bit platform$0.20/h$0.30/h(windows)
High-CPU Extra Large Instance
7GB mem20 EC2 Compute Unites
8 virtural cores x 2.51690GB storage$0.80/h $1.20/h(windows)
![Page 15: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/15.jpg)
トラフィックも課金対象
![Page 16: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/16.jpg)
詳細な料金はこちらで把握
http://calculator.s3.amazonaws.com/calc5.html
![Page 17: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/17.jpg)
申込方法
面倒なのでここでは説明しません日本語での説明は以下が秀逸です
ってか,元々そこを読んでもらえばいいんだけどhttp://d.hatena.ne.jp/rx7/20080528/p1
![Page 18: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/18.jpg)
制御方法
提供されたjavaベースのCUIで制御ブラウザのアドオンで制御AWSが提供するwebサービスで制御サードパーティのwebサービスで制御
![Page 19: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/19.jpg)
提供されたコマンドラインツール
http://docs.amazonwebservices.com/AWSEC2/latest/DeveloperGuide/
![Page 20: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/20.jpg)
ブラウザ addon EC2用
Elasticfox
![Page 21: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/21.jpg)
AWSが提供するwebサービス
http://console.aws.amazon.com
![Page 22: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/22.jpg)
サードパーティのwebサービス利用
![Page 23: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/23.jpg)
Amazon Simple Storage Service
![Page 24: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/24.jpg)
Amazon Simple Storage Service
1Bから5GBまでのデータの固まりを読み書き消去保存できるデータ群は無制限米国と欧州に保存可能Amazon S3 Service Level Agreementで保証
http://aws.amazon.com/s3-sla/
![Page 25: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/25.jpg)
料金体系
![Page 26: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/26.jpg)
ブラウザのaddon S3用
S3 Organizer
![Page 27: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/27.jpg)
利用例:S3を利用したバックアップツールとか
http://jeremy.zawodny.com/blog/archives/007641.html
![Page 28: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/28.jpg)
利用例:S3FS
http://code.google.com/p/s3fs/wiki/FuseOverAmazon
![Page 29: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/29.jpg)
利用例:S3FS for Hadoop
http://wiki.apache.org/hadoop/AmazonS3
![Page 30: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/30.jpg)
開発中はParkPlaceで (S3 Clone)
http://github.com/why/parkplace/tree/master
![Page 31: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/31.jpg)
EC2/S3以外のサービス
ざっと紹介
![Page 32: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/32.jpg)
Amazon SimpleDB
Amazon謹製 Dynamohttp://www.allthingsdistributed.com/2007/10/amazons_dynamo.htmlCTO Werner Vogels らが開発
key-valueストア(ハッシュテーブル)スケールアウト(数百台とか)障害に強い(マシン障害のみならずラック障害にも)
my %hash = ( key1 => "value1", key2 => "value2");
![Page 33: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/33.jpg)
Amazon CloudFront
CDNサービス米国8箇所,ロンドン,ダブリン、アムステルダム,フランクフルト,香港,東京1000Mbps, 1000req/sのピーク負荷に耐える
![Page 34: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/34.jpg)
Amazon Simple Queue Service
信頼性が高く,高度にスケーラブルなキュー環境分散アプリケーションのコンポーネント同士のメッセージバッファキューに関しては以下の説明を読んでください
http://japan.cnet.com/blog/kenn/2004/11/05/entry_amazon_simple_q/
![Page 35: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/35.jpg)
Payments & Billing Services
Amazon Flexible Payments Service (Amazon FPS)PaypalとGoogle Checkoutに対抗する決裁サービスクレジット/デビットカード,Amazon PaymentsAmazonでつかっている情報を利用
Amazon DevPayEC2上で動かすサービスに対して開発者が課金Amazon EC2 Machine Image (AMI) 販売
![Page 36: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/36.jpg)
On-Demand Workforce
Amazon Mechanical Turk沢山の人にタスクをこなしてもらうためのマーケットQ&Aだけではない例えば...
![Page 37: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/37.jpg)
利用例:Help Find Jim Gray
http://www.allthingsdistributed.com/2007/02/help_find_jim_gray.html
![Page 38: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/38.jpg)
利用例:Ten Thousand Cents
http://www.tenthousandcents.com/index.html
![Page 39: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/39.jpg)
サービスが止まってないか?
簡単な死活監視
![Page 40: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/40.jpg)
AWS Service Health Dashboard
http://status.aws.amazon.com/
![Page 41: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/41.jpg)
何げにでかいこと書いてる日経BP
http://itpro.nikkeibp.co.jp/article/EVENTS/20090309/326164/
![Page 42: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/42.jpg)
Xen
EC2はXenベース
![Page 43: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/43.jpg)
最近の話題
Xenネタで
![Page 44: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/44.jpg)
プライベートクラウド
普段はローカルな環境のXenでゲストを動かしておき,必要な時にはEC2にそのゲストを投げる OpenNebula
http://www.opennebula.org/doku.php
![Page 45: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/45.jpg)
パブリッククラウド
Amazon EC2/S2互換インタフェース Eucalyptus
http://eucalyptus.cs.ucsb.edu/wiki/EucalyptusOverview
![Page 46: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/46.jpg)
XenServer無料ダウンロード開始
http://deliver.citrix.com/go/citrix/wbFreeXenServer
![Page 47: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/47.jpg)
概要
ドキュメントが実体においついてない
![Page 48: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/48.jpg)
http://tinyurl.com/dbkul7
![Page 49: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/49.jpg)
Xenのネットワーク周り
二つの仮想スイッチ
![Page 50: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/50.jpg)
仮想ネットワーク(Xenbr)
![Page 51: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/51.jpg)
仮想ネットワーク(Virbr)
![Page 52: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/52.jpg)
こういうのもでてきた
http://www.linode.com/
![Page 53: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/53.jpg)
Hadoop
試しにインストールはしてみたけどまだよくわかってない
![Page 54: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/54.jpg)
使っているところ
A9.com(Amazon)AdknowledgeBaiduCornell University Web LabFacebookNeptuneNetSeerPowerset/MicrosoftSearch WikiaThe Lydia News Analysis ProjectVisible TechnologiesYahoo!
1-10050-20010-500100600200<1000<40012517+10315020,000
http://wiki.apache.org/hadoop/PoweredBy
![Page 55: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/55.jpg)
年内に本が出る
http://oreilly.com/catalog/9780596521998/index.html#top
![Page 56: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/56.jpg)
日本語解説
Hadoop, hBaseで構築する大規模分散データ処理システムhttp://codezine.jp/article/detail/2448
複数マシンへHadoopをインストールするhttp://codezine.jp/article/detail/2699
Hadoopのインストールとサンプルプログラムの実行http://codezine.jp/article/detail/2485
blogeyeの実装に学ぶ、Amazon EC2/S3でのHadoop活用術https://codezine.jp/article/detail/2841
mapreduceに対するnaoya氏の解説http://d.hatena.ne.jp/naoya/20080511/1210506301
Hadoop Streamingに対するnaoya氏の解説http://d.hatena.ne.jp/naoya/20080513/1210684438
![Page 57: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/57.jpg)
おまけ
Googleファンの方向け
![Page 58: Seize The Cloud](https://reader034.vdocuments.net/reader034/viewer/2022042713/5482b415b4af9f8c0d8b48c1/html5/thumbnails/58.jpg)
Google AppEngine クローン
http://code.google.com/p/appscale/