SLES11!"#$%
Xen&'(+HA)*+,-.!
/0&'(123456789:;<6=>CEO
?@A*B7CDEFD
GH7I
JKLMNO3456
/0&'(1234567PQ!
•! 6RL/0&'(123456 –! STRLVirtualTech Japan Inc.
–! UVL/0&'(12WVTJ
•! XYL2006Z12[
•! \0]L14,250,000^
•! 06L_`abcdbc1-1-10
•! :;<LGH7Ie89:;<6=>CEOf •! gh7ije:;<CTOf •! +,klL8Remno5.5Rp&'(12q.rstuv!$f •! URLLhttp://VirtualTech.jp/
•! &'(12wx$%EFyz{|} –! &'(12wx$%~���
–! &'(12wx����l���v�|}
–! &'(12��-���+���"#!
/0���Y�
&'(12q�56e�6��f!
2
�-!
&'(��"#���,O����!
X�!•! X�
–! ���o+���t��Ak���) !v¡¢£��¤s !¥¦��X�
–! §¨©��ª¡*sus«eNs¬�)f
•! �-
–! &'(�¢®��¤s©k£�t�¯°
–! &'(±²eP2V�@��³«���¤sf
•! ´µ¶·
–! rstuv¸¹!
–! 12�����¯°
–! Xen��+º�»�NO����!
´µ¶·!
3 Ns¼�u®��*O½�s+�k¡¾�����¿¯°!
High Availability Extension7PQ!
•! SUSE Linux Enterprise 11!�HAeHigh
Availabilityf��"#��À�Á©k£�t
•! OpenAIS�N�+
•! DRBDyz{OCFS2�����
•! GUI!XÃÄÅpÆÇ!
È!
ÉÊ�ËÌ��!
•! OS:SUSE Linux Enerprise 11eÍÎ SLES 11f
–!ÏÅÐXenÑÒ³s+��OwÓÔ
•! ÁÂ�l�LSUSE Linux Enterprise 11 High
Availability ExtensioneÍÎ SLES 11 HAEf
–!³?�tlÕ³O�~Ö+�wº×��ØyÙ
•! HA��Ú¡*³¢/ÛÜs¼¢"Ý!"#
–!¡*³¢/¡*³¢ÚÞËÌ
–!ßà!á%eÚâãf
ä!
HA��"#åæ!
1.! SLES 11 HAE�³s+��O
2.! /etc/hosts!�Ö+�RXÃ
3.! NTP�çµ��Ö+�è�éêëì
4.! OpenAIS�)*+,XÃ
5.! DRBDXÃ
6.! )*+,¢��+í�DRBDîïÁÂ
7.! &'�seÍÎvmfðÝ
8.! )*+,¢��+í�vmÁÂ!
ñ!
SLES 11 HAE³s+��O!
1.! òÀ SLES 11�³s+��Oóª+)ô�ÙÚISO³?�t�µõ�ØyÙ
2.! [YaST]![�l���v]![v»ös÷ø]�)¢k)
3.! v»ösÁÂ��ªù�»púû$%�!oüýwþÿØð��!À%
4.! "#��l���v�ÁÂ![$Ƶ%]pÁÂ&'Ø(%�!¬�k)�-'Ø)*
5.! ³s+��O+#wSLES 11�³s+��Oóª+)�Q,&'%�!oóª+)�-'%�ISO³?�t�üÃ�Ø)*
-!
R./0�XÃ!
xen1yz{xen2!XÃ
1.! [YaST]![Ak���)��1+]![Ö+�R]�úû
2.! [ÁÂ]�)¢k)
3.! IPv»�+¾Ö+�R¾Ö+��r³¢v+�-K
–! 192.168.0.1 xen1.example.com xen1
–! 192.168.0.2 xen2.example.com xen2
2!
NTP���XÃ!
xen1!XÃ
1.! [YaST]![Ak���)��1+]![NTP��XÃ]�úû
2.! NTPó�3s��+��úûéw|4$%zmXÃ
3.! ëì,³¡56�[Undisciplined Local Clock(LOCAL)]�78
4.! [9:]!;�ÜO<=);k)�XÃ
5.! [»*³���>]![Stratum]�5wÓÔ!
?!
NTP)*³vs�XÃ!
xen2!XÃ
1.! [YaST]![Ak���)��1+]![NTP
��XÃ]�úû
2.! NTPó�3s��+��úûéw|4$%zmXÃ
3.! [ÁÂ]!ëì@A�XÃw[���]�¬�k)�oxen1�v»�+�-K
BC!
OpenAISÛk�vk¡e¡*³¢f!
xen1!XÃ
1.! [YaST]![DEF�O]![)*+,]�úû
2.! [Communication Channel]!çµ$%)*+,M�»�Ak���)v»�+oO¬§¨+�v»�+oO¬§¨+�����Xà –! Bind Network AddressL192.168.0.0
–! Multicast AddressL224.0.0.1
–! Multicast PortL5405
3.! M�»�IDw1�XÃ
4.! rrp mode�activewXÃ!
BB!
OpenAISÛk�vk¡eÛÜs¼¢f7!
xen2!XÃ
1.! [YaST]![DEF�O]![)*+,]�úû
2.! [Communication Channel]!çµ$%)*+,M�»�Ak���)v»�+oO¬§¨+�v»�+oO¬§¨+�����Xà –! Bind Network AddressL192.168.0.0
–! Multicast AddressL224.0.0.1
–! Multicast PortL5405
3.! M�»�IDw2�XÃ
4.! rrp mode�passivewXÃ!
BG!
)*+,�úû¾H)!
¡*³¢/ÛÜs¼¢IJ!XÃ
1.! KL�úû
2.! M�ù�haclusterw©+��»�Xà –! xen1# passwd hacluster
–! xen2# passwd hacluster
3.! IJ�Ö+��KLzNÍÎ�ºs»!)*+,�úû –! xen1# service openais start
–! xen2# service openais start
4.! ¡*³¢Ö+�!)*+,�GUIXÃF�O�úû –! xen1# crm_gui &
5.! Connection!)*+,wH) –! Server:127.0.0.1
–! User NameLhacluster
–! PasswordLXÃ��©+��»
BO!
)*+,�P0XÃ!
1.! )*+,XÃF�O�QwR%[CRM
Config]�)¢k)
2.! [No Quorum Policy]XÃ�[ignore]wÓÔ
–!DRBD�Sµ�o)T�*��Sµ�½(�À
3.! [Stonith Enabled]�¬�k)�U$
–!STONITH�çV½(�À!
BÈ!
DRBDµîï�W¶!
•! [YaST]!]�+��]![óª+)�àX]�úû
•! LVMµ©��ª�¤s�ÁÂ
•! B¢®��ÄÅ!YÅB¢®���ÁÂ
–!B¢®��«O�¡lv4drbd�ÁÂ
–!YÅB¢®��vmconfigZvmimages�ÁÂ
–! /dev/lv4drbd/vmconfig 3GB
–! /dev/lv4drbd/vmimages 40GB!
Bä!
DRBD�XÃ(vmconfig)!
•! [YaST]![DEF�O]![Drbd]�úû
•! ��+XÃ�78�oAdd�)¢k)
•! DRBD¢��+vmconfig�ÁÂ
Node 1! Node 2!
\[R! vmconfig!
Name! xen1! xen2!
Address:Port! 192.168.0.1:7789! 192.168.0.2:7789!
Device! /dev/drbd0! /dev/drbd0!
Disk! /dev/lv4drbd/vmconfig! /dev/lv4drbd/vmconfig!
Meta-disk! internal! internal!
Syncer Rate! 500M(Advanced Config!XÃ�½(Z250KB)!Bñ!
DRBD�XÃ(vmimages)!
•! DRBD¢��+vmimages�ÁÂ
Node 1! Node 2!
\[R! vmimages!
Name! xen1! xen2!
Address:Port! 192.168.0.1:7790! 192.168.0.2:7790!
Device! /dev/drbd1! /dev/drbd1!
Disk! /dev/lv4drbd/vmimages! /dev/lv4drbd/vmimages!
Meta-disk! internal! internal!
Syncer Rate! 500M(Advanced Config!XÃ�½(Z250KB)!
B-!
DRBD�úû!
¡*³¢/ÛÜs¼¢!DRBD�úû
1.! ¡*³¢��ÛÜs¼¢w/etc/drbd.conf�º×�
2.! KL�úû
3.! DRBD�úû –! xen1# service drbd start
–! xen2# service drbd start
4.! ?,ó�,�ðÝ –! xen1# drbdadm create-md vmconfig
–! xen1# drbdadm create-md vmimages
–! xen2# drbdadm create-md vmconfig
–! xen2# drbdadm create-md vmimages
B2!
DRBD¢��+��ì(!
1.! ¡*³¢!DRBD¢��+��ì( –! xen1# drbdadm -- --overwrite-data-of-peer primary all
2.! DRBD�\]pUpToDatew½%��W^ –! xen1# service drbd status
–! xen2# service drbd status
3.! ¡*³¢!/dev/drbd0yz{/dev/drbd1��ì( –! xen1# mkfs –t xfs /dev/drbd0
–! xen1# mkfs –t xfs /dev/drbd1
4.! ¡*³¢/ÛÜs¼¢IJ!DRBD�ó�3s�_` –! )*+,¢��+Z�Øúû&a%�À
–! # service drbd stop
B?!
DRBD�)*+,¢��+wÁÂ!
1.! ¡*³¢Ö+��KLzNCUI)*+,XÃF�O�úû
–! # crm config
2.! DRBD�)*+,¢��+wÁÂ
–!º×b!c�de
–! 1*�f'gphi�wjõ!
GC!
vmconfigµXÃkl!
•! primitive vmconfig ocf:heartbeat:drbd params drbd_resource=vmconfig op monitor role=Master interval=60s timeout=30s op monitor role=Slave interval=60s timeout=30s
•! ms ms-vmconfig vmconfig meta clone-max=2 notify=true globally-unique=false target-role=stopped
•! primitive fs-vmconfig ocf:heartbeat:Filesystem params fstype=xfs directory=/etc/xen/vm device=/dev/drbd0 meta target-role=stopped
•! order ms-vmconfig-before-fs-vmconfig mandatory: ms-vmconfig:promote fs-vmconfig:start
•! colocation fs-vmconfig-on-ms-vmconfig inf: fs-vmconfig ms-vmconfig:Master
•! commit
•! quit
GB!
vmimagesµXÃkl!
•! primitive vmimages ocf:heartbeat:drbd params drbd_resource=vmimages op monitor role=Master interval=60s timeout=30s op monitor role=Slave interval=60s timeout=30s
•! ms ms-vmimages vmimages meta clone-max=2 notify=true globally-unique=false target-role=stopped
•! primitive fs-vmimages ocf:heartbeat:Filesystem params fstype=xfs directory=/etc/xen/vm device=/dev/drbd0 meta target-role=stopped
•! order ms-vmimages-before-fs-vmimages mandatory: ms-vmimages:promote fs-vmimages:start
•! colocation fs-vmimages-on-ms-vmimages inf: fs-vmimages ms-vmimages:Master
•! commit
•! quit
GG!
DRBD¢��+úû!
1.! ¡*³¢!)*+,�GUIXÃF�O�úû
–! # crm_gui
2.! Connection!)*+,wH)
3.! DRBD�¢��+pÁÂ&'Ø(%iZ�W^
4.! master¢��+�78�Ø?u®��úûB,s�)¢k)�Ø¢��+�úû
5.! KLzNdfºs»�m*�ØÍÎw�s�&'Ø(%iZ�W^
–! /dev/drbd0 ! /etc/xen/vm
–! /dev/drbd0 ! /var/lib/xen/images!
GO!
&'�s�ðÝ!
1.! [YaST]![&'(]![&'�s�ðÝ]
�úû
2.! &'�s�ðÝ
–!&'�sRLsles11-ha
–!OS:SLES11
–!n�oÚpqXÃ
•! Windowsô)*+,¢��+Z�ØrsÆÇ!
GÈ!
&'�s�)*+,¢��+wÁÂ!
•! ¡*³¢Ö+��KLzNCUI)*+,XÃF�O�úû
–! # crm config
•! &'�ssles11-ha�)*+,¢��+wÁÂ
–!º×b!c�de
–! 1*�f'gphi�wjõ!
Gä!
&'�sµXÃkl!
•! primitive sles11_ha ocf:heartbeat:Xen params name="sles11-ha" xmfile="/etc/xen/vm/sles11-ha” op monitor interval="10s” op start interval="0s" timeout="30s” op stop interval="0s" timeout="300s"
•! colocation sles11_ha-with-fs-vmconfig inf: sles11_ha fs-vmconfig
•! order sles11_ha-after-fs-vmconfig inf: fs-vmconfig:start sles11_ha:start
•! colocation sles11_ha-with-fs-vmimages inf: sles11_ha fs-vmimages
•! order sles11_ha-after-fs-vmimages inf: fs-vmimages:start sles11_ha:start
•! commit
•! quit
Gñ!
HAûðW^!
1.! &'�sp¡*³¢!ûð�Ø(%iZ�W^
2.! ¡*³¢/ÛÜs¼¢IJ!GUI)*+,XÃF�O�úû�o)*+,�\]�tu
3.! ¡*³¢�v[�OFFw$%
4.! ÛÜs¼¢w!&'�spúû$%iZ�W^
G-!
ZÀ!
•! XÃåæ�xÝyZ�ØÚ75%z�(
•! XÃklpå{á½�p|Ó
•! }ÿÙN:N~�ZZØô��w½%
•! GUIXÃF�Op�S
–!�Ç�wÚ100%!Ú½(p
–!GUIÚzÙ�n%�!oCUIôçmZ�(!
G2!
&'(w�(����(
•!���»���Z~e²Va����&'(�¢®��¤s�ó3ôÆÇ
��ºs�O�ªs«m�#
y��wy�(²VaÙ�&( 29
y�(²Va�!
�&'(���"#��(pohiw��$'�((�ã�!
âÚ��w¿��Ù�&(!
日本仮想化技術株式会社
����������� ¡¢£¤¥�¦§��!¨¡¢¤¨©���� ¡¢£¤¥�¦§�!CäCª-ä-BªCä2È!
30
y «!
SSDÚ¬(�ã!
A.!SSDÚ�&nm�
–!$¬½*s¼�v)Û+
–!®¯vK
–!}°
B.! SSD�-Úéì±²ã
–! �m³p´½(
–! � �»*³�µ¶p$(
–!{᷸ʹwºí�»¼!
32
<¥!
TPC-B Ns¬�)½¾!
33
<¥!
Ns¬�)m*��!
•! SASóª+)L2.5” 36.4GB 15krpm " 2¿
•! SSDLIntel X25-E(SLC) 32GB " 2¿ –! RAIDºs�;�*��§¨k�®ÚOff
–! óª+)ÀÁ�§¨k�®�On/Off�ÂÃ
•! FC SANLHP MSA1000 –! SCSI 146GB 10krpm " 14¿wz%RAID 5
–! ºs�;�*�w512MB§¨k�® •! Cache OffLR50%/W50%
•! Cache OnLR0%/W100%
•! PostgreSQL 8.3.7wz%Ns¬�) –! pgbench -c 20 -t 3000
–! 20Êm*�o11ÊÃ20Ê�ÄÅÆ�Çs!
34
<¥!
•! ÈCPUpÉÊë%ÇeËp4%Ìyf
•! CPUºv¹Í&'CPU²�¹p+ô�(½¾Z½ÿØ(%
•! Opteron�8VMÚÎ�«Ú´½(poÏÐ�CPUçµÑÚ68%Ìy!ÒKRNe4ºvÒNf
%ÇÓÔ!
35
Opteron 2435
(2.6GHz)!
Xeon X5570
(2.93GHz HT On)!
Xeon X5570
(2.93GHz HT Off)!
8VM! 1553.1! 68.6%! 2175.3! 96.0%! 2180.3*! 96.2%!
12VM! 2265.4*! 100%! 2207.5! 97.4%! 2171.8! 95.9%!
16VM! 2249.1! 99.3%! 2248.7*! 99.3%! 2166.8! 95.6%!
<¥!
®¯vKÓÔ!
•! Ns¬�)é�+|®¯vK!ÓÔ
•! OpteronÚXeonw@�Ø16%��18%®¯vKp(
•! Hyper Threadingp%ÇÕww@$%®¯vK�ÖÑpR N�Ù½((3.8%:9.4%)!
36
Opteron 2435
(2.6GHz)!
Xeon X5570
(2.93GHz HT On)!
Xeon X5570
(2.93GHz HT Off)!
8VM! 200W! 87.3%! 259W! 113.1%! 253W*! 110.5%!
12VM! 229W*! 100%! 272W! 118.8%! 258W! 112.7%!
16VM! 229W! 100%! 279W*! 121.8%! 255W! 111.4%!
<¥!