HPCI"ÛżƎƃŪūŧĘÆRÏŘĀþœ¦à�

 i¥Y]%]õNħwSŻƦŽƨ%

·¸Ó��%

ŧůƂƘƀűűƠŪƄŸƦƖŹŪƙƭƫƬƭƯ;²ęY]�

ŧŹūƦž�

•  High%Performance%Compu3ng%Infrastructure%(HPCI)%•  HPCI"ÛżƎƃŪūŧĘÆRÏ%– 1ÆŸƅơŮ%

•  RENKEI<VPEŘĀþœaö%•  HPCI"ÛżƎƃŪūŧĘÆRÏŘĜ %

•  ċµ��ªĢŅœŖ.�ņţŀŎŕHPCƞƨŷgŀķ$NŘHPCơżƨźť8Àşł1ÆŒŁŢ�2œ äŜť� Ňķ��ʼnŢ�

•  $Nú¨ŒòðÍÔÚĿŠYú¨ÔÚķÅ¥1ÆŖŤŌŢklĻHPC1Æť���

HPCI�

-(ƮHPCI¶ ­ĦŵƦżƨŸŧƙĸHPCIœŋئàť�dʼnŢŵƦżƨŸŧƙŘ'�:ŖHŃő−�ãSI−Ĺşš�

h?ps://www.hpci<office.jp/�

HPCIŒ1ÆŒŁŢŶƨƌź�

-(ƮHPCI¶ ­ĦŵƦżƨŸŧƙĸHPCIœŋئàť�dʼnŢŵƦżƨŸŧƙŘ'�:ŖHŃő−�ãSI−Ĺşš�

HPCIŒ1ÆŒŁŢŶƨƌź�

-(ƮHPCI¶ ­ĦŵƦżƨŸŧƙĸHPCIœŋئàť�dʼnŢŵƦżƨŸŧƙŘ'�:ŖHŃő−�ãSI−Ĺşš�

•  ċµ��ªĢŀ�ʼnþÞªċµ�•  100PBoŘlQ&�źƃƣƨŹƩ&ÆźƃƣƨŹƪ�•  þÞċµķźƃƣƨŹċµŚŘŸƦŲƢŶũƦŮƦ�•  ƥƦźƃƀƐŘćıÈĈƧŧůŪƦƃ�

HPCI1ÆìŘþÞª1ÆŸƅơŮ(x`)�

1Æì<.� 1ÆŸƅơŮ� tùÃT�

uÆHPCÔÚì% •  HPCċµťÆĻŌYú¨Ö]~õþÞƩƂƨŽý¡ƧŸƘƝƣƨŸƟƦÝƪťaô%

•  ¾`OSƧƠũƏƠơŖ�\ʼnŢŧƐơť1Æ%•  HPCċµŖŧűŻźʼnŢƖƨŽƢŶƨƌźťaô%

①Yú¨źƋŵƦ�

②ij�İķb�Ŗ1ÆŒŁŢŶƨƊ%

•  {¢%ĠƧƐƤŹūűƃƚƦƊƨ*wS&�ŘŌŝŘWebƖƨŽƢťĘÆ%CSáÔÚì�

•  root©ĤŀtùŕķOSƣƒƢŘÔÚĠË#•  ƠũƏƠơĠËŘŌŝķø�ØOSŒŘ¤Ăťa�%•  .�ŸźƁƙŘĠËťʼnŢŌŝķX�¹ŖŲƤƨƊƢIPť�ŐŶƨƊťĜ �

③ßÂì©Ĥť�ŏŌŶƨƊ�

④ßÂì©Ĥť�ŏŌŶƨƊĿŠŕŢķlQ.�ÃT�

HPCIŸźƁƙ¦{ªĢŘźƋŵƦŀ%ŶƖƨƃŒŁŢŘřńŘÃTŘŜ�

þÞªŸźƁƙ1ÆŸƅơŮ�

HPCI4ĎŘJHPCN%(]ħYú¨wSRÏ&F1ÆƧ&FÔÚ�¹)ÔÚćıŞķ%�ŘHPCÔÚƐƤŹūűƃŘ*bť!Ŗ.IJ�

HPCI"ÛżƎƃŪūŧĘÆRÏ%(HPCI<AE)�

•  «ŘÃTť��ŇķHPCþÞªċµŘ1±ÆŘ�ėķijmŕŸźƁƙżƎƃŪūŧŘÔÚĠËť��ʼnŢŶƨƌźRÏ%–  ②ij�İķb�Ŗ1ÆŒŁŢŶƨƊ%–  ③ßÂì©Ĥť�ŏŌŶƨƊ%–  ④lQ.�ÃT%

•  ②ķ③ŖĢŇőř]õƧKÆűƠŪƄ1ÆŀBíŒĺŢŀƧƧƧ%–  HPCIċµœŇőřķÁ¿ķ%;YŧůƂƘƀűűƠŪƄŘŜ%

–  KÆűƠŪƄřķ�HPCIċµœŘ%Ĕ�ŖƕƃƢƇƀű%&%SINETªí%رÆ�Bí%

-(ƮHPCI<Officeĸ��ªĢœƉƨƄŪūŧƧżƎƃŪūŧċµ�üĹşš�

HPCI<AE1ÆŸƅơŮ�

1.  ÔÚ{¢Ř%ĠķƂƨŽ&�%

2.  ƐƣƧƖźƃ,Â%

3.  ŸźƁƙżƎƃŪūŧŘĠË�

1.%ÔÚ{¢Ř%ĠķƂƨŽ&��

•  ÔÚƐƤŹūűƃ®ŘWebŶƨƊť��%–  CMSƋƀųƨŹťd#ŇŌwS&�Ŷũƃ%

•  HPCI&ÆźƃƣƨŹœĖ�ŇŌƖƨŽƢť¦à%– ŸƘƝƣƨŸƟƦŘ-6ƂƨŽŕŔŘYbĝƂƨŽťWebŒ&�Ƨ%Ġ�

HPCI&Æ%źƃƣƨŹ�

ƐƤŹūűƃ%Web%ŶƨƊ%

HPCI<AEŖşš��%

ƐƤŹūűƃ1ÆźƃƣƨŹįQŖŧű%Żź©ŘĺŢŧůŪƦƃŒƗŪƦƃ�

Mount�1Æì/%Webģüì�

WebƏƠŪŹƦŲ�HPCźƃƣƨŹƂƨŽ%ĆŜ�Ł�

2.%ƐƣƧƖźƃ,Â�•  �vŕŔŘÂÇŖşšķ%źƋŵƦ�ŒŘ1ÆŀĪ%ŇĻƂƨŽý¡żƎƃŪūŧ%Ýťaô%

•  ŸƘƝƣƨŸƟƦŘ4,Âķ%r,Âťa�% &�źƃƣƨŹ%

(HPCI&ÆźƃƣƨŹ)�

VM�

•  �«þÞř�¹HPCơżƨźŒ%

�«ƂƨŽřĕŞĿŖ&�źƃƣƨŹŖďĒƩĵƬƪ�

VM� VM�

Ƨij«þÞřVMŒƂƨƛƦÍŖaô%Ƨ�«ƂƨŽŀ#š«Üij«þÞĠZ�

ij«þÞå¢ť&��

3.%ŸźƁƙżƎƃŪūŧŘĠË�•  źƋŵƦŒřĠËŀMĪŕŸźƁƙżƎƃŪūŧťĠË%•  źƋŵƦķźƃƣƨŹķƇƀƃƥƨűÝŘDØċµœijmŖĖ�ŇŌ.�ŸźƁƙŘĠË%

ƊƀűŬƦƄŖHPCċµťÆĻŢ%WebƒƨźŶƨƌź�

BLAST%Online%SearchŕŔ�

HPCċµťÑĖ�ņŊŢ%ŲơƀƄŶƨƌź�

HPCIđ7ªíĠËŕŔ�

HPCI<AEŘŸźƁƙRÏ�•  �ÖÒ[ÿÔÚĸÔÚŵƘƝƆƁŨq{ŘŌŝŘċµĖ�~õŖĢʼnŢÔÚĹŘ{¢½Ř1ŐŒĺŢRENKEI<VPEť�Æ%–  ÔÚÆŶƨƊťVMœŇő��%–  ŲơƀƄƘƄƢŪūŧ.�Ĝ Ř8À:ŘŌŝŖĠË�

RENKEI<VPE/HPCIŘƂŷũƦ�•  &�źƃƣƨŹŖĺŢŸźƁƙƂƨŽƩOSũƚƨŹƪťÆĻőķ�yŘŶũƃŖVMťč9%

•  $ŶũƃŖőP�ŕżƎƃŪūŧ¦{%–  ÊØűƠŪƄƘƄƢġŘĖ�ķ&ĔƂŨźűƎŭƨƗƀƃŖřśōÔÚĠËƧ§¶:ŀtù%

–  űƠŪƄƘƄƢŪūŧŘ�@ķĘÆƈŪƉŪŘóÙřśō�=.%–  �@Ř�ėœķŶũƃŘßÂĉ�ť3³ŀÐÍ%

•  HPCIĄĂRÏœŘĖ�%–  GSIĄĂŖşŢƤŲũƦŶƨƊ%ŚŘSSO%

–  ShibbolethĄĂŖşŢWebƖƨ%ŽƢŚŘSSO%(ĠË�)�

RENKEI<VPEªí�

•  VMŘßÂ%– č9ķ¿z�\ķã�%–  Suspend/Resume%– ƗƢſƔƨƙVM%–  VMaôŶũƃ�`%– ƔźƃOSĉñŖuňŌVMŧƤųƨŸƟƦ%

–  IPŧƄƣźŘĬÍ5p%–  VM¦{Ř&�Ƨ+1Æ%

•  ċµ1Æ2Ĥ%– 1ÆBíŶũƃ%– č9BíVM�%

•  OSũƚƨŹßÂ%– ÌĞķ�Æķ3ĥķExport%

– �1ÆìœŘ&�%

•  Etc%–  GSIĄĂŖşŢƤŲũƦ%

RENKEI<VPEªí�

•  VMŘßÂ%– č9ķ¿z�\ķã�%–  Suspend/Resume%– ƗƢſƔƨƙVM%–  VMaôŶũƃ�`%– ƔźƃOSĉñŖuňŌVMŧƤųƨŸƟƦ%

–  IPŧƄƣźŘĬÍ5p%–  VM¦{Ř&�Ƨ+1Æ%

•  ċµ1Æ2Ĥ%– 1ÆBíŶũƃ%– č9BíVM�%

•  OSũƚƨŹßÂ%– ÌĞķ�Æķ3ĥķExport%

– �1ÆìœŘ&�%

•  Etc%–  GSIĄĂŖşŢƤŲũƦ%

VMßÂŘR�ªířOpenNebula%v2.2ť�Æ%%

Č:%�úĠËĶĶī:%ªí�n�

RENKEI<VPEŧƨŰƁűſƜ�

OpenNebula�

RENKEI<VPE�GSI%Auth�

Central%Manager�

kvm�libvirt�

Hos3ng%Server�

OS%Image%Storage�

Gfarm%Client�

Gfarm%Client�

Gfarm%

Portal%Server�

RENKEI<VPE%Portal�Shibboleth%Auth�

Manage%VM�

Put/get%OS%images�

Update%accounts�

Gfarm%Server�

Put/get%OS%images�

Gfarm%Meta%Data�

RENKEI<VPEaö%<%OSũƚƨŹźƃƣƨŹ%(1/2)%<�

•  Gfarm.�ƎŦũƢŸźƁƙť�Æ%– ƔźƁŨƦŲŶƨƊêŘƤƨůƢźƃƣƨŹťĨâŇőķlQ&�źƃƣƨŹť¦à%

–  ƚŽƂƨŽřßÂŶƨƊŒßÂ%

•  OSũƚƨŹŘø÷ťßÂʼnŢńœŒķWAN�ŒŘOSũƚƨŹďĒť3³%

RENKEI<VPEaö%<%OSũƚƨŹźƃƣƨŹĴ(2/2)%<�

•  ø÷�{�ŘOSũƚƨŹŘ�Ċv%–  OSũƚƨŹřWrite%OnceœŇőßÂ%=>%LıºŇ%

•  VMč9�ŖGfarmƋƨƁŨŸƟƦĿŠƤƨůƢƋƨƁŨŸƟƦŖŵƍƨķV�řƤƨůƢŘŜŒôļ%

•  V�ř0OSũƚƨŹŖ�\ķĺŢĻřÕ£%

– �WƮ��}�ŘPrivateŕOSũƚƨŹŚŘV�řķVM�¬�Ŗ�Ł|ʼnńœŀBí%•  ŋŘşļŕOSũƚƨŹť�ĽŢŘř1ŐŘVMŘŜĴ=>%ŵƦƎơűƃŕŇ%•  �ŁĐŜŀ_�ʼnŢśŒķŋŘOSũƚƨŹŘ1Æř�āB�

gfarm�IMG�

ext4�

gfarm�

ext4�

gfarm�IMG�IMG’� IMG’�

RENKEI<VPEaö%<%ßÂŶƨƊ%<�

•  ŸźƁƙŖJ�\O%•  XMLRPCŶƨƊ/űƠũŧƦƃaö%

1.  VMķƇƀƃƥƨű`ëÝŘDØOpenNebula`ëƎŦũƢť%î9Ä{�

2.  OpenNebulaŘXMLRPCťCall%

•  OpenNebulaŚŘ�nĮÐ%–  Ŷũƃ`ë%

•  ŶũƃŅœŘƇƀƃƥƨű`ë%•  Ŷũƃť�`ŇŌVMč9%

–  GfarmœŘæE%–  ċµ1Æ2ĤDB%

•  RENKEI<VPE*ěŖsqliteŖőaö%

RENKEI<VPEaö%<%ƔźƁŨƦŲŶƨƊ%<�

•  ŸźƁƙŖø�\OķŶũƃŅœŖŲƢƨƐßÂ%–  DŶũƃŖGfarmźƃƣƨŹŶƨƊªíť�ʼnŶƨƊť1CĀé%

•  §¶Íŕlibvirt/kvmĀ`%+%GfarműƠũŧƦƃť�ʼn%Linux%Box%

•  VMÆŘƇƀƃƥƨűťBridge�è%•  ßÂĮÐ%

–  ĔjŘHW�^ƧÎû�–  Gfarm,%VMč9ÆŘĄĂƎŦũƢ��%

VMĜ �ġŘă��

CPU� Intel%Xeon%W3565%(3.2GHz,%8threads/4cores)�

Mem� 24GB%

Disk� 28TB%(R:%720,%W:%690%MB/s)�

ƔźƁŨƦŲŶƨƊ¦{�

ƔźƁŨƦŲŶƨƊ�

Total#Time�

Time#to#Prepare�

Time#for#OS#Boot�

Time#to#copy#Img�

 iY1� 116� 19� 97� 0.549�

 iY2� 111� 14� 97� 1.47�

NII1� 118� 21� 97� 7.58�

NII2� 141� 44� 97� 23.2�

;Y� 164� 68� 96� 60.3�

>�ř×�

ă�Ā`%•  iY1ŖľĻŌ653MBŘ�e¦{Ř%CentOS%5.5%VMťDŶƨƊŒč9%•  1%CPU,%1GBƚƛơŘVMœŇőč9�•  VMč9ù¯ĿŠč9_�ƩVM�Œ�rŘinitaôƪśŒŘ�ġťþ´%

HPCI<AEĜ ƧĘÆ�2�

•  ßÂŶƨƌźê%–  i¥Y]%

– Web:%h?p://hpci<ae.r.gsic.3tech.ac.jp/%%%(�`%Ġ¼)%

•  ƔźƁŨƦŲŶƨƊ��ªĢ%�¹� źƓƀű� C��

;²ęY]� 40Core,%128GB%Mem,%2TB%Disk,%10Gbps%WAN�

1�

 Y]� 12Core,%48GB%Mem,%1.2TB%Disk� 3<10�

 i¥Y]� 4Core,%24GB%Mem,%28TB%Disk,%10Gbps%WAN�

1<2�

�hY]� 6Core,%24GB%Mem,%12TB%Disk� 4�

ƇƀƃƥƨűÃT�

Æē� �èqz�

ũƦŽƨƇƀƃĔ�Ƈƀƃƥƨű� ßÂŶƨƊŒŘŜ�è�

RENKEI<VPEßÂƇƀƃƥƨű� SINET%L3VPNť�Æ%ƐƠũƒƨƃƇƀƃƥƨű�

1ÆìVMÆƇƀƃƥƨű� SINET%L3VPNť�Æ%ƐƠũƒƨƃƇƀƃƥƨű�

Ŷũƃ*ßÂƇƀƃƥƨű� ŶũƃƖơŸƨŖuňő�è�

;Y� Y�

Ɣźƃ�ßÂŶƨƊ�

Ɣźƃ�Ɣźƃ�Ɣźƃ�Ɣźƃ� Ɣźƃ�

 iY�

ßÂÆVPN(VMƧOSũƚƨŹ��)�

VM� VM� VM�

1ÆìVMÆVPN�

�Y�

Ɣźƃ�Ɣźƃ�

VM�

ũƦŽƨƇƀƃ�

VMÃT1ÆũƚƨŹ�WěƇƀƃƥƨűĿŠ.�ņţőĻŢVMŚŘŧűŻźť�çʼnŢŶƨƊťĀé�

ŴƨƃŪūũŶƨƊ�

•  ¦{%– ĔjLinuxŶƨƊ%– 1ÆìVMÆƇƀƃƥƨűêŖ�è%

•  Ŷƨƌź%– ?»ÆDNS,%NTP,%HTTP%ProxyťVMŖ��%–  SSHķReverse%ProxyŖşŢVMŚŘŧűŻź%

•  HPCIĄĂRÏ(GSI)ťÆĻŌSSO%

•  pĭřßÂŶƨƊŀ�ªíť)ŗŢ%– 1ÆìUƧĉñUŖ�ĻķC�U7ņŊŢ�

HPCI<AE1Æ�°%<%ƤŲũƦ%<�

ƞƨŷ� ĄĂƖƨŽƢ�HPCIŧůŪƦƃ,%%ƋźƥƨƄ�

Proxy%���

ProxyĂ��Ä{���

•  ßÂŶƨƊŚŧűŻź%(VMßÂ��)%•  ŴƨƃŪūũŶƨƊŚŧűŻźĴ(VM1Æ)%

���

ProxyĂ��ť%žŪƦƤƨƄ�

ĄĂfƧĂ��ËôŸźƁƙ�

$ myproxy-logon …$ gsissh ŶƨƊG�

ƞƨŷ� ĄĂƖƨŽƢ� ĄĂfƧĂ��ËôŸźƁƙ�

HPCI<AE1Æ�°%<%ƤŲũƦ%<�

HPCIŧůŪƦƃ,%%ƋźƥƨƄ�

Proxy%���

ProxyĂ��Ä{���

•  ßÂŶƨƊŚŧűŻź%(VMßÂ��)%•  ŴƨƃŪūũŶƨƊŚŧűŻźĴ(VM1Æ)%

���

ProxyĂ��ť%žŪƦƤƨƄ�

$ myproxy-logon …$ gsissh ŶƨƊG�

ShibbolethĄĂ�

GSIĄĂ�

ƞƨŷ� ĄĂƖƨŽƢ� ĄĂfƧĂ��ËôŸźƁƙ�

HPCI<AE1Æ�°%<%ƤŲũƦ%<�

HPCIŧůŪƦƃ,%%ƋźƥƨƄ�

Proxy%���

ProxyĂ��Ä{���

•  ßÂŶƨƊŚŧűŻź%(VMßÂ��)%•  ŴƨƃŪūũŶƨƊŚŧűŻźĴ(VM1Æ)%

���

ProxyĂ��ť%žŪƦƤƨƄ�

$ myproxy-logon …$ gsissh ŶƨƊG�

ShibbolethĄĂ�

GSIĄĂ�

ßÂƖƨŽƢ%

• ŧůŪƦƃĀ`%• 1ÆìÃTĀ`%• 1ÆæþAs�

HPCI<AE1Æ�°%<%RENKEI<VPE1Æ%<�

•  VMč9%

•  VMƩ�ïLinux%OSƪƑŘƤŲũƦ%

•  VM¿zŘ�\%

•  VMŘ�¬�

$ rvpevm create small centos5.5 ~/.ssh/authorized_keys \tokyo_tech csi-grid�

VM¦{� OSũƚƨŹ� SSH%Ġğ�

VMaôŶũƃ� VM�èƇƀƃƥƨű%(ø�B)�

$ ssh -l root VM_HOSTNAME�

$ rvpevm mark_save VM_HOSTNAME mycentos5.5 ‘sample’�OSũƚƨŹG� ą���

$ rvpevm shutdown VM_HOSTNAME�

ĵ%VMaô�ŖVMƔźƃGř/��

śœŝ�

•  HPCI"ÛżƎƃŪūŧĘÆRÏ%–  HPCċµŘ±ÆŘ�ėķŸźƁƙżƎƃŪūŧÔÚĠËťôļÃTť��%

–  RENKEI<VPEťŸźƁƙżƎƃŪūŧŖ�Æ%–  iYķ;Yķ Yķ�YŚŘĜ %

•  �rŘþÉ%– ßÂƖƨŽƢŘShibbolethcu%–  RENKEI<VPEŶƨƌźÎûŸźƁƙŘĜ %–  SINET%VPNŶƨƌźœĖ�ŇŌƞƨŷÃTŘ.ĩ%