Server Virtualization with CISCO and Networking Best Practice

Server Virtualization with CISCO and Networking Best Practice - Upload a doc

Read this doc on Scribd: Server Virtualization with CISCO and Networking Best Practice

Server Virtualization M au riz io Portolani Network Implications & Best Practices P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 1 Session Objectives At the end of the session, the participants should b e ab le to: Objective 1: Understand key concepts of server virtu al iz ation arch itectu res as th ey rel ate to th e netw ork. Objective 2: E x pl ain th e im pact of server virtu al iz ation on D C netw ork desig n ( E th ernet & F iber C h annel ) Objective 3: D esig n C isco D C netw orks to su pport server virtu al iz ation environm ents P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 2 A g end a VMware Architecture and Components VMware L AN N etwork ing Cisco/ VMware D C D E S I G N S B l ade S erv er D esig ns S torag e I mpl ications of S erv er Virtual iz ation P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 3 V ir tu a l iz a tion App Guest OS VM App Guest OS App Guest OS VM App Guest OS App M o d i f i ed OS VM App M o d i f i ed OS Mof ied S tripped D own O S with H y perv isor CPU CPU ¢ ¡ H y p e r v is o r H ost O S ¢ ¡ Mof ied S tripped D own O S with H y perv isor CPU ¡ ¢ VM w a r e M ic r o s o ft XEN aka Pa r a v i r t u a l i z a t i o n P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 4 M ig r a tion VMotion, a VM to b e r H a rd w a re inte r r u p t s k a VM Mig r a tion a l l ow s a e a l l oc a te d on a d if f e r e nt w ith ou t h a v ing to e r v ic e . D ow ntim e in th e or d e r of f e w m il l is e c ond s to f e w m inu te s , not h ou r s or d a y s C a n b e u s e d to p e r f or m Maintenance on a s e r v e r , 2 ty p e s of Mig r a tion: VM o t i o n M i g r a t i o n R e g u la r M ig r a tio n OS Console OS App. App. VMware Virtualization Layer OS OS VMware Virtualization Layer H y p e r v is o r H y p e r v is o r C a n b e u s e d to s h if t w or k l oa d s m or e e f f ic ie ntl y ¤ £ CPU CPU ¢ ¡ ¡ ¢ £ ¤ Console OS 5 App. P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l M a na g em ent D a ta c e n te r D a ta c e n te r D a ta c e n te r P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 6 V M w a r e A r ch itectu r e in a N u tsh el l Mg m t N e tw or k App. App. App. C o n so l e OS VM K e r ne l N e tw or k P r od u c tion N e tw or k OS OS OS Vir tu a l Ma c h ine s VM Vir tu a l iz a tion L a y e r P h y s ic a l H a r d w a r e CPU E S X S erv er H ost C is c o C o n fid e n tia l … ¡ ¢ P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . 7 V M w a r eH A C l u ster ing App1 App1 Guest OS App2 Guest OS App3 Guest OS App4 Guest OS Guest OS App5 Guest OS App2 Guest OS H y p e r v is o r H y p e r v is o r H y p e r v is o r E S X H ost 1 CPU CPU ¢ ¡ E S X H ost 2 CPU ¢ ¡ E S X H ost 3 ¡ ¢ P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 8 Application-le v e l H A clu s te r ing (Provided by MSCS, V erit a s et c …) App1 Guest OS App2 Guest OS App3 Guest OS App4 Guest OS App1 Guest OS App5 Guest OS App2 Guest OS H y p e r v is o r H y p e r v is o r H y p e r v is o r E S X H ost 1 CPU CPU ¢ ¡ E S X H ost 2 CPU ¢ ¡ E S X H ost 3 ¡ ¢ P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 9 HA +DRS HA takes care of Powering on V M s on av ail ab l e E S X h osts in th e l east p ossib l e tim e (regu l ar m igration, not V M otion b ased ) D R S takes care of m igrating th e V M s ov er tim e to th e m ost ap p rop riate E S X h ost b ased on resou rce al l ocation (V M otion m igration) P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 10 Q u estions W h ich E S X h ost “interface” is u sed by V irtu al C enter to m onitor and config u re V M s? W h ich E S X h ost “interface” is u sed by iS C S I ? C an I m ig rate a “pow ered on” V M a different one? from a datacenter to H ow l ong does it take for V M w are H A to recover from an E S X h ost fail u re? D oes H A cl u stering req u ire V m otion? P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 11 A g end a VMw a r e A r c h ite c tu r e a nd C om p one nts VMw a r e L A N N e tw or k ing v S w it N ICT v S w it M ig r a ch ea ch tio Ba s i c s m in g v s L AN S w i t c h n , H A, D R S C is c o/ VMw a r e D C D E S I G N S B l a d e S e r v e r D e s ig ns S tor a g e I m p l ic a tions of S e r v e r Vir tu a l iz a tion P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 12 Pe r E S X -s e r v e r c o n f i g u r a t i o n V M w a r e N etw or k ing C om p onents VM s v S w itc h VM N I CS = u p l i n k s VM _ L UN _ 0 0 0 7 v N IC v S w itc h 0 v m n ic 0 VM _ L UN _ 0 0 0 5 v N IC Vi r t u a l Po r t s v m n ic 1 13 P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l vN I C M A C a d d r ess / v m fs/ v ol u m es/ 4 6 b 9 d 7 9 a2d e6 e23 e-9 29 d 0 0 1 b 7 8 b b 5 a2c/ V M _ L U N _ 0 0 0 5 /V M _ L U N _ 0 0 0 5 .v m x eth ernet0 . generated Ad d ress = " 0 0 : 5 0 : 5 6 : b 0 : 5 f: 24 „ eth ernet0 . ad d ress = " 0 0 :5 0 :5 6 :0 0 :0 0 :0 6 „ M ech anism s to av oid M AC col l ision V M ’s M AC ad d ress au tom atical l y generated V M ’s M AC ad d resses can b e m ad e static b y m od ify ing th e configu ration fil es eth ernetN . ad d ress = 0 0 :5 0 :5 6 :X X :Y Y :Z Z V M ’s M AC ad d ress d oesn’t ch ange with migration eth ernet0 . ad d ressT y p e = " v p x " eth ernet0 . ad d ressT y p e = „static“ P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 14 vSw itch F or w a r d ing C h a r a cter istics F or w ar d ing b as e d on M AC ad d r e s s ( N o L e ar ning ) : I f tr af f ic d oe s n’t m atch a V M M AC is s e nt ou t to v m nic V M -to-V M V s w itch e s T AG tr af f ic s tay s local tr af f ic w ith 8 0 2 . 1 q V L AN ID v S w itch e s ar e 8 0 2 . 1 q C apab le v S w itch e s can cr e ate E th e r ch anne ls P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 15 vSw itch C r ea tion Y O U D O N ’T H AVE T O S E L E CT A N I C T h is is ju s t a n a m e v N I Cs v s w itc h S e l e c t t h e Po r t -G r o u p b y s p e c i f y i n g t h e N E T W O R K L ABE L P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 16 VM P or t-G r ou p vSw itch P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 17 E x am ple C onf ig u r ation Mu l t ip l e Port -G rou p s , s a m e V L A N T h e VL AN n e e d n o t d i f f e r o n d i f f e r e n t Po r t -G r o u p s P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 18 VM w ith 2 vN I C to sa m e vSw itch VM 4, d u a l -h o m e d P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 19 V L AN T ag g ing O ptions E x t ern a l Sw it c h T a g g in g E x te r na l s w itc h ta g s p a c k e t VL AN a s s i g n m e n t C onf ig u r e d b y s e tting th e N e tw or k L a b e l VL A N I D to b e 0 H ow is VM-toVM tr a f f ic s w itc h e d ? ( th r ou g h L A N or th r ou g h v S w itc h ) S w itc h A V M N IC 0 C a n u s e na tiv e VL A N on 8 02 . 1 q tr u nk ( a s l ong a s na tiv e VL A N is not ta g g e d ) Vi r t u a l S w i t c h 1 1 Po r t-Gr o up 1 Vi r t u a l S w i t c h 2 30 Po r t-Gr o up 2 B V M N IC 2 2 31 32 VMs E S X S e rv e r H o s t P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 20 V L AN T ag g ing O ptions V irt u a l Sw it c h T a g g in g v S w itc h ta g g ing V M N IC 0 80 2. 1q t r u n k V M N IC 1 V M N IC 2 V M N IC 3 I t is s e t b y a s s ig ning th e VL A N I D to th e N e tw or k L a b e l in th e P or t-G r ou p P r ov id e s is ol a tion b e tw e e n VL A N s Mos t C om m on D e p l oy m e nt S tr ip s ta g f r om inb ou nd p a c k e t T a g s ou tb ou nd p a c k e ts Vi r t u a l S w i t c h Po r t G r o u p A 1 2 Po r t G r o u p B 30 31 32 VL AN “A” VL AN “B” V i r tua l M a c h i n es E S X S e r v e r H os t P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 21 A g end a VMware Architecture and Components VMware L AN vSw N IC vSw Mig itc h B a s ic s T e a m ing itc h v s L A N S w itc h r a tion, H A , D R S N etwork ing Cisco/ VMware D C D E S I G N S B l ade S erv er D esig ns S torag e I mpl ications of S erv er Virtual iz ation P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 22 M ea ning of N I C T ea m ing in V M w a r e ( 1 ) E S X s e r v e r N ICc a r d s v S w i t c h Up l i n k s v m n ic 0 N ICT e a m in g v N IC v N IC v N IC v m n ic 1 v m n ic 2 v m n ic 3 N ICT e a m in g T H IS IS N O T N ICT e a m in g v N IC v N IC E S X S erv er H ost P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 23 M ea ning of N I C T ea m ing in V M w a r e ( 2 ) T e a m i n g i s Co n f i g u r e d a t T h e v m n ic L e v e l This is NOT Teaming P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 24 D e s ig n E x am ple 2 N I Cs , V L A N 1 a n d 2 , A c t ive/ St a n dby Po r t-Gr o up 1 VLAN 2 8 0 2. 1q V l a n 1,2 8 0 2. 1q V l a n 1,2 v m n ic 1 E SX Ser v er v m n ic 0 v Sw i tc h 0 Po r t-Gr o up 2 VLAN 1 VM1 P r e s e n ta tio n _ ID VM2 Ser v i c e C o n so l e C is c o C o n fid e n tia l ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . 25 B ea con P r obing VM ports u pl i n k ports Team ed ph y si c a l N IC s LAN Beacon probing attempts to detect failures which don’t result in a link state failure for the N I C Broadcast frames sent from each N I C seen by other N I C s in the team Beacons are sent on each V L A N ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l in the team should be in use 26 P r e s e n ta tio n _ ID Activ e / S tand b y pe r -P or t-G r ou p C B S-l ef t C B S-r i g h t V M N IC 0 V M N IC 1 Po r t -G r o u p 1 Po r t -G r o u p 2 v S witch0 .5 P r e s e n ta tio n _ ID VM5 VM7 .7 E SX Ser v er C is c o C o n fid e n tia l VM4 .4 VM6 .6 ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . 27 P or t-G r ou p ov e r r id e s v S w itch G lob al C onf ig u r ation P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 28 Activ e / Activ e E S X s e r v e r N ICc a r d s E S X s e rv e r v m n ic 0 v m n ic 1 v S w itc h Po r t -G r o u p VM 1 VM 2 VM 3 VM 4 VM 5 P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 29 Activ e / Activ e I P-ba s ed L oa d B a l a n c in g W o r k s w i t h Ch a n n e l -G r o u p m o d e O N L ACP i s n o t s u p p o r t e d ( s e e b e l o w ) : 9w 0d:% Gi g a b i tE 9w 0d:% Gi g a b i tE 9w 0d:% susp en d th e r em o 9w 0d:% susp en d th e r em o L I N K -3-U PD OW N th er n et1/ 0 / 14 , c h L I N K -3-U PD OW N th er n et1/ 0 / 13, c h E C -5-L 3D ON T B N ed : L A C P c ur r en te p o r t. E C -5-L 3D ON T B N ed : L A C P c ur r en te p o r t. : I n ter f a c e a n g ed sta te to up : I n ter f a c e a n g ed sta te to up D L 2: Gi 1/ 0 / 14 tl y n o t en a b l ed o n D L 2: Gi 1/ 0 / 13 tl y n o t en a b l ed o n Po r t -c h a n n e l i n g E S X s e rv e r v m n ic 0 v m n ic 1 v S w itc h Po r t -G r o u p VM 1 VM 2 VM 3 VM 4 P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 30 A g end a VMware Architecture and Components VMware L AN N etwork ing v S witch B asics N I C T eaming v S witch v s L AN S witch Mig ration, H A, D R S Cisco/ VMware D C D E S I G N S B l ade S erv er D esig ns S torag e I mpl ications of S erv er Virtual iz ation P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 31 R olling F ailov e r ( ak a P r e e m ption) B y def a u l t Preem p t ion is on 8 0 2. 1q V l a n 1,2 8 0 2. 1q V l a n 1,2 8 0 2. 1q V l a n 1,2 8 0 2. 1q V l a n 1,2 v m n ic 0 v Sw i tc h 0 v m n ic 1 v m n ic 0 v Sw i tc h 0 v m n ic 1 VM1 P r e s e n ta tio n _ ID VM2 ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l VM1 VM2 32 All L ink s Activ e , N o S panning -T r e e I s th e r e a L oop? C B S-l ef t C B S-r i g h t N IC 1 N IC 2 N IC 3 N IC 4 P o r t -G r o u p 1 P o r t -G r o u p 2 v S witch1 .5 P r e s e n ta tio n _ ID VM5 VM7 .7 E SX Ser v er C is c o C o n fid e n tia l VM4 .4 VM6 .6 ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . 33 B r oad cas t/ M u lticas t/ U nk now n U nicas t F or w ar d ing in Activ e / Activ e ( 1 ) 8 0 2. 1q V l a n 1,2 8 0 2. 1q V l a n 1,2 v m n ic 0 v Sw i tc h 0 Po r t-Gr o up 1 VLAN 2 v m n ic 1 E SX Ser v er P r e s e n ta tio n _ ID VM1 VM2 C is c o C o n fid e n tia l ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . 34 B r oad cas t/ M u lticas t/ U nk now n U nicas t F or w ar d ing in Activ e / Activ e ( 2 ) 8 0 2. 1q V l a n 1,2 8 0 2. 1q V l a n 1,2 E SX H o st v Sw i tc h N IC 1 N IC 2 VM1 P r e s e n ta tio n _ ID VM2 VM3 C is c o C o n fid e n tia l ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . 35 C a n th e vSw itch p a ss tr a f f ic th r ou g h ? E . g . H SR P? v Sw i tc h N IC 1 N IC 2 VM1 P r e s e n ta tio n _ ID VM2 C is c o C o n fid e n tia l ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . 36 C an V M 1 talk to S e r v e r 3 ? 4 U p lin k s 8 0 2. 1q V l a n 1,2 8 0 2. 1q V l a n 1,2 v Sw i tc h Po r t-Gr o up 1 VLAN 2 N IC 1 N IC 2 Po r t-Gr o up 2 VLAN 1 Ser v er 3 VM1 P r e s e n ta tio n _ ID VM2 Ser v i c e C o n so l e C is c o C o n fid e n tia l ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . 37 C a n V M 5 ta l k to V M 4 ? Ca t a l y s t 1 A l l l i n k s a r e a c ti v e Ca t a l y s t 2 8 0 2. 1q 8 0 2. 1q E S X s e rv e r1 v Sw i tc h 1 V M N IC 2 2 3 V M N IC 1 4 E S X s e rv e r 2 V M N IC 2 v Sw i tc h V M N IC 1 .5 P r e s e n ta tio n _ ID VM5 VM7 .7 C is c o C o n fid e n tia l VM4 .4 VM6 .6 ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . 38 I s th is d esig n p ossibl e? Ca t a l y s t 1 Ca t a l y s t 2 8 0 2. 1q E S X s e rv e r1 v Sw i tc h 1 V M N IC 2 2 8 0 2. 1q V M N IC 1 .5 P r e s e n ta tio n _ ID VM5 VM7 .7 C is c o C o n fid e n tia l ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . 39 vSw itch Secu r ity Prom iscu ou s m od e R ej ect p rev ents a p ort from cap tu ring traffic wh ose ad d ress is not th e V M ’s ad d ress M AC Ad d ress C h ange, p rev ents th e V M from m od ify ing th e v N I C ad d ress F orget T ransm its p rev ents th e V M from send ing ou t traffic with a d ifferent M AC (e. g N L B ) P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 40 vSw itch vs L A N Sw itch S im il arl y to a L AN V M -to-V M F orward ing b ased on M AC ad d ress S witch : D iffe r e n tly fr o m N o S p a n n i n g -T r e e p r o t o c o l N o 80 2. 3a d L ACP N o L e a r n in g a L AN S w i t c h N o D y n a m i c t r u n k n e g o t i a t i o n ( D T P) Ce r t a i n d e s i g n s c a n i s o l a t e VM s V switch es T AG traffic with 8 0 2. 1 q V L AN I D v S witch es can create E th erch annel s traffic stay s l ocal v S witch es are 8 0 2. 1 q C ap ab l e P reemption Conf ig uration ( simil ar to F l ex l ink s, b ut no del ay preemption) Be a c o n i n g d o e s n ’t s e e m N o S PAN / m i r r o r i n g c a p a b i l i t i e s : Traffic cap t u rin g is b y far n o t t h e e q u iv al e n t o f S P A N P o rt S e cu rit y v e ry l im it e d to a d d m u c h v a lu e v S w i t c h d o e s n ’t h a v e t h e e q u i v a l e n t o f UPL I N K T R ACK I N G 2E th e r c h a n n e l b a c k in g u p e a c h o th e r is n o t p o s s ib le P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 41 A g end a V M ware A rch itectu re and C omponents V M ware L A N Networking N I C T eaming v S witch B asics v S witch v s L AN S witch Mig ration, H A, D R S C isco/ V M ware D C D E S IG NS S torag e Implications of S erv er V irtu aliz ation 42 P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l V M otion M ig r a tion R eq u ir em ents P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 43 V M K er nel N etw or k ca n be r ou ted VM K e r ne l N e tw or k Mg m t N e tw or k VM K e r ne l N e tw or k P r od u c tion N e tw or k Vir tu a l Ma c h ine s E S X S erv er H ost P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l … 44 V M otion L 2 D esig n R a c k 10 Rack1 v m n ic 0 v m n ic 1 v m n ic 2 v m n ic 3 v m n ic 0 v m n ic 2 v Sw i tc h 0 v Sw i tc h 1 v Sw i tc h 2 v Sw i tc h 0 v Sw i tc h 2 v m k e rn e l E SX H o st 2 P r e s e n ta tio n _ ID S e r v ic e c o n s o le VM4 C is c o C o n fid e n tia l v m k e rn e l VM5 VM6 E SX H o st 1 ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . 45 VM M ig r a tion—Sp ecW eb9 9 M ig r a tion Ser v er s SPECweb99 i s t h e SPEC ben c h m a r k f o r ev a l u a t i n g t h e p er f o r m a n c e o f W W W T h e St a n d a r d Per f o r m a n c e Ev a l u a t i o n Co r p o r a t i o n ( SPEC) i s a n o n -p r o f i t c o r p o r a t i o n f o r m ed t o es t a bl i s h , m a i n t a i n a n d en d o r s e a s t a n d a r d i z ed s et o f r el ev a n t ben c h m a r k s t h a t c a n be a p p l i ed t o t h e n ewes t g en er a t i o n o f h i g h -p er f o r m a n c e c o m p u t er s Xen P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 46 H A cl u ster ing ( 1 ) E MC/ L eg ato AAM b ased R ecommendations: H A Ag ent runs in ev ery host H a v e 2 S e r v ic e C ons ol e on r e d u nd a nt p a th s A v oid l os ing S A N a c c e s s ( e . g . v ia iS C S I ) Make sure you know before h and i f D R S i s ac t i v at ed t oo! L os ing P r od u c tion VL c onne c tiv ity onl y , I S O VMs ( th e r e ’s no e q u iv u p l ink tr a c k ing on th e N IC T E A MI N G AN LATES a l e nt of v s w itc h ) H eartb eats U nicast U D P port ~ 8 0 4 2 ( 4 U D P ports opened) W hen a F ail ure O ccurs, the E S X H ost ping s the g ateway ( on the S E R VI CE CO N S O L E O N L Y ) to v erif y N etwork Connectiv ity I f E S X H ost is isol ated, it shuts down the VMs thus rel easeing l ock s on the S AN H earb eats run on the S erv ice Consol e O N L Y Cav eats: S ol ution: P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 47 H A cl u ster ing ( 2 ) CO S 10 . 0 . 2. 0 Pr o d 10 . 0 . 10 0 . 0 i S CS I a c c e s s / VM k e r n e l 10 . 0 . 20 0 . 0 v m n ic 0 v m n ic 0 VM 1 VM 2 E S X 1 S erv er H ost P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l E S X 2 S erv er H ost VM 1 VM 2 48 Q u estions W h at is a N etw ork L abel ? W h at does th e vN I C D o vS w itch es al w ays h ave vm nics? Y es/ N o C an 2 P ort-G rou ps be in th e sam e V L A N vS w itch ? D oes N I C team ing req u ire N I C in V M ? Y es/ N o D oes a V M MAC attach to? A vsw itch ? A V L A N ? on th e sam e vendor driver instal l ation address ch ang e du ring a m ig ration? P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 49 A g end a VMw a r e A r c h ite c tu r e a nd C om p one nts VMw a r e L A N N e tw or k ing v S w it N ICT v S w it M ig r a ch ea ch tio Ba s i c s m in g v s L AN S w i t c h n , H A, D R S C is c o/ VMw a r e D C D E S I G N S B l a d e S e r v e r D e s ig ns S tor a g e I m p l ic a tions of S e r v e r Vir tu a l iz a tion P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 50 vSw itch a nd N I C Q : S houl d I use mul tipl e v S witches or mul tipl e P ortG roups to isol ate traf f ic? T ea m ing B est P r a ctices Q : W h ic h N ICT e a m in g c o n fig u r a tio n s h o u ld I u s e ? A: Ac t i v e / Ac t i v e , Vi r t u a l Po r t -I D b a s e d A: W e didn’t see any adv antag e in using mul tipl e v S witches, mul tipl e P ort-G roups with dif f erent VL AN s g iv e y ou enoug h f l ex ib il ity to isol ate serv ers Q : S houl d I use E S T or VS T ? f or A: Al way s use VS T , i. e. assig n the VL AN f rom the v S witch Q : D o I h a v e t o a t t a c h a l l N I Cs i n t h e t e a m to th e s a m e s w itc h o r to d iffe r e n t s w itc h e s ? A: w i t h Ac t i v e / Ac t i v e Vi r t u a l Po r t -I D b a s e d , i t d o e s n ’t m a t t e r Q : S h o u l d I u s e Be a c o n i n g ? A: N o A: Y es y ou can, b ut to mak e it simpl e don’t. I f y ou do, do not T AG VMs with the nativ e VL AN 51 Q : Can I use nativ e VL AN VMs? Q : S h o u ld I u s e R o llin g F a ilo v e r (i.e . n o p r e e m p tio n ) A: N o , d e f a u l t i s g o o d , j u s t e n a b l e t ru n k fas t o n t h e Ci s c o s w i t c h P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l N I C T ea m A cr oss H a r d w a r e P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 52 C isco Sw itch p or t C onf ig u r a tion M a k e it a T r u n k E n a b le T r u n k fa s t Ca n t h e N a t i v e VL AN b e u s e d f o r VM s ? Y e s , b u t IF y o u d o , y o u h a v e 2o p tio n s Co n f i g u r e VL AN I D = 0 f o r t h e VM s t h a t a r e g o i n g t o u s e t h e n a t i v e VL AN (p re fe rre d ) i n ter f a c e Gi g a b i tE th er n etX / X d esc r i p ti o n < < * * V M Po r t * * > > n o i p a d d r ess sw i tc h p o r t sw i tc h p o r t tr un k en c a p sul a ti o n d o t1q switchport tru n k n a tiv e v l a n < id > sw i tc h p o r t tr un k a l l o w ed v l a n x x ,y y -z z sw i tc h p o r t m o d e tr un k switchport n on e g otia te n o c d p en a b l e spa n n in g -tre e portf a st tru n k ! D o n o t e n a b l e Po r t S e c u r i t y ( s e e n e x t s lid e ) Co n f i g u r e “v l a n d o t 1q t a g n a t i v e ” o n t h e 6k ( n o t r e c o m m e n d e d ) M a k e s u r e t h a t “t e a m e d ” N I Cs a r e i n t h e s a m e L a y e r 2d o m a in Pr o v i d e a R e d u n d a n t L a y e r 2 p a t h T y p i c a l l y : S C, VM K e r n e l , VM Pr o d u c t i o n P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 53 P or t S e cu r ity and V M w ar e I n c om p a t ibl e http: / / www. cisco. com/ en/ U S / par tner/ products/ hw/ switches/ ps5 0 2 3 / products_ conf ig uration_ g uid e_ chapter0 9 1 8 6 a0 0 8 0 8 b 0 2 1 0 . ht ml # wp1 1 7 0 5 8 1 3 7 5 0 -S T ACK -top-R 1 ( conf ig if ) # switchport port-security max imum < numb er> v l an < v l an_ numb er> S C , S C iS C S I , VMK e r ne l , VMotion = 4 + 1 MA C p e r VM + B I A MA C I f a M AC m ov es (i. e. V m otion m igration or N I C T eam ing) 9 w0 d : % PO R T _ S E C U R I T Y -2PS E C U R E _ V I O L AT I O N : S ecu rity v iol ation occu rred , cau sed Port goes d own or traffic is d rop p ed 3 7 5 0 -S T AC K -top -R 1 # H ow many MACs do y ou hav e to count? max imum 5 , v iol ation restrict P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 54 Configuration with 2 NIC SC, V M K e r n e l , P r o d u c t i o n s h a r e N I Cs T r un k s 8 0 2. 1q N I C tea m i n g A c ti v e/ A c ti v e V M N IC 1 Po r t-Gr o up 2 8 0 2. 1q : Pr o d uc ti o n V L A N s, Ser v i c e C o n so l e, V M K er n el E SX Ser v er Po r t-Gr o up 3 V M N IC 2 R edundant S C and VMK ernel Connectiv ity R edundant P roduction G Al b l a l l ink lo Ac t i v e / Ac t i v e Po r t-Gr o up 1 v S w itc h 0 s used S C, VMK ernel VS T share N I Cs with P roduction T raf f ic VM1 VM2 HBA1 HBA2 Ser v i c e C o n so l e VM K er n el P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l Ac t i v e / S t a n d b y Vm n i c 1/ v m n i c 2 Ac t i v e / S t a n d b y Vm n i c 2/ v m n i c 1 55 Configuration with 2 NICs D e d i c a t e d N I C t o SC, V M K e r n e l , Se p a r a t e N I C f o r P r o d u c tio n T r un k s 8 0 2. 1q N I C tea m i n g A c ti v e/ A c ti v e Po r t-Gr o up 2 8 0 2. 1q : Pr o d uc ti o n V L A N s, Ser v i c e C o n so l e, V M K er n el E SX Ser v er Po r t-Gr o up 3 V M N IC 2 R edundant S C and VMN 1 VMK ernel Connectiv I C ity G lo b a l Ac t i v e / S t a n d b y Vm n i c 1/ v m n i c 2 R edundant P roduction w itc h 0 vS Al l l ink s used Po r t-Gr o up 1 I n normal condition S C and P roduction are VS T O n dif f erent N I Cs VM1 HBA1 VM2 HBA2 Ser v i c e C o n so l e VM K er n el P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l Ac t i v e / S t a n d b y Vm n i c 2/ v m n i c 1 Ac t i v e / S t a n d b y Vm n i c 2/ v m n i c 1 56 N etw or k A tta ch m ent ( 1 ) ro o t T ru n k fa s t BPD U g u a r d 8 0 2. 1q : Pr o d uc ti o n , SC , V M K er n el S e c o n d a ry ro o t R a p i d PVS T + N o Bl o c k e d Po r t , No Loop Ca t a l y s t 2 8 0 2. 1q Ca t a l y s t 1 8 0 2. 1q : Pr o d uc ti o n , SC , V M K er n el 1 V M N IC 1 v Sw i tc h V M N IC 2 2 3 4 V M N IC 1 v Sw i tc h V M N IC 2 Al l N I Cs a r e u s e d T r a ffic d is tr ib u te d O n a ll lin k s E S X s e rv e r1 E S X s e rv e r 2 57 P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l N e tw or k Attach m e nt ( 2 ) ro o t 8 0 2. 1q : Pr o d uc ti o n , SC , V M K er n el S e c o n d a ry ro o t R a p i d PVS T + T ru n k fa s t BPD U g u a r d T y p i c a l S p a n n i n g -T r e e V-S h a p e T o p o l o g y 8 0 2. 1q : Pr o d uc ti o n , SC , V M K er n el 8 0 2. 1q 1 V M N IC 1 v Sw i tc h V M N IC 2 2 3 4 V M N IC 1 V M N IC 2 Al l N I Cs a r e u s e d T r a ffic d is tr ib u te d O n a ll lin k s E S X s e rv e r1 P r e s e n ta tio n _ ID E S X s e r v e r 2 v Sw i tc h C is c o C o n fid e n tia l ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . 58 Configuration with 4 NICs D e d i c a t e d N I Cs f o r SC a n d V M K e r n e l D edicatedn N I C f or S C Pr o d u c t i o D edicated N I C f or VMK ernel R edundant P roduction H ow g ood is this desig n? Ac t i v e / Ac t i v e Vm n i c 1/ v m n i c 2 V M N IC 1 VL AN s V M N IC 2 V M N IC 3 E SX Ser v er V M N IC 4 VMs b ecome compl etel y isol ated I sol ates Manag ement Access Po r E VC cannot controlt-Gr o S up X 1H ost v s w itc h Manag ement access is l ost iS CS I access is l ost VMotion can’t run I sol ates VMK ernel I f this is part of an H A Cl uster VMs are powered down HBA1 HBA2 P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l I f using iS CS I this is the worst Ser P ossibo n l v soiec l e ail ure, K v er n el compl icated fe ery VM C T o recov er f rom I f this is part of a D R S cl uster I t prev ents automatic mig ration 59 C onf ig u r ation w ith 4 N I C s R edundant S C and Pr o d u c o VMK ernel Connectiv t i ityn V M N IC 1 R edundant P roduction VL AN s S C, VM K e r n e l VL AN s V M N IC 2 V M N IC 3 E SX Ser v er V M N IC 4 H A aug mented b y teaming on D if f erent N I C chipsets P roduction and Manag ement G o throug h chipset 2 Al l l ink s used P roduction and Manag ement Ac t i v e / Ac t i v e v s w itc h Vm n i c 1/ v m n i c 3 G o throug h chipset1 “D edicated N I Cs” f or S C And VMK ernel S C swaps to v mnic4 VC can H stil 1l control2 H ost BA HBA P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . Po r t-Gr o up 1 VMK ernel swaps to v mnic2 Ser v i c e C o n so l e P roduction T raf f ic Continues on v mnic1 Ac t i v e / S t a n d b y Vm n i c 4/ v m n i c 2 60 VM K er n el P roduction T raf f ic g oes to v mnic3 C is c o C o n fid e n tia l Ac t i v e / S t a n d b y Vm n i c 2/ v m n i c 4 N etw or k A tta ch m ent ( 1 ) ro o t S e c o n d a ry ro o t R a p i d PVS T + T ru n k fa s t BPD U g u a r d 8 0 2. 1q : Pr o d uc ti o n , SC , V M K er n el N o Bl o c k e d Po r t , No Loop Ca t a l y s t 2 SC 8 0 2. 1q : a n d V M K er n el Ca t a l y s t 1 8 0 2. 1q : Pr o d uc ti o n 1 2 3 E S X s e rv e r1 v Sw i tc h P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . 4 5 6 7 8 E S X s e rv e r 2 v Sw i tc h C is c o C o n fid e n tia l 61 N etw or k A tta ch m ent ( 2 ) ro o t T ru n k fa s t BPD U g u a r d 8 0 2. 1q : Pr o d uc ti o n , SC , V M K er n el S e c o n d a ry ro o t R a p i d PVS T + T y p i c a l S p a n n i n g -T r e e V-S h a p e T o p o l o g y Ca t a l y s t 1 8 0 2. 1q : Pr o d uc ti o n Ca t a l y s t 2 8 0 2. 1q : a n d V M K er n el 1 2 3 4 5 6 SC 7 8 E S X s e rv e r 2 v Sw i tc h E S X s e rv e r1 v Sw i tc h P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 62 H ow M T ru BPD If A bou t? Pr o d u c t i o n o n E S X 1 i s 8 Co2. m 1q p : l e t e l y i s o l a t S e e d c o n d a r y 0 Pr o d uc ti o n , SC , V M K er n el ro o t ro o t H A d o e s n ’t d o a n y t h i n g f o r E S X 1, VM s a r e i s o l a t e d t e d . O n E S X 2, i f y o u u s e i S CS I , t h i s i s re c o v e r fro m t h a t t h e VM s a r e p o w e r e d o f f o n E S X 2 T y p i c a l S p a n n i n g -T r e e d in E S X 1!!!!! V-S h a p e T o p o l o g y Ca t a l y s t 2 8 0 2. 1q : a n d V M K er n el a n a g e m e n t a n d VM K e r n e l a r e i s o l a n k fa s t n o t e a s y to Ug u a r d y o u u s e a n H Ac lu s te r c h a n c e s a r e a n d re s ta rte Ca t a l y s t 1 8 0 2. 1q : Pr o d uc ti o n E S X s e rv e r1 v Sw i tc h 1 2 3 4 5 6 SC 7 8 E S X s e rv e r 2 v Sw i tc h P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 63 4 N I C s w ith E th er ch a nnel “C l uster ed ” sw i tc h es 8 0 2. 1q : Pr o d uc ti o n 1 3 2 4 5 7 6 8 8 0 2. 1q : SC , V M K er n el v Sw i tc h E S X s e rv e r1 v Sw i tc h E S X s e rv e r 2 P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 64 T y p ica l E SX H A / D R S cl u ster d esig n M ain t e n an ce M o d e i n a n H A c l u s t e r l e v e r a g e s VM o t i o n M i g r a t i o n D R S cl u s t e r m a y r e q u i r e VM o t i o n M i g r a t i o n I f y o u w a n t VM s t o a u t o m a t i c a l l y M o v e t o t h e H o s t w i t h m o r e m e m o r y a n d CPU D C Co r e A g g r eg a ti o n Access1 Access2 Access E S X s e rv e rs Al l VM Pr o d u c t i o n VL AN s T r u n k e d V M w a r e “c l uster ” ( ty p i c a l l y ~ 10 -20 ser v er s) P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 65 V M otion M ig r a tion E x a m p l e R ack1 R a c k 10 v m n ic 0 E SX H o st 1 v Sw i tc h v m n ic 1 v m n ic 0 E SX H o st 2 v m n ic 1 v Sw i tc h VM1 P r e s e n ta tio n _ ID VM2 VM3 C is c o C o n fid e n tia l VM4 VM5 VM6 66 ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . N etw or k L a bel a nd V M otion V M s m ov ing from one E S X serv er to a d ifferent one l ook for th e sam e Network Label P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 67 V M otion B est P r a ctices D atapoints: Mig ration onl y happens within a VM HA/DRS cluster and/ or within a d a ta cen ter VMotion l ook s f or the N etwork L ab el to b e av ail ab l e on the T arg et E S X H ost VM MAC doesn’t chang e during the mig ration Best Practice E nab l e the option “N otif y S witch” in the v switch so that targ et v switch sends out a R AR P to update the mac-f orwarding tab l es At most the L ay er 2 domain needs to encompass ~ 1 0 -2 0 machines, set the L ay er 2 b oundary within the D ata center according l y Mak e the VMk ernel network routed, ex tend the L ay er 2 domain onl y f or the VM production traf f ic P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 68 E x p e rim e ntal R oute d Ne twork for P owe re d -off M igration or H A Cl us te r R ou ted N etwork VLAN3 VLAN2 VLAN5 VLAN4 v m n ic 0 v m n ic 1 v m n ic 2 v m n ic 0 v m n ic 2 v Sw i tc h 0 v Sw i tc h 1 v Sw i tc h 2 v Sw i tc h 0 v Sw i tc h 2 E SX H o st 2 1 0 .1 0 .3.4 1 v m k e rn e l S e r v ic e c o n s o le VM4 VLAN2 1 0 .1 0 .2. x E SX H o st 1 1 0 .1 0 .5.4 1 v m k e rn e l 1 0 .1 0 .4. x VLAN4 P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 69 A g end a VMware Architecture and Components VMware L AN N etwork ing v S witch B asics N I C T eaming v S witch v s L AN S witch Mig ration, H A, D R S Cisco/ VMware D C D E S I G N S B l ade S erv er D esig ns S torag e I mpl ications of S erv er Virtual iz ation P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 70 H and y F e ature s for L arge S c al e D e p l oy m e nts F le x lin k s F lex link s k eeps one set of ports in forwarding state and a back up set of ports are non forwarding for the same set of V L A N s T o Core R outers Y ou can hav e half V L A N s activ e on one set of link s and half V L A N s activ e on the other set of link s P reemption configurable F ailov er < 1 0 0 ms N o S panning-T ree is inv olv ed so it’s v ery light weight on the C ontrol P lane P reemption D elay C onfigurable o ff fo rc e d b a n d w id th P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 71 D e s ig n w ith th e I nte g r ate d S w itch U p l in k T ra c k in g / T ru n k R es il ien c y s w it s w it s w it s w it s w it s w it ch( ch( ch( ch( ch( ch( con con con con con con fig fig fig fig fig fig )# lin )# in -i f -r a -i f -r a -i f -r a -i f -r a k s ta te tra t r a n g e PO n g e )# lin k n g e )# in t r n g e )# lin k n g e )# e n d ck 1, st an st 1 PO a te ge a te Using Integrated Ethernet Switches 2 g r o u p 1u p s tr e a m g i g 0 / 1 - 16 g r o u p 1d o w n s tr e a m L3 Sw it c hes N o te : PO 1 i s c o m p o s e d o f g i g p o r t s 21 a n d 22 PO 2 i s c o m p o s e d o f g i g p o r t s 23 a n d 24 T h e s e E th e r c h a n n e ls m u s t b e c r e a te d s e p a r a te ly p r io r to c r e a tin g th e L a y e r 2T r u n k F a ilo v e r F e a tu r e . I n t eg rat ed L 2 sw it c hes Blade Server Chassis Interface 1 Interface 2 P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 72 H P B lad e S e r v e r + V M 8 U p lin k s 8 U p lin k s C B S-l ef t C B S-l ef t C B S-r i g h t 8 0 2. 1q C B S-r i g h t 8 0 2. 1q E SX Ser v er 2 Mgmt. Module 1 2 3 4 E SX Ser v er 1 1 2 3 v Sw i tc h 0 4 1 – 16 B l a d e Ser v er v Sw i tc h 0 Bl a d e S e r v e r E n c l o s u r e E SX ser v er s VM1 VM2 Ser v i c e VM C o n so l e K er n el VM1 VM2 Ser v i c e VM C o n so l e K er n el 73 P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l T r a ck ing on V M N etw or k P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 74 A g end a VMw a r e A r c h ite c tu r e a nd C om p one nts VMw a r e L A N N e tw or k ing C is c o/ VMw a r e D C D E S I G N S B l a d e S e r v e r D e s ig ns S tor a g e I m p l ic a tions of S e r v e r Vir tu a l iz a tion VMW A R E S tor a g e D e s ig n A s p e c ts P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 75 I t’s J u st A noth er SA N N IC T e a m ing LAN A tta ch ed H ost… Mu l ti P a th ing 8 02 . 1 q tr u nk SAN Vir tu a l S w itc h e s VL A N S e tu p 1 VMNI C0 VMNI C1 VMNI C2 VMNI C3 VS P or t G r ou p s HBA FC FC HBA Po r t G r o u p A 2 Vi r t u a l S w i t c h Po r t G r o u p B 30 L UN M a p p i n g 31 32 IP A d d r e s s ing VL AN “A” V i r tua l M a c h i n es VL AN “B” P or t G r ou p U nif or m ity Vol u m e Mg m t V i r tua l M a c h i n es Mu l tip l e Vir E S X S e r v e r H os ttu a l N I C s P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l E S X S e r v e r H os t 76 V M w a r e E SX Stor a g e Op tions FC VM iS C S I/ NF S VM DAS VM VM VM VM FC FC SCSI 80%+ of install base uses FC stor ag e iS CS I is p op ular in S M B m ar k et D A S is not p op ular bec ause it p r oh ibits V M otion P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 77 E SX N etw or k ed Stor a g e Su p p or t Type FC BootESX S er v er Yes V M o t io n Yes VM FS Yes RDM Yes MSCS S u p p o rt Yes V M w a re HA & DRS Yes NFS Yes Yes No No No Yes iS C S I ( H W ) * Yes Yes Yes Yes No Yes iS C S I ( S W ) No Yes Yes Yes No Yes P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 78 E SX F C D a ta F l ow E S X H os t VM VM 1. 2. 3. 4. Al l storag e shows up on v irtual S CS I control l er and appears as S CS I driv e reg ardl ess of storag e source O S dev ice driv er sends req uest to the v irtual S CS I control l er Virtual Machine g uest O S issues R ead/ W rite to disk HW 5. VMk ernel l ocates VM f il e on VMF S , maps v irtual to phy sical b l ock s, sends req uest to phy sical H B A driv er H B A sends F CP operations out the wire D r iv e r S C S I Layer Layer VM FS Virtual S CS I control l er f orwards command to the VMk ernel V i r tua l SC SI I n ter f a c e V M k er n el V i r tua l SC SI I n ter f a c e V i r tua l SC SI VMM V i r tua l M a c h i n e F i l e Sy stem Sc h ed ul i n g / Q uei n g – E r r o r s Pr o c . D i sc o v er y – C o m m a n d Pr o c essi n g U ti l i ti es – SC SI – i SC SI - I D E FC FC P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 79 V ir tu a l Ser ver s Sh a r e a P h y sica l H B A A z one inc lud es th e p stor ag e ar r ay A c c ess c ontr ol is d em “L U N m ask ing and m th e p h y sic al H B A p W it is th e sam e for all V T h e h y p er v isor is in c er r or s m ay be d isastr M D S9 0 0 0 M a p p in g h y sic al h ba and th e and ed to stor ag e ar r ay ap p ing ”, it is based on W N and Ms h ar g e of th e m ap p ing , ous (L U N Sto r a g e A r r a y M a p p i n g a n d M a sk i n g ) Hy p e r v i s o r V ir tu a l S e rv e rs FC HW p W W N -P FC pWWN-P Zone P r e s e n ta tio n _ ID Si n g l e L o g i n o n a Si n g l e Po i n t-to -Po i n t C o n n ec ti o n ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l FC N a m e Ser v er 80 A d atastore is sim p l y a p ool of storage, internal or networked C an b e V M F S -b ased or R awM ap p ed W ith networked storage a d atastore is a cl u ster resou rce av ail ab l e to al l E S X h osts T o enab l e V M otion a d atastore m u st b e av ail ab l e to th e sou rce and d estination E S X h osts M u l tip l e d atastores can b e d efined with in a cl u ster P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l W h a t I s a D a ta stor e? VM1 VM2 VM3 VM4 FC FC FC FC D a ta sto r e1 VM1 VM2 VM FS VM3 D a ta sto r e2 VM4 VM FS 81 R D M al l ows d irect read / write access to d isk B l ock m ap p ing is stil l m aintained with in a V M F S fil e R arel y u sed b u t im p ortant for cl u stering (M S C S su p p orted ) U sed with N PI V env ironm ents R aw D evice M a p p ing VM1 VM2 FC FC RDM M a ppi n g VM FS FC P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 82 N o storage l oad b al ancing, strictl y fail ov er T wo m od es of op eration d ictate b eh av ior (F ix ed and M ost R ecent) F ix ed M od e A llows definition of preferred paths I f preferred path fails a secondary path is used I f preferred path reappears it will fail back Stor a g e M u l ti-P a th ing VM VM FC FC M ost R ecentl y U sed I f prev ious path reappears the current path is still used I f current path fails a secondary path is used P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 83 E SX Stor a g e R ef er ence D ocu m ents ESX SAN Compatibility Guide h ttp: / / w w w . v mw ar e. c om/ pdf / v i3 _ s an _ g uide. pdf V M w ar e SAN Stor ag e D es ig n Guide iSCSI Con f ig ur ation Guide h ttp: / / w w w . v mw ar e. c om/ pdf / v i3 _ s an _ des ig n _ deploy. pdf h ttp: / / w w w . v mw ar e. c om/ pdf / v i3 _ is c s i_ c f g . pdf P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 84 A g end a VMw a r e A r c h ite c tu r e a nd C om p one nts VMw a r e L A N N e tw or k ing C is c o/ VMw a r e D C D E S I G N S B l a d e S e r v e r D e s ig ns S tor a g e I m p l ic a tions of S e r v e r Vir tu a l iz a tion VMW A R E S tor a g e D e s ig n A s p e c ts P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 85 Z oning f or V M otion VM VM VM VM VM VM VM VM VM VM FC FC VM VM VM VM VM VM VM VM VM VM FC FC VM VM VM VM VM VM VM VM VM VM FC FC VM VM VM VM VM VM VM VM VM VM FC FC VM VM VM VM VM VM VM VM VM VM FC FC P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l A ll p h y sic al inter fac es w ith in a c luster M U S T h av e ac c ess to all of th e d isk to sup p or t V M otion S M B m ay use P er m it d efault z one E nter p r ise c ustom er s id eally w ill use m any -to-m any z one 86 Over su bscr ip tion C h a l l eng es T r ad itional M D S P or t G r oup U sag e V ir tual M D S P or t G r oup U sag e VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM H y VM VMi so r VM VM VM VM p er v VM VM VM VM VM VM VM VM H y p er v i so r VM VM VM VM VM VM VM H y p er v i so r H y p er v i so r M any cu stom ers target l ow I / O serv ers for V M consol id ation b u t… Aggregation of m u l tip l e V M s on a singl e HB A increases b and wid th req u irem ents on a p er-p ort b asis P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 87 V ir tu a l Ser ver U sing N P I V a nd Stor a g e D evice M a p p ing V ir tu a l S e rv e rs V ir tual H B A s c an be z oned ind iv id ually “L U N m ask ing and m ap p ing ” is based on th e v ir tual H B A p W W N eac h V M s V er y safe w ith r esp ec t to c onfig ur ation er r or s O nly sup p or ts R D M A v ailble in E S X 3 . 5 M D S9 0 0 0 of Sto r a g e A r r a y Hy p e r v i s o r Ma p p i n g Ma p p i n g Ma p p i n g Ma p p i n g FC T o pWWN-1 T o pWWN-2 pWWN-P pWWN-1 pWWN-2 pWWN-3 pWWN-4 T o pWWN-3 T o pWWN-4 FC FC FC FC p W W N -1 p W W N -2 p W W N -3 p W W N -4 HW p W W N -P FC M ul ti p l e L o g i n s o n a Si n g l e Po i n t-to -Po i n t C o n n ec ti o n P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l FC N a m e Ser v er 88 P r e s e n ta tio n _ ID ©2 0 0 6 C is c o S y s te m s , In c . A ll r ig h ts r e s e r v e d . C is c o C o n fid e n tia l 89