IBM+P570主机在线更换HBA卡详细过程

IBM+P570主机在线更换HBA卡详细过程IBMP570主机在线更换HBA卡详细过程 mfkqwyc86Version: 作者:周铃Email:mikqwyc86@163.comUpdate Date: 2010.06ocat ionU7879. 001, DQDKKNT-P1-C5-T1DescriptionADAPTER ERRORProbable causesADAPTER HARDWARE OR CABLEADAPTER MI CROCODEFIBRE CHANNEL SW I TCH OR FC-AL HUBFailure causesADAPTERCABLES AND CONNECT I ONSDEVI CERecommended Actions限于个人学习参考使月PERFORM PROBLEM DETERMINAT ION PROCEDURESCHECK CABLES AND THEIR CONNECT IONSVERIFY DEV I CE CONF I GURAT IONP570_RAG1:/# fget config-Aν/查看存储链路现状daro-.User array name=dS4000dac1 active dacO ACTIVEDiskDAC LUN Logical Dr ivetmhdisk2 dac1 0hdisk3 dac 1hdisk4 dac 1hdisk5 dac13hdisk6 dac1)4hdisk7 dac1 5hd isk dac12、根据erpt信息确认硬件状态检查上机HBA卡fs0所在位置U787900 QDKKWT-P1-C5-T1,发现HBA卡已无光,同时通过Storage Manager Client登录DS4000,存储链路发生了切换,由于证明HBA卡fs0损坏,需要更换。ITPUB个人空间http://space.itpubnet/9664900第3页共11页IBMP570主机在线更换HBA卡详细过程 mfkqwyc86Version: 作者:周铃Email:mikqwyc86@163.comUpdate Date: 2010.062.故障处理2.1.处理结果1、通过在线更换P570主机的HBA卡fcs0后故障解决22.处理过程1、准备工作1)工具:防静电手套、镙线刀2)更换HBA卡期间,尽量选择在业务较闲时操作,防止意外造成业务中断造成较人的损失。3)能备份的操作尽量备份,如SAN交换机配置备份、存储配置备份,并确认数据库的备份有效。2、检查是否满足AIX版本和文件集的最低要求官方要求如下Table 12. Minimum A/X operating systems and file set versions required for supporting HBAhot swapOperating systemPackage nameMinimum file set versionAⅨX5.1devices. fcp. disk array rte5.1.0.65AX5.2devices. fcp. disk array rte5.2.0.60AX5.3devices. fcp disk array rte5.3.0.20检查本次需要更换IBA卡的P570,证明已满足官方要求,如下:P570_RAC1: / IsIpp -h grep fcpdevices. fcp. disk array di agdev ices fcp. disk. array rtedevices. fcp. disk. rte5.3.0. 42 APPLI ED FC SCSI CD-ROM. Diskdev ices. fcp. tape. rt5. 0. 42 APPLlED FC SCSI Tape Device Softwaredevices. fcp disk array rtedevices. fcp. disk rte5.3.0.30 COMMITTED FC SCS CD-ROM. Diskdevices. fcp. tape rte 5. 3.0. 30 CoMMiTTed fc scs tape Dev ice Software/注意:●在热插拔更换HBA卡的过程中,dar的 autor ecovery属性必须设置为否(no),否则有丢失数据访问的可能。必须在确认HBA卡更换完成,后续的配置工作也完成之后,才可以“ Redistr ibute logical Drivesto the preferred path",否则有丢失数据访问的可能。3、查看HBA卡当前状态,记录相关信息P570_RAC1: /# Isdev-c grep fcsITPUB个人空间http://space.itpubnet/9664900第4页共11页IBMP570主机在线更换HBA卡详细过程 mfkqwyc86Version: 作者:周铃Email:mikqwyc86@163.comUpdate Date: 2010.06fcsOAvailable oB-08FC AdapterfcsAvailable on-08FC AdapterP570_RAC1: / Isdev -c grep dacdacoAvailable ob-08-021815DS4800 Disk Array Controllerdac 1Available oN-08-021815DS4800 Disk Array ControllerP570 RAC1: / Iscfg -vpI fcsO007879. 001. DQDKKWT-P1-C5-T1 FC AdapterPart Number.03N5014EC LevelASerial number..,,,,,,,,,,,,.1B60801814ManufacturerFeature Code/Market ing ID.. 280DFRU Number,,,,,,,,,,,03N5014Device Specif ic(ZMNetwor k Address..10000000c9531814ROS Leve and D...02C82134Device Specific(z0)1036406DDevice Spec ific.(Z1)....00000000Device Specific.(Z2)00000000Dev ice Spec fic(Z3)03000909Device Specific.(Z4..FFC01158Device Spec ific.(Z5)02c82134Device Spec ific.(z6)06032134Device Specific(Z7)07C32134Dev ice Specific.(28)....200000009531814Device Spec ific.(Z9)..BS2.10X4Device SpecifiC(ZA)B1D2.10X4Device Specific(ZB).... B2D2 10X4Device Spec i fic.(YL)U7879.001. DODKKWT-P1-C5-T1PLATFORM SPECIFICName: fibre-channe IMode LP11000Node: fibre-channe I i@Device Type: fcpPhysical Location: U7879. 001. DQDKKWT-P1-05-T1根据 Physical location硝定HBA卡位置:在U7879.001 DQDKKWT柜子中P1C5槽位,如下图:ITPUB个人空间http://space.itpubnet/9664900第5页共11页IBMP570主机在线更换HBA卡详细过程 mfkqwyc86Version: 作者:周铃Email:mikqwyc86@163.comUpdate Date: 2010.06P1-C1P1-c6/P1-c7P1-T10P1-C2P1-c8-T1P1-12CP1-C3P1-C8-12P1-T1P1-C4P1-C8-T3P1-T2P1-c5P1-c8-T4P1-T3P1-E1PTE|°世山可次P1-C7-T1P1-T4P1-T8 P1-T9P1T10P1-C7-T2P1-T6P1-T5P1-T7IPHAH50Q-24、查看DAR的 autorecovery属性P570 RAC1: / Isattr -El darOact controller dacO dacl Active ControllersFalsefre600Polled aen frequency in secondsTrueall controller daco daclAvailable controllersFalseautorecovery noautorecover after failure is corrected Truebalance trcq600Dynamic Load Balancing frcqucncy in seconds Truccache size4096Cache size for both controllersFalsefast write ok yesFast Write availableFalseheld in reset noneHeld-in-reset controllerTruehlthchk freq 600Health check frequency in secondsTload balancing noDynamic Load Balancingrueswitch retries 5Number of times to retry failed switches True确认 autorccovcry的属性为no。如果 autorccovcry属性为Yes,需用如下命令手动关闭P570 RAC1: / chev -I daro -a autorecover y=no5、热插拔更换HBA卡1)删除需更换的fcs卡,将其状态置为 definedP570 RAC1: / rmdev -RI fcsOITPUB个人空间http://space.itpubnet/9664900第6页共11页IBMP570主机在线更换HBA卡详细过程 mfkqwyc86Version: 作者:周铃Email:mikqwyc86@163.comUpdate Date: 2010.06mdey -rl fcsefcnete defineddace Definedfscsi0 Definedfcse Defined2)物理更换HBA卡dag1 ask Selection-> Hot Plug ->PCI Hot Plug Manager通过此处在线更换HBA卡,过程如下图父注意:此时不要将光纤线插回新换上的HBA卡%Figure 1. Lift up the EMC shieldFigure 2. Rotate the emc shield into the open positionFigure 3. PCI adapter cassette removed from the system unit3)用光纤环回堵头测试新更换上的HBA卡将 fibre channel loop back堵头插入HBA卡,然后扫描设备:P570 RAC1: / cfgmgr注意:ITPUB个人空间http://space.itpubnet/9664900第7页共11页IBMP570主机在线更换HBA卡详细过程 mfkqwyc86Version: 作者:周铃Email:mikqwyc86@163.comUpdate Date: 2010.06新的HBA卡会被放在 Mapping里的 Default group中,如果 Default group中存在 hd i sk的映射,则在 cfgmgr之后对应新的HBA卡会产生多余dar和dac设备。在后面更新完 Mapp ing中的WwPN信息后,使用 rmdev命令删除多余的dar和dac设备检查更换上的HBA卡为 Availablc状态P570 RAC1: / Isdev-c grep fcso4)、检查更换上的HBA卡是否需要升级微码P570 RAC1: / Iscfg -vpI fcsoU7879. 001. DODKKWT-P1-C5-T1 FC AdapterPart Number...03N5014EC Leve lSeria number...,,,,,,,,,,,,1B70701314Manufacturer,,,,,,,001BFeature Code/Marketing ID.. 280DFRU Numb03N5014Device Spec if ic. (ZM)Networ k Address...1000000009601314ROS Leve and|D..,,,,,,,,,,02c82138DSev ice spec IC1036406DDevice Spec ific.(Z1)00000000evice Spec ific.(Z2)..00000000Device Specific.(Z3)3000909Device Specific(Z4FFc01159Device Specific(Z502c82138Device Specific. (Z6).,..06C32138Device Spec ific.(Z707032138Dev ice Speci f ic(Z8)20000000c9601314Dev ice Spec ic. (Z9BSs2.10X8微码没问题,不需要升级。Device Specific(ZA)B1D2.10X8Device Specific(ZB).... B2D2 10X8Device Spec ific. ( YL)U7879.001. DQDKKWT-P1-C5-T15)重新将HBA卡置为 Defined状态P570 RAC1: / rmdev -Ri fcsO6、在DS4000 Storage Manager的 Mapping配置中更新HBA卡WwPN信息Storagc Manager Clicnt->Mappings-> Show All Host Port Information查找已被更换的HBA卡fcs0的WWPN号,查看其别名( alias)ITPUB个人空间http://space.itpubnet/9664900第8页共11页IBMP570主机在线更换HBA卡详细过程 mfkqwyc86Version: 作者:周铃Email:mikqwyc86@163.comUpdate Date: 2010.06Storage Subsystem Viex Pinc Aray Loccal Drive Contreller Drive Adranced HelpDefineALOgical/Physical View围veTopologyBeplace Host Port.e-storage SubsystemSocN DINe NeAccessible BY LUNShow A Most Port InformationHortOris上 Uhdetned Mopp RgsHost OronDefei GroupHost OrionHost Group ExchangeHost orona日0toro3 LMAHos Ports地ApE00题 HBA Host PoBRE 001选择对应P70RACf0别名的 HBA HoSt ports, Mappings> Replace host port,输入新的16位WWPN号码。torage Subsystem Viez Tappings Aray Loaiea Drive Coatrdzler Drive Advanced HelpLogical/Physical viewTopologyDefned MappingsReplace Host Port9-storage SubsAccessible ByUNShow All Kost Port InformationHost Orione日 Endet ned MeK·Host oronDefaut GroupHost orona E=Host Group ExchanHost orion8日0Host oriona LHBA Host Ports回 HBA Host Port FBRE0HBA Host PortBRE 0017、更换HBA卡后的配置操作1)在主机上拔下f0卡上的光纤环回堵头,并插入原光纤线。2)检查SAN交换机的Zone配置在SAN交换机上,如果有绑定WWPN的光纤交换机,修改Zone配置,如果绑定端口,则不用处理3)SAN交换机注册HBA卡的wwPN号在P570RAC1主机中运行 cfgm重新扫描设备后,登录SAN交换机,检查HBA卡在光纤交换札上是否注册新的WWPN号。4)检查fcs和dac设备处于 available状态P570 RAC1: / Isdev-c grep fcsoP570 RAC1: / I -c grep fcs1P570 RAC1: / Isdev-C grep dacoP570 RAC1: / Isdev-C grep dac1ITPUB个人空间http://space.itpubnet/9664900第9页共11页IBMP570主机在线更换HBA卡详细过程 mfkqwyc86Version: 作者:周铃Email:mfkqwyc86(@163.comUpdate Date: 2010.065)检查是否有多余的dar设备,当前的dar设备是否处于 Available状态,并删除多余的dar设备。(每个DS4000柜子只能对应一个dar设备)P570 RAC1: / Isdev-C grep dar6)检查每个dar下是否有两个 active的dac设备P570_ RAC1: / Isattr -El daro grep act controllerP570 RAC1: / Isattr-El dar1 grep act controller7)在DS4000存储上重新分布光纤链路,将之前切换的路径调整冋之前的控制器在 Storage Manager Client中相应的lun+ change→ Ownership/ Preferred Path→ Controller in Slot A/B操作如下图Storage Subsystem View Mappings Array Logical Drive Controller Drive Advanced HelpG Logical/Physical View B Mappings ViewLob/ Storage Subsystem DS4700PhysicalEnclosure 100- Show FC Show SATA+l-OTotal Unconfigured Capacity (56. 44 TB)(front)0RAD5)058.0GB1目目目日目国目目目目目目日Create ArrayFreeChangeModification Priority,.Increase Capacity,,Cache Settings.Create Copy.Media Scan Settings, ,Create Remote MirrorPre-Read Redundancy Check.Create FlashCopy Logical DriveOwnership/PreFerred Path|◆ ntroller in5 lot A(PreferredSegment SizeController in slot BRenameProperties00000000000000OO8)检查P570RAC1主机上的光纤链路P570RAC1:/# fget config-Av//查看存储链路现状daroUser array name =D$4000dac1 active dacO ACTIVEDisk DAc LUN Logical Dr ivetm21hdisk2 dac1 0hd isk3 dacOhdisk4 dac1 2hdisk 5 daco 3diskoITPUB个人空间http://space.itpubnet/9664900第10页共11页