haip一般出现与私网网卡上,在安装rac的过程中,通过算法生成一个169.254网段的ip地址,然后通过arp方式向局域网内发送广播,判断当局域网内无此IP时,就会正式分配此IP给rac。此haip地址是分配之后无法更改的,及时修改了私网IP地址,此IP都不会发生变化。
**************************************errpt**************************************[ph2oldb2:root]:/>errptIDENTIFIER TIMESTAMP T C RESOURCE_NAME DESCRIPTIONFE2DEE00 0726213218 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NETFE2DEE00 0726212818 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NETFE2DEE00 0726212018 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NETFE2DEE00 0726210918 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NETFE2DEE00 0726210018 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NETFE2DEE00 0726205418 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NETFE2DEE00 0726204918 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NETFE2DEE00 0726204118 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NETFE2DEE00 0726204018 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NET[ph2oldb2:root]:/>errpt -aj FE2DEE00|more [ph2oldb2:root]:/>errpt -aj FE2DEE00---------------------------------------------------------------------------LABEL: AIXIF_ARP_DUP_ADDRIDENTIFIER: FE2DEE00Date/Time: Thu Jul 26 21:32:17 BEIST 2018Sequence Number: 1612Machine Id: 00F977EF4C00Node Id: ph2oldb2Class: SType: PERMWPAR: GlobalResource Name: SYSXAIXIFDescriptionDUPLICATE IP ADDRESS DETECTED IN THE NETFailure CausesARP RESPONSE RECEIVED FOR MY IP ADDRESSRecommended ActionsCONTACT NETWORK ADMINISTRATORDetail DataDUPLICATE IP ADDRESSA9FE 62C2 MAC ADDRESS8EC2 E6E3 9D03 ---------------------------------------------------------------------------LABEL: AIXIF_ARP_DUP_ADDRIDENTIFIER: FE2DEE00Date/Time: Thu Jul 26 21:28:17 BEIST 2018Sequence Number: 1611Machine Id: 00F977EF4C00Node Id: ph2oldb2Class: SType: PERMWPAR: GlobalResource Name: SYSXAIXIFDescriptionDUPLICATE IP ADDRESS DETECTED IN THE NETFailure CausesARP RESPONSE RECEIVED FOR MY IP ADDRESSRecommended ActionsCONTACT NETWORK ADMINISTRATORDetail DataDUPLICATE IP ADDRESSA9FE 62C2 MAC ADDRESS8EC2 E6E3 9D03 DuplicatesNumber of duplicates1Time of first duplicateThu Jul 26 21:27:58 BEIST 2018Time of last duplicateThu Jul 26 21:28:17 BEIST 2018---------------------------------------------------------------------------LABEL: AIXIF_ARP_DUP_ADDRIDENTIFIER: FE2DEE00Date/Time: Thu Jul 26 21:20:57 BEIST 2018Sequence Number: 1610Machine Id: 00F977EF4C00Node Id: ph2oldb2Class: SType: PERMWPAR: GlobalResource Name: SYSXAIXIFDescriptionDUPLICATE IP ADDRESS DETECTED IN THE NETFailure CausesARP RESPONSE RECEIVED FOR MY IP ADDRESSRecommended ActionsCONTACT NETWORK ADMINISTRATORDetail DataDUPLICATE IP ADDRESSA9FE 62C2 MAC ADDRESS8EC2 E6E3 9D03 DuplicatesNumber of duplicates1Time of first duplicateThu Jul 26 21:20:47 BEIST 2018Time of last duplicateThu Jul 26 21:20:57 BEIST 2018---------------------------------------------------------------------------LABEL: AIXIF_ARP_DUP_ADDRIDENTIFIER: FE2DEE00Date/Time: Thu Jul 26 21:09:27 BEIST 2018Sequence Number: 1609Machine Id: 00F977EF4C00Node Id: ph2oldb2Class: SType: PERMWPAR: GlobalResource Name: SYSXAIXIFDescriptionDUPLICATE IP ADDRESS DETECTED IN THE NETFailure CausesARP RESPONSE RECEIVED FOR MY IP ADDRESSRecommended ActionsCONTACT NETWORK ADMINISTRATORDetail DataDUPLICATE IP ADDRESSA9FE 62C2 MAC ADDRESS8EC2 E6E3 9D03 ---------------------------------------------------------------------------LABEL: AIXIF_ARP_DUP_ADDRIDENTIFIER: FE2DEE00Date/Time: Thu Jul 26 21:00:17 BEIST 2018Sequence Number: 1608Machine Id: 00F977EF4C00Node Id: ph2oldb2Class: SType: PERMWPAR: GlobalResource Name: SYSXAIXIFDescriptionDUPLICATE IP ADDRESS DETECTED IN THE NETFailure CausesARP RESPONSE RECEIVED FOR MY IP ADDRESSRecommended ActionsCONTACT NETWORK ADMINISTRATORDetail DataDUPLICATE IP ADDRESSA9FE 62C2 MAC ADDRESS8EC2 E6E3 9D03 DuplicatesNumber of duplicates2Time of first duplicateThu Jul 26 21:00:02 BEIST 2018Time of last duplicateThu Jul 26 21:00:17 BEIST 2018---------------------------------------------------------------------------LABEL: AIXIF_ARP_DUP_ADDRIDENTIFIER: FE2DEE00Date/Time: Thu Jul 26 20:54:07 BEIST 2018Sequence Number: 1607Machine Id: 00F977EF4C00Node Id: ph2oldb2Class: SType: PERMWPAR: GlobalResource Name: SYSXAIXIFDescriptionDUPLICATE IP ADDRESS DETECTED IN THE NETFailure CausesARP RESPONSE RECEIVED FOR MY IP ADDRESSRecommended ActionsCONTACT NETWORK ADMINISTRATORDetail DataDUPLICATE IP ADDRESSA9FE 62C2 MAC ADDRESS8EC2 E6E3 9D03 DuplicatesNumber of duplicates2Time of first duplicateThu Jul 26 20:53:55 BEIST 2018Time of last duplicateThu Jul 26 20:54:07 BEIST 2018---------------------------------------------------------------------------LABEL: AIXIF_ARP_DUP_ADDRIDENTIFIER: FE2DEE00Date/Time: Thu Jul 26 20:49:27 BEIST 2018Sequence Number: 1606Machine Id: 00F977EF4C00Node Id: ph2oldb2Class: SType: PERMWPAR: GlobalResource Name: SYSXAIXIFDescriptionDUPLICATE IP ADDRESS DETECTED IN THE NETFailure CausesARP RESPONSE RECEIVED FOR MY IP ADDRESSRecommended ActionsCONTACT NETWORK ADMINISTRATORDetail DataDUPLICATE IP ADDRESSA9FE 62C2 MAC ADDRESS8EC2 E6E3 9D03 DuplicatesNumber of duplicates4Time of first duplicateThu Jul 26 20:49:09 BEIST 2018Time of last duplicateThu Jul 26 20:49:27 BEIST 2018---------------------------------------------------------------------------LABEL: AIXIF_ARP_DUP_ADDRIDENTIFIER: FE2DEE00Date/Time: Thu Jul 26 20:41:57 BEIST 2018Sequence Number: 1605Machine Id: 00F977EF4C00Node Id: ph2oldb2Class: SType: PERMWPAR: GlobalResource Name: SYSXAIXIFDescriptionDUPLICATE IP ADDRESS DETECTED IN THE NETFailure CausesARP RESPONSE RECEIVED FOR MY IP ADDRESSRecommended ActionsCONTACT NETWORK ADMINISTRATORDetail DataDUPLICATE IP ADDRESSA9FE 62C2 MAC ADDRESS8EC2 E6E3 9D03 ---------------------------------------------------------------------------LABEL: AIXIF_ARP_DUP_ADDRIDENTIFIER: FE2DEE00Date/Time: Thu Jul 26 20:40:46 BEIST 2018Sequence Number: 1604Machine Id: 00F977EF4C00Node Id: ph2oldb2Class: SType: PERMWPAR: GlobalResource Name: SYSXAIXIFDescriptionDUPLICATE IP ADDRESS DETECTED IN THE NETFailure CausesARP RESPONSE RECEIVED FOR MY IP ADDRESSRecommended ActionsCONTACT NETWORK ADMINISTRATORDetail DataDUPLICATE IP ADDRESSA9FE 62C2 MAC ADDRESS8EC2 E6E3 9D03**************************************A9FE 62C2E*16^0=14F*16^1=15*16=2409*16^2=230410*16^3=40960169.254.98.194***************禁用haip服务及haip依赖***************[ora12c1:root]:/>crsctl modify res ora.cluster_interconnect.haip -attr "ENABLED=0" -init[ora12c1:root]:/>d(ora.cssd,ora.ctssd)pullup(ora.cssd,ora.ctssd)weak(ora.drivers.acfs)'" -init <[ora12c1:root]:/>crsctl modify res ora.asm -attr "STOP_DEPENDENCIES='hard(intermediate:ora.cssd)'" -init***************关闭集群***************[ora12c1:root]:/>crsctl stop crsCRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ora12c1'CRS-2673: Attempting to stop 'ora.crsd' on 'ora12c1'CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'ora12c1'CRS-2673: Attempting to stop 'ora.oratest.db' on 'ora12c1'CRS-2677: Stop of 'ora.oratest.db' on 'ora12c1' succeededCRS-2673: Attempting to stop 'ora.DATADG.dg' on 'ora12c1'CRS-2673: Attempting to stop 'ora.SYSTEMDG.dg' on 'ora12c1'CRS-2673: Attempting to stop 'ora.MGMT.dg' on 'ora12c1'CRS-2673: Attempting to stop 'ora.TESTDG.dg' on 'ora12c1'CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'ora12c1'CRS-2677: Stop of 'ora.SYSTEMDG.dg' on 'ora12c1' succeededCRS-2677: Stop of 'ora.DATADG.dg' on 'ora12c1' succeededCRS-2677: Stop of 'ora.MGMT.dg' on 'ora12c1' succeededCRS-2677: Stop of 'ora.TESTDG.dg' on 'ora12c1' succeededCRS-2673: Attempting to stop 'ora.asm' on 'ora12c1'CRS-2677: Stop of 'ora.asm' on 'ora12c1' succeededCRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'ora12c1'CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'ora12c1' succeededCRS-2673: Attempting to stop 'ora.ora12c1.vip' on 'ora12c1'CRS-2677: Stop of 'ora.ora12c1.vip' on 'ora12c1' succeededCRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'ora12c1' succeededCRS-2672: Attempting to start 'ora.ora12c1.vip' on 'ora12c2'CRS-2676: Start of 'ora.ora12c1.vip' on 'ora12c2' succeededCRS-2673: Attempting to stop 'ora.ons' on 'ora12c1'CRS-2677: Stop of 'ora.ons' on 'ora12c1' succeededCRS-2673: Attempting to stop 'ora.net1.network' on 'ora12c1'CRS-2677: Stop of 'ora.net1.network' on 'ora12c1' succeededCRS-2792: Shutdown of Cluster Ready Services-managed resources on 'ora12c1' has completedCRS-2677: Stop of 'ora.crsd' on 'ora12c1' succeededCRS-2673: Attempting to stop 'ora.asm' on 'ora12c1'CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'ora12c1'CRS-2673: Attempting to stop 'ora.crf' on 'ora12c1'CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'ora12c1'CRS-2673: Attempting to stop 'ora.gpnpd' on 'ora12c1'CRS-2673: Attempting to stop 'ora.mdnsd' on 'ora12c1'CRS-2677: Stop of 'ora.drivers.acfs' on 'ora12c1' succeededCRS-2677: Stop of 'ora.gpnpd' on 'ora12c1' succeededCRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'ora12c1' succeededCRS-2677: Stop of 'ora.crf' on 'ora12c1' succeededCRS-2677: Stop of 'ora.mdnsd' on 'ora12c1' succeededCRS-5017: The resource action "ora.asm stop" encountered the following error: ORA-03113: end-of-file on communication channelProcess ID: 21102610Session ID: 239 Serial number: 64014. For details refer to "(:CLSN00108:)" in "/oracle/app/grid/diag/crs/ora12c1/crs/trace/ohasd_oraagent_grid.trc".CRS-2677: Stop of 'ora.asm' on 'ora12c1' succeededCRS-2679: Attempting to clean 'ora.asm' on 'ora12c1'CRS-2681: Clean of 'ora.asm' on 'ora12c1' succeededCRS-2673: Attempting to stop 'ora.ctssd' on 'ora12c1'CRS-2673: Attempting to stop 'ora.evmd' on 'ora12c1'CRS-2677: Stop of 'ora.ctssd' on 'ora12c1' succeededCRS-2677: Stop of 'ora.evmd' on 'ora12c1' succeededCRS-2673: Attempting to stop 'ora.cssd' on 'ora12c1'CRS-2677: Stop of 'ora.cssd' on 'ora12c1' succeededCRS-2673: Attempting to stop 'ora.gipcd' on 'ora12c1'CRS-2677: Stop of 'ora.gipcd' on 'ora12c1' succeededCRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ora12c1' has completedCRS-4133: Oracle High Availability Services has been stopped.***************启动集群***************[ora12c1:root]:/>crsctl stat res -t -init--------------------------------------------------------------------------------Name Target State Server State details --------------------------------------------------------------------------------Cluster Resources--------------------------------------------------------------------------------ora.asm 1 ONLINE ONLINE ora12c1 STABLEora.cluster_interconnect.haip 1 ONLINE OFFLINE STABLEora.crf 1 ONLINE ONLINE ora12c1 STABLEora.crsd 1 ONLINE ONLINE ora12c1 STABLEora.cssd 1 ONLINE ONLINE ora12c1 STABLEora.cssdmonitor 1 ONLINE ONLINE ora12c1 STABLEora.ctssd 1 ONLINE ONLINE ora12c1 OBSERVER,STABLEora.diskmon 1 OFFLINE OFFLINE STABLEora.drivers.acfs 1 ONLINE ONLINE ora12c1 STABLEora.evmd 1 ONLINE ONLINE ora12c1 STABLEora.gipcd 1 ONLINE ONLINE ora12c1 STABLEora.gpnpd 1 ONLINE ONLINE ora12c1 STABLEora.mdnsd 1 ONLINE ONLINE ora12c1 STABLEora.storage 1 ONLINE ONLINE ora12c1 STABLE--------------------------------------------------------------------------------***************恢复haip服务,重启集群***************crsctl modify res ora.cluster_interconnect.haip -attr "ENABLED=1" -init[ora12c1:root]:/>crsctl stat res -t -init--------------------------------------------------------------------------------Name Target State Server State details --------------------------------------------------------------------------------Cluster Resources--------------------------------------------------------------------------------ora.asm 1 ONLINE ONLINE ora12c1 Started,STABLEora.cluster_interconnect.haip 1 ONLINE ONLINE ora12c1 STABLEora.crf 1 ONLINE ONLINE ora12c1 STABLEora.crsd 1 ONLINE ONLINE ora12c1 STABLEora.cssd 1 ONLINE ONLINE ora12c1 STABLEora.cssdmonitor 1 ONLINE ONLINE ora12c1 STABLEora.ctssd 1 ONLINE ONLINE ora12c1 OBSERVER,STABLEora.diskmon 1 OFFLINE OFFLINE STABLEora.drivers.acfs 1 ONLINE ONLINE ora12c1 STABLEora.evmd 1 ONLINE ONLINE ora12c1 STABLEora.gipcd 1 ONLINE ONLINE ora12c1 STABLEora.gpnpd 1 ONLINE ONLINE ora12c1 STABLEora.mdnsd 1 ONLINE ONLINE ora12c1 STABLEora.storage 1 ONLINE ONLINE ora12c1 STABLE-------------------------------------------------------------------------------
官方建议:
1.Run "crsctl stop crs" on all nodes to stop CRS stack.2. 关闭HAIP
2. On one node, run the following commands:
$CRS_HOME/bin/crsctl start crs -excl -nocrs $CRS_HOME/bin/crsctl stop res ora.asm -init $CRS_HOME/bin/crsctl modify res ora.cluster_interconnect.haip -attr "ENABLED=0" -init $CRS_HOME/bin/crsctl modify res ora.asm -attr "START_DEPENDENCIES='hard(ora.cssd,ora.ctssd)pullup(ora.cssd,ora.ctssd)weak(ora.drivers.acfs)',STOP_DEPENDENCIES='hard(intermediate:ora.cssd)'" -init $CRS_HOME/bin/crsctl stop crs4. 进一步测试3. Repeat Step(2) on other nodes.4. Run "crsctl start crs" on all nodes to restart CRS stack.