oracle rac vip不通,Oracle RAC 中vip网关引起错误的解决-程序员宅基地

技术标签: oracle rac vip不通  

在虚拟机上刚装完Oracle RAC,重新启动系统后。重新启动了oracle所有的服务,一开始所有的服务都正常。

但是过了一会,节点2的vip又再次飘移到了节点1上,并且节点2的监听服务也OFFLINE了。反复启动了几次都是同样的效果的。

[root@node2 bin]# ./crs_stat -t

Name          Type          Target    State    Host

------------------------------------------------------------

ora.devdb.db  application    ONLINE    ONLINE    node2

ora....b1.inst application    ONLINE    ONLINE    node1

ora....b2.inst application    ONLINE    ONLINE    node2

ora....SM1.asm application    ONLINE    ONLINE    node1

ora....E1.lsnr application    ONLINE    ONLINE    node1

ora.node1.gsd  application    ONLINE    ONLINE    node1

ora.node1.ons  application    ONLINE    ONLINE    node1

ora.node1.vip  application    ONLINE    ONLINE    node1

ora....SM2.asm application    ONLINE    ONLINE    node2

ora....E2.lsnr application    ONLINE    OFFLINE

ora.node2.gsd  application    ONLINE    ONLINE    node2

ora.node2.ons  application    ONLINE    ONLINE    node2

ora.node2.vip  application    ONLINE    ONLINE    node1

节点2上的监听没有起,并且节点2的vip起在节点1上。之前监听器是在节点1上建立的一个集群监听。

尝试将节点2的vip停止下来再重新启动,发现只能在节点1上启动。

/u01/app/oracle/crs/log/node2/crsd/crsd.log的日志报错:

2014-11-03 13:41:33.386: [ CRSRES][2659736480]0Attempting to start `ora.node2.vip` on member `node2`

2014-11-03 13:41:46.720: [ CRSAPP][2659736480]0StartResource error for ora.rac10g2.vip error code = 1

2014-11-03 13:41:51.405: [ CRSRES][2659736480]0Start of `ora.node2.vip` on member `node2` failed.

2014-11-03 13:41:51.532: [ CRSRES][2659736480]0Attempting to start `ora.node2.vip` on member `node1`

2014-11-03 13:41:55.388: [ CRSRES][2659736480]0Start of `ora.node2.vip` on member `node1` succeeded.

将所有服务都停止,然后一一重启就好了。

[root@node2 bin]# ./crs_stat -t

Name          Type          Target    State    Host

------------------------------------------------------------

ora.devdb.db  application    ONLINE    ONLINE    node2

ora....b1.inst application    ONLINE    ONLINE    node1

ora....b2.inst application    ONLINE    ONLINE    node2

ora....SM1.asm application    ONLINE    ONLINE    node1

ora....E1.lsnr application    ONLINE    ONLINE    node1

ora.node1.gsd  application    ONLINE    ONLINE    node1

ora.node1.ons  application    ONLINE    ONLINE    node1

ora.node1.vip  application    ONLINE    ONLINE    node1

ora....SM2.asm application    ONLINE    ONLINE    node2

ora....E2.lsnr application    ONLINE    ONLINE    node2

ora.node2.gsd  application    ONLINE    ONLINE    node2

ora.node2.ons  application    ONLINE    ONLINE    node2

ora.node2.vip  application    ONLINE    ONLINE    node2

但是过了一会,节点2的vip又再次飘移到了节点1上,并且节点2的监听服务也OFFLINE了。

在/u01/app/oracle/crs/log/node2/racg下的ora.node2.vip.log日志中发现如下报错:

[root@node2 bin]# cat /u01/app/oracle/product/crs/log/node2/racg/ora.node2.vip.log

Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2005 Oracle.  All rights reserved.

2014-11-03 09:58:20.864: [    RACG][3067430592] [8114][3067430592][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 09:58:20.864: [    RACG][3067430592] [8114][3067430592][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 09:58:20.864: [    RACG][3067430592] [8114][3067430592][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 09:58:20.864: [    RACG][3067430592] [8114][3067430592][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.330s

2014-11-03 09:58:20.864: [    RACG][3067430592] [8114][3067430592][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.340s

2014-11-03 10:01:36.674: [    RACG][3068290752] [12884][3068290752][ora.node2.vip]: IP:143.168.0.15 is already up in the network (host=node2)

2014-11-03 10:01:36.674: [    RACG][3068290752] [12884][3068290752][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 10:01:36.674: [    RACG][3068290752] [12884][3068290752][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2

2014-11-03 10:01:36.674: [    RACG][3068290752] [12884][3068290752][ora.node2.vip]: clsrcexecut: rc = 1, time = 2.240s

2014-11-03 10:01:38.818: [    RACG][3068290752] [12884][3068290752][ora.node2.vip]: IP:143.168.0.15 is already up in the network (host=node2)

2014-11-03 10:01:38.818: [    RACG][3068290752] [12884][3068290752][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 10:01:38.818: [    RACG][3068290752] [12884][3068290752][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 10:01:38.818: [    RACG][3068290752] [12884][3068290752][ora.node2.vip]: clsrcexecut: rc = 1, time = 2.150s

2014-11-03 10:01:38.818: [    RACG][3068290752] [12884][3068290752][ora.node2.vip]: end for resource = ora.node2.vip, action = start, status = 1, time = 4.530s

2014-11-03 10:01:41.418: [    RACG][3068180160] [13098][3068180160][ora.node2.vip]: bounce eth0 (host=node2)

2014-11-03 10:05:41.296: [    RACG][3067840192] [18850][3067840192][ora.node2.vip]: IP:143.168.0.15 is already up in the network (host=node2)

2014-11-03 10:05:41.296: [    RACG][3067840192] [18850][3067840192][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 10:05:41.296: [    RACG][3067840192] [18850][3067840192][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2

2014-11-03 10:05:41.296: [    RACG][3067840192] [18850][3067840192][ora.node2.vip]: clsrcexecut: rc = 1, time = 2.150s

2014-11-03 10:05:43.434: [    RACG][3067840192] [18850][3067840192][ora.node2.vip]: IP:143.168.0.15 is already up in the network (host=node2)

2014-11-03 10:05:43.434: [    RACG][3067840192] [18850][3067840192][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 10:05:43.434: [    RACG][3067840192] [18850][3067840192][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 10:05:43.434: [    RACG][3067840192] [18850][3067840192][ora.node2.vip]: clsrcexecut: rc = 1, time = 2.140s

2014-11-03 10:05:43.434: [    RACG][3067840192] [18850][3067840192][ora.node2.vip]: end for resource = ora.node2.vip, action = start, status = 1, time = 4.350s

2014-11-03 10:05:45.791: [    RACG][3067639488] [19001][3067639488][ora.node2.vip]: bounce eth0 (host=node2)

2014-11-03 10:53:28.997: [    RACG][3067741888] [2298][3067741888][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 10:53:28.997: [    RACG][3067741888] [2298][3067741888][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 10:53:28.997: [    RACG][3067741888] [2298][3067741888][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 10:53:28.997: [    RACG][3067741888] [2298][3067741888][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.390s

2014-11-03 10:53:28.997: [    RACG][3067741888] [2298][3067741888][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 9.930s

2014-11-03 10:56:47.744: [    RACG][3067373248] [7351][3067373248][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 10:56:47.745: [    RACG][3067373248] [7351][3067373248][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 10:56:47.745: [    RACG][3067373248] [7351][3067373248][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 10:56:47.745: [    RACG][3067373248] [7351][3067373248][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.320s

2014-11-03 10:56:47.745: [    RACG][3067373248] [7351][3067373248][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.340s

2014-11-03 10:58:35.730: [    RACG][3067692736] [9859][3067692736][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 10:58:35.730: [    RACG][3067692736] [9859][3067692736][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 10:58:35.730: [    RACG][3067692736] [9859][3067692736][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2

2014-11-03 10:58:35.730: [    RACG][3067692736] [9859][3067692736][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.240s

2014-11-03 10:58:42.058: [    RACG][3067692736] [9859][3067692736][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 10:58:42.058: [    RACG][3067692736] [9859][3067692736][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 10:58:42.058: [    RACG][3067692736] [9859][3067692736][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 10:58:42.058: [    RACG][3067692736] [9859][3067692736][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.330s

2014-11-03 10:58:42.058: [    RACG][3067692736] [9859][3067692736][ora.node2.vip]: end for resource = ora.node2.vip, action = start, status = 1, time = 15.590s

2014-11-03 11:01:20.158: [  OCRMSG][3068126912]prom_rpc: CLSC send failure..ret code 11

2014-11-03 11:01:20.187: [  OCRMSG][3068126912]prom_rpc: possible OCR retry scenario

2014-11-03 11:01:21.188: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #0

2014-11-03 11:01:21.380: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:22.382: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #1

2014-11-03 11:01:22.567: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:23.569: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #2

2014-11-03 11:01:23.757: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:24.758: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #3

2014-11-03 11:01:24.946: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:25.947: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #4

2014-11-03 11:01:26.138: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:27.139: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #5

2014-11-03 11:01:27.327: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:28.328: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #6

2014-11-03 11:01:28.523: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:29.525: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #7

2014-11-03 11:01:29.708: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:30.709: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #8

2014-11-03 11:01:30.893: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:31.894: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #9

2014-11-03 11:01:32.080: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:33.081: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #10

2014-11-03 11:01:33.269: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:34.271: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #11

2014-11-03 11:01:34.459: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:35.461: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #12

2014-11-03 11:01:35.647: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:36.649: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #13

2014-11-03 11:01:36.836: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:37.837: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #14

2014-11-03 11:01:38.024: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

[  OCRAPI][3068126912]a_get_last_error: Buf too small (0, 95)

2014-11-03 11:01:38.024: [    RACG][3068126912] [13698][3068126912][ora.node2.vip]: clsrccssgetnodename: clssnsqname() failed. rc=21

2014-11-03 11:01:38.216: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:39.217: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #0

2014-11-03 11:01:39.399: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:40.400: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #1

2014-11-03 11:01:40.584: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:41.587: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #2

2014-11-03 11:01:41.779: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:42.780: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #3

2014-11-03 11:01:42.970: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:43.972: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #4

2014-11-03 11:01:44.159: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:45.162: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #5

2014-11-03 11:01:45.347: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:46.348: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #6

2014-11-03 11:01:46.541: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:47.542: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #7

2014-11-03 11:01:47.729: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:48.731: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #8

2014-11-03 11:01:48.919: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:49.920: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #9

2014-11-03 11:01:50.103: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:51.107: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #10

2014-11-03 11:01:51.294: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:52.295: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #11

2014-11-03 11:01:52.488: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:53.489: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #12

2014-11-03 11:01:53.676: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:54.677: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #13

2014-11-03 11:01:54.865: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:55.867: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #14

2014-11-03 11:01:56.050: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

[  OCRAPI][3068126912]a_get_last_error: Buf too small (0, 95)

2014-11-03 11:01:56.051: [    RACG][3068126912] [13698][3068126912][ora.node2.vip]: clsrccssgetnodename: clssnsqname() failed. rc=21

2014-11-03 11:01:56.051: [    RACG][3068126912] [13698][3068126912][ora.node2.vip]: clsrcep: clsrcgetnodename error: leaving node name null

2014-11-03 11:01:56.237: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:57.239: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #0

2014-11-03 11:01:57.434: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:58.436: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #1

2014-11-03 11:01:58.629: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:01:59.630: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #2

2014-11-03 11:01:59.817: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:02:00.819: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #3

2014-11-03 11:02:01.006: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:02:02.008: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #4

2014-11-03 11:02:02.192: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:02:03.193: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #5

2014-11-03 11:02:03.402: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:02:04.403: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #6

2014-11-03 11:02:04.587: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:02:05.589: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #7

2014-11-03 11:02:05.775: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:02:06.777: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #8

2014-11-03 11:02:06.965: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:02:07.966: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #9

2014-11-03 11:02:08.155: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:02:09.156: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #10

2014-11-03 11:02:09.348: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:02:10.349: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #11

2014-11-03 11:02:10.535: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:02:11.536: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #12

2014-11-03 11:02:11.722: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:02:12.722: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #13

2014-11-03 11:02:12.908: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

2014-11-03 11:02:13.909: [  OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #14

2014-11-03 11:02:14.096: [  OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9

[  OCRAPI][3068126912]a_get_last_error: Buf too small (0, 95)

2014-11-03 11:02:14.096: [    RACG][3068126912] [13698][3068126912][ora.node2.vip]: clsrccssalive: Unable to get node number stat=21

2014-11-03 11:22:23.844: [    RACG][3068208832] [27259][3068208832][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 11:22:23.844: [    RACG][3068208832] [27259][3068208832][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 11:22:23.844: [    RACG][3068208832] [27259][3068208832][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 11:22:23.844: [    RACG][3068208832] [27259][3068208832][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.330s

2014-11-03 11:22:23.844: [    RACG][3068208832] [27259][3068208832][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.350s

2014-11-03 11:24:23.113: [    RACG][3068204736] [30064][3068204736][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 11:24:23.114: [    RACG][3068204736] [30064][3068204736][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 11:24:23.114: [    RACG][3068204736] [30064][3068204736][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2

2014-11-03 11:24:23.114: [    RACG][3068204736] [30064][3068204736][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.310s

2014-11-03 11:24:32.479: [    RACG][3068204736] [30064][3068204736][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 11:24:32.479: [    RACG][3068204736] [30064][3068204736][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 11:24:32.479: [    RACG][3068204736] [30064][3068204736][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 11:24:32.479: [    RACG][3068204736] [30064][3068204736][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.360s

2014-11-03 11:24:32.479: [    RACG][3068204736] [30064][3068204736][ora.node2.vip]: end for resource = ora.node2.vip, action = start, status = 1, time = 18.690s

2014-11-03 13:49:31.224: [    RACG][3067307712] [4955][3067307712][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 13:49:31.266: [    RACG][3067307712] [4955][3067307712][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 13:49:31.266: [    RACG][3067307712] [4955][3067307712][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2

2014-11-03 13:49:31.266: [    RACG][3067307712] [4955][3067307712][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.680s

2014-11-03 13:49:40.790: [    RACG][3067307712] [4955][3067307712][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 13:49:40.790: [    RACG][3067307712] [4955][3067307712][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 13:49:40.790: [    RACG][3067307712] [4955][3067307712][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 13:49:40.790: [    RACG][3067307712] [4955][3067307712][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.530s

2014-11-03 13:49:40.790: [    RACG][3067307712] [4955][3067307712][ora.node2.vip]: end for resource = ora.node2.vip, action = start, status = 1, time = 19.720s

2014-11-03 13:53:22.690: [    RACG][3068077760] [10724][3068077760][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 13:53:22.690: [    RACG][3068077760] [10724][3068077760][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 13:53:22.690: [    RACG][3068077760] [10724][3068077760][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 13:53:22.690: [    RACG][3068077760] [10724][3068077760][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.440s

2014-11-03 13:53:22.690: [    RACG][3068077760] [10724][3068077760][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.460s

2014-11-03 14:16:51.547: [    RACG][3067770560] [12993][3067770560][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 14:16:51.547: [    RACG][3067770560] [12993][3067770560][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 14:16:51.547: [    RACG][3067770560] [12993][3067770560][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2

2014-11-03 14:16:51.547: [    RACG][3067770560] [12993][3067770560][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.250s

2014-11-03 14:20:23.748: [    RACG][3067922112] [18191][3067922112][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 14:20:23.749: [    RACG][3067922112] [18191][3067922112][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 14:20:23.749: [    RACG][3067922112] [18191][3067922112][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 14:20:23.749: [    RACG][3067922112] [18191][3067922112][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.220s

2014-11-03 14:20:23.749: [    RACG][3067922112] [18191][3067922112][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.240s

2014-11-03 14:28:08.920: [    RACG][3068122816] [29510][3068122816][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 14:28:08.921: [    RACG][3068122816] [29510][3068122816][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 14:28:08.921: [    RACG][3068122816] [29510][3068122816][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 14:28:08.921: [    RACG][3068122816] [29510][3068122816][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.360s

2014-11-03 14:28:08.921: [    RACG][3068122816] [29510][3068122816][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.370s

2014-11-03 14:37:35.267: [    RACG][3067410112] [10640][3067410112][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 14:37:35.267: [    RACG][3067410112] [10640][3067410112][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 14:37:35.267: [    RACG][3067410112] [10640][3067410112][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 14:37:35.267: [    RACG][3067410112] [10640][3067410112][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.280s

2014-11-03 14:37:35.267: [    RACG][3067410112] [10640][3067410112][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.300s

2014-11-03 14:40:36.266: [    RACG][3067541184] [15021][3067541184][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 14:40:36.266: [    RACG][3067541184] [15021][3067541184][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 14:40:36.266: [    RACG][3067541184] [15021][3067541184][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 14:40:36.266: [    RACG][3067541184] [15021][3067541184][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.310s

2014-11-03 14:40:36.267: [    RACG][3067541184] [15021][3067541184][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.380s

2014-11-03 14:43:27.050: [    RACG][3067307712] [19015][3067307712][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 14:43:27.050: [    RACG][3067307712] [19015][3067307712][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 14:43:27.050: [    RACG][3067307712] [19015][3067307712][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2

2014-11-03 14:43:27.050: [    RACG][3067307712] [19015][3067307712][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.280s

2014-11-03 14:47:19.942: [    RACG][3067995840] [23291][3067995840][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 14:47:19.942: [    RACG][3067995840] [23291][3067995840][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 14:47:19.942: [    RACG][3067995840] [23291][3067995840][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 14:47:19.942: [    RACG][3067995840] [23291][3067995840][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.230s

2014-11-03 14:47:19.942: [    RACG][3067995840] [23291][3067995840][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.250s

2014-11-03 14:51:49.744: [    RACG][3067389632] [30018][3067389632][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 14:51:49.745: [    RACG][3067389632] [30018][3067389632][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 14:51:49.745: [    RACG][3067389632] [30018][3067389632][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 14:51:49.745: [    RACG][3067389632] [30018][3067389632][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.520s

2014-11-03 14:51:49.745: [    RACG][3067389632] [30018][3067389632][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.540s

2014-11-03 15:54:22.213: [    RACG][3067971264] [5646][3067971264][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 15:54:22.218: [    RACG][3067971264] [5646][3067971264][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 15:54:22.218: [    RACG][3067971264] [5646][3067971264][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 15:54:22.218: [    RACG][3067971264] [5646][3067971264][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.380s

2014-11-03 15:54:22.218: [    RACG][3067971264] [5646][3067971264][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.430s

2014-11-03 15:59:28.335: [    RACG][3067631296] [13317][3067631296][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 15:59:28.335: [    RACG][3067631296] [13317][3067631296][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 15:59:28.335: [    RACG][3067631296] [13317][3067631296][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2

2014-11-03 15:59:28.335: [    RACG][3067631296] [13317][3067631296][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.510s

2014-11-03 16:37:22.661: [    RACG][3067848384] [31375][3067848384][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 16:37:22.661: [    RACG][3067848384] [31375][3067848384][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 16:37:22.661: [    RACG][3067848384] [31375][3067848384][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 16:37:22.661: [    RACG][3067848384] [31375][3067848384][ora.node2.vip]: clsrcexecut: rc = 1, time = 51.290s

2014-11-03 16:37:22.661: [    RACG][3067848384] [31375][3067848384][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 113.690s

2014-11-03 16:37:57.544: [    RACG][3067524800] [32281][3067524800][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 16:37:57.545: [    RACG][3067524800] [32281][3067524800][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 16:37:57.545: [    RACG][3067524800] [32281][3067524800][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 16:37:57.545: [    RACG][3067524800] [32281][3067524800][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.720s

2014-11-03 16:37:57.545: [    RACG][3067524800] [32281][3067524800][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 11.210s

2014-11-03 16:43:06.214: [    RACG][3067926208] [5514][3067926208][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 16:43:06.215: [    RACG][3067926208] [5514][3067926208][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 16:43:06.215: [    RACG][3067926208] [5514][3067926208][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2

2014-11-03 16:43:06.215: [    RACG][3067926208] [5514][3067926208][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.250s

2014-11-03 16:44:25.848: [    RACG][3067700928] [7520][3067700928][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 16:44:25.848: [    RACG][3067700928] [7520][3067700928][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 16:44:25.848: [    RACG][3067700928] [7520][3067700928][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 16:44:25.848: [    RACG][3067700928] [7520][3067700928][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.380s

2014-11-03 16:44:25.848: [    RACG][3067700928] [7520][3067700928][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.400s

2014-11-03 16:49:22.955: [    RACG][3067414208] [14413][3067414208][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 16:49:22.955: [    RACG][3067414208] [14413][3067414208][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 16:49:22.955: [    RACG][3067414208] [14413][3067414208][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2

2014-11-03 16:49:22.955: [    RACG][3067414208] [14413][3067414208][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.320s

2014-11-03 16:49:32.234: [    RACG][3067414208] [14413][3067414208][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 16:49:32.234: [    RACG][3067414208] [14413][3067414208][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 16:49:32.234: [    RACG][3067414208] [14413][3067414208][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 16:49:32.234: [    RACG][3067414208] [14413][3067414208][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.280s

2014-11-03 16:49:32.234: [    RACG][3067414208] [14413][3067414208][ora.node2.vip]: end for resource = ora.node2.vip, action = start, status = 1, time = 18.630s

2014-11-03 17:29:29.895: [    RACG][3067782848] [5942][3067782848][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 17:29:29.895: [    RACG][3067782848] [5942][3067782848][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 17:29:29.895: [    RACG][3067782848] [5942][3067782848][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 17:29:29.895: [    RACG][3067782848] [5942][3067782848][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.370s

2014-11-03 17:29:29.895: [    RACG][3067782848] [5942][3067782848][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.390s

2014-11-03 17:38:01.381: [    RACG][3067832000] [18181][3067832000][ora.node2.vip]: Interface eth0 checked failed (host=node2)

Invalid parameters, or failed to bring up VIP (host=node2)

2014-11-03 17:38:01.381: [    RACG][3067832000] [18181][3067832000][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs

2014-11-03 17:38:01.381: [    RACG][3067832000] [18181][3067832000][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2

2014-11-03 17:38:01.381: [    RACG][3067832000] [18181][3067832000][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.210s

2014-11-03 17:38:01.381: [    RACG][3067832000] [18181][3067832000][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.260s

发现eth0 ping的网关不正常。

将eth1上的网关设置删除后,还是出现相同的报错,怀疑是vip的默认网关配置出了问题。

将所有的服务都停止。

对节点2的vip进行debug,最后的5是_USR_ORA_DEBUG flag ,表示级别。

[root@rac10g2 ~]# crsctl debug log res "ora.node2.vip:5"

Set Resource Debug Module: ora.node2.vip Level: 5

启动ora.node2.vip。

[root@rac10g2 ~]# crs_start ora.node2.vip

查看trace日志。trace日志在$ORA_CRS_HOME/log//racg/

果然发现默认网关设置不正常,设置为192.168.94.1,并不是预计的192.168.1.1。

2014-11-03 15:53:15.830: [ RACG][3086924000] [2200][3086924000][ora.rac10g2.vip]: Fri Nov 03 15:53:09 CST 2014 [ 2204 ] /sbin/mii-tool eth0 error

Fri Nov 18 15:53:09 CST 2014 [ 2204 ] defaultgw: started

Fri Nov 03 15:53:09 CST 2014 [ 2204 ] defaultgw: completed with 192.168.94.1

2014-11-03 15:53:15.830: [ RACG][3086924000] [2200][3086924000][ora.node2.vip]: ping to 192.168.94.1 via eth0 failed, rc = 1 (host=node2)

ping to 192.168.94.1 via eth0 failed, rc = 1 (host=rac10g2)

Fri Nov 03 15:53:15 CST 2014 [ 2204 ] checkIf: ping and RX packets checked if=eth0 failed

Interface eth0 checked failed (host=node2)

2014-11-03 15:53:15.830: [ RACG][3086924000] [2200][3086924000][ora.node2.vip]: Fri Dec 18 15:53:15 CST 2014 [ 2204 ] checkIf: end for if=eth0

Invalid parameters, or failed to bring up VIP (host=node2)

修改默认网关:

修改文件$ORA_CRS_HOME/bin/racgvip,将以下内容修改为想要指派的新的网关。

DEFAULTGW原本是没有值的,现在修改为192.168.1.1。

# hard code default gateway here if needed

DEFAULTGW=192.168.1.1

修改之后,在trace看到该部分已经检测ok。

2014-11-03 16:11:40.984: [ RACG][3086924000] [7808][3086924000][ora.rac10g2.vip]: Fri Nov 03 16:11:40 CST 2014 [ 7812 ] /sbin/mii-tool eth0 error

Fri Nov 03 16:11:40 CST 2014 [ 7812 ] checkIf: ping checked if=eth0 ok

Fri Nov 03 16:11:40 CST 2014 [ 7812 ] checkIf: end for if=eth0

该修改需要在节点1和节点2上同时修改,观察很长一段时间之后,没有再发现之前的问题。

其实该问题的出现,主要的原因是在eth1上配置了默认网关,用于私有网络的网卡不建议配置网关。所以该问题中,如果没有特别的必要,将私有网卡上的网关删除,删除默认路由网关,重启vip即可解决该问题。

0b1331709591d260c1c78e86d0c51c18.png

版权声明:本文为博主原创文章,遵循 CC 4.0 BY-SA 版权协议,转载请附上原文出处链接和本声明。
本文链接:https://blog.csdn.net/weixin_36111561/article/details/116328652

智能推荐

上采样(upsample)-程序员宅基地

文章浏览阅读1.7k次。转载链接:https://blog.csdn.net/wydbyxr/article/details/83819089上采样(upsample)的方法  在神经网络中,扩大特征图的方法,即upsample/上采样的方法  1)unpooling:恢复max的位置,其余部分补零  2)deconvolution(反卷积):先对input补零,再conv  3)插值方法,双线性插值等;  ..._upsample

ESP8266开发之旅 网络篇⑪ WebServer——ESP8266WebServer库的使用_esp8266开发之旅 网络篇 webserver——esp8266webserver库的使用-程序员宅基地

文章浏览阅读2.6w次,点赞28次,收藏25次。1. 前言    在前面章节的博客中,博主介绍了ESP8266WiFi库 Tcp server的用法,并模拟了Http webserver的功能。但是,可以看出通过Tcp server 处理http请求,我们需要自己解析请求协议以及判断各种数据,稍微不小心就很容易出现错误。    那么有没有针对Http webserver操作的库呢?答案肯定是有的,这就是博主本篇需要跟大家讲述的知识——ESP..._esp8266开发之旅 网络篇 webserver——esp8266webserver库的使用

Betaflight通过OSD设置摄像头参数(F*V Camera Control)_平头哥摄像头osd调参-程序员宅基地

文章浏览阅读6.3k次。简介在无人机飞行中,有些摄像头支持通过飞控的OSD界面进入到摄像头系统,从而设置摄像头的相关参数,如白平衡、亮度、个性化字符信息等参数。(F*V Camera Control)设置步骤DALRC F405飞控支持此项功能,需要配合OSD界面进行,USB连接后进入Betaflight Configurator的CLI命令模式下按如下步骤设置命令: 1.映射端口(飞控固件内已默认映射..._平头哥摄像头osd调参

知三角形三边和两点坐标计算另外一点的坐标_已知两点坐标以及三边边长-程序员宅基地

文章浏览阅读6.8k次,点赞4次,收藏27次。问题:已知三角形A、B点的坐标和三边长,求C点坐标,如图: 原理:方位角和三角函数关系求解过程:计算边AC和AB的夹角θ,即: 2. 计算边AB与x轴的夹角根据方位角一般公式 ..._已知两点坐标以及三边边长

【Python计量】自相关性(序列相关性)的检验_用残差图诊断模型的误差项是否存在自相关。-程序员宅基地

文章浏览阅读1.4w次,点赞11次,收藏97次。多元线性回归模型的基本假设之一就是模型的随机干扰项相互独立或不相关。如果模型的随机感染项违背了相互独立的基本假设,则称为存在序列相关性(自相关性)。我们以伍德里奇《计量经济学导论:现代方法》的”第12章 时间序列回归中序列相关和异方差性“的案例12.4为例,使用BARIUM中的数据来进行序列相关性的检验。import wooldridge as wooimport pandas as pdimport numpy as npimport statsmodels.api as smimport s_用残差图诊断模型的误差项是否存在自相关。

neo4j使用详解(十六、索引之语义索引<向量索引>——最全参考)_neo4j如何向量化查询-程序员宅基地

文章浏览阅读772次,点赞22次,收藏28次。节点矢量搜索索引在Neo4j 5.11中作为公测版本发布,在Neo4j 5.13中作为通用版本发布。向量索引允许用户从大型数据集查询向量嵌入。嵌入是数据对象(如文本、图像、音频或文档)的数字表示。例如,文本中的每个单词或标记通常表示为高维向量,其中每个维表示单词含义的某个方面。语义上相似或相关的词通常用向量空间中彼此更接近的向量来表示。这允许像加法和减法这样的数学运算带有语义意义。例如,“国王”减去“男人”加上“女人”的向量表示可能接近于“女王”的向量表示。_neo4j如何向量化查询

随便推点

WPF程序_spy++分析wpf程序-程序员宅基地

文章浏览阅读597次。WPF程序通过spy++只有一个窗口句柄, 下面的子控件是看不到句柄的。所以也就没办法通过Win32 API FindWindow来查找子控件了。 如果您的代码没有经过代码混淆的话,别人是可以用ILSPY来查看其exe的代码的。_spy++分析wpf程序

77. 组合_77.组合-程序员宅基地

文章浏览阅读64次。77. 组合https://leetcode-cn.com/problems/combinations/难度中等748给定两个整数n和k,返回范围[1, n]中所有可能的k个数的组合。你可以按任何顺序返回答案。示例 1:输入:n = 4, k = 2输出:[ [2,4], [3,4], [2,3], [1,2], [1,3], [1,4],]示例 2:输入:n = 1, k = 1输出:[[1]]提示:1 &l..._77.组合

Android开发都需要使用什么语言?_安卓开发的编程语言-程序员宅基地

文章浏览阅读2.2w次,点赞9次,收藏16次。Android是以Linux为核心的手机操作平台,作为一款开放式的操作系统,随着Android的快速发展,如今已允许开发者使用多种编程语言来开发Android应用程序,而不再是以前只能使用Java开发Android应用程序的单一局面。那么,Android系统都能使用哪些语言来开发呢? 在Android中,开发者可以使用Java作为编程语言来开发应用程序,也可以通过Android N_安卓开发的编程语言

四级单词列表_四级单词a到d有多少个-程序员宅基地

文章浏览阅读1.7k次。四级单词列表置顶2018年11月09日 13:27:35多多单词阅读数:5551、四级英语单词(1-100)2、四级英语单词(101-200)3、四级英语单词(201-300)4、四级英语单词(301-400)5、四级英语单词(401-500)6、四级英语单词(501-600)7、四级英语单词(601-700)8、四级英语单词(701-800)9、四级..._四级单词a到d有多少个

linux电子设计软件,集成电路eda软件-程序员宅基地

文章浏览阅读357次。立创EDA软件是一款用于电子线路设计的仿真设计工具,立创EDA为用户提供了原理图和PCB模块,用户可以轻松方便的绘制原理图,同时多层板流畅布线,能够有效提升使用者工作效率,减轻工作压力。软件介绍立创EDA是一款电子设计仿真软件,用户可以在这款软件上进行电子线路的仿真设计,其中软件自带了很多功能,例如电气工具等,以此达到让用户快速设计电路图的效果。软件功能1、原理图绘制:方便快速的绘制原理图,轻松分..._ltspice linux

Eyeriss中的RS(行固定)数据流-程序员宅基地

文章浏览阅读3.6k次,点赞45次,收藏59次。Eyeriss中的RS(行固定)数据流Eyeriss想必大家都读过,但是你在第一次读v1的时候可能并不清楚他所讲的RS数据流具体是什么样的。笔者在这里专门对Eyeriss v1中的RS(行固定)数据流进行详细举例说明。原文中有关RS数据流的部分:“Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks”中的第四段。“Eyeriss: A Spatial Archite_eyeriss