Focus On Oracle,MySQL,SQL Server and PostgreSQL..

案例：troubleshooting CRSD not starting on non-first node(一）

—

由

dbsupport
于 ,

本案例来自西区某客户，客户环境为AIX 7.1，RAC 11.2.0.4。故障现象为在重启主机之后，重启启动集群时1节点启动正常，但是第二个节点的crsd资源无法启动。

grid[ebsdb2]/u01/app/11.2.0/grid/log/ebsdb2/crsd> crsctl stat res  -t -init
--------------------------------------------------------------------------------
NAME           TARGET  STATE        SERVER                   STATE_DETAILS
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
      1        ONLINE  ONLINE       ebsdb2                   Started
ora.cluster_interconnect.haip
      1        ONLINE  ONLINE       ebsdb2
ora.crf
      1        ONLINE  ONLINE       ebsdb2
ora.crsd
      1        ONLINE  INTERMEDIATE ebsdb2
ora.cssd
      1        ONLINE  ONLINE       ebsdb2
ora.cssdmonitor
      1        ONLINE  ONLINE       ebsdb2
ora.ctssd
      1        ONLINE  ONLINE       ebsdb2                   OBSERVER
ora.diskmon
      1        OFFLINE OFFLINE
ora.drivers.acfs
      1        ONLINE  ONLINE       ebsdb2
ora.evmd
      1        ONLINE  INTERMEDIATE ebsdb2
ora.gipcd
      1        ONLINE  ONLINE       ebsdb2
ora.gpnpd
      1        ONLINE  ONLINE       ebsdb2
ora.mdnsd
      1        ONLINE  ONLINE       ebsdb2

可以看到crsd资源在启动时一直处于INTERMEDIATE状态，查看crsd日志看看有何发现

2022-03-30 16:32:50.765: [GIPCHALO][2314] gipchaLowerCleanInterfaces: performing cleanup of disabled interface 111976d70 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', local 11197c530, ip '10.14.1.1:46090', subnet '10.14.1.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x226 }
2022-03-30 16:32:51.010: [ CRSMAIN][515] Policy Engine is not initialized yet!
2022-03-30 16:32:52.767: [GIPCHGEN][2571] gipchaInterfaceDisable: disabling interface 1119770d0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', local 11197c890, ip '10.14.2.1:46091', subnet '10.14.2.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 2, flags 0x6 }
2022-03-30 16:32:53.766: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30008, msg 1130424d8 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 29 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 1, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }
2022-03-30 16:32:53.766: [GIPCHALO][2314] gipchaLowerCleanInterfaces: performing cleanup of disabled interface 1119770d0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', local 11197c890, ip '10.14.2.1:46091', subnet '10.14.2.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 2, flags 0x226 }
2022-03-30 16:32:55.766: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30007, msg 112479cd8 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 31 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 0, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }
2022-03-30 16:32:58.767: [GIPCHGEN][2571] gipchaNodeAddInterface: adding interface information for inf 111977210 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', local 0, ip '10.14.1.1:46093', subnet '10.14.1.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x2 }
2022-03-30 16:32:58.768: [GIPCHGEN][2571] gipchaNodeAddInterface: adding interface information for inf 111977d10 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', local 0, ip '10.14.2.1:46094', subnet '10.14.2.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x2 }
2022-03-30 16:32:59.766: [GIPCHTHR][2314] gipchaWorkerCreateInterface: created remote interface for node 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', inf 'udp://10.14.1.1:46093'
2022-03-30 16:32:59.766: [GIPCHGEN][2314] gipchaWorkerAttachInterface: Interface attached inf 111977210 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', local 11197c530, ip '10.14.1.1:46093', subnet '10.14.1.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x6 }
2022-03-30 16:32:59.766: [GIPCHTHR][2314] gipchaWorkerCreateInterface: created remote interface for node 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', inf 'udp://10.14.2.1:46094'
2022-03-30 16:32:59.766: [GIPCHGEN][2314] gipchaWorkerAttachInterface: Interface attached inf 111977d10 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', local 11197c890, ip '10.14.2.1:46094', subnet '10.14.2.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x6 }
2022-03-30 16:33:03.769: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30009, msg 11305e378 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 34 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 2, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }
2022-03-30 16:33:08.770: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30008, msg 11247c578 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 37 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 2, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }
2022-03-30 16:33:14.771: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30008, msg 11306c0b8 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 39 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 2, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }
2022-03-30 16:33:15.771: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30007, msg 113069818 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 41 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 2, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }
2022-03-30 16:33:18.771: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30006, msg 112470a18 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 43 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 2, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }
2022-03-30 16:33:20.771: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30006, msg 112207718 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 45 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 2, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }
2022-03-30 16:33:21.012: [ CRSMAIN][515] Policy Engine is not initialized yet!
2022-03-30 16:33:51.012: [ CRSMAIN][515] Policy Engine is not initialized yet!
2022-03-30 16:34:21.012: [ CRSMAIN][515] Policy Engine is not initialized yet!
2022-03-30 16:34:51.012: [ CRSMAIN][515] Policy Engine is not initialized yet!
2022-03-30 16:35:21.013: [ CRSMAIN][515] Policy Engine is not initialized yet!
2022-03-30 16:35:51.013: [ CRSMAIN][515] Policy Engine is not initialized yet!
2022-03-30 16:36:21.012: [ CRSMAIN][515] Policy Engine is not initialized yet!
2022-03-30 16:36:51.013: [ CRSMAIN][515] Policy Engine is not initialized yet!
2022-03-30 16:37:21.012: [ CRSMAIN][515] Policy Engine is not initialized yet!
2022-03-30 16:37:51.011: [ CRSMAIN][515] Policy Engine is not initialized yet!
2022-03-30 16:38:21.011: [ CRSMAIN][515] Policy Engine is not initialized yet!
2022-03-30 16:38:51.011: [ CRSMAIN][515] Policy Engine is not initialized yet!
2022-03-30 16:39:21.011: [ CRSMAIN][515] Policy Engine is not initialized yet!
2022-03-30 16:39:51.012: [ CRSMAIN][515] Policy Engine is not initialized yet!

第二个节点启动crsd时，需要与Policy Engine的master节点的crsd进行通信完成Policy Engine的初始化，这里可以看到在通信时在接收message时一直由于timeout被drop，message大小仅仅1000多byte而已，最终导致crsd通信失败从而导致PE初始化失败。

2022-03-30 16:32:53.766: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30008, msg 1130424d8 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 29 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 1, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }
2022-03-30 16:32:53.766: [GIPCHALO][2314] gipchaLowerCleanInterfaces: performing cleanup of disabled interface 1119770d0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', local 11197c890, ip '10.14.2.1:46091', subnet '10.14.2.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 2, flags 0x226 }
2022-03-30 16:32:55.766: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30007, msg 112479cd8 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 31 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 0, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }
2022-03-30 16:32:58.767: [GIPCHGEN][2571] gipchaNodeAddInterface: adding interface information for inf 111977210 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', local 0, ip '10.14.1.1:46093', subnet '10.14.1.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x2 }
2022-03-30 16:32:58.768: [GIPCHGEN][2571] gipchaNodeAddInterface: adding interface information for inf 111977d10 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', local 0, ip '10.14.2.1:46094', subnet '10.14.2.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x2 }
2022-03-30 16:32:59.766: [GIPCHTHR][2314] gipchaWorkerCreateInterface: created remote interface for node 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', inf 'udp://10.14.1.1:46093'
2022-03-30 16:32:59.766: [GIPCHGEN][2314] gipchaWorkerAttachInterface: Interface attached inf 111977210 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', local 11197c530, ip '10.14.1.1:46093', subnet '10.14.1.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x6 }
2022-03-30 16:32:59.766: [GIPCHTHR][2314] gipchaWorkerCreateInterface: created remote interface for node 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', inf 'udp://10.14.2.1:46094'
2022-03-30 16:32:59.766: [GIPCHGEN][2314] gipchaWorkerAttachInterface: Interface attached inf 111977d10 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', local 11197c890, ip '10.14.2.1:46094', subnet '10.14.2.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x6 }
2022-03-30 16:33:03.769: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30009, msg 11305e378 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 34 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 2, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }
2022-03-30 16:33:08.770: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30008, msg 11247c578 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 37 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 2, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }
2022-03-30 16:33:14.771: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30008, msg 11306c0b8 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 39 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 2, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }
2022-03-30 16:33:15.771: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30007, msg 113069818 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 41 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 2, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }
2022-03-30 16:33:18.771: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30006, msg 112470a18 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 43 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 2, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }
2022-03-30 16:33:20.771: [GIPCHALO][2314] gipchaLowerDropMsg: dropping because of sequence timeout, waited 30006, msg 112207718 { len 1576, seq 5, type gipchaHdrTypeRecv (2), lastSeq 6, lastAck 3, minAck 4, flags 0x5, srcLuid 98c50bd5-838c87a5, dstLuid 4da460bf-0cdf2c8d, msgId 45 }, node 1119726f0 { host 'ebsdb1', haName '7d0c-5dc2-5bdf-a0f3', srcLuid 4da460bf-0cdf2c8d, dstLuid 98c50bd5-838c87a5 numInf 2, contigSeq 3, lastAck 6, lastValidAck 3, sendSeq [6 : 6], createTime 1903707969, sentRegister 1, localMonitor 0, flags 0x8 }

从mos文档可以看到有一篇非常匹配该现象的文章CRSD not starting on non-first node: gipchaLowerDropMsg: dropping because of sequence timeout (Doc ID 2189195.1) ，结论是由于bug导致的。

CAUSE
Issue investigated in:

BUG 16872408 - CRSD NOT STARTING ON 2ND NODE

And closed as duplicate of:

BUG 17452638 - SUPPORT FOR ENV VARIABLE GIPC_MTU_SIZE

SOLUTION
The fix is in 12.1.0.2, the solution is to download/request and apply patch 17452638.

As a workaround, stop Grid Infrastructure on all nodes then restart Grid Infrastructure on each.

workaround为打patch，临时可以通过停掉所有节点的gi重新启动解决。

但是尝试停掉所有节点的gi重新启动并不能解决。而且个人认为这篇mos过于武断了，导致dropmsg的原因有很多，居然那么肯定是bug？

通常集群间通信异常都与网络相关，netstat是一个很好的分析方向，我通常会结合watch命令去查看netstat -s的变化

watch -n 1 -d 'netstat -s|grep -E "err|timeout|over|fail|drop|bad"'

重新发起启动crsd资源的命令，后观察netstat -s的变化输出

crsctl start res "ora.crsd" -init

发现有几个指标会增长

        467 dropped due to no socket
        2 broadcast/multicast datagrams dropped due to no socket
        1473 packets dropped due to the full socket receive buffer

都是udp socket buffer相关统计指标，于是怀疑udp socket buffer相关参数设置不对，考虑到重启过主机就不行了，很可能是没有永久修改udp_recvspace和udp_sendspace导致的。

# no -a|grep udp
       udp_bad_port_limit = 0
       udp_ephemeral_high = 65535
        udp_ephemeral_low = 32768
    udp_inpcb_hashtab_siz = 24499
        udp_pmtu_discover = 1
            udp_recv_perf = 0
            udp_recvspace = 42080
            udp_send_perf = 0
            udp_sendspace = 9216
                  udp_ttl = 30

no查看当前设置发现果然如此。

解决方法增大udp_recvspace和udp_sendspace即可

no -p –o udp_sendspace=1048576
no -p -o udp_recvspace=10485760
no -p -o sb_max=10485760

对于AIX上的RAC环境的网络相关参数可以参考RAC and Oracle Clusterware Best Practices and Starter Kit (AIX) (Doc ID 811293.1)

tcp_recvspace = 65536
tcp_sendspace = 65536
udp_sendspace = ((DB_BLOCK_SIZE * DB_FILE_MULTIBLOCK_READ_COUNT) + 4 KB) but no lower than 65536
udp_recvspace = 655360 (Minimum recommended value is 10x udp_sendspace, parameter value must be less than sb_max)
rfc1323 = 1
sb_max = 4194304
ipqmaxlen = 512

本案例修改完参数之后重启2节点crsd资源，over！

评论

发表回复

您的电子邮箱地址不会被公开。 必填项已用 * 标注