mbufs full no matter NMBCLUSTER value

[lcuguen@nerim.net (Loïc Cuguen)]

hi all,

I've juste installed a new openbsd 3.0 stable on a DL380 compaq

the kernel is a generic based one plus the NMBCLUSTER set to 20000

I tried to set up the value to 64000 and it is still the same message
after a day or so which is the classic "mbufs full try increasing
NMBCLUSTER" :)

so i watch the behavior of the box during a few hours and it keep
increasing the mbufs without reaching a limit (or until it is full)

and thus the ip stack is dead and the console still work normally.

This network is heavily loaded and I can't have action on the
different routers across it. but a bridge pass all the broadcast from
one network to the others ....

And as is said i cannot change this network topology for now ...

so if anybody has a clue on how to fix this problem except saying "go
increase the NMBCLUSTERS value"

here are the infos I got from the box, if you need specific information
just tell me which one you need.

if it's a bug i will send the report, but i'd like to know where this
problem come from.

thx in advance for your reply.

--
Loic

dmesg:

OpenBSD 3.0-stable (GENERIC) #2: Wed Feb 13 11:07:56 CET 2002
    root@toulouse:/usr/src/sys/arch/i386/compile/GENERIC
cpu0: Intel Pentium III (Coppermine) ("GenuineIntel" 686-class) 1 GHz
cpu0: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SYS,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SIMD
real mem  = 536440832 (523868K)
avail mem = 491737088 (480212K)
using 5689 buffers containing 26923008 bytes (26292K) of memory
mainbus0 (root)
bios0 at mainbus0: AT/286+(00) BIOS, date 12/31/99, BIOS32 rev. 0 @
    0xf0000
pcibios0 at bios0: rev. 2.1 @ 0xf0000/0x2000
pcibios0: PCI BIOS has 7 Interrupt Routing table entries
pcibios0: no compatible PCI ICU found
pcibios0: Warning, unable to fix up PCI interrupt routing
pcibios0: PCI bus #0 is the last bus
bios0: ROM list: 0xc0000/0x8000 0xc8000/0x4000! 0xcc000/0x1800 0xcd800/0x1800 0xcf000/0x1800 0xd0800/0x1800 0xe8000/0x6000 0xee000/0x2000!
pci0 at mainbus0 bus 0: configuration mode 1 (no bios)
pchb0 at pci0 dev 0 function 0 "ServerWorks CNB20LE Host" rev 0x06
pchb1 at pci0 dev 0 function 1 "ServerWorks CNB20LE Host" rev 0x06
pci1 at pchb1 bus 3
fxp0 at pci1 dev 4 function 0 "Intel 82557" rev 0x08: irq 15, address
    00:02:a5:40:af:8d
inphy0 at fxp0 phy 1: i82555 10/100 media interface, rev. 4
fxp1 at pci1 dev 5 function 0 "Intel 82557" rev 0x08: irq 10, address
    00:02:a5:40:77:2d
inphy1 at fxp1 phy 1: i82555 10/100 media interface, rev. 4
fxp2 at pci1 dev 6 function 0 "Intel 82557" rev 0x08: irq 5, address
    00:02:a5:40:72:00
inphy2 at fxp2 phy 1: i82555 10/100 media interface, rev. 4
cac0 at pci0 dev 1 function 0 "Symbios Logic 53c1510" rev 0x02: irq 7
    Compaq Integrated Array
scsibus0 at cac0: 1 targets
sd0 at scsibus0 targ 0 lun 0: <Compaq, RAID1 volume  #0, > SCSI2
    0/direct fixed
sd0: 34727MB, 8716 cyl, 255 head, 32 sec, 512 bytes/sec, 71122560 sec total
fxp3 at pci0 dev 2 function 0 "Intel 82557" rev 0x08: irq 4, address
    00:02:a5:d4:d0:0f
inphy3 at fxp3 phy 1: i82555 10/100 media interface, rev. 4
vga1 at pci0 dev 3 function 0 "ATI Mach64 GV" rev 0x7a
wsdisplay0 at vga1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
"Compaq Netelligent ASMC" rev 0x00 at pci0 dev 4 function 0 not
    configured
fxp4 at pci0 dev 5 function 0 "Intel 82557" rev 0x08: irq 11, address
    00:02:a5:40:b0:0d
inphy4 at fxp4 phy 1: i82555 10/100 media interface, rev. 4
pcib0 at pci0 dev 15 function 0 "ServerWorks ROSB4 SouthBridge" rev
    0x51
pciide0 at pci0 dev 15 function 1 "ServerWorks IDE" rev 0x00: DMA
    (unsupported), channel 0 configured to compatibility, channel 1
    configured to compatib
ility
atapiscsi0 at pciide0 channel 0 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <COMPAQ, CD-ROM SN-124Q, QA17> SCSI0
    5/cdrom removable
pciide0: no compatibility interrupt for use by channel 1
isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pmsi0 at pckbc0 (aux slot)
pckbc0: using irq 12 for aux slot
wsmouse0 at pmsi0 mux 0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
sysbeep0 at pcppi0
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
biomask 40c0 netmask ccf0 ttymask dcf2
pctr: 686-class user-level performance counters enabled
mtrr: Pentium Pro MTRR support
dkcsum: sd0 matched BIOS disk 80
root on sd0a
rootdev=0x400 rrootdev=0xd00 rawdev=0xd02

netstat -m :

20002 mbufs in use:
        20001 mbufs allocated to data
        1 mbuf allocated to socket names and addresses
20000/20000 mapped pages in use
45008 Kbytes allocated to network (6% in use)
0 requests for memory denied
0 requests for memory delayed
24988 calls to protocol drain routines


systat mbufs:

                    /0   /1   /2   /3   /4   /5   /6   /7   /8   /9
                    /10
     Load Average   

          /0   /5   /10  /15  /20  /25  /30  /35  /40  /45  /50  /55
          /60
data      XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
          20001
sockets   X