<font size=2 face="sans-serif">Hi Matthijs,</font>
<br>
<br><font size=2 face="sans-serif">thank you for your fast response. The
version we used prior to NSD-3.2.3 was NSD-2.1.4. We execute the
nsd-patch at a 6 hours interval</font>
<br><font size=2 face="sans-serif">and after that we are deleting the ixfr.db.
So it won't be larger and larger. But this didn't help at the past. </font>
<br>
<br><tt><font size=2>>> The zone in memory is about twice as big
in memory then on disk. At most<br>
>> it can be four times as large. So a RAM of 5 GB should be sufficient.</font></tt>
<br>
<br><tt><font size=2>You tell me that 5 Gb should be sufficient for a 1.1
GB zonefile, but if i have a look </font></tt>
<br><tt><font size=2>onto a top like the following, i see that nsd uses
9.6 GB of RAM. How could this be ?</font></tt>
<br><tt><font size=2>Or do you mean we need 5 GB for each process ?</font></tt>
<br>
<br>
<br><font size=2 face="sans-serif">top - 13:20:33 up 55 days, 1:21,
0 users, load average: 0.00, 0.00, 0.00</font>
<br><font size=2 face="sans-serif">Tasks: 52 total, 2 running,
50 sleeping, 0 stopped, 0 zombie</font>
<br><font size=2 face="sans-serif">Cpu(s): 0.0%us, 0.0%sy,
0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st</font>
<br><font size=2 face="sans-serif">Mem: 12582912k total, 8555160k
used, 4027752k free, 52316k buffers</font>
<br><font size=2 face="sans-serif">Swap: 9999992k total, 856700k
used, 9143292k free, 1861800k cached</font>
<br>
<br><font size=2 face="sans-serif"> PID USER PR
NI VIRT RES SHR S %CPU %MEM TIME+
COMMAND</font>
<br><font size=2 face="sans-serif">18025 dnsadm 15
0 3709m 3.6g 332 S 0 29.9 0:00.44 nsd</font>
<br><font size=2 face="sans-serif">18026 dnsadm 18
0 3709m 3.6g 136 S 0 29.9 0:00.00 nsd</font>
<br><font size=2 face="sans-serif">22273 dnsadm 15
0 3282m 2.4g 616 S 0 20.0 0:14.31 nsd</font>
<br>
<br><font size=2 face="sans-serif">Between this mail and the last one NSD
was not restartet. Only IXFR update is running. </font>
<br><font size=2 face="sans-serif">And if you have a look onto the older
top and the newer one from today you can see that the RAM footprint is
increasing</font>
<br>
<br><font size=2 color=#c20000 face="sans-serif">old</font>
<br>
<br><tt><font size=2 color=#c20000> top - 15:14:33 up 50 days, 3:15,
2 users, load average: 0.00, 0.23, 0.34<br>
> Tasks: 61 total, 1 running, 60 sleeping,
0 stopped, 0 zombie<br>
> Cpu(s): 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa,
0.0%hi, 0.0%si,<br>
> 0.0%st<br>
> Mem: 12582912k total, 6505944k used, 6076968k free,
1088k buffers<br>
> Swap: 9999992k total, 689732k used, 9310260k free,
8348k cached<br>
> <br>
> PID USER PR NI VIRT RES
SHR S %CPU %MEM TIME+ COMMAND<br>
> 20616 dnsadm 15 0 86632 1612 912 S
0 0.0 0:00.00 sshd<br>
> 20617 dnsadm 15 0 67276 1988 988 S
0 0.0 0:00.01 tcsh<br>
> 20909 dnsadm 15 0 63536 992 836 S
0 0.0 0:00.00 less<br>
> 21936 dnsadm 15 0 86628 1608 912 S
0 0.0 0:00.00 sshd<br>
> 21937 dnsadm 15 0 67268 1984 988 S
0 0.0 0:00.02 tcsh<br>
> 22259 dnsadm 15 0 10704 992 776 R
0 0.0 0:00.15 top<br>
> 22273 dnsadm 16 0 3282m <b>2.6g</b> 608
S 0 21.3 0:14.30 nsd<br>
> 22284 dnsadm 15 0 3439m <b>3.3g</b> 412
S 0 27.7 5:40.85 nsd<br>
> 22526 dnsadm 18 0 3439m <b>3.3g</b> 136
S 0 27.7 0:00.00 nsd</font></tt>
<br>
<br><tt><font size=2 color=#c20000>6,6 GB + 2,6 Gb = 9,2 Gb</font></tt>
<br>
<br><font size=2 color=#001fe2 face="sans-serif">new</font>
<br>
<br><font size=2 color=#001fe2 face="sans-serif">top - 13:20:33 up 55 days,
1:21, 0 users, load average: 0.00, 0.00, 0.00</font>
<br><font size=2 color=#001fe2 face="sans-serif">Tasks: 52 total,
2 running, 50 sleeping, 0 stopped, 0 zombie</font>
<br><font size=2 color=#001fe2 face="sans-serif">Cpu(s): 0.0%us,
0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si,
0.0%st</font>
<br><font size=2 color=#001fe2 face="sans-serif">Mem: 12582912k total,
8555160k used, 4027752k free, 52316k buffers</font>
<br><font size=2 color=#001fe2 face="sans-serif">Swap: 9999992k total,
856700k used, 9143292k free, 1861800k cached</font>
<br>
<br><font size=2 color=#001fe2 face="sans-serif"> PID USER
PR NI VIRT RES SHR S %CPU %MEM
TIME+ COMMAND</font>
<br><font size=2 color=#001fe2 face="sans-serif">18025 dnsadm 15
0 3709m <b>3.6g</b> 332 S 0 29.9 0:00.44
nsd</font>
<br><font size=2 color=#001fe2 face="sans-serif">18026 dnsadm 18
0 3709m <b>3.6g</b> 136 S 0 29.9 0:00.00
nsd</font>
<br><font size=2 color=#001fe2 face="sans-serif">22273 dnsadm 15
0 3282m<b> 2.4g</b> 616 S 0 20.0 0:14.31
nsd</font>
<br>
<br><font size=2 color=#001fe2 face="sans-serif">7,2 Gb + 2,4 Gb = 9,6
Gb</font>
<br>
<br>
<br><font size=2 face="sans-serif">Do you have any ideas ?</font>
<br>
<br><font size=2 face="sans-serif">thank you very much </font>
<br>
<br><font size=2 face="sans-serif">kind regards..</font>
<br>
<br><font size=2 face="sans-serif">Christian</font>
<br>
<br>
<br><font size=2 face="sans-serif">-- <br>
Christian Petrasch <br>
IT-Services<br>
<br>
DENIC eG<br>
Kaiserstraße 75-77<br>
60329 Frankfurt am Main<br>
GERMANY<br>
<br>
E-Mail: petrasch@denic.de<br>
Fon: +49 69 27235-429<br>
Fax: +49 69 27235-239<br>
</font><a href=http://www.denic.de/><font size=2 face="sans-serif">http://www.denic.de</font></a><font size=2 face="sans-serif"><br>
<br>
PGP-KeyID: 17613DFA, Fingerprint: 791A 40DF 47EF DBBD D8E3 72D0 9A6A 846E
1761 3DFA<br>
<br>
Angaben nach § 25a Absatz 1 GenG:<br>
DENIC Domain Verwaltungs- und Betriebsgesellschaft eG (Sitz: Frankfurt
am Main)<br>
Vorstand: Sabine Dolderer, Marcus Schäfer, Carsten Schiefner, Dr. Jörg
Schweiger <br>
Vorsitzender des Aufsichtsrats: Elmar Knipp<br>
Eingetragen unter Nr. 770 im Genossenschaftsregister, Amtsgericht Frankfurt
am Main</font>
<br>
<br>
<br>
<br><font size=1 color=#5f5f5f face="sans-serif">Von:
</font><font size=1 face="sans-serif">Matthijs Mekking <matthijs@NLnetLabs.nl></font>
<br><font size=1 color=#5f5f5f face="sans-serif">An:
</font><font size=1 face="sans-serif">Christian Petrasch
<petrasch@denic.de></font>
<br><font size=1 color=#5f5f5f face="sans-serif">Kopie:
</font><font size=1 face="sans-serif">nsd-info@nlnetlabs.nl,
labs@nlnetlabs.nl, nsd-users@nlnetlabs.nl, Jürgen Geinitz <geinitz@denic.de>,
Elmar Bins <bins@denic.de>, Wolfgang Kriegleder <kriegleder@denic.de></font>
<br><font size=1 color=#5f5f5f face="sans-serif">Datum:
</font><font size=1 face="sans-serif">09.04.2010 17:35</font>
<br><font size=1 color=#5f5f5f face="sans-serif">Betreff:
</font><font size=1 face="sans-serif">Re: Assumed
Memory Leak in NSD-3.2.3 ??</font>
<br>
<hr noshade>
<br>
<br>
<br><tt><font size=2>-----BEGIN PGP SIGNED MESSAGE-----<br>
Hash: SHA1<br>
<br>
Hi Christian,<br>
<br>
We are more than happy to help you with this problem.<br>
What was the version of NSD you used prior to 3.2.3?<br>
<br>
I assume you run nsdc patch at a regular interval?<br>
<br>
I have some more comments inline.<br>
<br>
Best regards,<br>
<br>
Matthijs Mekking<br>
NLnet Labs<br>
<br>
What was<br>
Christian Petrasch wrote:<br>
> Hello,<br>
> <br>
> we ( the DENIC eG ) are using your nameserver software NSD now for<br>
> several years.<br>
> After switching to NSD-3.2.3 we are getting trouble with
the memory<br>
> footprint of NSD-3.2.3.<br>
> The memory consumtion is raising until its physical limit
ist reached,<br>
> then swap is used.<br>
> After all limits are reached NSD-3.2.3 can't start an
ixfr anymore.<br>
> <br>
> It looks like if swapped memory is not freed.<br>
> Starting NSD with one process, NSD forks a second process as usual.<br>
> Then another process is opened. beeing independent from the others.<br>
> I assume the forked process is used to perform the ixfr.<br>
> I don't know the purpose of the independent process.<br>
<br>
The 'independent' is indeed the xfr daemon. It will request axfr and ixfr.<br>
<br>
> <br>
> We run our servers on Xen virtual machines using 12 GB of RAM and
10 GB<br>
> Swap.<br>
> The size of our zonefile is about 1.1 GB.<br>
> What size of RAM and swao do you recommend for a zonefile of
this size ?<br>
> In the past, using NSD-2.1.4, a RAM size of 8 GB
had been sufficient.<br>
<br>
The zone in memory is about twice as big in memory then on disk. At most<br>
it can be four times as large. So a RAM of 5 GB should be sufficient.<br>
<br>
> Here an output of top of our server after a fresh start:<br>
> <br>
> top - 15:14:33 up 50 days, 3:15, 2 users, load average:
0.00, 0.23, 0.34<br>
> Tasks: 61 total, 1 running, 60 sleeping,
0 stopped, 0 zombie<br>
> Cpu(s): 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa,
0.0%hi, 0.0%si,<br>
> 0.0%st<br>
> Mem: 12582912k total, 6505944k used, 6076968k free,
1088k buffers<br>
> Swap: 9999992k total, 689732k used, 9310260k free,
8348k cached<br>
> <br>
> PID USER PR NI VIRT RES
SHR S %CPU %MEM TIME+ COMMAND<br>
> 20616 dnsadm 15 0 86632 1612 912 S
0 0.0 0:00.00 sshd<br>
> 20617 dnsadm 15 0 67276 1988 988 S
0 0.0 0:00.01 tcsh<br>
> 20909 dnsadm 15 0 63536 992 836 S
0 0.0 0:00.00 less<br>
> 21936 dnsadm 15 0 86628 1608 912 S
0 0.0 0:00.00 sshd<br>
> 21937 dnsadm 15 0 67268 1984 988 S
0 0.0 0:00.02 tcsh<br>
> 22259 dnsadm 15 0 10704 992 776 R
0 0.0 0:00.15 top<br>
> 22273 dnsadm 16 0 3282m 2.6g 608 S
0 21.3 0:14.30 nsd<br>
> 22284 dnsadm 15 0 3439m 3.3g 412 S
0 27.7 5:40.85 nsd<br>
> 22526 dnsadm 18 0 3439m 3.3g 136 S
0 27.7 0:00.00 nsd<br>
> <br>
> <br>
> <br>
> Here the output of top approx. 1 week of running:<br>
> <br>
> top - 14:53:59 up 50 days, 2:54, 2 users, load average:
0.00, 0.00, 0.00<br>
> Tasks: 61 total, 2 running, 59 sleeping,
0 stopped, 0 zombie<br>
> Cpu(s): 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa,
0.0%hi, 0.0%si,<br>
> 0.0%st<br>
> Mem: 12582912k total, 9097360k used, 3485552k free,
94196k buffers<br>
> Swap: 9999992k total, 2720028k used, 7279964k free,
1953724k cached<br>
> <br>
> PID USER PR NI VIRT RES
SHR S %CPU %MEM TIME+ COMMAND<br>
> 19608 dnsadm 15 0 5758m 5.6g 340 S
0 46.5 0:00.84 nsd<br>
> 19609 dnsadm 18 0 5758m 5.6g 136 S
0 46.5 0:00.00 nsd<br>
> 20197 dnsadm 15 0 3282m 704m 616 S
0 5.7 0:14.68 nsd<br>
> 20616 dnsadm 15 0 86632 1624 912 S
0 0.0 0:00.00 sshd<br>
> 20617 dnsadm 15 0 67276 1988 988 S
0 0.0 0:00.01 tcsh<br>
> 20909 dnsadm 15 0 63536 992 836 S
0 0.0 0:00.00 less<br>
> 21936 dnsadm 16 0 86628 1616 912 R
0 0.0 0:00.00 sshd<br>
> 21937 dnsadm 15 0 67268 1984 988 S
0 0.0 0:00.02 tcsh<br>
> 21970 dnsadm 15 0 10704 992 776 R
0 0.0 0:00.00 top<br>
> <br>
> <br>
> As You can see, NSD is using a lot of RAM space.<br>
> The longer NSD is running the more memory is allocated until the limit<br>
> is reached having the famous oom-killer (out of memory) inside the<br>
> kernel killing some process.<br>
> <br>
> There seems to be a memory leak somewhere.<br>
> <br>
> Can you assist us with this problem ?<br>
> <br>
> Thank you very much..<br>
> <br>
> kind regards<br>
> <br>
> -- <br>
> Christian Petrasch<br>
> IT-Services<br>
> <br>
> DENIC eG<br>
> Kaiserstraße 75-77<br>
> 60329 Frankfurt am Main<br>
> GERMANY<br>
> <br>
> E-Mail: petrasch@denic.de<br>
> Fon: +49 69 27235-429<br>
> Fax: +49 69 27235-239<br>
> </font></tt><a href=http://www.denic.de/><tt><font size=2>http://www.denic.de</font></tt></a><tt><font size=2>
<</font></tt><a href=http://www.denic.de/><tt><font size=2>http://www.denic.de/</font></tt></a><tt><font size=2>><br>
> <br>
> PGP-KeyID: 17613DFA, Fingerprint: 791A 40DF 47EF DBBD D8E3 72D0 9A6A<br>
> 846E 1761 3DFA<br>
> <br>
> Angaben nach § 25a Absatz 1 GenG:<br>
> DENIC Domain Verwaltungs- und Betriebsgesellschaft eG (Sitz: Frankfurt<br>
> am Main)<br>
> Vorstand: Sabine Dolderer, Marcus Schäfer, Carsten Schiefner, Dr.
Jörg<br>
> Schweiger<br>
> Vorsitzender des Aufsichtsrats: Elmar Knipp<br>
> Eingetragen unter Nr. 770 im Genossenschaftsregister, Amtsgericht<br>
> Frankfurt am Main<br>
<br>
-----BEGIN PGP SIGNATURE-----<br>
Version: GnuPG v1.4.9 (GNU/Linux)<br>
Comment: Using GnuPG with Mozilla - </font></tt><a href=http://enigmail.mozdev.org/><tt><font size=2>http://enigmail.mozdev.org</font></tt></a><tt><font size=2><br>
<br>
iQEcBAEBAgAGBQJLv0dcAAoJEA8yVCPsQCW5yvYIAMzOKpN/yV9NI85k9yg2mW7q<br>
PH/mZfaPVNnVerSWTBQozfNUzW5x8DeBmBWrYjuvA7KupjShTtmiwCBcV9ABK5nd<br>
B6OAKjwo6Oya7kg4wfybqe3Db9HanGn1/pCmEFmmjlYD0rSFBsP1qOKxMRc3y5ec<br>
SLsf5GmILUPa+8p/R3szidOWhdxTHrNlgmScK5UBo+c63gD0C4FrYsietl0Hqs/w<br>
Rb7gi2PV2C27VU59r4zRAedY3Ht1U0wvrdbDZq7LZxAaGYzHk6sfpjMENn5TeVKX<br>
CKsOZ4lC77jiEuW8bHllZTE6XKcwZkknua03Fn99q5b+GoMvMxw2ADGRWCQwdro=<br>
=aQhE<br>
-----END PGP SIGNATURE-----<br>
</font></tt>
<br>