NetXMS Support Forum

English Support => General Support => Topic started by: zapp25 on February 12, 2020, 05:51:13 PM

Title: netxmsd Killed, Ran Out of Memory?
Post by: zapp25 on February 12, 2020, 05:51:13 PM
Every few days netxmsd dies due to it being out of memory. I'll get an error on my console stating "Out of memory: Kill process xxxx (netxmsd) score 94x or sacrifice child" with the following notification that the process has been killed. Anyone seeing this type of behavior? I'm running 3.1.343 on a VM with 8 vCPUs and 32GB of memory on Ubuntu 18.04.4 (installed from repo). My only thought is I could be flooding the server with several thousand syslog messages.
Title: Re: netxmsd Killed, Ran Out of Memory?
Post by: Alex Kirhenshtein on February 12, 2020, 08:43:11 PM
How many objects do you have in the systems? What are queue sizes?
Show output of:
* nxadm -c 'sh st'
* nxadm -c 'sh q'
Title: Re: netxmsd Killed, Ran Out of Memory?
Post by: zapp25 on February 17, 2020, 04:24:30 PM
23,758 Objects.

Just had to restart the daemon so it's still populating.

4 DB writer queues are currently set.
Title: Re: netxmsd Killed, Ran Out of Memory?
Post by: zapp25 on February 19, 2020, 07:18:29 PM
Did it again this morning.
Title: Re: netxmsd Killed, Ran Out of Memory?
Post by: Filipp Sudanov on February 20, 2020, 03:38:52 PM
1) please show full output of nxadm -c 'sh st'
2) please show full output of nxadm -c 'sh q'
3) please show graph of NetXMS server: physical memory used by process for the duration for few days - from server start till out of memory event.