NetXMS Support Forum

Hi! We noticed that NetXMS generates SYS_NODE_DOWN event followed by SYS_NODE_UP with 1 min delay from time to time polling our equipment, in particular Juniper switches and Ubiquiti access points.
Further inspection revealed a common pattern.

---

For Ubiquiti AP the pattern is:
Events:

"ID","Time","Source","DCI","Event","Severity","Message","User tag","Root ID"
"2127109","13.10.2017 10:28:39","wifi-ap","0","SYS_NODE_NORMAL","Normal","Node status changed to NORMAL","","0"
"2127104","13.10.2017 10:28:39","wifi-ap","0","SYS_IF_UP","Normal","Interface ""wifi0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 5)","","0"
"2127107","13.10.2017 10:28:39","wifi-ap","0","SYS_IF_UP","Normal","Interface ""br0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 2)","","0"
"2127106","13.10.2017 10:28:39","wifi-ap","0","SYS_IF_UP","Normal","Interface ""ath0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 6)","","0"
"2127108","13.10.2017 10:28:39","wifi-ap","0","SYS_NODE_UP","Normal","Node up","","0"
"2127105","13.10.2017 10:28:39","wifi-ap","0","SYS_IF_UP","Normal","Interface ""br0.9"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 8)","","0"
"2127103","13.10.2017 10:28:38","wifi-ap","0","SYS_IF_UP","Normal","Interface ""eth0.9"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 7)","","0"
"2127102","13.10.2017 10:28:38","wifi-ap","0","SYS_IF_UP","Normal","Interface ""eth0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 3)","","0"
"2127100","13.10.2017 10:28:38","wifi-ap","0","SYS_IF_UP","Normal","Interface ""lo"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 1)","","0"
"2127101","13.10.2017 10:28:38","wifi-ap","0","SYS_IF_DISABLED","Normal","Interface ""eth1"" disabled (IP Addr: UNSPEC/0, IfIndex: 4)","","0"
"2127099","13.10.2017 10:28:37","wifi-ap","0","SYS_SNMP_OK","Normal","Connectivity with SNMP agent restored","","0"
"2127097","13.10.2017 10:27:32","wifi-ap","0","SYS_NODE_CRITICAL","Critical","Node status changed to CRITICAL","","0"
"2127095","13.10.2017 10:27:32","wifi-ap","0","SYS_NODE_DOWN","Critical","Node down","","0"
"2127096","13.10.2017 10:27:32","wifi-ap","0","SYS_NODE_UNKNOWN","Normal","Node status changed to UNKNOWN","","0"

Network:

"No.","Time","Source","Destination","Protocol","Length","Info"
"1","2017-10-13 10:24:07.407391","NETXMS_IP","UBIQUITI_IP","SNMP","93","get-next-request 1.3.6.1.2.1.4.21.1.1"
"2","2017-10-13 10:24:07.612367","UBIQUITI_IP","NETXMS_IP","SNMP","95","get-response 1.3.6.1.2.1.11.1.0"
"3","2017-10-13 10:27:32.882671","NETXMS_IP","UBIQUITI_IP","SNMP","96","get-next-request 1.3.6.1.2.1.17.7.1.4.3.1.1"
"4","2017-10-13 10:27:33.229215","UBIQUITI_IP","NETXMS_IP","SNMP","100","get-response 1.3.6.1.4.1.10002.1.1.1.1.1.0"
"5","2017-10-13 10:27:33.229282","NETXMS_IP","UBIQUITI_IP","SNMP","96","get-next-request 1.3.6.1.2.1.17.7.1.4.2.1.4"
"6","2017-10-13 10:27:33.361641","UBIQUITI_IP","NETXMS_IP","SNMP","100","get-response 1.3.6.1.4.1.10002.1.1.1.1.1.0"
"7","2017-10-13 10:27:33.361698","NETXMS_IP","UBIQUITI_IP","SNMP","96","get-next-request 1.3.6.1.2.1.17.7.1.4.3.1.2"
"8","2017-10-13 10:27:33.504172","UBIQUITI_IP","NETXMS_IP","SNMP","100","get-response 1.3.6.1.4.1.10002.1.1.1.1.1.0"
"9","2017-10-13 10:27:33.504390","NETXMS_IP","UBIQUITI_IP","SNMP","97","get-next-request 1.3.6.1.4.1.14988.1.1.1.2.1.3"
"10","2017-10-13 10:27:33.797663","UBIQUITI_IP","NETXMS_IP","SNMP","104","get-response 1.3.6.1.4.1.41112.1.6.1.1.1.2.0"
"11","2017-10-13 10:28:37.498911","NETXMS_IP","UBIQUITI_IP","SNMP","92","get-request 1.3.6.1.2.1.1.2.0"
"12","2017-10-13 10:28:37.631093","UBIQUITI_IP","NETXMS_IP","SNMP","100","get-response 1.3.6.1.2.1.1.2.0"

Every response has error-status: noError. We were capturing icmp too, but it seems that NetXMS did not fall back to icmp ping.

---

For juniper:

"ID","Time","Source","DCI","Event","Severity","Message","User tag","Root ID"
"2127333","13.10.2017 11:29:56","jun-switch","0","SYS_NODE_UP","Normal","Node up","","0"
"2127331","13.10.2017 11:29:56","jun-switch","0","SYS_IF_UP","Normal","Interface ""pime"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 10)","","0"
"2127330","13.10.2017 11:29:56","jun-switch","0","SYS_IF_UP","Normal","Interface ""tap"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 7)","","0"
"2127332","13.10.2017 11:29:56","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/1 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 503)","","0"
"2127334","13.10.2017 11:29:56","jun-switch","0","SYS_NODE_NORMAL","Normal","Node status changed to NORMAL","","0"
"2127328","13.10.2017 11:29:55","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/23 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 533)","","0"
"2127326","13.10.2017 11:29:55","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/14.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 514)","","0"
"2127329","13.10.2017 11:29:55","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/8.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 546)","","0"
"2127327","13.10.2017 11:29:55","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/19 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 523)","","0"
"2127325","13.10.2017 11:29:54","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/22 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 531)","","0"
"2127324","13.10.2017 11:29:54","jun-switch","0","SYS_IF_UP","Normal","Interface ""lo0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 6)","","0"
"2127323","13.10.2017 11:29:54","jun-switch","0","SYS_IF_UP","Normal","Interface ""bme0.32768"" changed state to UP (IP Addr: 128.0.0.1/2, IfIndex: 38)","","0"
"2127321","13.10.2017 11:29:53","jun-switch","0","SYS_IF_UP","Normal","Interface ""pimd"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 11)","","0"
"2127322","13.10.2017 11:29:53","jun-switch","0","SYS_IF_UP","Normal","Interface ""ipip"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 9)","","0"
"2127319","13.10.2017 11:29:53","jun-switch","0","SYS_IF_UP","Normal","Interface ""vlan.6"" changed state to UP (IP Addr: 10.201.6.2/24, IfIndex: 551)","","0"
"2127320","13.10.2017 11:29:53","jun-switch","0","SYS_IF_UP","Normal","Interface ""bme0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 37)","","0"
"2127318","13.10.2017 11:29:52","jun-switch","0","SYS_IF_UP","Normal","Interface ""mtun"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 12)","","0"
"2127316","13.10.2017 11:29:52","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/23.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 534)","","0"
"2127317","13.10.2017 11:29:52","jun-switch","0","SYS_IF_UP","Normal","Interface ""gre"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 8)","","0"
"2127315","13.10.2017 11:29:52","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/20 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 527)","","0"
"2127312","13.10.2017 11:29:51","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/20.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 528)","","0"
"2127313","13.10.2017 11:29:51","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/21.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 530)","","0"
"2127314","13.10.2017 11:29:51","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/5.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 540)","","0"
"2127308","13.10.2017 11:29:50","jun-switch","0","SYS_IF_UP","Normal","Interface ""vlan"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 549)","","0"
"2127309","13.10.2017 11:29:50","jun-switch","0","SYS_IF_UP","Normal","Interface ""lsi"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 4)","","0"
"2127310","13.10.2017 11:29:50","jun-switch","0","SYS_IF_UP","Normal","Interface ""dsc"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 5)","","0"
"2127311","13.10.2017 11:29:50","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/21 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 529)","","0"
"2127305","13.10.2017 11:29:49","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/2"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 525)","","0"
"2127306","13.10.2017 11:29:49","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/8"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 545)","","0"
"2127304","13.10.2017 11:29:49","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 501)","","0"
"2127307","13.10.2017 11:29:49","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/1.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 504)","","0"
"2127300","13.10.2017 11:29:48","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/22.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 532)","","0"
"2127302","13.10.2017 11:29:48","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/19.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 524)","","0"
"2127303","13.10.2017 11:29:48","jun-switch","0","SYS_IF_UP","Normal","Interface ""lo0.16384"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 21)","","0"
"2127301","13.10.2017 11:29:48","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/5"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 539)","","0"
"2127297","13.10.2017 11:29:47","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/17.0 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 520)","","0"
"2127299","13.10.2017 11:29:47","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/16 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 517)","","0"
"2127298","13.10.2017 11:29:47","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/14 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 513)","","0"
"2127296","13.10.2017 11:29:46","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/17"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 519)","","0"
"2127293","13.10.2017 11:29:46","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/0.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 502)","","0"
"2127294","13.10.2017 11:29:46","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/18.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 522)","","0"
"2127295","13.10.2017 11:29:46","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/2.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 526)","","0"
"2127291","13.10.2017 11:29:45","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/18 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 521)","","0"
"2127292","13.10.2017 11:29:45","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/16.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 518)","","0"
"2127290","13.10.2017 11:29:45","jun-switch","0","SYS_SNMP_OK","Normal","Connectivity with SNMP agent restored","","0"
"2127285","13.10.2017 11:28:41","jun-switch","0","SYS_NODE_CRITICAL","Critical","Node status changed to CRITICAL","","0"
"2127284","13.10.2017 11:28:41","jun-switch","0","SYS_NODE_DOWN","Critical","Node down","","0"

Network:

"No.","Time","Source","Destination","Protocol","Length","Info"
"1","2017-10-13 11:23:54.816540","netxms_ip","jun_ip","SNMP","93","get-next-request 1.3.6.1.2.1.4.21.1.1"
"2","2017-10-13 11:23:54.953011","jun_ip","netxms_ip","SNMP","100","get-response 1.3.6.1.2.1.4.22.1.1.38.128.0.0.1"
"3","2017-10-13 11:28:41.391314","netxms_ip","jun_ip","SNMP","98","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1"
"4","2017-10-13 11:28:41.544835","jun_ip","netxms_ip","SNMP","114","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.2"
"5","2017-10-13 11:28:41.545043","netxms_ip","jun_ip","SNMP","100","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.2"
"6","2017-10-13 11:28:41.681306","jun_ip","netxms_ip","SNMP","114","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.3"
"7","2017-10-13 11:28:41.681604","netxms_ip","jun_ip","SNMP","100","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.3"
"8","2017-10-13 11:28:41.824843","jun_ip","netxms_ip","SNMP","108","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.4"
"9","2017-10-13 11:28:41.824936","netxms_ip","jun_ip","SNMP","100","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.4"
"10","2017-10-13 11:28:41.962373","jun_ip","netxms_ip","SNMP","112","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.5"
"11","2017-10-13 11:28:41.962455","netxms_ip","jun_ip","SNMP","100","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.5"
"12","2017-10-13 11:28:42.098320","jun_ip","netxms_ip","SNMP","111","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.6"
"13","2017-10-13 11:28:42.098420","netxms_ip","jun_ip","SNMP","100","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.6"
"14","2017-10-13 11:28:42.235346","jun_ip","netxms_ip","SNMP","107","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.8"
"15","2017-10-13 11:28:42.235420","netxms_ip","jun_ip","SNMP","100","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.8"
"16","2017-10-13 11:28:42.379286","jun_ip","netxms_ip","SNMP","101","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.3.2"
"17","2017-10-13 11:28:42.379498","netxms_ip","jun_ip","SNMP","100","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.3.2"
...
"387","2017-10-13 11:29:07.878230","netxms_ip","jun_ip","SNMP","102","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.531"
"388","2017-10-13 11:29:08.014139","jun_ip","netxms_ip","SNMP","103","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.532"
"389","2017-10-13 11:29:08.014320","netxms_ip","jun_ip","SNMP","102","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.532"
"390","2017-10-13 11:29:08.150575","jun_ip","netxms_ip","SNMP","103","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.533"
"391","2017-10-13 11:29:08.150677","netxms_ip","jun_ip","SNMP","102","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.533"
"392","2017-10-13 11:29:08.305570","jun_ip","netxms_ip","SNMP","103","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.534"
"393","2017-10-13 11:29:08.305660","netxms_ip","jun_ip","SNMP","102","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.534"
"394","2017-10-13 11:29:08.443077","jun_ip","netxms_ip","SNMP","103","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.535"
"395","2017-10-13 11:29:08.443153","netxms_ip","jun_ip","SNMP","102","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.535"
"396","2017-10-13 11:29:08.580558","jun_ip","netxms_ip","SNMP","103","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.536"
"397","2017-10-13 11:29:08.580629","netxms_ip","jun_ip","SNMP","102","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.536"
"398","2017-10-13 11:29:08.725585","jun_ip","netxms_ip","SNMP","101","get-response 1.3.6.1.4.1.2636.3.40.1.7.1.1.1.1.0"
"399","2017-10-13 11:29:45.176593","netxms_ip","jun_ip","SNMP","92","get-request 1.3.6.1.2.1.1.2.0"
"400","2017-10-13 11:29:45.306845","jun_ip","netxms_ip","SNMP","104","get-response 1.3.6.1.2.1.1.2.0"

Every response has error-status: noError. We were capturing icmp too, but it seems that NetXMS did not fall back to icmp ping.

---

It seems that NetXMS believes that node is down when it gets unexpected snmp response.

Hi. Our netxms sever crushed because of segmentation fault. Here is back trace:

Core was generated by `/usr/bin/netxmsd -d'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  wcscmp () at ../sysdeps/x86_64/wcscmp.S:424
424     ../sysdeps/x86_64/wcscmp.S: No such file or directory.
(gdb) set print pretty on
(gdb) set height 0
(gdb) bt full
#0  wcscmp () at ../sysdeps/x86_64/wcscmp.S:424
No locals.
#1  0x00007fca7b446db1 in msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788288, n=2) at msort.c:83
        b1 = 0x11788288 "\200B\271\022"
        b2 = 0x11788290 "\300Ag\017"
        n1 = 1
        n2 = 1
        tmp = 0xfa7c210 "\240;\254\016"
        s = 8
        cmp = 0x7fca7e9c2e20 <PackageNameComparator(SoftwarePackage const**, SoftwarePackage const**)>
        arg = 0x0
#2  0x00007fca7b446b18 in msort_with_tmp (n=2, b=0x11788288, p=0x7fc9c31b3d20) at msort.c:45
No locals.
#3  msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=3) at msort.c:54
        b1 = 0x11788280 "\220\242\276\021"
        b2 = 0x11788288 "\200B\271\022"
        n1 = 1
        n2 = 2
        tmp = <optimized out>
        s = <optimized out>
        cmp = <optimized out>
        arg = <optimized out>
#4  0x00007fca7b446b02 in msort_with_tmp (n=3, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45
No locals.
#5  msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=6) at msort.c:53
        b1 = 0x11788280 "\220\242\276\021"
        b2 = 0x11788298 "\200d\376\017"
        n1 = 3
        n2 = 3
        tmp = <optimized out>
        s = <optimized out>
        cmp = <optimized out>
        arg = <optimized out>
#6  0x00007fca7b446b02 in msort_with_tmp (n=6, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45
No locals.
#7  msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=13) at msort.c:53
        b1 = 0x11788280 "\220\242\276\021"
        b2 = 0x117882b0 "P\321\r\023"
        n1 = 6
        n2 = 7
        tmp = <optimized out>
        s = <optimized out>
        cmp = <optimized out>
        arg = <optimized out>
#8  0x00007fca7b446b02 in msort_with_tmp (n=13, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45
No locals.
#9  msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=26) at msort.c:53
        b1 = 0x11788280 "\220\242\276\021"
        b2 = 0x117882e8 "@\353t\020"
        n1 = 13
        n2 = 13
        tmp = <optimized out>
        s = <optimized out>
        cmp = <optimized out>
        arg = <optimized out>
#10 0x00007fca7b446b02 in msort_with_tmp (n=26, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45
No locals.
#11 msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=53) at msort.c:53
        b1 = 0x11788280 "\220\242\276\021"
        b2 = 0x11788350 "\300\002J\024"
        n1 = 26
        n2 = 27
        tmp = <optimized out>
        s = <optimized out>
        cmp = <optimized out>
        arg = <optimized out>
#12 0x00007fca7b446b02 in msort_with_tmp (n=53, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45
No locals.
#13 msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=107) at msort.c:53
        b1 = 0x11788280 "\220\242\276\021"
        b2 = 0x11788428 "\340\201?\025"
        n1 = 53
        n2 = 54
        tmp = <optimized out>
        s = <optimized out>
        cmp = <optimized out>
        arg = <optimized out>
#14 0x00007fca7b446b02 in msort_with_tmp (n=107, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45
No locals.
#15 msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=215) at msort.c:53
        b1 = 0x11788280 "\220\242\276\021"
        b2 = 0x117885d8 "\260\277\300\020"
        n1 = 107
        n2 = 108
        tmp = <optimized out>
        s = <optimized out>
        cmp = <optimized out>
        arg = <optimized out>
#16 0x00007fca7b446b02 in msort_with_tmp (n=215, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45
No locals.
#17 msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=430) at msort.c:53
        b1 = 0x11788280 "\220\242\276\021"
        b2 = 0x11788938 "\200\227\337\024"
        n1 = 215
        n2 = 215
        tmp = <optimized out>
        s = <optimized out>
        cmp = <optimized out>
        arg = <optimized out>
#18 0x00007fca7b44705c in msort_with_tmp (n=430, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45
No locals.
#19 __GI_qsort_r (b=0x11788280, n=430, s=8, cmp=0x7fca7e9c2e20 <PackageNameComparator(SoftwarePackage const**, SoftwarePackage const**)>, arg=<optimized out>)
    at msort.c:297
        size = <optimized out>
        tmp = 0xfa7c210 "\240;\254\016"
        p = {
          s = 8,
          var = 1,
          cmp = 0x7fca7e9c2e20 <PackageNameComparator(SoftwarePackage const**, SoftwarePackage const**)>,
          arg = 0x0,
          t = 0xfa7c210 "\240;\254\016"
        }
#20 0x00007fca7e9d44fa in sort (cb=<optimized out>, this=<optimized out>) at ../../../include/nms_util.h:726
No locals.
#21 Node::updateSoftwarePackages (this=0x7443860, poller=0x1ae, requestId=0) at node.cpp:2214
        table = 0x10830150
        packages = 0x11bea250
#22 0x00007fca7e9d87d5 in Node::configurationPoll (this=0x7443860, pSession=0x0, dwRqId=0, poller=0x7fca4d0b4bd0, maskBits=0) at node.cpp:2428
        type = NODE_TYPE_UNKNOWN
        szBuffer = L'\000' <repeats 3678 times>...
        hasChanges = true
#23 0x00007fca7e9d8ec3 in Node::configurationPoll (this=0x7443860, poller=0x7fca4d0b4bd0) at node.cpp:2275
No locals.
#24 0x00007fca7e970781 in __ThreadPoolExecute_Wrapper<Node, PollerInfo*> (arg=0x7fca4c4423b0) at ../../../include/nms_threads.h:970
        wd = 0x7fca4c4423b0
#25 0x00007fca7d9ed3b6 in WorkerThread (arg=0x7fca4c2cd240) at tp.cpp:127
        rq = 0x7fca4c2fbf90
        p = 0x7fca4c0fd2b0
        q = 0x7fca4c0fd380
#26 0x00007fca7c642064 in start_thread (arg=0x7fc9c31b8700) at pthread_create.c:309
        __res = <optimized out>
        pd = 0x7fc9c31b8700
        now = <optimized out>
        unwind_buf = {
          cancel_jmp_buf = {{
              jmp_buf = {140504538515200, 8965125287727607267, 0, 263873856, 17, 140504538515200, -8937107837346107933, -8935566916459024925},
              mask_was_saved = 0
            }},
          priv = {
            pad = {0x0, 0x0, 0x0, 0x0},
            data = {
              prev = 0x0,
              cleanup = 0x0,
              canceltype = 0
            }
          }
        }
        not_first_call = <optimized out>
        pagesize_m1 = <optimized out>
        sp = <optimized out>
        freesize = <optimized out>
        __PRETTY_FUNCTION__ = "start_thread"
#27 0x00007fca7b4f862d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
No locals.
(gdb)

It seems that the problem is in "software inventory" feature. Error occurred during poll from agent of version 2.0.7. Is it possible to temporary disable this feature?

Hi! We have been experiencing performance issues with netxms lately. There were no particular point at which netxms started to lag but for now we have these problems:

• 'Force DCI poll' button does not work
• Large delays in DCI polling. e.g. 10 minutes between polls where 60 second poll is configured

info:

nxadm -c 'sh stat'
Total number of objects:     3924
Number of monitored nodes:   394
Number of collectable DCIs:  12063

nxadm -c 'sh q'
Data collector                   : 6921 (floats around 3-7K)
DCI cache loader                 : 0
Database writer                  : 0
Database writer (IData)          : 0
Database writer (raw DCI values) : 0
Event processor                  : 0
Node poller                      : 0
Syslog processing                : 0
Syslog writer                    : 0

Number of DCI collectors: 200 (increasing this number from 25 did not give much effect)
Average time to queue DCI for polling for last minute: 4
load average: 0.97, 0.93, 0.92
2 CPUs
free -h
             total       used       free     shared    buffers     cached
Mem:          2.0G       1.9G       106M       540M       138M       716M
-/+ buffers/cache:       1.0G       961M
Swap:         2.0G       330M       1.6G

iostat 60 5
Linux 3.16.0-4-amd64 (netxms) 08/03/2017 _x86_64_ (2 CPU)

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          18.28    0.01    5.13    2.92    0.00   73.67

Device:            tps    kB_read/s    kB_wrtn/s    kB_read    kB_wrtn
sda              66.76       140.82       562.47  685000987 2735994668

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          14.50    0.00    3.95    2.40    0.00   79.14

Device:            tps    kB_read/s    kB_wrtn/s    kB_read    kB_wrtn
sda              45.10       141.40       346.67       8484      20800

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          33.37    0.00   10.06    2.58    0.00   54.00

Device:            tps    kB_read/s    kB_wrtn/s    kB_read    kB_wrtn
sda             150.00        22.33      1707.20       1340     102432

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           8.64    0.00    2.47    0.29    0.00   88.60

Device:            tps    kB_read/s    kB_wrtn/s    kB_read    kB_wrtn
sda              26.60         1.33       289.00         80      17340

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          27.19    0.00    7.45    1.59    0.00   63.77

Device:            tps    kB_read/s    kB_wrtn/s    kB_read    kB_wrtn
sda              58.25         9.47       583.13        568      34988



Hi! I have tried to build Netxms WebAPI on Debian Jessie with openjdk 7.
I have followed these steps to encountered such a problem:
On master (commit ecabd44ec20f8e7e1dfceba428490a42a184a72c) mvn install threw this error:

root@netxms:/opt/netxms/src/server/nxapisrv/java# mvn install
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.netxms:netxms-websvc:war:2.1-RC1
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ line 77, column 18
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building NetXMS REST API Server 2.1-RC1
[INFO] ------------------------------------------------------------------------
[WARNING] The POM for org.netxms:netxms-base:jar:2.1-RC1 is missing, no dependency information available
[WARNING] The POM for org.netxms:netxms-client:jar:2.1-RC1 is missing, no dependency information available
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2.438s
[INFO] Finished at: Mon May 22 10:14:32 UTC 2017
[INFO] Final Memory: 5M/30M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project netxms-websvc: Could not resolve dependencies for project org.netxms:netxms-websvc:war:2.1-RC1: The following artifacts could not be resolved: org.netxms:netxms-base:jar:2.1-RC1, org.netxms:netxms-client:jar:2.1-RC1: Failure to find org.netxms:netxms-base:jar:2.1-RC1 in http://maven.restlet.com was cached in the local repository, resolution will not be reattempted until the update interval of maven-restlet has elapsed or updates are forced -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException

Then I tried to do the same on tag 2.1-M3 and mvn install threw this:

root@netxms:/opt/netxms/src/server/nxapisrv/java# mvn install
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.netxms:netxms-websvc:war:2.1-M2
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ line 77, column 18
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building NetXMS REST API Server 2.1-M2
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-resources-plugin:2.3:resources (default-resources) @ netxms-websvc ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO]
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ netxms-websvc ---
[INFO] Compiling 17 source files to /opt/netxms/src/server/nxapisrv/java/target/classes
[INFO] -------------------------------------------------------------
[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/json/JsonTools.java:[26,34] error: package org.netxms.base.annotations does not exist
[ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/handlers/Objects.java:[51,58] error: incompatible types
[ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/handlers/Objects.java:[133,38] error: cannot find symbol
[ERROR]   symbol:   method isWithinArea(double,double,double,double)
  location: class GeoLocation
/opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/handlers/GrafanaDataCollection.java:[51,42] error: incompatible types
[ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/json/JsonTools.java:[70,35] error: cannot find symbol
[ERROR]   symbol: class Internal
/opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/json/JsonTools.java:[76,41] error: cannot find symbol
[INFO] 6 errors
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 11.300s
[INFO] Finished at: Mon May 22 10:05:03 UTC 2017
[INFO] Final Memory: 11M/30M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:compile (default-compile) on project netxms-websvc: Compilation failure: Compilation failure:
[ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/json/JsonTools.java:[26,34] error: package org.netxms.base.annotations does not exist
[ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/handlers/Objects.java:[51,58] error: incompatible types
[ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/handlers/Objects.java:[133,38] error: cannot find symbol
[ERROR] symbol:   method isWithinArea(double,double,double,double)
[ERROR] location: class GeoLocation
[ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/handlers/GrafanaDataCollection.java:[51,42] error: incompatible types
[ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/json/JsonTools.java:[70,35] error: cannot find symbol
[ERROR] symbol: class Internal
[ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/json/JsonTools.java:[76,41] error: cannot find symbol
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

Can you point what's wrong with it? Or will pre-built package of WebAPI available soon?

Prior 2.1-M3, It was possible to create Data Collection Item in nxshell like this:

template_id = session.findObjectByName("Some_template").getObjectId()
config = session.openDataCollectionConfiguration(template_id)
DCIid = config.createItem()
DCI = template_config.findItem(DCIid)


Now, createItem method requires DataCollectionObject instance. Moreover, DataCollectionObject constructor is protected and requires an id parameter.
How can I create DCI using this method or what is the right way to create DCI in template using nxshell?

Согласно этим постам
    https://www.netxms.org/forum/e-eoe-o-koaot-netxms/to_json-eta/
    https://www.netxms.org/forum/announcements/netxms-2-0-5-released/
появился метод toJson() для класса Event, но как им пользоваться в nxsl скриптах?
Мне нужно отладить какой аларм терминируется пришедшим ивентом, и было бы удобно увидеть в логе все параметры пришедшего ивента.
Напрмер, в EventProcessingPolicy для правила на ивент SYS_ALARM_TIMEOUT добавить в Filtering Script такое:

trace(3,toJson($event));