NetXMS Support Forum

Hello,

I upgraded the server from version 1.2.14 to 1.2.17. Everytime I start the server it runs for couple of minutes and then suddenly stops. Here is what I get once the server is started. Is there any way to fix it?

root@:~/netxms-1.2.17# netxmsd -D 4
Using configuration file "/etc/netxmsd.conf"
[24-Oct-2014 16:27:15.942] [DEBUG] Code page set to ASCII
[24-Oct-2014 16:27:15.943] [INFO ] Platform subagent "/usr/local/lib/netxms/linux.nsm" successfully loaded
[24-Oct-2014 16:27:15.943] [DEBUG] Debug callback set for DB library
[24-Oct-2014 16:27:15.945] [INFO ] Database driver "mysql.ddr" loaded and initialized successfully
[24-Oct-2014 16:27:15.947] [DEBUG] New DB connection opened: handle=0x262f220
[24-Oct-2014 16:27:15.947] [DEBUG] Successfully connected to database netxms@localhost
[24-Oct-2014 16:27:15.950] [DEBUG] New DB connection opened: handle=0x26311a0
[24-Oct-2014 16:27:15.950] [DEBUG] New DB connection opened: handle=0x2630c30
[24-Oct-2014 16:27:15.951] [DEBUG] New DB connection opened: handle=0x2633860
[24-Oct-2014 16:27:15.952] [DEBUG] New DB connection opened: handle=0x264c370
[24-Oct-2014 16:27:15.952] [DEBUG] New DB connection opened: handle=0x2652e40
[24-Oct-2014 16:27:15.952] [DEBUG] Database Connection Pool initialized
[24-Oct-2014 16:27:15.952] [DEBUG] Database Connection Pool maintenance thread started
[24-Oct-2014 16:27:15.981] [INFO ] Stalled database lock removed
[24-Oct-2014 16:27:15.996] [DEBUG] Data directory set to /usr/local/share/netxms from server configuration variable
[24-Oct-2014 16:27:16.000] [DEBUG] CAS config reloaded
[24-Oct-2014 16:27:16.000] [DEBUG] Global configuration loaded
[24-Oct-2014 16:27:16.002] [DEBUG] Validating ciphers
[24-Oct-2014 16:27:16.002] [DEBUG]    AES-256 enabled
[24-Oct-2014 16:27:16.002] [DEBUG]    Blowfish-256 enabled
[24-Oct-2014 16:27:16.002] [DEBUG]    IDEA disabled (config)
[24-Oct-2014 16:27:16.002] [DEBUG]    3DES enabled
[24-Oct-2014 16:27:16.002] [DEBUG]    AES-128 enabled
[24-Oct-2014 16:27:16.002] [DEBUG]    Blowfish-128 enabled
[24-Oct-2014 16:27:16.002] [DEBUG] Crypto library initialized
[24-Oct-2014 16:27:16.022] [DEBUG] ID table created
[24-Oct-2014 16:27:16.023] [DEBUG] Script Filter::SNMP added to library
[24-Oct-2014 16:27:16.023] [DEBUG] Script Filter::Agent added to library
[24-Oct-2014 16:27:16.023] [DEBUG] Script Filter::AgentOrSNMP added to library
[24-Oct-2014 16:27:16.023] [DEBUG] Script DCI::SampleTransform added to library
[24-Oct-2014 16:27:16.023] [DEBUG] Script LastValue added to library
[24-Oct-2014 16:27:16.023] [DEBUG] SMTP mailer thread started
[24-Oct-2014 16:27:16.024] [DEBUG] User account status update thread started
[24-Oct-2014 16:27:16.047] [DEBUG] User accounts loaded
[24-Oct-2014 16:27:16.813] [DEBUG] Loading network device drivers from /usr/local/lib/netxms/ndd
[24-Oct-2014 16:27:16.814] [INFO ] Network device driver "MIKROTIK" loaded successfully
[24-Oct-2014 16:27:16.814] [INFO ] Network device driver "CISCO-ESW" loaded successfully
[24-Oct-2014 16:27:16.814] [INFO ] Network device driver "NTWS" loaded successfully
[24-Oct-2014 16:27:16.814] [INFO ] Network device driver "H3C" loaded successfully
[24-Oct-2014 16:27:16.814] [INFO ] Network device driver "DELL-PWC" loaded successfully
[24-Oct-2014 16:27:16.815] [INFO ] Network device driver "PROCURVE" loaded successfully
[24-Oct-2014 16:27:16.815] [INFO ] Network device driver "CATALYST-2900XL" loaded successfully
[24-Oct-2014 16:27:16.815] [INFO ] Network device driver "AT" loaded successfully
[24-Oct-2014 16:27:16.815] [INFO ] Network device driver "UBNT" loaded successfully
[24-Oct-2014 16:27:16.815] [INFO ] Network device driver "CATALYST-GENERIC" loaded successfully
[24-Oct-2014 16:27:16.816] [INFO ] Network device driver "BAYSTACK" loaded successfully
[24-Oct-2014 16:27:16.816] [INFO ] Network device driver "AIRESPACE" loaded successfully
[24-Oct-2014 16:27:16.816] [INFO ] Network device driver "CISCO-SB" loaded successfully
[24-Oct-2014 16:27:16.816] [INFO ] Network device driver "NETSCREEN" loaded successfully
[24-Oct-2014 16:27:16.816] [INFO ] Network device driver "PING3" loaded successfully
[24-Oct-2014 16:27:16.817] [INFO ] Network device driver "ERS8000" loaded successfully
[24-Oct-2014 16:27:16.817] [INFO ] Network device driver "DLINK" loaded successfully
[24-Oct-2014 16:27:16.817] [INFO ] Network device driver "SYMBOL-WS" loaded successfully
[24-Oct-2014 16:27:16.817] [DEBUG] 18 network device drivers loaded
[24-Oct-2014 16:27:16.820] [DEBUG] Built-in objects created
[24-Oct-2014 16:27:16.820] [DEBUG] Loading container categories...
[24-Oct-2014 16:27:16.820] [DEBUG] Apply template thread started
[24-Oct-2014 16:27:16.821] [DEBUG] Loading built-in object properties...
[24-Oct-2014 16:27:16.826] [DEBUG] NetObj::loadCommonProperties() failed for object Policies [5] class=16
[24-Oct-2014 16:27:16.832] [DEBUG] Loading zones...
[24-Oct-2014 16:27:16.877] [DEBUG] Loading conditions...
[24-Oct-2014 16:27:16.878] [DEBUG] Loading subnets...
[24-Oct-2014 16:27:22.986] [DEBUG] Loading mobile devices...
[24-Oct-2014 16:27:22.987] [DEBUG] Loading nodes...
[24-Oct-2014 16:27:46.752] [DEBUG] Loading access points...
[24-Oct-2014 16:27:46.752] [DEBUG] Loading interfaces...
[24-Oct-2014 16:28:19.935] [DEBUG] Loading network services...
[24-Oct-2014 16:28:19.935] [DEBUG] Loading VPN connectors...
[24-Oct-2014 16:28:19.936] [DEBUG] Loading clusters...
[24-Oct-2014 16:28:19.936] [DEBUG] Loading templates...
[24-Oct-2014 16:28:19.936] [DEBUG] Started caching of DCI values
[24-Oct-2014 16:28:20.280] [DEBUG] Finished caching of DCI values
[24-Oct-2014 16:28:20.425] [DEBUG] Loading agent policies...
[24-Oct-2014 16:28:20.425] [DEBUG] Loading network maps...
[24-Oct-2014 16:28:20.461] [DEBUG] Loading containers...
[24-Oct-2014 16:28:20.766] [DEBUG] Loading racks...
[24-Oct-2014 16:28:20.766] [DEBUG] Loading template groups...
[24-Oct-2014 16:28:20.841] [DEBUG] Loading policy groups...
[24-Oct-2014 16:28:20.841] [DEBUG] Loading map groups...
[24-Oct-2014 16:28:20.842] [DEBUG] Loading dashboards...
[24-Oct-2014 16:28:23.514] [DEBUG] Loading business services...
[24-Oct-2014 16:28:23.520] [DEBUG] Loading node links...
[24-Oct-2014 16:28:23.525] [DEBUG] Loading service checks...
[24-Oct-2014 16:28:23.529] [DEBUG] Linking objects...
[24-Oct-2014 16:28:23.535] [DEBUG] Objects loaded and initialized
[24-Oct-2014 16:28:23.535] [DEBUG] Map update thread started
[24-Oct-2014 16:28:23.535] [DEBUG] Situations loaded and initialized
[24-Oct-2014 16:28:23.537] [DEBUG] Helpdesk link disabled
[24-Oct-2014 16:28:23.537] [DEBUG] Loading performance data storage drivers
[24-Oct-2014 16:28:23.537] [DEBUG] 0 performance data storage drivers loaded
[24-Oct-2014 16:28:23.638] [DEBUG] 0 mapping tables loaded
[24-Oct-2014 16:28:23.639] [DEBUG] Job Manager worker thread started
[24-Oct-2014 16:28:23.639] [DEBUG] Node poller started
[24-Oct-2014 16:28:23.640] [DEBUG] New DB connection opened: handle=0x78e2060
[24-Oct-2014 16:28:23.640] [DEBUG] Event storm detector thread stopped because event storm detection is off
[24-Oct-2014 16:28:23.641] [DEBUG] Syncer thread started, sync_interval = 60
[24-Oct-2014 16:28:23.644] [DEBUG] PollManager: 3561 pollers to start
[24-Oct-2014 16:28:23.645] [INFO ] Listening for SNMP traps on UDP socket 0.0.0.0:162
[24-Oct-2014 16:28:23.645] [DEBUG] SNMP Trap Receiver started on port 162
[24-Oct-2014 16:28:23.646] [DEBUG] New DB connection opened: handle=0x7f0e78041870
[24-Oct-2014 16:28:23.647] [DEBUG] New DB connection opened: handle=0x78e14a0
[24-Oct-2014 16:28:23.648] [DEBUG] New DB connection opened: handle=0x7f0e78042f80
[24-Oct-2014 16:28:23.649] [DEBUG] New DB connection opened: handle=0x8077d90
[24-Oct-2014 16:28:23.650] [DEBUG] New DB connection opened: handle=0x7f0e78041ed0
[24-Oct-2014 16:28:23.650] [DEBUG] New DB connection opened: handle=0x7f0e780404b0
[24-Oct-2014 16:28:23.651] [DEBUG] New DB connection opened: handle=0x78e1d00
[24-Oct-2014 16:28:23.653] [DEBUG] New DB connection opened: handle=0x8092700
[24-Oct-2014 16:28:23.654] [DEBUG] New DB connection opened: handle=0x7f0e78040430
[24-Oct-2014 16:28:23.654] [DEBUG] New DB connection opened: handle=0x807a6a0
[24-Oct-2014 16:28:23.656] [DEBUG] New DB connection opened: handle=0x7f0e78062c40
[24-Oct-2014 16:28:23.656] [DEBUG] New DB connection opened: handle=0x7f0e78063210
[24-Oct-2014 16:28:23.656] [DEBUG] New DB connection opened: handle=0x7f0df4000a00
[24-Oct-2014 16:28:23.656] [DEBUG] New DB connection opened: handle=0x7f0e84353890
[24-Oct-2014 16:28:23.657] [DEBUG] New DB connection opened: handle=0x807d1b0
[24-Oct-2014 16:28:23.657] [DEBUG] New DB connection opened: handle=0x7f0e78063310
[24-Oct-2014 16:28:23.657] [DEBUG] New DB connection opened: handle=0x7f0e84351f80
[24-Oct-2014 16:28:23.657] [DEBUG] New DB connection opened: handle=0x807d360
[24-Oct-2014 16:28:23.658] [DEBUG] New DB connection opened: handle=0x7f0df400e2c0
[24-Oct-2014 16:28:23.658] [DEBUG] New DB connection opened: handle=0x7f0e780462e0
[24-Oct-2014 16:28:23.658] [DEBUG] New DB connection opened: handle=0x807de30
[24-Oct-2014 16:28:23.658] [DEBUG] New DB connection opened: handle=0x7f0e78061ff0
[24-Oct-2014 16:28:23.659] [DEBUG] New DB connection opened: handle=0x7f0e84350f50
[24-Oct-2014 16:28:23.659] [DEBUG] New DB connection opened: handle=0x7f0e8435f490
[24-Oct-2014 16:28:23.660] [DEBUG] New DB connection opened: handle=0x80dcce0
[24-Oct-2014 16:28:23.660] [DEBUG] New DB connection opened: handle=0x7f0df400f4f0
[24-Oct-2014 16:28:23.660] [DEBUG] New DB connection opened: handle=0x7f0df400f850
[24-Oct-2014 16:28:23.661] [DEBUG] New DB connection opened: handle=0x7f0e84363da0
[24-Oct-2014 16:28:23.661] [DEBUG] New DB connection opened: handle=0x7f0e78061820
[24-Oct-2014 16:28:23.661] [DEBUG] New DB connection opened: handle=0x80f6300
[24-Oct-2014 16:28:23.661] [DEBUG] New DB connection opened: handle=0x7f0df40108b0
[24-Oct-2014 16:28:23.661] [DEBUG] New DB connection opened: handle=0x7f0e780626e0
[24-Oct-2014 16:28:23.661] [DEBUG] New DB connection opened: handle=0x80f64b0
[24-Oct-2014 16:28:23.662] [DEBUG] New DB connection opened: handle=0x7f0dec013d80
[24-Oct-2014 16:28:23.671] [DEBUG] New DB connection opened: handle=0x7f0df4019a40
[24-Oct-2014 16:28:23.671] [DEBUG] New DB connection opened: handle=0x80f70c0
[24-Oct-2014 16:28:23.672] [DEBUG] New DB connection opened: handle=0x7f0dec01a920
[24-Oct-2014 16:28:23.673] [DEBUG] New DB connection opened: handle=0x80f8230
[24-Oct-2014 16:28:23.673] [DEBUG] New DB connection opened: handle=0x7f0dec01b3e0
[24-Oct-2014 16:28:23.674] [DEBUG] New DB connection opened: handle=0x7f0dec01c4c0
[24-Oct-2014 16:28:23.675] [DEBUG] New DB connection opened: handle=0x80fa4b0
[24-Oct-2014 16:28:23.676] [DEBUG] New DB connection opened: handle=0x7f0dec01c580
[24-Oct-2014 16:28:23.677] [DEBUG] New DB connection opened: handle=0x80f9c60
[24-Oct-2014 16:28:23.677] [DEBUG] New DB connection opened: handle=0x7f0dec01c1e0
[24-Oct-2014 16:28:23.678] [DEBUG] New DB connection opened: handle=0x80f9960
[24-Oct-2014 16:28:23.679] [DEBUG] New DB connection opened: handle=0x811d010
[24-Oct-2014 16:28:23.680] [DEBUG] New DB connection opened: handle=0x7f0dec01d1b0
[24-Oct-2014 16:28:23.680] [DEBUG] New DB connection opened: handle=0x80d4620
[24-Oct-2014 16:28:23.681] [DEBUG] New DB connection opened: handle=0x7f0dec01d530
[24-Oct-2014 16:28:23.681] [DEBUG] New DB connection opened: handle=0x81045b0
[24-Oct-2014 16:28:23.682] [DEBUG] New DB connection opened: handle=0x8103620
[24-Oct-2014 16:28:23.683] [DEBUG] New DB connection opened: handle=0x813a680
[24-Oct-2014 16:28:23.683] [DEBUG] New DB connection opened: handle=0x81433e0
[24-Oct-2014 16:28:23.684] [DEBUG] New DB connection opened: handle=0x8103530
[24-Oct-2014 16:28:23.685] [DEBUG] New DB connection opened: handle=0x8102fc0
[24-Oct-2014 16:28:23.686] [DEBUG] New DB connection opened: handle=0x7f0dec01d710
[24-Oct-2014 16:28:23.689] [DEBUG] Beacon poller will not start because beacon host list is empty
[24-Oct-2014 16:28:23.689] [DEBUG] Reporting Server connector started (localhost:4710)
[24-Oct-2014 16:28:23.690] [DEBUG] LIBDIR: /usr/local/lib/netxms
[24-Oct-2014 16:28:23.690] [DEBUG] UptimeCalculator thread started
[24-Oct-2014 16:28:23.690] [INFO ] Listening for mobile device connections on TCP socket 0.0.0.0:4747
[24-Oct-2014 16:28:23.690] [INFO ] Listening for client connections on TCP socket 0.0.0.0:4701
[24-Oct-2014 16:28:23.690] [DEBUG] Server initialization completed
[24-Oct-2014 16:28:23.692] [INFO ] NetXMS Server started

NetXMS Server V1.2.17 Build 7892 (NON-UNICODE) Ready
Enter "help" for command list or "down" for server shutdown
System Console

netxmsd: [24-Oct-2014 16:28:24.657] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=972 "Icmp.Ping(172.18.1.14)" target=4727 proxy=4586)
[24-Oct-2014 16:28:24.690] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4065 "Icmp.Ping(10.0.0.90)" target=9741 proxy=9727)
[24-Oct-2014 16:28:24.691] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4066 "Icmp.PacketLoss(10.0.0.90)" target=9741 proxy=9727)
[24-Oct-2014 16:28:24.693] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4082 "Icmp.Ping(10.0.0.113)" target=9836 proxy=9727)
[24-Oct-2014 16:28:24.694] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4083 "Icmp.PacketLoss(10.0.0.113)" target=9836 proxy=9727)
[24-Oct-2014 16:28:24.695] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4080 "Icmp.Ping(10.0.0.123)" target=9867 proxy=9727)
[24-Oct-2014 16:28:24.696] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4081 "Icmp.PacketLoss(10.0.0.123)" target=9867 proxy=9727)
[24-Oct-2014 16:28:24.697] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4084 "Icmp.Ping(10.0.1.2)" target=9837 proxy=9727)
[24-Oct-2014 16:28:24.703] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4582 "Icmp.Ping(10.10.2.0)" target=11909 proxy=5594)
[24-Oct-2014 16:28:24.706] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4583 "Icmp.PacketLoss(10.10.2.0)" target=11909 proxy=5594)
[24-Oct-2014 16:28:24.910] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4085 "Icmp.PacketLoss(10.0.1.2)" target=9837 proxy=9727)
Segmentation fault




Oct 24 14:56:04 nms3 kernel: [ 7912.546410] netxmsd[19666]: segfault at 800000 ip 00007f1977b4ab9e sp 00007f18e9c70930 error 6 in libnxsnmp.so.1.0.0[7f1977b3f000+f000]
Oct 24 15:01:28 nms3 kernel: [ 8236.707310] netxmsd[31035]: segfault at 1000 ip 0000000000001000 sp 00007fd1cabea930 error 14 in netxmsd[400000+2000]

Oct 24 16:26:10 nms3 kernel: [13318.481620] netxmsd[21557] general protection ip:7f390123ea0f sp:7f386b3f2928 error:0 in libnxsnmp.so.1.0.0[7f3901233000+f000]
Oct 24 16:28:25 nms3 kernel: [13453.008846] netxmsd[492]: segfault at 2280000 ip 0000000002280000 sp 00007f0e652d25b0 error 14

Hello,

I decided to make a new post about this since I am unable to understand most of the posts about it or they are clearly too old. I have been getting this warning on mutiple occassions already.

[26-May-2014 10:25:14.844] [WARN ] Unable to create raw socket for ICMP protocol

At some point the netxmsd stops and I need to manually start it. Sometimes I had to start it mutiple times before the server starts running properly. My question is what is causing this and is there a way to fix it? Thank you

Hello,

Since I got the same problem as described here (https://www.netxms.org/forum/oe-oo/netxmsd-1-2-13-segmentation-fault/msg13535/?topicseen#msg13535) and I am unable to understand Russian I am starting a new topic here.

As I understand for the moment developers are working on this. Unfortunatelly, applying the bug fix that is suggested on the linked post, did not work for me. Furthermore, the suggested hourly check is also not a viable solution in my opinion, since the server crashes every couple of minutes.

Hence, I would like to know how to safely downrade to the previous version 1.2.12. I went trought the forums and appearently downgrading varies from version to version. Could you asssist me on this? I am using Debian 3.2.54-2 x86_64

First, I am sorry for writing in English. I do not understand any of this, but today I upgraded to 1.2.13 and got the same error "Segmentation fault". The server runs for couple of minutes and then I get this error. Any known way to fix this?

Hello,

First off. I am sorry for hijaking the post. This now looks like different problem. I suspect it came with the new release of version 1.2.12.

I have managed to solve the problem with the dashboards not showing up at all by clearing the tomcat cache. Unfortunatelly, the general bug remains. Please find attached some more screen shots. As you can see the menu disappears at when you navigate to some menu tabs like dashboards, object details and IP neighbours.

Hello,

I would like to report the same problem (or at least I think so).

This Friday I added a number of new dashboards and everything seemed fine. Unfortunatelly, two days later all dashboards show empty. If I add a new dashboard the graph is yet again empty. Furthermore, both dashboard and object details, object overview seem to have bugged and whenever I open them all other options disappear from the web console . I have attached screen shots showing the exact issue. Whenever I open the same from the netxms console application there is no problem.

Any help is welcome. Thank you!