NetXMS Support Forum

Hello,

I upgraded the server from version 1.2.14 to 1.2.17. Everytime I start the server it runs for couple of minutes and then suddenly stops. Here is what I get once the server is started. Is there any way to fix it?

root@:~/netxms-1.2.17# netxmsd -D 4
Using configuration file "/etc/netxmsd.conf"
[24-Oct-2014 16:27:15.942] [DEBUG] Code page set to ASCII
[24-Oct-2014 16:27:15.943] [INFO ] Platform subagent "/usr/local/lib/netxms/linux.nsm" successfully loaded
[24-Oct-2014 16:27:15.943] [DEBUG] Debug callback set for DB library
[24-Oct-2014 16:27:15.945] [INFO ] Database driver "mysql.ddr" loaded and initialized successfully
[24-Oct-2014 16:27:15.947] [DEBUG] New DB connection opened: handle=0x262f220
[24-Oct-2014 16:27:15.947] [DEBUG] Successfully connected to database netxms@localhost
[24-Oct-2014 16:27:15.950] [DEBUG] New DB connection opened: handle=0x26311a0
[24-Oct-2014 16:27:15.950] [DEBUG] New DB connection opened: handle=0x2630c30
[24-Oct-2014 16:27:15.951] [DEBUG] New DB connection opened: handle=0x2633860
[24-Oct-2014 16:27:15.952] [DEBUG] New DB connection opened: handle=0x264c370
[24-Oct-2014 16:27:15.952] [DEBUG] New DB connection opened: handle=0x2652e40
[24-Oct-2014 16:27:15.952] [DEBUG] Database Connection Pool initialized
[24-Oct-2014 16:27:15.952] [DEBUG] Database Connection Pool maintenance thread started
[24-Oct-2014 16:27:15.981] [INFO ] Stalled database lock removed
[24-Oct-2014 16:27:15.996] [DEBUG] Data directory set to /usr/local/share/netxms from server configuration variable
[24-Oct-2014 16:27:16.000] [DEBUG] CAS config reloaded
[24-Oct-2014 16:27:16.000] [DEBUG] Global configuration loaded
[24-Oct-2014 16:27:16.002] [DEBUG] Validating ciphers
[24-Oct-2014 16:27:16.002] [DEBUG]    AES-256 enabled
[24-Oct-2014 16:27:16.002] [DEBUG]    Blowfish-256 enabled
[24-Oct-2014 16:27:16.002] [DEBUG]    IDEA disabled (config)
[24-Oct-2014 16:27:16.002] [DEBUG]    3DES enabled
[24-Oct-2014 16:27:16.002] [DEBUG]    AES-128 enabled
[24-Oct-2014 16:27:16.002] [DEBUG]    Blowfish-128 enabled
[24-Oct-2014 16:27:16.002] [DEBUG] Crypto library initialized
[24-Oct-2014 16:27:16.022] [DEBUG] ID table created
[24-Oct-2014 16:27:16.023] [DEBUG] Script Filter::SNMP added to library
[24-Oct-2014 16:27:16.023] [DEBUG] Script Filter::Agent added to library
[24-Oct-2014 16:27:16.023] [DEBUG] Script Filter::AgentOrSNMP added to library
[24-Oct-2014 16:27:16.023] [DEBUG] Script DCI::SampleTransform added to library
[24-Oct-2014 16:27:16.023] [DEBUG] Script LastValue added to library
[24-Oct-2014 16:27:16.023] [DEBUG] SMTP mailer thread started
[24-Oct-2014 16:27:16.024] [DEBUG] User account status update thread started
[24-Oct-2014 16:27:16.047] [DEBUG] User accounts loaded
[24-Oct-2014 16:27:16.813] [DEBUG] Loading network device drivers from /usr/local/lib/netxms/ndd
[24-Oct-2014 16:27:16.814] [INFO ] Network device driver "MIKROTIK" loaded successfully
[24-Oct-2014 16:27:16.814] [INFO ] Network device driver "CISCO-ESW" loaded successfully
[24-Oct-2014 16:27:16.814] [INFO ] Network device driver "NTWS" loaded successfully
[24-Oct-2014 16:27:16.814] [INFO ] Network device driver "H3C" loaded successfully
[24-Oct-2014 16:27:16.814] [INFO ] Network device driver "DELL-PWC" loaded successfully
[24-Oct-2014 16:27:16.815] [INFO ] Network device driver "PROCURVE" loaded successfully
[24-Oct-2014 16:27:16.815] [INFO ] Network device driver "CATALYST-2900XL" loaded successfully
[24-Oct-2014 16:27:16.815] [INFO ] Network device driver "AT" loaded successfully
[24-Oct-2014 16:27:16.815] [INFO ] Network device driver "UBNT" loaded successfully
[24-Oct-2014 16:27:16.815] [INFO ] Network device driver "CATALYST-GENERIC" loaded successfully
[24-Oct-2014 16:27:16.816] [INFO ] Network device driver "BAYSTACK" loaded successfully
[24-Oct-2014 16:27:16.816] [INFO ] Network device driver "AIRESPACE" loaded successfully
[24-Oct-2014 16:27:16.816] [INFO ] Network device driver "CISCO-SB" loaded successfully
[24-Oct-2014 16:27:16.816] [INFO ] Network device driver "NETSCREEN" loaded successfully
[24-Oct-2014 16:27:16.816] [INFO ] Network device driver "PING3" loaded successfully
[24-Oct-2014 16:27:16.817] [INFO ] Network device driver "ERS8000" loaded successfully
[24-Oct-2014 16:27:16.817] [INFO ] Network device driver "DLINK" loaded successfully
[24-Oct-2014 16:27:16.817] [INFO ] Network device driver "SYMBOL-WS" loaded successfully
[24-Oct-2014 16:27:16.817] [DEBUG] 18 network device drivers loaded
[24-Oct-2014 16:27:16.820] [DEBUG] Built-in objects created
[24-Oct-2014 16:27:16.820] [DEBUG] Loading container categories...
[24-Oct-2014 16:27:16.820] [DEBUG] Apply template thread started
[24-Oct-2014 16:27:16.821] [DEBUG] Loading built-in object properties...
[24-Oct-2014 16:27:16.826] [DEBUG] NetObj::loadCommonProperties() failed for object Policies [5] class=16
[24-Oct-2014 16:27:16.832] [DEBUG] Loading zones...
[24-Oct-2014 16:27:16.877] [DEBUG] Loading conditions...
[24-Oct-2014 16:27:16.878] [DEBUG] Loading subnets...
[24-Oct-2014 16:27:22.986] [DEBUG] Loading mobile devices...
[24-Oct-2014 16:27:22.987] [DEBUG] Loading nodes...
[24-Oct-2014 16:27:46.752] [DEBUG] Loading access points...
[24-Oct-2014 16:27:46.752] [DEBUG] Loading interfaces...
[24-Oct-2014 16:28:19.935] [DEBUG] Loading network services...
[24-Oct-2014 16:28:19.935] [DEBUG] Loading VPN connectors...
[24-Oct-2014 16:28:19.936] [DEBUG] Loading clusters...
[24-Oct-2014 16:28:19.936] [DEBUG] Loading templates...
[24-Oct-2014 16:28:19.936] [DEBUG] Started caching of DCI values
[24-Oct-2014 16:28:20.280] [DEBUG] Finished caching of DCI values
[24-Oct-2014 16:28:20.425] [DEBUG] Loading agent policies...
[24-Oct-2014 16:28:20.425] [DEBUG] Loading network maps...
[24-Oct-2014 16:28:20.461] [DEBUG] Loading containers...
[24-Oct-2014 16:28:20.766] [DEBUG] Loading racks...
[24-Oct-2014 16:28:20.766] [DEBUG] Loading template groups...
[24-Oct-2014 16:28:20.841] [DEBUG] Loading policy groups...
[24-Oct-2014 16:28:20.841] [DEBUG] Loading map groups...
[24-Oct-2014 16:28:20.842] [DEBUG] Loading dashboards...
[24-Oct-2014 16:28:23.514] [DEBUG] Loading business services...
[24-Oct-2014 16:28:23.520] [DEBUG] Loading node links...
[24-Oct-2014 16:28:23.525] [DEBUG] Loading service checks...
[24-Oct-2014 16:28:23.529] [DEBUG] Linking objects...
[24-Oct-2014 16:28:23.535] [DEBUG] Objects loaded and initialized
[24-Oct-2014 16:28:23.535] [DEBUG] Map update thread started
[24-Oct-2014 16:28:23.535] [DEBUG] Situations loaded and initialized
[24-Oct-2014 16:28:23.537] [DEBUG] Helpdesk link disabled
[24-Oct-2014 16:28:23.537] [DEBUG] Loading performance data storage drivers
[24-Oct-2014 16:28:23.537] [DEBUG] 0 performance data storage drivers loaded
[24-Oct-2014 16:28:23.638] [DEBUG] 0 mapping tables loaded
[24-Oct-2014 16:28:23.639] [DEBUG] Job Manager worker thread started
[24-Oct-2014 16:28:23.639] [DEBUG] Node poller started
[24-Oct-2014 16:28:23.640] [DEBUG] New DB connection opened: handle=0x78e2060
[24-Oct-2014 16:28:23.640] [DEBUG] Event storm detector thread stopped because event storm detection is off
[24-Oct-2014 16:28:23.641] [DEBUG] Syncer thread started, sync_interval = 60
[24-Oct-2014 16:28:23.644] [DEBUG] PollManager: 3561 pollers to start
[24-Oct-2014 16:28:23.645] [INFO ] Listening for SNMP traps on UDP socket 0.0.0.0:162
[24-Oct-2014 16:28:23.645] [DEBUG] SNMP Trap Receiver started on port 162
[24-Oct-2014 16:28:23.646] [DEBUG] New DB connection opened: handle=0x7f0e78041870
[24-Oct-2014 16:28:23.647] [DEBUG] New DB connection opened: handle=0x78e14a0
[24-Oct-2014 16:28:23.648] [DEBUG] New DB connection opened: handle=0x7f0e78042f80
[24-Oct-2014 16:28:23.649] [DEBUG] New DB connection opened: handle=0x8077d90
[24-Oct-2014 16:28:23.650] [DEBUG] New DB connection opened: handle=0x7f0e78041ed0
[24-Oct-2014 16:28:23.650] [DEBUG] New DB connection opened: handle=0x7f0e780404b0
[24-Oct-2014 16:28:23.651] [DEBUG] New DB connection opened: handle=0x78e1d00
[24-Oct-2014 16:28:23.653] [DEBUG] New DB connection opened: handle=0x8092700
[24-Oct-2014 16:28:23.654] [DEBUG] New DB connection opened: handle=0x7f0e78040430
[24-Oct-2014 16:28:23.654] [DEBUG] New DB connection opened: handle=0x807a6a0
[24-Oct-2014 16:28:23.656] [DEBUG] New DB connection opened: handle=0x7f0e78062c40
[24-Oct-2014 16:28:23.656] [DEBUG] New DB connection opened: handle=0x7f0e78063210
[24-Oct-2014 16:28:23.656] [DEBUG] New DB connection opened: handle=0x7f0df4000a00
[24-Oct-2014 16:28:23.656] [DEBUG] New DB connection opened: handle=0x7f0e84353890
[24-Oct-2014 16:28:23.657] [DEBUG] New DB connection opened: handle=0x807d1b0
[24-Oct-2014 16:28:23.657] [DEBUG] New DB connection opened: handle=0x7f0e78063310
[24-Oct-2014 16:28:23.657] [DEBUG] New DB connection opened: handle=0x7f0e84351f80
[24-Oct-2014 16:28:23.657] [DEBUG] New DB connection opened: handle=0x807d360
[24-Oct-2014 16:28:23.658] [DEBUG] New DB connection opened: handle=0x7f0df400e2c0
[24-Oct-2014 16:28:23.658] [DEBUG] New DB connection opened: handle=0x7f0e780462e0
[24-Oct-2014 16:28:23.658] [DEBUG] New DB connection opened: handle=0x807de30
[24-Oct-2014 16:28:23.658] [DEBUG] New DB connection opened: handle=0x7f0e78061ff0
[24-Oct-2014 16:28:23.659] [DEBUG] New DB connection opened: handle=0x7f0e84350f50
[24-Oct-2014 16:28:23.659] [DEBUG] New DB connection opened: handle=0x7f0e8435f490
[24-Oct-2014 16:28:23.660] [DEBUG] New DB connection opened: handle=0x80dcce0
[24-Oct-2014 16:28:23.660] [DEBUG] New DB connection opened: handle=0x7f0df400f4f0
[24-Oct-2014 16:28:23.660] [DEBUG] New DB connection opened: handle=0x7f0df400f850
[24-Oct-2014 16:28:23.661] [DEBUG] New DB connection opened: handle=0x7f0e84363da0
[24-Oct-2014 16:28:23.661] [DEBUG] New DB connection opened: handle=0x7f0e78061820
[24-Oct-2014 16:28:23.661] [DEBUG] New DB connection opened: handle=0x80f6300
[24-Oct-2014 16:28:23.661] [DEBUG] New DB connection opened: handle=0x7f0df40108b0
[24-Oct-2014 16:28:23.661] [DEBUG] New DB connection opened: handle=0x7f0e780626e0
[24-Oct-2014 16:28:23.661] [DEBUG] New DB connection opened: handle=0x80f64b0
[24-Oct-2014 16:28:23.662] [DEBUG] New DB connection opened: handle=0x7f0dec013d80
[24-Oct-2014 16:28:23.671] [DEBUG] New DB connection opened: handle=0x7f0df4019a40
[24-Oct-2014 16:28:23.671] [DEBUG] New DB connection opened: handle=0x80f70c0
[24-Oct-2014 16:28:23.672] [DEBUG] New DB connection opened: handle=0x7f0dec01a920
[24-Oct-2014 16:28:23.673] [DEBUG] New DB connection opened: handle=0x80f8230
[24-Oct-2014 16:28:23.673] [DEBUG] New DB connection opened: handle=0x7f0dec01b3e0
[24-Oct-2014 16:28:23.674] [DEBUG] New DB connection opened: handle=0x7f0dec01c4c0
[24-Oct-2014 16:28:23.675] [DEBUG] New DB connection opened: handle=0x80fa4b0
[24-Oct-2014 16:28:23.676] [DEBUG] New DB connection opened: handle=0x7f0dec01c580
[24-Oct-2014 16:28:23.677] [DEBUG] New DB connection opened: handle=0x80f9c60
[24-Oct-2014 16:28:23.677] [DEBUG] New DB connection opened: handle=0x7f0dec01c1e0
[24-Oct-2014 16:28:23.678] [DEBUG] New DB connection opened: handle=0x80f9960
[24-Oct-2014 16:28:23.679] [DEBUG] New DB connection opened: handle=0x811d010
[24-Oct-2014 16:28:23.680] [DEBUG] New DB connection opened: handle=0x7f0dec01d1b0
[24-Oct-2014 16:28:23.680] [DEBUG] New DB connection opened: handle=0x80d4620
[24-Oct-2014 16:28:23.681] [DEBUG] New DB connection opened: handle=0x7f0dec01d530
[24-Oct-2014 16:28:23.681] [DEBUG] New DB connection opened: handle=0x81045b0
[24-Oct-2014 16:28:23.682] [DEBUG] New DB connection opened: handle=0x8103620
[24-Oct-2014 16:28:23.683] [DEBUG] New DB connection opened: handle=0x813a680
[24-Oct-2014 16:28:23.683] [DEBUG] New DB connection opened: handle=0x81433e0
[24-Oct-2014 16:28:23.684] [DEBUG] New DB connection opened: handle=0x8103530
[24-Oct-2014 16:28:23.685] [DEBUG] New DB connection opened: handle=0x8102fc0
[24-Oct-2014 16:28:23.686] [DEBUG] New DB connection opened: handle=0x7f0dec01d710
[24-Oct-2014 16:28:23.689] [DEBUG] Beacon poller will not start because beacon host list is empty
[24-Oct-2014 16:28:23.689] [DEBUG] Reporting Server connector started (localhost:4710)
[24-Oct-2014 16:28:23.690] [DEBUG] LIBDIR: /usr/local/lib/netxms
[24-Oct-2014 16:28:23.690] [DEBUG] UptimeCalculator thread started
[24-Oct-2014 16:28:23.690] [INFO ] Listening for mobile device connections on TCP socket 0.0.0.0:4747
[24-Oct-2014 16:28:23.690] [INFO ] Listening for client connections on TCP socket 0.0.0.0:4701
[24-Oct-2014 16:28:23.690] [DEBUG] Server initialization completed
[24-Oct-2014 16:28:23.692] [INFO ] NetXMS Server started

NetXMS Server V1.2.17 Build 7892 (NON-UNICODE) Ready
Enter "help" for command list or "down" for server shutdown
System Console

netxmsd: [24-Oct-2014 16:28:24.657] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=972 "Icmp.Ping(172.18.1.14)" target=4727 proxy=4586)
[24-Oct-2014 16:28:24.690] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4065 "Icmp.Ping(10.0.0.90)" target=9741 proxy=9727)
[24-Oct-2014 16:28:24.691] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4066 "Icmp.PacketLoss(10.0.0.90)" target=9741 proxy=9727)
[24-Oct-2014 16:28:24.693] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4082 "Icmp.Ping(10.0.0.113)" target=9836 proxy=9727)
[24-Oct-2014 16:28:24.694] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4083 "Icmp.PacketLoss(10.0.0.113)" target=9836 proxy=9727)
[24-Oct-2014 16:28:24.695] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4080 "Icmp.Ping(10.0.0.123)" target=9867 proxy=9727)
[24-Oct-2014 16:28:24.696] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4081 "Icmp.PacketLoss(10.0.0.123)" target=9867 proxy=9727)
[24-Oct-2014 16:28:24.697] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4084 "Icmp.Ping(10.0.1.2)" target=9837 proxy=9727)
[24-Oct-2014 16:28:24.703] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4582 "Icmp.Ping(10.10.2.0)" target=11909 proxy=5594)
[24-Oct-2014 16:28:24.706] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4583 "Icmp.PacketLoss(10.10.2.0)" target=11909 proxy=5594)
[24-Oct-2014 16:28:24.910] [DEBUG] *** DataCollector: Attempt to collect information for non-existing node (DCI=4085 "Icmp.PacketLoss(10.0.1.2)" target=9837 proxy=9727)
Segmentation fault




Oct 24 14:56:04 nms3 kernel: [ 7912.546410] netxmsd[19666]: segfault at 800000 ip 00007f1977b4ab9e sp 00007f18e9c70930 error 6 in libnxsnmp.so.1.0.0[7f1977b3f000+f000]
Oct 24 15:01:28 nms3 kernel: [ 8236.707310] netxmsd[31035]: segfault at 1000 ip 0000000000001000 sp 00007fd1cabea930 error 14 in netxmsd[400000+2000]

Oct 24 16:26:10 nms3 kernel: [13318.481620] netxmsd[21557] general protection ip:7f390123ea0f sp:7f386b3f2928 error:0 in libnxsnmp.so.1.0.0[7f3901233000+f000]
Oct 24 16:28:25 nms3 kernel: [13453.008846] netxmsd[492]: segfault at 2280000 ip 0000000002280000 sp 00007f0e652d25b0 error 14

Hello.

Could you please provide us with stack trace? https://wiki.debian.org/HowToGetABacktrace#Running_gdb