NetXMS Support Forum

NetXMS server crashing:

netxms version 3.5.90
platform windows server 2012 r2
database microsoft sql server 2014

2020.09.18 10:19:50.470 *E* [                   ] EXCEPTION C0000005 (Access violation) at 00007FFFFE4084CA (crash dump was generated); please send files
C:\\netxmsd-339780-1600436087.info and C:\\netxmsd-339780-1600436087.mdmp to [email protected]

I'm sure its probably a transformation, autobind, or event processing scripts, but in the limited time I have between starting the server and the time it crashes (repeatedly) I have not been able to identify it.

the mdmp is too large to email (600MB).

thanks for your help
Stan

Took about 1/2 hour in total (running nxdbmgr check before and after manual schema update).
MSSQL database is about 68GB.
All i can say is ........
.........WOW
It flies now....and no timeouts!!!!!

netxmsd: sho stats
Objects............ 78972
Monitored nodes.... 12782
Collectible DCIs... 243070
Active alarms...... 99052


Now I can start to clear out some of the active alarms.

A huge thank you  to all the people at Radensolutions for a great and evolving product.

NXMC:Various Perspectives,


It would be nice to have row counts on any/all of the table/list displays.

I know i can write scripts to count them and that works for some things, but summary tables add a different dimension to things and some/all/me of my users have trouble finding things on the right-click context menus.

thanks,
Stan

Nxmc: Object Details(of a container): General Dialog of Overview.

Would it be possible to display total non-recursive child object counts.

Because it is sometimes hard to tell the difference between 273 and 327 nodes or objects in a container.

thx
Stan

NetXMS Database Manager Version 2.2.12 Build 9516 (2.2.12) (UNICODE)

Upgrading database...
Upgrading from version 22.41 to 22.42
SQL query failed ([Microsoft][SQL Server Native Client 10.0][SQL Server]Cannot define PRIMARY KEY constraint on nullable
column in table 'address_lists'.):
ALTER TABLE address_lists ADD CONSTRAINT pk_address_lists PRIMARY KEY (list_type,community_id,zone_uin,addr_type,addr1,addr2)
Rolling back last stage due to upgrade errors...
Database upgrade failed


I started from 2.2.10 and got this error on a direct upgrade to 2.2.12 so i reverted back to 2.2.10,
did a ".\nxdbmgr check" --> clean.
upgraded to 2.2.11
then another ".\nxdbmgr check" --> clean.
and tried another upgrade to 2.2.12 with the same error.

The first run through i let the windows installer update the schema but things ended up in the same conditions. subsequent tries I deselected the update schema option, but nxdbmgr upgrade fails with the same condition.

at this point i have reverted back to 2.2.10 , any ideas?

server -> win2012r2
dbserver -> win2012r2 with
Microsoft SQL Server Management Studio      12.0.5207.0
Microsoft Analysis Services Client Tools      12.0.5207.0
Microsoft Data Access Components (MDAC)      6.3.9600.17415
Microsoft MSXML                  3.0 6.0
Microsoft Internet Explorer               9.11.9600.19236
Microsoft .NET Framework               4.0.30319.42000
Operating System                  6.3.9600

Hi,
We are having some problems with 2.2.7.  nxdbmgr reports clean on a "check" and "check_data_tables".
On Startup things start up it seems ok but throws an error:


2018.07.22 12:48:57.007 *D* 28 network device drivers loaded
2018.07.22 12:48:57.007 *D* Built-in objects created
2018.07.22 12:48:57.007 *D* SQLite version 3.22.0
2018.07.22 12:48:57.007 *I* Database driver "sqlite.ddr" loaded and initialized successfully
2018.07.22 12:48:57.007 *D* [db.conn            ] New DB connection opened: handle=000000FE67A8E630
2018.07.22 12:48:57.007 *D* Caching object configuration tables
2018.07.22 12:49:17.694 *D* Loading built-in object properties...
2018.07.22 12:49:17.710 *D* Loading zones...
2018.07.22 12:49:17.710 *D* NetObj::loadCommonProperties() failed for object Default [4] class=6
2018.07.22 12:49:17.819 *D* Loading conditions...

It continues on and loads everything else ... starts polling and tunnel creation and if I check the show q and show thr  in nxadm everything looks ok.  Show watchdog responds:

netxmsd: sho w
Thread                                           Interval Status
----------------------------------------------------------------------------
Item Poller                                      10       Running
Syncer Thread                                    30       Sleeping
Poll Manager                                     5        Sleeping
Ad hoc scheduler                                 5        Sleeping
Recurrent scheduler                              5        Sleeping

A couple of minutes later polling seems to stop (with a lot of active requests waiting) and the watchdog does not respond any more.

netxmsd: sho thr
MAIN
   Threads:            42 (8/1024)
   Load average:       0.32 0.12 0.04
   Current load:       0%
   Usage:              4%
   Active requests:    0
   Scheduled requests: 0

POLLERS
   Threads:            4096 (2048/4096)
   Load average:       10964.91 3197.29 1102.58
   Current load:       414%
   Usage:              100%
   Active requests:    16967
   Scheduled requests: 0

DATACOLL
   Threads:            1024 (10/1024)
   Load average:       1220.03 569.57 211.84
   Current load:       2%
   Usage:              100%
   Active requests:    28
   Scheduled requests: 0

SCHEDULER
   Threads:            1 (1/64)
   Load average:       0.00 0.00 0.00
   Current load:       0%
   Usage:              1%
   Active requests:    0
   Scheduled requests: 0

AGENT
   Threads:            61 (4/512)
   Load average:       12.35 2.86 0.94
   Current load:       100%
   Usage:              11%
   Active requests:    61
   Scheduled requests: 0

SYNCER
   Threads:            1 (1/10)
   Load average:       0.00 0.00 0.00
   Current load:       0%
   Usage:              10%
   Active requests:    0
   Scheduled requests: 0

netxmsd: sho w
Thread                                           Interval Status
----------------------------------------------------------------------------



I can leave this for hours and nothing changes.  The only activities are tunnels opening and closing and threads stopping in data collection due to inactivity.

The only other error message that I can find in the log files is:

Cannot establish connection with ISC peer ::1

I have restarted the netxmsd service many times.
I have rebooted multiple times.
Windows updates are all up to date.  (Windows Server 2012r2 running in a hyperv vm, 32GB 10CPU's)
Database is on a separate 2012 server with MSSQL 2014 with lots of space.

Any help would be appreciated

would it be possible to add a manual discovery poll on a subnet? similar to a manual node poll?
i.e. (EntireNetwork->(zoneUIN)->subnet/mask) rightclick -> poll -> discovery

Along with a Hook::DiscoveryPoll script that could be called even if no new nodes are added.  This way a subnet-customattribute could be updated with a last run date/time similar to Alex's configuration poll example.

Thx.

With the New agent there are parameters called:
System.Update.LastInstallTime
System.Update.Lastdownloadtime
System.Update.lastdetect

with windows 10 and windows server 2016 they are throwing the following error in the agent log file:

GetParameterValue(): result is 500 (INTERNAL ERROR)

I don't have any 32bit windows 10 machines to test this however it does work on Windows 7 and Windows Server 2012r2

I know I'm lazy but it would be nice to be able to clone existing DCI Summary Tables.

thx

I have thousands of these messages showing in the log file:

DCObject::isReadyForPolling: cannot obtain lock for data collection object xxxxxx

Is there something i can change to allow for more locks? or does it wait and retry the the lock on the object?

(mssql 2014, windows server 2012 r2)
thx
________

Sorry.... Netxms Version 2.1.1

Maybe I am just blind or need more coffee....

Where can I change the number of threads for the "MAIN"  on the show threads display of the server console?

netxmsd: sho thr
MAIN
   Threads:      256 (8/256)
   Load average: 10.25 2.96 2.47
   Current load: 75%
   Usage:        100%
   Requests:     192

Is this a problem that i need to worry about or change?  or is there something i can check to see if it is a dci causing the problem. 

[08-Aug-2017 13:04:05.627] [ERROR] SQL query failed (Query = "INSERT INTO tdata_56226 (item_id,tdata_timestamp,tdata_value) VALUES (?,?,?)"): [Microsoft][SQL Server Native Client 10.0]COUNT field incorrect or syntax error

this is a new node (56226) that i just recreated after deleting the previous incarnation of this device. I have about 200 nodes that are all doing this .  I haven't checked them all but any that i have map to dell powerconnect switches.
These messages are filling the log files.  Is the simple solution to set LogFailedSQLQueries = no and ignore it or am I just covering up a bigger problem.


Thx.




info: 
server = netxms2.1.0 on win 2012r2 with MSSQL2014  (upgraded from 2.1rc1)
device = Dell Powerconnect 5524
driver = DELL-PWC

Template DCI's:

"ID","Origin","Description","Parameter","Data Type","Polling Interval","Retention Time","Status","Thresholds","Template"
"224355","SNMP","Switch: Stack Info",".1.3.6.1.4.1.89.53.14.1.1","<< TABLE >>","custom schedule","default","Active","",""
"224354","SNMP","Switch: Software Version",".1.3.6.1.4.1.674.10895.3000.1.2.100.4.0","String","custom schedule","default","Active","",""
"224353","SNMP","Switch: Service Tag",".1.3.6.1.4.1.674.10895.3000.1.2.100.8.1.4.1","String","custom schedule","default","Active","",""
"224352","SNMP","Switch: Port Information",".1.3.6.1.4.1.89.53.3.1.1","<< TABLE >>","7200","default","Active","",""
"224356","SNMP","Switch: Stack Units",".1.3.6.1.4.1.89.53.8.0","Integer","custom schedule","default","Active","",""
"224351","SNMP","Switch: Physical Serial Number",".1.3.6.1.4.1.674.10895.3000.1.2.100.8.1.2.1","String","custom schedule","default","Active","",""
"224350","SNMP","Switch: Model",".1.3.6.1.4.1.674.10895.3000.1.2.100.1.0","String","custom schedule","default","Active","",""
"224349","SNMP","Switch: Global Status",".1.3.6.1.4.1.674.10895.3000.1.2.110.1.0","Integer","3600","default","Active","last(1) == 5",""

I have not found any other reference in the feature requests (although it may be in the other language areas), so if this is a repeat i apologize.  I would like to have a filter for the dynamic geo map widget.  so i can show or not show containers or nodes based on some criteria or status. 

thx.

P.S. GREAT TOOL!