Menu

Show posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.

Show posts Menu

Messages - madmucho

#1
Dear support team is there way to stop collecting and processing rpm packages on RHEL installation of agent?

We have currently problem with corruption on rpm db which causes huge amount of packages removed and added and agent reads them. This issue is looks like Redhat bug, but i have all installation updated and same behavior occurs on another RHEL 8 servers.

I don't want unmonitor this server, just want skip packages processing. Is there any option's on agent to stop collecting rpm db data ?
#2
General Support / Re: Database schema upgrade, sqlite
December 01, 2021, 02:51:24 PM
Thank You Victor,
after sqlite db modification update procedure continues and done successfully.

Ok then i will create new base image and put it on dockerhub for other to use version with this manual fix.
But upgrade from old image will still be not possible because after docker start i begin upgrading db schema, and if user have old sqlite db it will not upgrade correctly, nxdbmgr hangs and because it is in entry point of docker image, docker image will not start up netxms service and agent.

Please it is possible make fix it into nxdbmgr, to do same manual fix? If it will be in new version i will release docker image with this fix, upgrade procedure will be automatic.

Quote from: Victor Kirhenshtein on November 30, 2021, 05:06:45 PM
Next it tries to open second connection to database, which I suppose is not working for SQLite. Do you have any network maps configured?

If you DO NOT have any network maps, you can do this step manually by executing the following queries (it will delete any configured links on network maps):


DROP TABLE network_map_links;
CREATE TABLE network_map_links
(
  map_id integer not null,
  link_id integer not null,
  element1 integer not null,
  element2 integer not null,
  link_type integer not null,
  link_name varchar(255) null,
  connector_name1 varchar(255) null,
  connector_name2 varchar(255) null,
  element_data varchar null,
  flags integer not null,
  color_source integer not null,
  color integer not null,
  color_provider varchar(255) null,
  PRIMARY KEY(map_id,link_id)
);
CREATE INDEX idx_network_map_links_map_id ON network_map_links(map_id);
UPDATE metadata SET var_value='9' WHERE var_name='SchemaVersionMinor';


And then run nxdbmgr upgrade again - it should continue from next step.

Best regards,
Victor
#3
General Support / Re: Database schema upgrade, sqlite
November 30, 2021, 01:11:25 PM
Dear Victor,
thank you for reply.

nxdbmgr -t update

Output is attached in screen and last query in text.

CREATE TABLE new_network_map_links (   map_id integer not null,   link_id integer not null,   element1 integer not null,   element2 integer not nul
l,   link_type integer not null,   link_name varchar(255) null,   connector_name1 varchar(255) null,   connector_name2 varchar(255) null,   element_dat
a varchar null,   flags integer not null,   color_source integer not null,   color integer not null,   color_provider varchar(255) null,   PRIMARY KEY(
map_id,link_id))


#4
General Support / Database schema upgrade, sqlite
November 24, 2021, 02:18:45 PM
Dear support team,
i have problem with my sqlite database which im using in docker image on debian 10 base, im unable to upgrade database schema from version 39.8 to 39.9

before i write this forum topic i check consistency of migrated db, and all checks are ok.

Upgrade db schema ends in step 39.8 to 39.9 and not continue further, any idea what to check ?

Docker image is avalible here > https://hub.docker.com/repository/docker/madmucho/netxms/general
i stopped all services in docker using supervisorctl stop all
update distro packages and during package update process upgrade schema hangs.

In attachment is screen of update proces on which step upgrade stops and not continue further.
#5
Quote from: Victor Kirhenshtein on April 28, 2021, 08:47:51 AM
Hi!

Try to add the following option to netxmsd.conf:

DBCacheConfigurationTables = no

Best regards,
Victor

Thank You Victor, after configuration change memory footprint is much better now, memory peak is much smaller and server have enough RAM.
No swaping occurs at start.
#6
Dear support team,
i observing strange behavior in times when netxms service starting, maibe service trying to cache some data from database, but this takes a lot of memory and if memory goes empty system begins to swap some process out and in this time netxms process release a lot of memory and then starts and runs ok...its strange.

My environment is debian 10, database is mariadb.

Server version 3.8.267-1

Monitored nodes 297
Collectible DCIs  22487
Active alarms 180012

Mariadb has 60Gb of data.

System has 2vCPU 10GB RAM, usually memory is at 75 percent and everything runs ok, I see problems only at startup.

You can see a few minutes delay in startup log, in this time memory usage goes to swap, and then drops to normal.


2021.04.27 16:14:32.298 *I* [logger             ] Log file opened (rotation policy 2, max size 16777216)
2021.04.27 16:14:32.298 *D* [                   ] LIB directory set to /usr/lib/x86_64-linux-gnu/netxms
2021.04.27 16:14:32.298 *I* [                   ] Code page set to UTF8
2021.04.27 16:14:32.301 *I* [                   ] Platform subagent "/usr/lib/x86_64-linux-gnu/netxms/linux.nsm" successfully loaded
2021.04.27 16:14:32.302 *I* [db.drv             ] Database driver "mariadb.ddr" loaded and initialized successfully
2021.04.27 16:14:32.303 *D* [                   ] Local administration interface listener started
2021.04.27 16:14:32.303 *D* [                   ] Successfully connected to database [email protected]
2021.04.27 16:14:32.312 *D* [db.cpool           ] Database Connection Pool initialized
2021.04.27 16:14:32.312 *D* [db.cpool           ] Database Connection Pool maintenance thread started
2021.04.27 16:14:32.312 *I* [                   ] Server ID 3007CF4CB43E2255
2021.04.27 16:14:32.316 *D* [db.lock            ] Database lock set
2021.04.27 16:14:32.322 *I* [db.writer          ] DBWriter/Housekeeper interlock is OFF
2021.04.27 16:14:32.322 *D* [core               ] Data directory set to /var/lib/netxms
2021.04.27 16:14:32.323 *D* [                   ] Global configuration loaded
2021.04.27 16:14:32.325 *D* [crypto             ] Validating ciphers
2021.04.27 16:14:32.325 *D* [crypto             ]    AES-256 enabled
2021.04.27 16:14:32.325 *D* [crypto             ]    Blowfish-256 enabled
2021.04.27 16:14:32.325 *D* [crypto             ]    IDEA disabled (config)
2021.04.27 16:14:32.325 *D* [crypto             ]    3DES enabled
2021.04.27 16:14:32.325 *D* [crypto             ]    AES-128 enabled
2021.04.27 16:14:32.325 *D* [crypto             ]    Blowfish-128 enabled
2021.04.27 16:14:32.325 *I* [crypto             ] Crypto library initialized (OpenSSL 1.1.1d  10 Sep 2019)
2021.04.27 16:14:32.325 *I* [crypto.cert        ] Server certificate not set
2021.04.27 16:14:32.334 *D* [threads.pool       ] Thread pool MAIN initialized (min=8, max=256)
2021.04.27 16:14:32.334 *D* [threads.pool       ] Thread pool AGENT initialized (min=4, max=256)
2021.04.27 16:14:32.363 *D* [watchdog           ] Watchdog thread started
2021.04.27 16:14:32.364 *D* [db.writer          ] Using 1 DCI data write queues
2021.04.27 16:14:32.364 *D* [db.writer          ] Raw DCI data flush interval is 30 seconds
2021.04.27 16:14:32.364 *D* [threads.pool       ] Thread pool NPE initialized (min=1, max=1024)
2021.04.27 16:14:32.364 *D* [                   ] SMTP mailer thread started
2021.04.27 16:14:32.365 *D* [                   ] SQLite version 3.27.2
2021.04.27 16:14:32.365 *I* [db.drv             ] Database driver "sqlite.ddr" loaded and initialized successfully
2021.04.27 16:14:34.605 *D* [                   ] SQLite version 3.27.2
2021.04.27 16:14:34.605 *I* [db.drv             ] Database driver "sqlite.ddr" loaded and initialized successfully
here something eats my memory few minutes
2021.04.27 16:17:06.738 *D* [nc                 ] Loading notification channel drivers from /usr/lib/x86_64-linux-gnu/netxms/ncdrv
2021.04.27 16:17:06.906 *D* [nc                 ] 18 notification channel drivers loaded
2021.04.27 16:17:06.906 *D* [nc                 ] 0 notification channels added
2021.04.27 16:17:06.907 *D* [ndd                ] Loading network device drivers from /usr/lib/x86_64-linux-gnu/netxms/ndd
2021.04.27 16:17:06.908 *I* [ndd                ] Network device driver CAMBIUM-CNPILOT loaded successfully
2021.04.27 16:17:06.908 *I* [ndd                ] Network device driver CAMBIUM-EPMP loaded successfully
2021.04.27 16:17:06.924 *I* [ndd                ] Network device driver SAF-INTEGRA-B loaded successfully
2021.04.27 16:17:06.925 *I* [ndd                ] Network device driver SYMBOL-WS loaded successfully
2021.04.27 16:17:06.925 *I* [ndd                ] Network device driver WESTERSTRAND loaded successfully
2021.04.27 16:17:06.926 *I* [ndd                ] Network device driver UBNT loaded successfully
2021.04.27 16:17:06.927 *I* [ndd                ] Network device driver AT loaded successfully
2021.04.27 16:17:06.928 *I* [ndd                ] Network device driver CATALYST-GENERIC loaded successfully
2021.04.27 16:17:06.928 *I* [ndd                ] Network device driver CATALYST-2900XL loaded successfully
2021.04.27 16:17:06.928 *I* [ndd                ] Network device driver CISCO-ESW loaded successfully
2021.04.27 16:17:06.928 *I* [ndd                ] Network device driver CISCO-NEXUS loaded successfully
2021.04.27 16:17:06.928 *I* [ndd                ] Network device driver CISCO-SB loaded successfully
2021.04.27 16:17:06.928 *I* [ndd                ] Network device driver CISCO-WLC loaded successfully
2021.04.27 16:17:06.928 *I* [ndd                ] Network device driver CISCO-GENERIC loaded successfully
2021.04.27 16:17:06.928 *I* [ndd                ] Network device driver OPTIX loaded successfully
....
2021.04.27 16:17:12.453 *D* [                   ] 0 startup scripts processed
2021.04.27 16:17:12.453 *D* [                   ] Server initialization completed in 160155 milliseconds
2021.04.27 16:17:12.454 *D* [statcoll           ] Server statistic collector thread started
2021.04.27 16:17:12.454 *I* [                   ] NetXMS Server started



After server started all working ok.
HTop images attached from time after Netxms server is up and responding to console.

Any idea what can cause this peak ?
#7
General Support / Re: docker image on dockerhub info
March 02, 2021, 06:30:15 PM
It has been 5 Years since I created the first netxms docker image and publish it on docker hub, now it is time to update from old debian jessie to buster and server to 3.8.

I do this image and publish it on docker hub, https://hub.docker.com/repository/docker/madmucho/netxms

In this time there are plenty of docker images of netxms in dockerhub repository, i must say i inspire from many of them but many of them is obsolete and dont fit my needs

Main news in 3.8 tag and current latest is that image is put to supervisord control, long running container needs from time to time upgrade some config and packages, make some tweaks, supervisord allow all configured services make changes on fly, start/stop them with no need to reboot container itself.

If you want you can try to use it, test it and let me know you opinion.

Idea of this image is make basic netxms server available fast, image keeps clean and minimalistic, do not take necessary dependencies to base image (not webui, not mta, no docker compose necesary) and allow You to make all this changes if you want them.

Tested on portainer, synology docker package, vps hosting as swarm node.

And at end, i was able to upgrade my old 2.0.2 server instance schema/data to 3.8 just using change netxmsd.conf and mariadb tables ROW_FORMAT=DYNAMIC.
Cheers  ;D
#8
General Support / Re: SQL query failed mariadb.
October 17, 2020, 10:07:33 PM
Ajajaj have this db since version 2, so i try migrate data o my local and see how that works, our db has now 60gb.

Thank you for information.
#9
General Support / SQL query failed mariadb.
October 16, 2020, 12:27:03 PM
Dear Technical support,
i get two SQL query failed events in my netxmsd instance, it happens again and again

Instance is debian 10 and database mariadb, and netxms 3.5.136-1 version.

I set up debug mode and catch as much as i can, looks like there is special char in value which cause query to fail.
mariadb database for netxms is Charset latin1 and collation name latin1_swedish_ci

2020.10.16 11:14:05.968 *D* [db.query           ] BEGIN TRANSACTION successful (level 1)
2020.10.16 11:14:05.997 *D* [                   ] Node(MTFlaje.poh.cz)->getMetricFromSNMP(.1.3.6.1.2.1.31.1.1.1.11.11): dwResult=0
2020.10.16 11:14:05.997 *D* [                   ] DataCollector(): processing DC object 368423 ".1.3.6.1.2.1.31.1.1.1.11.120" owner=183 sourceNode=0
2020.10.16 11:14:06.015 *E* [db.drv             ] SQL query failed (Query = "INSERT INTO hardware_inventory (node_id,category,component_index,hw_type,vendor,model,location,capacity,part_number,seri
al_number,description) VALUES (?,?,?,?,?,?,?,?,?,?,?)"): Incorrect string value: '\xC5\xA5 Eth...' for column `netxms`.`hardware_inventory`.`hw_type` at row 1
2020.10.16 11:14:06.015 *D* [                   ] NetObj::expandText(sourceObject=108 template='Database query failed (Query: %1; Error: %2)' alarm=0 event=102620065)
2020.10.16 11:14:06.015 *D* [event.corr         ] CorrelateEvent: event SYS_DB_QUERY_FAILED id 102620065 source netxms [108]


] EVENT SYS_DB_QUERY_FAILED [52] at {0} (ID:102620065 F:0x0001 S:4 TAGS:"") FROM netxms: Database query failed (Query: INSERT INTO hardware_inventory
(node_id,category,component_index,hw_type,vendor,model,location,capacity,part_number,serial_number,description) VALUES (?,?,?,?,?,?,?,?,?,?,?); Error: Incorrect string value: '\xC5\xA5 Eth...' for
column `netxms`.`hardware_inventory`.`hw_type` at row 1)



Looks like unescaped value to insert.
#10
General Support / caption in AlarmHistoryRetentionTime
October 16, 2020, 09:49:59 AM
Dear support team,
i found small mistake while editing AlarmHistoryRetentionTime using console,
there is value and caption for it as "seconds" should be days i think.

In my case value is 60 days.
#11
General Support / Re: Netxms tomcat .war deploy
August 06, 2020, 11:17:10 AM
Quote from: Victor Kirhenshtein on August 04, 2020, 04:11:33 PM
/var/lib/tomcat8/webapps is where application is deployed. But working directories for applications are in /var/lib/tomcat8/work/Catalina/localhost - try to delete them.

Best regards,
Victor

Thank You Victor, exactly like you write, after delete catalina work dir and start tomcat again new UI is up and running.

Problem solved.
#12
General Support / Re: Netxms tomcat .war deploy
August 04, 2020, 12:04:28 PM
That is strange,

i using tomcat8 on debian 10, so i stop it, delete working dir /var/lib/tomcat8/webapps

start it for test, so no web working, i copy downloaded .war from web into webapps folder, it been automaticaly deployed i see v3 libs in plugins directory, but web told me same is i posted before.
:-\
i do upgrade of previous versions using this method and was ok.

#!/bin/bash

wget -O ROOT.war https://www.netxms.org/download/releases/3.4/nxmc-3.4.284.war
chown tomcat8:tomcat8 ROOT.war
service tomcat8 stop
cp -f ROOT.war /var/lib/tomcat8/webapps
service tomcat8 start
#13
General Support / Netxms tomcat .war deploy
August 03, 2020, 04:51:09 PM
Dear support team,
i migrated to v3, and unable to get correct web ui .war file when i deploy latest .war from download section i still get app version 2.2.17 (9525) at logon screen and version conflict after login.

Screenshot attached.
#14
Quote from: Victor Kirhenshtein on March 26, 2018, 05:36:03 PM
Hi,

oracle.ddr from Windows installer is built for Oracle client 12. You can use Oracle Instant Client - put it into NetXMS bin folder or add to system PATH.

Best regards,
Victor

Thank you,
i copied content of instantclient-basic-windows.x64-11.2.0.4.0.zip to nxagent bin folder , set up credentials, copied tnsnames.ora to bin folder

*ORACLE
ID = USER
TNSName = XYZ.WORLD
Username = USER
Password = PASS

Connected and queries are retrieved, Working ok.

:)
#15
Dear Support team,
I have problem with oracle subagent, cannot load it correctly at agent side.

In config i have line Subagent = oracle.nsm 
But starting agent from comand line for check if loads correctly gives me
DB Library: Unable to load database driver module "oracle.ddr": %1 is not a valid Win32 application.

I have oracle.ddr and oracle.nsm files in bin directory after install, looks like it calls something from oracle client installation, which is installed and working on same win server as agent is.

Any hints what can be wrong or what is prerequirments on windows installation for oracle subagent to load correctly?

Netxms agnet 2.2.4
Oracle client 11.2.0