Hello @all,
want to update NetXMS from V5.2.8 to V6.0.1. After the Update NetXMS cannot upgrade DB:
Upgrading database...
Upgrading from version 52.24 to 53.0
Upgrading from version 53.0 to 53.1
Upgrading from version 53.1 to 53.2
Upgrading from version 53.2 to 53.3
Upgrading from version 53.3 to 53.4
Upgrading from version 53.4 to 53.5
Upgrading from version 53.5 to 53.6
Upgrading from version 53.6 to 53.7
Upgrading from version 53.7 to 53.8
Upgrading from version 53.8 to 53.9
Upgrading from version 53.9 to 53.10
Upgrading from version 53.10 to 53.11
Upgrading from version 53.11 to 60.0
Upgrading from version 60.0 to 60.1
Upgrading from version 60.1 to 60.2
Upgrading from version 60.2 to 60.3
Upgrading from version 60.3 to 60.4
Upgrading from version 60.4 to 60.5
Upgrading from version 60.5 to 60.6
Upgrading from version 60.6 to 60.7
Upgrading from version 60.7 to 60.8
Pending online upgrades must be completed before this step
Rolling back last stage due to upgrade errors...
Database upgrade failed
Background upgrades pending. Please run mnxdbmgr background-upgrade when possible.
So i rolled back the server to the latest snapshot...
After that i tried to upgrade the db with the following commands. Everytime i startet the upgrade, the "nxdbmgr background-upgrade" says the background update is locked by another process...
Also i don't understand, that "nxdbmgr check" says, its the latest db version, but if i run the "nxdbmgr background-upgrade" it want to upgrade the db version 52.24...
Please help, i'm a little bit lost... What have i to do to fix the db problem...
Many thanks
Marco
-------------------------------------
:~$ nxdbmgr check
NetXMS Database Manager Version 5.2.8 Build 5.2-506-g7d4137c08a
Checking database (excluding collected data):
* Zone object properties [PASSED]
* Node object properties [PASSED]
* Node to subnet bindings [PASSED]
* Interface object properties [PASSED]
* Interface bindings [PASSED]
* Network service object properties [PASSED]
* Network service bindings [PASSED]
* Cluster object properties [PASSED]
* Cluster member nodes [PASSED]
* Access point object properties [PASSED]
* Template mapping [PASSED]
* Business services [PASSED]
* Business service prototypes [PASSED]
* Object properties [PASSED]
* Container membership [PASSED]
* Event processing policy [PASSED]
* Network map links [PASSED]
* Data tables [PASSED]
* Orphaned data tables [PASSED]
* DCI configuration [PASSED]
* Raw DCI values table [PASSED]
* DCI thresholds [PASSED]
* Table DCI thresholds [PASSED]
* Business service checks - service bindings [PASSED]
* Business service tickets - service bindings [PASSED]
* Business service tickets - check bindings [PASSED]
* Business service tickets - hierarchy [PASSED]
* Business service checks - state [PASSED]
* Business service downtime [PASSED]
* Assets [PASSED]
* Asset to node links [PASSED]
* Node to asset links [PASSED]
Database doesn't contain any errors
Database check completed
WARNING: Background upgrades pending. Please run nxdbmgr background-upgrade when possible.
-------------------------------------
:~$ sudo nxdbmgr background-upgrade
NetXMS Database Manager Version 5.2.8 Build 5.2-506-g7d4137c08a
Background upgrade is locked by another process
Are you sure you want to start background upgrade? (Yes/No)
-------------------------------------
:~$ nxdbmgr upgrade
NetXMS Database Manager Version 5.2.8 Build 5.2-506-g7d4137c08a
Upgrading database...
Core database schema is up to date
Database upgrade succeeded
WARNING: Background upgrades pending. Please run nxdbmgr background-upgrade when possible.
-------------------------------------
:~$ nxdbmgr background-upgrade
NetXMS Database Manager Version 5.2.8 Build 5.2-506-g7d4137c08a
Background upgrade is locked by another process
Are you sure you want to start background upgrade? (Yes/No) yes
Running background upgrade procedure for version 52.24
-------------------------------------
Yes, that's some background upgrade that was needed when upgrading to 5.2.8. When packages are upgraded by apt, background upgrade is initiated automatically. Could be that you stopped the server soon after upgrading to 5.2.8 and background upgrade did not complete. It's locking mechanism was introduced recently, so there might be some issues with it.
Recommended way is to check with ps fax or similar to see that there's no other nxdbmgr background-upgrade running on your system.
Since you've started nxdbmgr background-upgrade, once it completes system should be able to upgrade to 6.0 (note that there's 6.0.1 with some bugfixes, should be available already)
Hi Filipp,
thanks for the fast reply. How can i recognize then background prozess?
ps fax shows me only this in combination with netxms:
507 ? Ssl 0:36 /usr/bin/nxagentd -S
986 ? Ssl 4:16 /usr/bin/netxmsd -S
603 ? Ss 0:00 /usr/lib/postgresql/15/bin/postgres -D /var/lib/postgresql/15/main -c config_file=/etc/postgresql/15/main/postgresql.conf
659 ? Ss 0:06 \_ postgres: 15/main: checkpointer
660 ? Ss 0:00 \_ postgres: 15/main: background writer
667 ? Ss 0:01 \_ postgres: 15/main: walwriter
668 ? Ss 0:00 \_ postgres: 15/main: autovacuum launcher
669 ? Ss 0:00 \_ postgres: 15/main: logical replication launcher
990 ? Ss 0:20 \_ postgres: 15/main: netxms netxms 127.0.0.1(46052) idle
991 ? Ss 0:20 \_ postgres: 15/main: netxms netxms 127.0.0.1(46062) idle
992 ? Ss 0:19 \_ postgres: 15/main: netxms netxms 127.0.0.1(46064) idle
993 ? Ss 0:19 \_ postgres: 15/main: netxms netxms 127.0.0.1(46066) idle
994 ? Ss 0:17 \_ postgres: 15/main: netxms netxms 127.0.0.1(46078) idle in transaction
12165 ? Ss 0:16 \_ postgres: 15/main: netxms netxms 127.0.0.1(33932) idle
Other question: Can i run "nxdbmgr background-upgrade" while running the NetXMS server or must i stop the server?
Greetings
Marco
Command line should contain nxdbmgr
Yes, that's the idea of background upgrade that it runs while server is running. This way we minimize server downtime.
Hi Filipp,
nxdbmgr ist not running
:~$ ps fax | grep nx
507 ? Ssl 1:02 /usr/bin/nxagentd -S
42549 pts/0 S+ 0:00 \_ grep nx
...but nxdbmgr shows, that Background Update ist locked...
:~$ nxdbmgr background-upgrade
NetXMS Database Manager Version 5.2.8 Build 5.2-506-g7d4137c08a
Background upgrade is locked by another process
Are you sure you want to start background upgrade? (Yes/No)
Should I run "nxdbmgr background-upgrade" anyway?
Greetings
Marco
Yes, this seems to be a lock without the actual upgrade. Pls run nxdbmgr background-upgrade and force unlock.
Hi Filipp,
it worked!! :-)
Background Update has completed the task ...
:~$ nxdbmgr background-upgrade
NetXMS Database Manager Version 5.2.8 Build 5.2-506-g7d4137c08a
Background upgrade is locked by another process
Are you sure you want to start background upgrade? (Yes/No) yes
Running background upgrade procedure for version 52.24
Background upgrade procedure for version 52.24 completed
...and the update to V6.0.1 worked without any error messages... :-)
Many thanks for the support...
Greetings
Marco