Patch Moogsoft Enterprise Tarball for v8.2.x

Ensure the patch tarball is available to each server being patched:

Optional GPG key validation of the tarball to validate the installation file.

FOR ALL VERSIONS

Stop all processes on each host:

$MOOGSOFT_HOME/bin/utils/process_cntl moog_farmd stop;
$MOOGSOFT_HOME/bin/utils/process_cntl apache-tomcat stop;
kill -9 $(ps -ef | grep java | grep lam | awk '{print $2}') 2>/dev/null;
(crontab -l | sed -e 's/^\(.*events_analyser.*\)$/#\1/') | crontab -
(crontab -l | sed -e 's/^\(.*keepalive.*\)$/#\1/') | crontab -
ps -ef | grep java | egrep 'events_analyser|keepalive' | awk '{print $2}' | xargs kill 2>/dev/null;
$MOOGSOFT_HOME/bin/utils/process_cntl nginx stop;
$MOOGSOFT_HOME/bin/utils/process_cntl elasticsearch stop;
kill -9 $(ps -ef | grep org.elasticsearch.bootstrap.Elasticsearch | awk '{print $2}')
$MOOGSOFT_HOME/bin/utils/process_cntl rabbitmq stop;

FOR ALL VERSIONS

Gather the required variables (do not close the terminal these commands are run in, otherwise they will be lost):

export OLD_DIST_PATH=$(readlink -f $MOOGSOFT_HOME/bin|awk -F '/' 'sub(FS $NF,x)');
export CERT_REAL_PATH_PEM=$(readlink -f $(grep -h 'ssl_certificate ' $OLD_DIST_PATH/cots/nginx/config/conf.d/moog-ssl.conf|awk '{print $2}'|tr -d ';'));
export CERT_REAL_PATH_KEY=$(readlink -f $(grep -h 'ssl_certificate_key' $OLD_DIST_PATH/cots/nginx/config/conf.d/moog-ssl.conf|awk '{print $2}'|tr -d ';'));
export CERT_PATH_PEM=$(grep -h 'ssl_certificate ' $OLD_DIST_PATH/cots/nginx/config/conf.d/moog-ssl.conf);
export CERT_PATH_KEY=$(grep -h 'ssl_certificate_key' $OLD_DIST_PATH/cots/nginx/config/conf.d/moog-ssl.conf);

FOR ALL VERSIONS

Update Percona to the latest version using the instructions here: Percona Cluster 5.7 Tarball Minor Version Upgrade

FOR ALL VERSIONS

Place the downloaded tarball file into an empty directory called patch_directory8.2.0 and execute the following commands to start the patch installation:

cd patch_directory8.2.0;
tar -xf moogsoft-enterprise-8.2.0.tgz;
bash moogsoft-enterprise-install-8.2.0.sh;

FOR ALL VERSIONS

Now the RabbitMQ binaries have been upgraded, the RabbitMQ nodes need to be restarted.

$MOOGSOFT_HOME/bin/utils/process_cntl rabbitmq restart

Perform some health checks (for example as documented here: https://www.rabbitmq.com/monitoring.html#health-checks) to ensure the cluster is operating as expected

FOR ALL VERSIONS

Refresh all stored procedures (provide the 'root' DB user password when prompted):

$MOOGSOFT_HOME/bin/utils/moog_db_auto_upgrader -t 8.2.0 -u root

FOR ALL VERSIONS

One of the database views needs to be patched:

$MOOGSOFT_HOME/bin/utils/moog_mysql_client -e "CREATE OR REPLACE VIEW historic_feedback AS SELECT * FROM historic_moogdb.feedback"

FOR ALL VERSIONS

Re-deploy Apache Tomcat and reconfigure Nginx. IMPORTANT: If the Xmx value for apache-tomcat has been changed from the default in the $MOOGSOFT_HOME/bin/utils/process_cntl script, ensure the customised value is replaced after the upgrade, then restart the apache-tomcat process. Run these commands in the same terminal as the one where the variables were saved previously. Then restart nginx:

VERSION=8.2.0;
$MOOGSOFT_HOME/bin/utils/moog_init_ui.sh -tnfwz $($MOOGSOFT_HOME/bin/utils/moog_config_reader -k mooms.zone) --accept-eula
cp -f $CERT_REAL_PATH_PEM $MOOGSOFT_HOME/dist/${VERSION}/cots/nginx/ssl/;
cp -f $CERT_REAL_PATH_KEY $MOOGSOFT_HOME/dist/${VERSION}/cots/nginx/ssl/;
sed -i "s/.*ssl_certificate .*/${CERT_PATH_PEM}/" $MOOGSOFT_HOME/dist/${VERSION}/cots/nginx/config/conf.d/moog-ssl.conf;
sed -i "s/.*ssl_certificate_key.*/${CERT_PATH_KEY}/" $MOOGSOFT_HOME/dist/${VERSION}/cots/nginx/config/conf.d/moog-ssl.conf;
$MOOGSOFT_HOME/bin/utils/process_cntl nginx restart;

FOR ALL VERSIONS

Verify the remaining processes are working properly and update the crontab:

$MOOGSOFT_HOME/bin/utils/process_cntl apache-tomcat status;
$MOOGSOFT_HOME/bin/utils/process_cntl nginx status;
(crontab -l | sed -e 's/^\#\+\(.*events_analyser.*\)/\1/') | crontab -
(crontab -l | sed -e 's/^\#\+\(.*keepalive.*\)/\1/') | crontab -

FOR ALL VERSIONS

Validate the patch:

$MOOGSOFT_HOME/bin/utils/moog_install_validator.sh
$MOOGSOFT_HOME/bin/utils/tomcat_install_validator.sh
$MOOGSOFT_HOME/bin/utils/moog_db_validator.sh

If there are any errors from the above validators, please contact Moogsoft Support.

FOR ALL VERSIONS

Re-start non-UI integrations or LAMs

FOR ALL VERSIONS

The 'Addons' pack will need to be re-installed.

The Addons v2.4.0 bundle is included with this release: $MOOGSOFT_HOME/contrib/Moogsoft-Addons-2.4.0.tar.gz

Alternatively, the latest 'Addons' pack can always be found by following the instructions here:

FOR ALL VERSIONS

Elasticsearch is no longer the default Search provider for Moogsoft Enterprise. To install a single-node Opensearch deployment and create a user to connect with in one step on the current server, follow the steps below. For a cluster, follow the instructions here instead: Opensearch Clustering Guide

Ensure Elasticsearch has been stopped:

kill -9 $(ps -ef | grep org.elasticsearch.bootstrap.Elasticsearch | grep -v grep | awk '{print $2}') 2>/dev/null

Install Opensearch, change the default admin password, and create a new account to connect with the following command:

$MOOGSOFT_HOME/bin/utils/moog_init_search.sh -i

This will deploy Opensearch, change the default admin account password (the new password will be printed out to STDOUT/the terminal, so be sure to make a note of it), and create a 'moog_opensearchuser' in Opensearch and $MOOGSOFT_HOME/config/system.conf is updated to use this user to connect.

WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by io.protostuff.runtime.PolymorphicThrowableSchema (file:/opt/moogsoft/install/dist/8.2.0/cots/opensearch/plugins/opensearch-anomaly-detection/protostuff-runtime-1.7.4.jar) to field java.lang.Throwable.cause
WARNING: Please consider reporting this to the maintainers of io.protostuff.runtime.PolymorphicThrowableSchema
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release

FOR ALL VERSIONS

Restart apache-tomcat:

$MOOGSOFT_HOME/bin/utils/process_cntl apache-tomcat restart;

FOR ALL VERSIONS

Restart moogfarmd:

$MOOGSOFT_HOME/bin/utils/process_cntl moog_farmd start;

Wait for MoogFarmD to finish loading by ensuring this line has appeared in the log: Farmd initialization complete

FOR ALL VERSIONS

As Opensearch is now being used instead of Elasticsearch, it will need to be re-indexed using the following command:

$MOOGSOFT_HOME/bin/utils/moog_indexer -f -n

FOR ALL VERSIONS

Restart any event feeds if they were stopped.

FOR ALL VERSIONS

Clear the browser cache and log in to the UI.