Upgrade a distributed RHEL, CentOS, or Oracle Linux installation of Splunk UBA

Before upgrading Splunk UBA in a distributed deployment, be sure you have verified the Upgrade Splunk UBA prerequisites. Make sure that the prerequisites are verified on each server in the distributed deployment.

Distributed environment upgrade steps

Follow the procedure in this section to upgrade Splunk UBA in a distributed environment.

1. Download the new version of Splunk UBA from Splunkbase to your management server. The file name is splunk-uba-software-upgrade-package_500.tgz. See Splunk UBA Software Update on Splunkbase.
2. Copy the Splunk UBA package to the /home/caspida directory of each server in the deployment.
3. Log in to each server in your deployment as the caspida user, and extract the downloaded file.

   tar -xvf /home/caspida/splunk-uba-software-upgrade-package_500.tgz

   The following files are extracted to the splunk-uba-software-update_50 directory:
   

   • Splunk-UBA-Platform-5.0.0-20191015-000100.tgz
   • Splunk-UBA-Platform-5.0.0-20191015-000100.tgz.md5sum
   • uba-ext-pkgs-5.0.0.tgz
   • uba-ext-pkgs-5.0.0.tgz.md5sum

   Move all of these files to the /home/caspida directory:

   mv splunk-uba-software-update_50/* /home/caspida

4. Log in to the Splunk UBA management server as the caspida user using SSH.
5. Stop Splunk UBA with the following command:

   /opt/caspida/bin/Caspida stop-all

6. If you are using the Splunk UBA Kafka Ingestion App, download and upgrade to version 1.2 of the Splunk UBA Kafka Ingestion App. During the upgrade, select the Upgrade app. Checking this will overwrite the app if it already exists. checkbox to upgrade the app without restarting Splunk Enterprise. See Install the Splunk UBA Kafka Ingestion App in the Splunk UBA Kafka Ingestion App manual.
7. Update to the latest kernel. See Operating system requirements for the specific kernel versions.

   Operating System	Update Instructions
   OEL 7.7	Perform all of the following tasks on each Splunk UBA node: Run the following commands to enable the repos for required packages: sudo subscription-manager repos --enable=rhel-7-server-extras-rpms sudo subscription-manager repos --enable=rhel-7-server-eus-rpms sudo subscription-manager repos --enable=rhel-7-server-rpms sudo subscription-manager repos --enable=rhel-7-server-optional-rpms Run the following command to install yum-utils: sudo yum install yum-utils -y Run the following commands to skip certain packages if they are not available: sudo yum-config-manager --disable pgdg94 sudo yum-config-manager --disable nodesource sudo yum-config-manager --disable rhel-7-server-rt-beta-rpms Obtain http://yum.oracle.com/public-yum-ol7.repo and download it to /home/caspida. wget http://yum.oracle.com/public-yum-ol7.repo /home/caspida Copy public-yum-ol7.repo to /etc/yum.repos.d: sudo cp /home/caspida/public-yum-ol7.repo /etc/yum.repos.d/public-yum-ol7.repo Enable the repositories: sudo yum-config-manager --enable ol7_UEKR5 sudo yum-config-manager --enable ol7_addons Run the following command to update the kernel: sudo yum update --releasever=7.7 --exclude="zookeeper redis-server redis-tools influxdb nodejs nodejs-docs postgres*" -y
   RHEL 7.7	Perform all of the following tasks on each Splunk UBA node: Run the following commands to enable the repos for required packages: sudo subscription-manager repos --enable=rhel-7-server-extras-rpms sudo subscription-manager repos --enable=rhel-7-server-eus-rpms sudo subscription-manager repos --enable=rhel-7-server-rpms sudo subscription-manager repos --enable=rhel-7-server-optional-rpms Run the following command to install yum-utils: sudo yum install yum-utils -y Run the following commands to skip certain packages if they are not available: sudo yum-config-manager --disable pgdg94 sudo yum-config-manager --disable nodesource sudo yum-config-manager --disable rhel-7-server-rt-beta-rpms Run the following command to update the kernel: sudo yum update --releasever=7.7 --exclude="zookeeper redis-server redis-tools influxdb nodejs nodejs-docs postgres*" -y
   CentOS 7.7	Perform all of the following tasks on each Splunk UBA node: Run the following command to update your CentOS kernel to the latest version: sudo yum update -y Perform the following tasks to upgrade your CentOS kernel to a specific version: Save /etc/yum.repos.d to a backup location. Enter the following code in a file so you can run it as a script: for fname in $(ls -1 /etc/yum.repos.d/*.repo 2>/dev/null) ; do echo "Changing from mirrorlist to baseurl in ${fname}" sed -i -e 's/^mirrorlist/#mirrorlist/g' -e 's/^#baseurl/baseurl/g' "${fname}" [ $? -eq 0 ] || die "Failed to disable mirrorlist option for ${fname}" echo "Switching from standard mirror to vault mirror" sed -i -e "s|baseurl=http://mirror.centos.org/centos/\$releasever|baseurl=http://vault.centos.org/centos/${OS_VER_FULL}|g" "${fname}" [ $? -eq 0 ] || die "Failed to switch to vault URL in ${fname}" done Update thebaseurl in the /etc/yum.repos.d/Centos-Base.repo file with the specific version of the kernel you want to update to. In this example, we use 7.6.1810: baseurl=http://vault.centos.org/centos/7.6.1810/os/$basearch/ Run the following command to update the kernel: sudo yum -y upgrade --releasever=${OS_VER_FULL} --exclude="${YUM_PKG_EXCLUDES}"

8. If the kernel upgrade does not succeed, run the following command to restart the existing Splunk UBA services:

   /opt/caspida/bin/Caspida start-all

   If the kernel upgrade is successful, reboot Splunk UBA:

   sudo /sbin/reboot

9. On the Splunk UBA management server, run the following command to start all services:
   /opt/caspida/bin/Caspida start-all --no-caspida
10. On each server in the deployment, perform the following steps to archive the previous version of Splunk UBA:

    sudo mkdir -p /var/vcap/release_archives
    sudo mv /opt/caspida /var/vcap/release_archives/caspida-4.3.x
    sudo mkdir -p /opt/caspida && sudo chown caspida:caspida /opt/caspida
    sudo chown caspida:caspida /var/vcap/release_archives
    sudo chown caspida:caspida /var/vcap/release_archives/caspida-4.3.x
    

11. On each server in the deployment, run the following command to extract the Splunk UBA platform package in the /opt/caspida directory:

    tar -C /opt/caspida -xvf /home/caspida/Splunk-UBA-Platform-5.0.0-20191015-000100.tgz
    

12. On the Splunk UBA management server, run the upgrade script to upgrade Splunk UBA to the new version and migrate your configurations. The upgrade script can take some time, and there are options for ensuring that the process is not interrupted:
    • If you have a terminal multiplexer product such as Linux Screen, you can start a screen session before running the upgrade command. For example, run the following command to start a new screen session called ubainstall:

      screen -S ubainstall

      Then run the upgrade script:

      /opt/caspida/upgrade/utils/upgrade_4.3_to_5.0.sh -p /var/vcap/release_archives/caspida-4.3.x -e /home/caspida/uba-ext-pkgs-5.0.0.tgz
      

      Refer to your product documentation for additional usage instructions.
    • Use nohup to run the upgrade script. For example:

      nohup /opt/caspida/upgrade/utils/upgrade_4.3_to_5.0.sh -p /var/vcap/release_archives/caspida-4.3.x -e /home/caspida/uba-ext-pkgs-5.0.0.tgz &
      

      To view the progress of the upgrade using nohup, use the following command to monitor the log messages being written to nohup.out:

      tail -f nohup.out

13. After the upgrade script finishes running, use the following command and look for the "Upgrade completed & started Caspida" confirmation message:

    tail -f /var/log/caspida/upgrade.out

Next steps

Verify a successful upgrade of Splunk UBA.