Troubleshooting

Change collection intervals

Change collection intervals to reduce the load on your Data Collection Nodes (DCNs) and your vCenters, and prevent load-related data collection failures.

1. Change the time interval for your host inventory job.
   1. On the instance where your scheduler is running, navigate to \etc\apps\Splunk_TA_vmware\default\.
   2. Open the ta_vmware_collection.conf file.
   3. Change hostinv_interval and hostinv_expiration from the 900 second default to a larger number (maximum 2700 seconds). Keep hostinv_interval and hostinv_expiration at the same number of seconds.
   4. Save your changes and exit.
2. Change the time interval for host performance data.
   1. On the instance where your scheduler is running, navigate to \etc\apps\Splunk_TA_vmware\local\.
   2. Open the ta_vmware_collection.conf file.
   3. Change hostvmperf_interval and hostvmperf_expiration from the 180 second default to a larger number (maximum 1200 seconds). Keep hostvmperf_interval and hostvmperf_expiration at the same number of seconds.
   4. Save your changes and exit.

Change the NTP server pool list

A computer uses the Network Time Protocol (NTP) to synchronize its time with another reference time source. If you are experiencing time synchronization issues between the indexer, DCN, and vCenter Server, you can change the NTP servers that the DCN uses by editing the /etc/ntp.conf file.

1. Access the /etc/ntp.conf file. The following values are defaults for the servers in the file.

 # Use public servers from the pool.ntp.org project.
 # Please consider joining the pool (http://www.pool.ntp.org/join.html).
 server 0.centos.pool.ntp.org
 server 1.centos.pool.ntp.org
 server 2.centos.pool.ntp.org

2. Replace the default values in the file with your NTP server values.

3. Restart ntpd using the following command: sudo service ntpd restart

Disable NTP on the data collection node

If your firewall prevents Internet access, you can disable NTP on the data collection node. If you disable NTP, enable VMware Tools Clock Synchronization which establishes the time for the DCN using the ESXi host.

1. Log in to Splunk Enterprise as a splunkadmin user.

2. Stop the ntpd service using the following command: sudo service ntpd stop

3. Configure ntpd so that it does not run when the system starts: sudo chkconfig ntpd off

4. Enable VMware Tools Clock Synchronization using the following command: vmware-toolbox-cmd timesync enable

5. Confirm that the VMware Tools Clock Synchronization is enabled correctly using the following command: vmware-toolbox-cmd timesync status