Applying a configuration in a SAS® Grid Manager module might fail with the error "ls_limcontrol: Cannot locate master LIM now, try again later"


The Grid Manager module for SAS® Environment Manager relies on the Platform Web Services service to perform monitoring and configuration of the grid.

As part of applying a new configuration, Platform Web Services runs the lsadmin -v -f reconfig command from its host on the middle tier. In some cases, after restarting the master candidates, it requires more time than allowed by default for the master LIM daemon to start up successfully. As a result, one or more of the hosts might return the following error:

"ls_limcontrol: Cannot locate master LIM now, try again later"

 

This error can be present in the following places:

To work around this issue, add the environment variable LSF_RESTART_DELAY. This variable enables you to set a delay between the restart attempt on each host, which gives the master LIM more time to start up.

To confirm that this workaround works, run the export LSF_RESTART_DELAY=5 command and try running the lsadmin reconfig command again on the middle tier host to confirm that the error is resolved. If it does not, try increasing the value in the command to 10.

If the workaround fixed the issue for your session, complete the following steps to implement the workaround for the environment:

  1. Make a backup of the profile.lsf file before making any changes.
  2. Add these lines to the LSF_TOP/conf/profile.lsf file below the definitions for the LSF version:
    Note: LSF_TOP is the path where Platform LSF is installed.  
LSF_RESTART_DELAY=5
export LSF_RESTART_DELAY

 

These lines enable you to set the LSF_RESTART_DELAY property while configuring the environment for LSF control, which should resolve the issue for the web environment. 

  1. After applying these changes to profile.lsf, restart the web application server where Platform Web Services is running, typically SASServer14_1. This action sources the new profile during start-up. Typically, restarting SASServer14_1 can be performed by running the following:

<SAS-configuration-directory>/Levn/Web/WebAppServer/SASServer14_1/bin/tcruntime-ctl.sh restart