Skip to main content

Cluster connection environment variables

The Environment variables section of the cluster configuration page allows you to pass additional environment variables to the SSH session that executes the spark-submit command. However, SSH sessions does not accept setting of environment variables unless specifically enabled in the SSH demon configuration (/etc/ssh/sshd_config).

To enable the feature on a remote machine

  1. Connect to the remote machine in a terminal application
  2. Edit the file /etc/ssh/sshd_config using a text editor such as vi or nano.
  3. Append the below line to the file:
AcceptEnv <Environment Variable Name>
  1. Save the file
  2. Restart sshd service on an Ubuntu or Debian Linux using the following command:
sudo systemctl restart ssh.service

Note: You need sudo permissions for this