When you execute the SAS/ACCESS Interface to Spark or SAS/ACCESS Interface to JDBC LIBNAME statement, an error message similar to the following might occur:
ERROR: SAS_HADOOP_JAR_PATH environment variable not set. It must be set for SAS/ACCESS to connect. See the SAS Configuration Guide for
SAS_HADOOP_JAR_PATH requirements.
ERROR: Error in the LIBNAME statement.
ERROR: Error trying to establish connection:
[Databricks] [Databricks JDBC Driver] (500051) ERROR processing query/statement. Error Code: 0, SQL state:
TStatus (statusCode: ERROR STATUS,
infoMessages: [*org.apache.hive.service.cli.HiveSQLException: Configuration sas.spark.jdbc.spark.conf.dir is not available.]
This issue is caused by a bug in the SAS/ACCESS Interface to Spark and SAS/ACCESS Interface to JDBC engine's code. The issue has been resolved in SAS® 9.4M8 (TS1M8) and later.
To circumvent this issue in SAS® 9.4M7 (TS1M7), use SAS/ACCESS® Interface to ODBC to access Databricks. (This issue does not occur with the ODBC engine.)
If you must use SAS/ACCESS Interface to JDBC in SAS 9.4M7, do as follows:
If you must use SAS/ACCESS Interface to Spark, upgrade to SAS 9.4M8 or preferably SAS® 9.4M9 (TS1M9). In SAS 9.4M9, SAS/ACCESS Interface to Spark is the preferred method for Databricks due to improved data type handling and bulkload/bulkunload support.