note
This article covers Databricks Connect for Databricks Runtime 13.3 LTS and above.
This article provides troubleshooting information for Databricks Connect for Scala. Databricks Connect enables you to connect popular IDEs, notebook servers, and custom applications to Databricks clusters. See What is Databricks Connect?. For the Python version of this article, see Troubleshooting Databricks Connect for Python.
Issue: When you try to run code with Databricks Connect, you get an error messages that contains strings such as StatusCode.UNAVAILABLE
, StatusCode.UNKNOWN
, DNS resolution failed
, or Received http2 header with status: 500
.
Cause: Databricks Connect cannot reach your cluster.
Solutions:
Issue: You are using Databricks Connect on Windows and see:
The filename, directory name, or volume label syntax is incorrect.
Cause: Databricks Connect was installed into a directory with a space in your path.
Solution: You can work around this by either installing into a directory path without spaces, or configuring your path using the short name form.
Error: Failed to initialize MemoryUtilâIssue: When you try to build a DatabricksSession
, it returns an error Failed to initialize MemoryUtil
.
Cause: Apache Arrow is a dependency of the Databricks Connect client, and it is trying to access a private Java method using reflection, which is by default blocked in Java 17 because of security considerations.
Solution:
Set the following JVM field prior to JVM initialization:
--add-opens=java.base/java.nio=org.apache.arrow.memory.core,ALL-UNNAMED
For more information, see Apache Arrow Java Compatibility.
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4