note
Databricks recommends defining libraries using cluster policies to provide custom configurations for compute environments. See Add libraries to a policy. Migrate all libraries installed with init scripts to use this pattern, because installing libraries using init scripts can lead to unexpected errors, such as "Module not found" failures during job execution.
important
This documentation has been retired and might not be updated. Databricks no longer recommends using init scripts to install libraries.
If your library requires custom configuration, you may not be able to install it using the workspace or cluster library interface. Instead, you can install the library using an init script.
Here is an example of an init script that uses pip to install Python libraries on a Databricks Runtime cluster at cluster initialization.
Bash
#!/bin/bash
/databricks/python/bin/pip install astropy
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4