Applies to: Databricks SQL Databricks Runtime 12.2 and above
Error conditions are descriptive, human-readable strings that unique to the error they describe.
You can use error conditions to programmatically handle errors in your application without the need to parse the error message.
This is a list of common, named error conditions returned by Databricks.
Databricks Runtime and Databricks SQLâ ADD_DEFAULT_UNSUPPORTEDâFailed to execute <statementType> command because DEFAULT values are not supported when adding new columns to previously existing target data source with table provider: "<dataSource>".
Detected aggregate functions in outer scope references <expression> which is not supported.
Non-deterministic expression <sqlExpr> should not appear in the arguments of an aggregate function.
No enough memory for aggregation
AI_FUNCTION_HTTP_PARSE_CAST_ERRORâFailed to parse model output when casting to the specified returnType: "<dataType>", response JSON was: "<responseString>". Please update the returnType to match the contents of the type represented by the response JSON and then retry the query again. Exception: <errorMessage>
The actual model output has more than one column "<responseString>". However, the specified return type["<dataType>"] has only one column. Please update the returnType to contain the same number of columns as the model output and then retry the query again.
Error occurred while making an HTTP request for function <funcName>: <errorMessage>
Invalid HTTP response for function <funcName>: <errorMessage>
The maximum number of words must be a non-negative integer, but got <maxWords>.
The provided model parameters (<modelParameters>) are invalid in the AI_QUERY function for serving endpoint "<endpointName>".
For more details see AI_FUNCTION_INVALID_MODEL_PARAMETERS
AI_FUNCTION_INVALID_RESPONSE_FORMAT_TYPEâAI function: "<functionName>" requires valid <format> string for responseFormat parameter, but found the following response format: "<invalidResponseFormat>". Exception: <errorMessage>
Error occurred while parsing the JSON response for function <funcName>: <errorMessage>
Failed to parse the schema for the serving endpoint "<endpointName>": <errorMessage>, response JSON was: "<responseJson>".
Set the returnType parameter manually in the AI_QUERY function to override schema resolution.
The function <funcName> is not supported in the current environment. It is only available in Databricks SQL Pro and Serverless.
Failed to evaluate the SQL function "<functionName>" because the provided argument of <invalidValue> has "<invalidDataType>", but only the following types are supported: <supportedDataTypes>. Please update the function call to provide an argument of string type and retry the query again.
Found unsupported response format.
For more details see AI_FUNCTION_UNSUPPORTED_RESPONSE_FORMAT
AI_FUNCTION_UNSUPPORTED_RETURN_TYPEâAI function: "<functionName>" does not support the following type as return type: "<typeName>". Return type must be a valid SQL type understood by Catalyst and supported by AI function. Current supported types includes: <supportedValues>
Provided value "<argValue>" is not supported by argument "<argName>". Supported values are: <supportedValues>
Expected the serving endpoint task type to be "Chat" for structured output support, but found "<taskType>" for the endpoint "<endpointName>".
Provided "<sqlExpr>" is not supported by the argument returnType.
Conflicting parameters detected for vector_search SQL function: <conflictParamNames>.<hint>
vector_search SQL function with embedding column type <embeddingColumnType> is not supported.
vector_search SQL function is missing query input parameter, please specify at least one from: <parameterNames>.
The parameter query to vector_search SQL function is not supported for hybrid vector search. Please use query_text instead.
Query text not found in the vector_search SQL function for hybrid vector search. Please provide query_text.
vector_search SQL function with index type <indexType> is not supported.
query_vector must be specified for index <indexName> because it is not associated with an embedding model endpoint.
Failure to materialize vector_search SQL function query from spark type <dataType> to scala-native objects during request-encoding with error: <errorMessage>.
vector_search SQL function with query type <unexpectedQueryType> is not supported. Please specify one from: <supportedQueryTypes>.
vector_search SQL function with num_results larger than <maxLimit> is not supported. The limit specified was <requestedLimit>. Please try again with num_results <= <maxLimit>
The ai_top_drivers parameter <param> must be between <lo> and <hi>.
ai_top_drivers does not support the <aggName> aggregate. Choose one of the following supported aggregates: <allowed>.
ai_top_drivers does not support numeric, map, or struct dimension columns. The column <colName> has type <dataType>. Remove this dimension or cast it to a supported type.
ai_top_drivers requires the label column type to be boolean. The column <colName> has type <dataType>. Change the label column or cast it to a supported type.
ai_top_drivers requires the metric column type to be numeric. The column <colName> has type <dataType>. Change the metric column or cast it to a supported type.
Using name parameterized queries requires all parameters to be named. Parameters missing names: <exprs>.
Cannot use all columns for partition columns.
ALTER_SCHEDULE_DOES_NOT_EXISTâCannot alter <scheduleType> on a table without an existing schedule or trigger. Please add a schedule or trigger to the table before attempting to alter it.
ALTER TABLE <type> column <columnName> specifies descriptor "<optionName>" more than once, which is invalid.
Name <name> is ambiguous in nested CTE.
Please set <config> to "CORRECTED" so that name defined in inner CTE takes precedence. If set it to "LEGACY", outer CTE definitions will take precedence.
See 'https://spark.apache.org/docs/latest/sql-migration-guide.html#query-engine'.
AMBIGUOUS_COLUMN_OR_FIELDâColumn or field <name> is ambiguous and has <n> matches.
Column <name> is ambiguous. It's because you joined several DataFrame together, and some of these DataFrames are the same.
This column points to one of the DataFrames but Spark is unable to figure out which one.
Please alias the DataFrames with different names via DataFrame.alias before joining them,
and specify the column using qualified name, e.g. df.alias("a").join(df.alias("b"), col("a.id") > col("b.id")).
Ambiguous reference to constraint <constraint>.
Lateral column alias <name> is ambiguous and has <n> matches.
Reference <name> is ambiguous, could be: <referenceNames>.
Ambiguous reference to the field <field>. It appears <count> times in the schema.
ANALYZE CONSTRAINTS is not supported.
The ANSI SQL configuration <config> cannot be disabled in this product.
AQE thread is interrupted, probably due to query cancellation by user.
ARGUMENT_NOT_CONSTANTâThe function <functionName> includes a parameter <parameterName> at position <pos> that requires a constant argument. Please compute the argument <sqlExpr> separately and pass the result as a constant.
<message>.<alternative> If necessary set <config> to "false" to bypass this error.
For more details see ARITHMETIC_OVERFLOW
ARROW_TYPE_MISMATCHâInvalid schema from <operation>: expected <outputTypes>, got <actualDataTypes>.
The artifact <normalizedRemoteRelativePath> already exists. Please choose a different name for the new artifact because it cannot be overwritten.
The number of columns or variables assigned or aliased: <numTarget> does not match the number of source expressions: <numExpr>.
Invalid as-of join.
For more details see AS_OF_JOIN
AVRO_CANNOT_WRITE_NULL_FIELDâCannot write null value for field <name> defined as non-null Avro data type <dataType>.
To allow null value for this field, specify its avro schema as a union type with "null" using avroSchema option.
The use of default values is not supported whenrescuedDataColumn is enabled. You may be able to remove this check by setting spark.databricks.sql.avro.rescuedDataBlockUserDefinedSchemaDefaultValue to false, but the default values will not apply and null values will still be used.
Cannot convert Avro <avroPath> to SQL <sqlPath> because the original encoded data type is <avroType>, however you're trying to read the field as <sqlType>, which would lead to an incorrect answer.
To allow reading this field, enable the SQL configuration: "spark.sql.legacy.avro.allowIncompatibleSchema".
AVRO_NOT_LOADED_SQL_FUNCTIONS_UNUSABLEâCannot call the <functionName> SQL function because the Avro data source is not loaded.
Please restart your job or session with the 'spark-avro' package loaded, such as by using the --packages argument on the command line, and then retry your query or command again.
AVRO_POSITIONAL_FIELD_MATCHING_UNSUPPORTEDâThe use of positional field matching is not supported when either rescuedDataColumn or failOnUnknownFields is enabled. Remove these options to proceed.
Unable to find batch <batchMetadataFile>.
BigQuery connection credentials must be specified with either the 'GoogleServiceAccountKeyJson' parameter or all of 'projectId', 'OAuthServiceAcctEmail', 'OAuthPvtKey'
BINARY_ARITHMETIC_OVERFLOWâ<value1> <symbol> <value2> caused overflow. Use <functionName> to ignore overflow problem and return NULL.
<operation> doesn't support built-in catalogs.
The method <methodName> can not be called on streaming Dataset/DataFrame.
ALTER TABLE (ALTER|CHANGE) COLUMN cannot change collation of type/subtypes of bucket columns, but found the bucket column <columnName> in the table <tableName>.
ALTER TABLE (ALTER|CHANGE) COLUMN is not supported for partition columns, but found the partition column <columnName> in the table <tableName>.
Watermark needs to be defined to reassign event time column. Failed to find watermark definition in the streaming query.
CANNOT_CAST_DATATYPEâCannot cast <sourceType> to <targetType>.
Cannot convert Protobuf <protobufColumn> to SQL <sqlColumn> because schema is incompatible (protobufType = <protobufType>, sqlType = <sqlType>).
Unable to convert <protobufType> of Protobuf to SQL type <toType>.
Cannot convert SQL <sqlColumn> to Protobuf <protobufColumn> because schema is incompatible (protobufType = <protobufType>, sqlType = <sqlType>).
Cannot convert SQL <sqlColumn> to Protobuf <protobufColumn> because <data> is not in defined values for enum: <enumString>.
Cannot copy catalog state like current database and temporary views from Unity Catalog to a legacy catalog.
CANNOT_CREATE_DATA_SOURCE_TABLEâFailed to create data source table <tableName>:
For more details see CANNOT_CREATE_DATA_SOURCE_TABLE
CANNOT_DECODE_URLâThe provided URL cannot be decoded: <url>. Please ensure that the URL is properly formatted and try again.
System owned <resourceType> cannot be deleted.
Cannot drop the constraint with the name <constraintName> shared by a CHECK constraint
and a PRIMARY KEY or FOREIGN KEY constraint. You can drop the PRIMARY KEY or
FOREIGN KEY constraint by queries:
ALTER TABLE .. DROP PRIMARY KEY or
ALTER TABLE .. DROP FOREIGN KEY ..
Cannot establish connection to remote <jdbcDialectName> database. Please check connection information and credentials e.g. host, port, user, password and database options. ** If you believe the information is correct, please check your workspace's network setup and ensure it does not have outbound restrictions to the host. Please also check that the host does not block inbound connections from the network where the workspace's Spark clusters are deployed. ** Detailed error message: <causeErrorMessage>.
Cannot establish connection to remote <jdbcDialectName> database. Please check connection information and credentials e.g. host, port, user, password and database options. ** If you believe the information is correct, please allow inbound traffic from the Internet to your host, as you are using Serverless Compute. If your network policies do not allow inbound Internet traffic, please use non Serverless Compute, or you may reach out to your Databricks representative to learn about Serverless Private Networking. ** Detailed error message: <causeErrorMessage>.
Dataset transformations and actions can only be invoked by the driver, not inside of other Dataset transformations; for example, dataset1.map(x => dataset2.values.count() * x) is invalid because the values transformation and count action cannot be performed inside of the dataset1.map transformation. For more information, see SPARK-28702.
Error loading streaming checkpoint file manager for path=<path>.
For more details see CANNOT_LOAD_CHECKPOINT_FILE_MANAGER
CANNOT_LOAD_FUNCTION_CLASSâCannot load class <className> when registering the function <functionName>, please make sure it is on the classpath.
Could not load Protobuf class with name <protobufClassName>. <explanation>.
An error occurred during loading state.
For more details see CANNOT_LOAD_STATE_STORE
CANNOT_MERGE_INCOMPATIBLE_DATA_TYPEâFailed to merge incompatible data types <left> and <right>. Please check the data types of the columns being merged and ensure that they are compatible. If necessary, consider casting the columns to compatible data types before attempting the merge.
Failed merging schemas:
Initial schema:
<left>
Schema that cannot be merged with the initial schema:
<right>.
Cannot modify the value of the Spark config: <key>.
See also 'https://spark.apache.org/docs/latest/sql-migration-guide.html#ddl-statements'.
CANNOT_PARSE_DECIMALâCannot parse decimal. Please ensure that the input is a valid number with optional decimal point or comma separators.
CANNOT_PARSE_INTERVALâUnable to parse <intervalString>. Please ensure that the value provided is in a valid format for defining an interval. You can reference the documentation for the correct format. If the issue persists, please double check that the input value is not null or empty and try again.
Cannot parse the field name <fieldName> and the value <fieldValue> of the JSON token type <jsonType> to target Spark data type <dataType>.
Error parsing descriptor bytes into Protobuf FileDescriptorSet.
CANNOT_PARSE_TIMEâThe input string <input> cannot be parsed to a TIME value because it does not match to the datetime format <format>.
<message>. Use <func> to tolerate invalid input string and return NULL instead.
Cannot query MV/ST during initialization.
For more details see CANNOT_QUERY_TABLE_DURING_INITIALIZATION
CANNOT_READ_ARCHIVED_FILEâCannot read file at path <path> because it has been archived. Please adjust your query filters to exclude archived files.
Cannot read <format> file at path: <path>.
For more details see CANNOT_READ_FILE
CANNOT_READ_SENSITIVE_KEY_FROM_SECURE_PROVIDERâCannot read sensitive key '<key>' from secure provider.
Cannot recognize hive type string: <fieldType>, column: <fieldName>. The specified data type for the field cannot be recognized by Spark SQL. Please check the data type of the specified field and ensure that it is a valid Spark SQL data type. Refer to the Spark SQL documentation for a list of valid data types and their format. If the data type is correct, please ensure that you are using a supported version of Spark SQL.
Cannot reference a Unity Catalog <objType> in Hive Metastore objects.
Cannot remove reserved property: <property>.
Renaming a <type> across catalogs is not allowed.
Renaming a <type> across schemas is not allowed.
Cannot resolve dataframe column <name>. It's probably because of illegal references like df1.select(df2.col("a")).
Cannot resolve <targetString>.* given input columns <columns>. Please check that the specified table or struct exists and is accessible in the input columns.
Failed to set permissions on created path <path> back to <permission>.
Cannot shallow-clone tables across Unity Catalog and Hive Metastore.
CANNOT_SHALLOW_CLONE_NESTEDâCannot shallow-clone a table <table> that is already a shallow clone.
Shallow clone is only supported for the MANAGED table type. The table <table> is not MANAGED table.
Cannot update <table> field <fieldName> type:
For more details see CANNOT_UPDATE_FIELD
CANNOT_UP_CAST_DATATYPEâCannot up cast <expression> from <sourceType> to <targetType>.
<details>
Cannot load Kryo serialization codec. Kryo serialization cannot be used in the Spark Connect client. Use Java serialization, provide a custom Codec, or use Spark Classic instead.
CANNOT_VALIDATE_CONNECTIONâValidation of <jdbcDialectName> connection is not supported. Please contact Databricks support for alternative solutions, or set "spark.databricks.testConnectionBeforeCreation" to "false" to skip connection testing before creating a connection object.
Error writing state store files for provider <providerClass>.
For more details see CANNOT_WRITE_STATE_STORE
CAST_INVALID_INPUTâThe value <expression> of the type <sourceType> cannot be cast to <targetType> because it is malformed. Correct the value as per the syntax, or change its target type. Use try_cast to tolerate malformed input and return NULL instead.
For more details see CAST_INVALID_INPUT
CAST_OVERFLOWâThe value <value> of the type <sourceType> cannot be cast to <targetType> due to an overflow. Use try_cast to tolerate overflow and return NULL instead.
Fail to assign a value of <sourceType> type to the <targetType> type column or variable <columnName> due to an overflow. Use try_cast on the input value to tolerate overflow and return NULL instead.
The catalog <catalogName> not found. Consider to set the SQL config <config> to a catalog plugin.
Creating Delta tables with <feature> table feature is not allowed. Please contact Databricks support.
Checkpoint block <rddBlockId> not found!
Either the executor that originally checkpointed this partition is no longer alive, or the original RDD is unpersisted.
If this problem persists, you may consider using rdd.checkpoint() instead, which is slower than local checkpointing but more fault-tolerant.
Cannot have circular references in class, but got the circular reference of class <t>.
<className> must override either <method1> or <method2>.
MapObjects does not support the class <cls> as resulting collection.
Clean Room commands are not supported
Invalid name to reference a <type> inside a Clean Room. Use a <type>'s name inside the clean room following the format of [catalog].[schema].[<type>].
If you are unsure about what name to use, you can run "SHOW ALL IN CLEANROOM [clean_room]" and use the value in the "name" column.
Cloning with history is specified with an invalid option: <invalidOption>.
Valid syntax: CREATE (OR REPLACE) TABLE ... DEEP CLONE ... WITH HISTORY.
Cloning with history is not supported.
CLOUD_FILE_SOURCE_FILE_NOT_FOUNDâA file notification was received for file: <filePath> but it does not exist anymore. Please ensure that files are not deleted before they are processed. To continue your stream, you can set the Spark SQL configuration <config> to true.
Cloud provider error: <message>
Specified clustering does not match that of the existing table <tableName>.
Specified clustering columns: [<specifiedClusteringString>].
Existing clustering columns: [<existingClusteringString>].
'<operation>' does not support clustering.
Please contact your Databricks representative to enable the cluster-by-auto feature.
CLUSTER_BY_AUTO_REQUIRES_CLUSTERING_FEATURE_ENABLEDâPlease enable clusteringTable.enableClusteringTableFeature to use CLUSTER BY AUTO.
CLUSTER BY AUTO requires Predictive Optimization to be enabled.
CLUSTER BY AUTO is only supported on UC Managed tables.
The codec <codecName> is not available.
For more details see CODEC_NOT_AVAILABLE
CODEC_SHORT_NAME_NOT_FOUNDâCannot find a short name for the codec <codecName>.
The value <collationName> does not represent a correct collation name. Suggested valid collation names: [<proposals>].
The value <provider> does not represent a correct collation provider. Supported providers are: [<supportedProviders>].
Could not determine which collation to use for string functions and operators.
For more details see COLLATION_MISMATCH
COLLECTION_SIZE_LIMIT_EXCEEDEDâCan't create array with <numberOfElements> elements which exceeding the array size limit <maxRoundedArrayLength>,
For more details see COLLECTION_SIZE_LIMIT_EXCEEDED
COLUMN_ALIASES_NOT_ALLOWEDâColumn aliases are not allowed in <op>.
The column <columnName> already exists. Choose another name or rename the existing column.
Some values in field <pos> are incompatible with the column array type. Expected type <type>.
Column masks could not be resolved on <tableName> because there was a mismatch between column masks inherited from policies and explicitly defined column masks. To proceed, please disable Attribute Based Access Control (ABAC) and contact Databricks support.
Creating CHECK constraint on table <tableName> with column mask policies is not supported.
A <statementType> statement attempted to assign a column mask policy to a column which included two or more other referenced columns in the USING COLUMNS list with the same name <columnName>, which is invalid.
Column mask policies for <tableName> are not supported:
For more details see COLUMN_MASKS_FEATURE_NOT_SUPPORTED
COLUMN_MASKS_INCOMPATIBLE_SCHEMA_CHANGEâUnable to <statementType> <columnName> from table <tableName> because it's referenced in a column mask policy for column <maskedColumn>. The table owner must remove or alter this policy before proceeding.
MERGE INTO operations do not support column mask policies in source table <tableName>.
MERGE INTO operations do not support writing into table <tableName> with column mask policies.
This statement attempted to assign a column mask policy to a column <columnName> with multiple name parts, which is invalid.
This statement attempted to assign a column mask policy to a column and the USING COLUMNS list included the name <columnName> with multiple name parts, which is invalid.
Support for defining column masks is not enabled
COLUMN_MASKS_REQUIRE_UNITY_CATALOGâColumn mask policies are only supported in Unity Catalog.
COLUMN_MASKS_SHOW_PARTITIONS_UNSUPPORTEDâSHOW PARTITIONS command is not supported for<format> tables with column masks.
<mode> clone from table <tableName> with column mask policies is not supported.
<mode> clone to table <tableName> with column mask policies is not supported.
Using a constant as a parameter in a column mask policy is not supported. Please update your SQL command to remove the constant from the column mask definition and then retry the command again.
COLUMN_MASKS_UNSUPPORTED_DATA_TYPEâFunction <functionName> used as a column mask policy contains parameter with unsupported data type <dataType>.
Failed to execute <statementType> command because assigning column mask policies is not supported for target data source with table provider: "<provider>".
The column <columnName> had the same name as the target column, which is invalid; please remove the column from the USING COLUMNS list and retry the command.
<colType> column <colName> is not defined in table <tableName>, defined table columns are: <tableCols>.
The column <colName> cannot be found. Verify the spelling and correctness of the column name according to the SQL config <caseSensitiveConfig>.
Column ordinal out of bounds. The number of columns in the table is <attributesLength>, but the column ordinal is <ordinal>.
Attributes are the following: <attributes>.
Unexpected ',' before constraint(s) definition. Ensure that the constraint clause does not start with a comma when columns (and expectations) are not defined.
The COMMENT ON CONNECTION command is not implemented yet
The comparator has returned a NULL for a comparison between <firstValue> and <secondValue>.
It should return a positive integer for "greater than", 0 for "equal" and a negative integer for "less than".
To revert to deprecated behavior where NULL is treated as 0 (equal), you must set "spark.sql.legacy.allowNullComparisonResultInArraySort" to "true".
Cannot process input data types for the expression: <expression>.
For more details see COMPLEX_EXPRESSION_UNSUPPORTED_INPUT
CONCURRENT_QUERYâAnother instance of this query [id: <queryId>] was just started by a concurrent session [existing runId: <existingQueryRunId> new runId: <newQueryRunId>].
The minimum number of free slots required in the cluster is <numTasks>, however, the cluster has only has <numSlots> slots free. Query will stall or fail. Increase cluster size to proceed.
Concurrent update to the log. Multiple streaming jobs detected for <batchId>.
Please make sure only one streaming job runs on a specific checkpoint location at a time.
CONFIG_NOT_AVAILABLEâConfiguration <config> is not available.
The following configuration(s) conflict with spark.databricks.streaming.realTimeMode.enabled: <confNames>. Remove these configurations from your cluster configuration and restart your Spark cluster.
Conflicting directory structures detected.
Suspicious paths:
<discoveredBasePaths>
If provided paths are partition directories, please set "basePath" in the options of the data source to specify the root directory of the table.
If there are multiple root directories, please load them separately and then union them.
CONFLICTING_PARTITION_COLUMN_NAMESâConflicting partition column names detected:
<distinctPartColLists>
For partitioned table directories, data files should only live in leaf directories.
And directories at the same level should have the same partition column name.
Please check the following directories for unexpected files or inconsistent partition column names:
<suspiciousPaths>
Partition column name '<partitionColumnName>' conflicts with reserved column name.
The schema of <tableName> is Hive-incompatible, Spark automatically generates a reserved column '<partitionColumnName>' to store the table in a specific way.
Please use a different name for the partition column.
CONFLICTING_PROVIDERâThe specified provider <provider> is inconsistent with the existing catalog provider <expectedProvider>. Please use 'USING <expectedProvider>' and retry the command.
The following configuration(s) conflict with spark.databricks.streaming.realTimeMode.enabled: <confNames>. Remove these configurations from your SparkSession configuration.
Generic Spark Connect error.
For more details see CONNECT
CONNECTION_ALREADY_EXISTSâCannot create connection <connectionName> because it already exists.
Choose a different name, drop or replace the existing connection, or add the IF NOT EXISTS clause to tolerate pre-existing connections.
Cannot execute this command because the connection name must be non-empty.
CONNECTION_NOT_FOUNDâCannot execute this command because the connection name <connectionName> was not found.
Connections of type '<connectionType>' do not support the following option(s): <optionsNotSupported>. Supported options: <allowedOptions>.
Cannot create connection of type '<connectionType>. Supported connection types: <allowedTypes>.
Connection with name <connectionName> and type <connectionType> is not supported in dataframe options.
Connection with name '<connectionName>' of type '<connectionType>' is not supported for remote query function execution.
Generic Session Migration error (userId: <userId>, sessionId: <sessionId>, serverSessionId: <serverSessionId>).
For more details see CONNECT_SESSION_MIGRATION
CONSTRAINTS_REQUIRE_UNITY_CATALOGâTable constraints are only supported in Unity Catalog.
CONVERSION_INVALID_INPUTâThe value <str> (<fmt>) cannot be converted to <targetType> because it is malformed. Correct the value as per the syntax, or change its format. Use <suggestion> to tolerate malformed input and return NULL instead.
Cannot write to <tableName>, the reason is
For more details see COPY_INTO_COLUMN_ARITY_MISMATCH
COPY_INTO_CREDENTIALS_NOT_ALLOWED_ONâInvalid scheme <scheme>. COPY INTO source credentials currently only supports s3/s3n/s3a/wasbs/abfss.
COPY INTO source credentials must specify <keyList>.
Duplicated files were committed in a concurrent COPY INTO operation. Please try again later.
Invalid scheme <scheme>. COPY INTO source encryption currently only supports s3/s3n/s3a/abfss.
COPY INTO encryption only supports ADLS Gen2, or abfss:// file scheme
COPY INTO source encryption must specify '<key>'.
Invalid encryption option <requiredKey>. COPY INTO source encryption must specify '<requiredKey>' = '<keyValue>'.
The COPY INTO feature '<feature>' is not compatible with '<incompatibleSetting>'.
COPY INTO other than appending data is not allowed to run concurrently with other transactions. Please try again later.
COPY INTO failed to load its state, maximum retries exceeded.
A schema mismatch was detected while copying into the Delta table (Table: <table>).
This may indicate an issue with the incoming data, or the Delta table schema can be evolved automatically according to the incoming data by setting:
COPY_OPTIONS ('mergeSchema' = 'true')
Schema difference:
<schemaDiff>
The format of the source files must be one of CSV, JSON, AVRO, ORC, PARQUET, TEXT, or BINARYFILE. Using COPY INTO on Delta tables as the source is not supported as duplicate data may be ingested after OPTIMIZE operations. This check can be turned off by running the SQL command set spark.databricks.delta.copyInto.formatCheck.enabled = false.
The source directory did not contain any parsable files of type <format>. Please check the contents of '<source>'.
The error can be silenced by setting '<config>' to 'false'.
An internal error occurred while processing COPY INTO state.
For more details see COPY_INTO_STATE_INTERNAL_ERROR
COPY_INTO_SYNTAX_ERRORâFailed to parse the COPY INTO command.
For more details see COPY_INTO_SYNTAX_ERROR
COPY_INTO_UNSUPPORTED_FEATUREâThe COPY INTO feature '<feature>' is not supported.
Cannot unload data in format '<formatType>'. Supported formats for <connectionType> are: <allowedFormats>.
Cannot convert the catalog function '<identifier>' into a SQL function due to corrupted function information in catalog. If the function is not a SQL function, please make sure the class name '<className>' is loadable.
The CREATE FOREIGN SCHEMA command is not implemented yet
The CREATE FOREIGN TABLE command is not implemented yet
CREATE OR REFRESH MATERIALIZED VIEW is not supported. Use CREATE OR REPLACE MATERIALIZED VIEW instead.
Cannot CREATE OR REFRESH materialized views or streaming tables with ASYNC specified. Please remove ASYNC from the CREATE OR REFRESH statement or use REFRESH ASYNC to refresh existing materialized views or streaming tables asynchronously.
Not allowed to create the permanent view <name> without explicitly assigning an alias for the expression <attr>.
CREATE TABLE column <columnName> specifies descriptor "<optionName>" more than once, which is invalid.
Cannot create view <viewName>, the reason is
For more details see CREATE_VIEW_COLUMN_ARITY_MISMATCH
CREDENTIAL_MISSINGâPlease provide credentials when creating or updating external locations.
CREDENTIAL_PURPOSE_MISMATCHâThe credential <credentialName> has purpose <actualPurpose> but the purpose given in the command is <expectedPurpose>.
The CSV option enforceSchema cannot be set when using rescuedDataColumn or failOnUnknownFields, as columns are read by name rather than ordinal.
Cyclic function reference detected: <path>.
Databricks Delta is not enabled in your account.<hints>
Cannot resolve <sqlExpr> due to data type mismatch:
For more details see DATATYPE_MISMATCH
DATATYPE_MISSING_SIZEâDataType <type> requires a length parameter, for example <type>(10). Please specify the length.
Write Lineage unsuccessful: missing corresponding relation with policies for CLM/RLS.
DATA_SOURCE_ALREADY_EXISTSâData source '<provider>' already exists. Please choose a different name for the new data source.
Encountered error when saving to external data source.
DATA_SOURCE_NOT_EXISTâData source '<provider>' not found. Please make sure the data source is registered.
Failed to find the data source: <provider>. Make sure the provider name is correct and the package is properly registered and compatible with your Spark version.
Option <option> must not be empty and should not contain invalid characters, query strings, or parameters.
Option <option> is required.
Provided data source option '<option>' contains invalid value ('<value>').
For more details see DATA_SOURCE_OPTION_VALUE_NOT_VALID
DATA_SOURCE_TABLE_SCHEMA_MISMATCHâThe schema of the data source table does not match the expected schema. If you are using the DataFrameReader.schema API or creating a table, avoid specifying the schema.
Data Source schema: <dsSchema>
Expected schema: <expectedSchema>
JDBC URL is not allowed in data source options, please specify 'host', 'port', and 'database' options instead.
DATETIME_FIELD_OUT_OF_BOUNDSâ<rangeMessage>.
For more details see DATETIME_FIELD_OUT_OF_BOUNDS
DATETIME_OVERFLOWâDatetime operation overflow: <operation>.
You have exceeded the API quota for the data source <sourceName>.
For more details see DC_API_QUOTA_EXCEEDED
DC_CONNECTION_ERRORâFailed to make a connection to the <sourceName> source. Error code: <errorCode>.
For more details see DC_CONNECTION_ERROR
DC_DYNAMICS_API_ERRORâError happened in Dynamics API calls, errorCode: <errorCode>.
For more details see DC_DYNAMICS_API_ERROR
DC_NETSUITE_ERRORâError happened in Netsuite JDBC calls, errorCode: <errorCode>.
For more details see DC_NETSUITE_ERROR
DC_SCHEMA_CHANGE_ERRORâSQLSTATE: none assigned
A schema change has occurred in table <tableName> of the <sourceName> source.
For more details see DC_SCHEMA_CHANGE_ERROR
DC_SERVICENOW_API_ERRORâError happened in ServiceNow API calls, errorCode: <errorCode>.
For more details see DC_SERVICENOW_API_ERROR
DC_SFDC_BULK_QUERY_JOB_INCOMPLETEâIngestion for object <objName> is incomplete because the Salesforce API query job took too long, failed, or was manually cancelled.
To try again, you can either re-run the entire pipeline or refresh this specific destination table. If the error persists, file a ticket. Job ID: <jobId>. Job status: <jobStatus>.
Error happened in Sharepoint API calls, errorCode: <errorCode>.
For more details see DC_SHAREPOINT_API_ERROR
DC_SOURCE_API_ERRORâAn error occurred in the <sourceName> API call. Source API type: <apiType>. Error code: <errorCode>.
This can sometimes happen when you've reached a <sourceName> API limit. If you haven't exceeded your API limit, try re-running the connector. If the issue persists, please file a ticket.
Unsupported error happened in data source <sourceName>.
For more details see DC_UNSUPPORTED_ERROR
DC_WORKDAY_RAAS_API_ERRORâError happened in Workday RAAS API calls, errorCode: <errorCode>.
For more details see DC_WORKDAY_RAAS_API_ERROR
DECIMAL_PRECISION_EXCEEDS_MAX_PRECISIONâDecimal precision <precision> exceeds max precision <maxPrecision>.
Default database <defaultDatabase> does not exist, please create it first or change default database to <defaultDatabase>.
It is possible the underlying files have been updated. You can explicitly invalidate the cache in Spark by running 'REFRESH TABLE tableName' command in SQL or by recreating the Dataset/DataFrame involved. If disk cache is stale or the underlying files have been removed, you can invalidate disk cache manually by restarting the cluster.
A DEFAULT keyword in a MERGE, INSERT, UPDATE, or SET VARIABLE command could not be directly assigned to a target column because it was part of an expression.
For example: UPDATE SET c1 = DEFAULT is allowed, but UPDATE T SET c1 = DEFAULT + 1 is not allowed.
Failed to execute <statementType> command because DEFAULT values are not supported for target data source with table provider: "<dataSource>".
DESCRIBE TABLE ... AS JSON only supported when [EXTENDED|FORMATTED] is specified.
For example: DESCRIBE EXTENDED <tableName> AS JSON is supported but DESCRIBE <tableName> AS JSON is not.
The streaming query was reading from an unexpected Delta table (id = '<newTableId>').
It used to read from another Delta table (id = '<oldTableId>') according to checkpoint.
This may happen when you changed the code to read from a new table or you deleted and
re-created a table. Please revert your change or delete your streaming query checkpoint
to restart from scratch.
DISTINCT_WINDOW_FUNCTION_UNSUPPORTEDâDistinct window functions are not supported: <windowExpr>.
Division by zero. Use try_divide to tolerate divisor being 0 and return NULL instead. If necessary set <config> to "false" to bypass this error.
For more details see DIVIDE_BY_ZERO
DLT_EXPECTATIONS_NOT_SUPPORTEDâExpectations are only supported within Lakeflow Declarative Pipelines.
DLT_VIEW_CLUSTER_BY_NOT_SUPPORTEDâMATERIALIZED VIEWs with a CLUSTER BY clause are supported only in Lakeflow Declarative Pipelines.
materialized view locations are supported only in Lakeflow Declarative Pipelines.
DLT_VIEW_SCHEMA_WITH_TYPE_NOT_SUPPORTEDâmaterialized view schemas with a specified type are supported only in Lakeflow Declarative Pipelines.
DLT_VIEW_TABLE_CONSTRAINTS_NOT_SUPPORTEDâCONSTRAINT clauses in a view are only supported in Lakeflow Declarative Pipelines.
Cannot drop SCHEDULE on a table without an existing schedule or trigger.
CTE definition can't have duplicate names: <duplicateNames>.
Duplicated field names in Arrow Struct are not allowed, got <fieldNames>.
Duplicate map key <key> was found, please check the input data.
If you want to remove the duplicated keys, you can set <mapKeyDedupPolicy> to "LAST_WIN" so that the key inserted at last takes precedence.
The metric name is not unique: <metricName>. The same name cannot be used for metrics with different results.
However multiple instances of metrics with with same result and name are allowed (e.g. self-joins).
DUPLICATE_ASSIGNMENTSâThe columns or variables <nameList> appear more than once as assignment targets.
Found duplicate clauses: <clauseName>. Please, remove one of them.
Found duplicate condition <condition> in the scope. Please, remove one of them.
Found duplicate handlers. Please, remove one of them.
For more details see DUPLICATE_EXCEPTION_HANDLER
DUPLICATE_KEYâFound duplicate keys <keyColumn>.
Call to routine <routineName> is invalid because it includes multiple argument assignments to the same parameter name <parameterName>.
For more details see DUPLICATE_ROUTINE_PARAMETER_ASSIGNMENT
DUPLICATE_ROUTINE_PARAMETER_NAMESâFound duplicate name(s) in the parameter list of the user-defined routine <routineName>: <names>.
Found duplicate column(s) in the RETURNS clause column list of the user-defined routine <routineName>: <columns>.
Previous node emitted a row with eventTime=<emittedRowEventTime> which is older than current_watermark_value=<currentWatermark>
This can lead to correctness issues in the stateful operators downstream in the execution pipeline.
Please correct the operator logic to emit rows after current global watermark value.
EMPTY_JSON_FIELD_VALUEâFailed to parse an empty string for data type <dataType>.
Empty local file in staging <operation> query
The <format> datasource does not support writing empty or nested empty schemas. Please make sure the data schema has at least one or more column(s).
Not found an encoder of the type <typeName> to Spark SQL internal representation.
Consider to change the input type to one of supported at '<docroot>/sql-ref-datatypes.html'.
End label <endLabel> can not exist without begin label.
Some of partitions in Kafka topic(s) report available offset which is less than end offset during running query with Trigger.AvailableNow. The error could be transient - restart your query, and report if you still see the same issue.
latest offset: <latestOffset>, end offset: <endOffset>
For Kafka data source with Trigger.AvailableNow, end offset should have lower or equal offset per each topic partition than pre-fetched offset. The error could be transient - restart your query, and report if you still see the same issue.
pre-fetched offset: <prefetchedOffset>, end offset: <endOffset>.
Error reading avro data -- encountered an unknown fingerprint: <fingerprint>, not sure what schema to use.
This could happen if you registered additional schemas after starting your spark context.
EVENT_LOG_EMPTYâThe event log for <tableOrPipeline> has no schema and contains no events. Try again later after events are generated
Cannot query event logs from an Assigned or No Isolation Shared cluster, please use a Shared cluster or a Databricks SQL warehouse instead.
EVENT_LOG_TVF_UNSUPPORTED_FOR_PIPELINEâThe EVENT_LOG Table-Valued Function is not supported for pipelines using the 'schema' field or pipelines publishing to default storage.
To query the event log, publish it to the metastore by specifying the event_log field in the pipeline settings.
For more information, see the Monitor Lakeflow Declarative Pipelines documentation: https://docs.databricks.com/aws/en/delta-live-tables/observability.
EVENT_LOG_UNAVAILABLEâNo event logs available for <tableOrPipeline>. Please try again later after events are generated
The table type of <tableIdentifier> is <tableType>.
Querying event logs only supports materialized views, streaming tables, or Lakeflow Declarative Pipelines.
EVENT_TIME_IS_NOT_ON_TIMESTAMP_TYPEâThe event time <eventName> has the invalid type <eventType>, but expected "TIMESTAMP".
Exceeds char/varchar type length limitation: <limit>.
The Excel data source does not support the value '<value>' for the write option '<option>'.
For more details see EXCEL_INVALID_WRITE_OPTION_VALUE
EXCEL_INVALID_WRITE_SCHEMAâThe Excel data source does not support the schema '<schema>' for writes.
<hint>
The Excel data source does not support the write option '<option>'.
<hint>
EXCEPT column <columnName> was resolved and expected to be StructType, but found type <dataType>.
Columns in an EXCEPT list must be distinct and non-overlapping, but got (<columns>).
EXCEPT columns [<exceptColumns>] were resolved, but do not match any of the columns [<expandedColumns>] from the star expansion.
The column/field name <objectName> in the EXCEPT clause cannot be resolved. Did you mean one of the following: [<objectList>]?
Note: nested columns in the EXCEPT clause may not include qualifiers (table name, parent struct column name, etc.) during a struct expansion; try removing qualifiers if they are used with nested columns.
There is not enough memory to build the broadcast relation <relationClassName>. Relation Size = <relationSize>. Total memory used by this task = <taskMemoryUsage>. Executor Memory Manager Metrics: onHeapExecutionMemoryUsed = <onHeapExecutionMemoryUsed>, offHeapExecutionMemoryUsed = <offHeapExecutionMemoryUsed>, onHeapStorageMemoryUsed = <onHeapStorageMemoryUsed>, offHeapStorageMemoryUsed = <offHeapStorageMemoryUsed>. [sparkPlanId: <sparkPlanId>] Disable broadcasts for this query using 'set spark.sql.autoBroadcastJoinThreshold=-1' or using join hint to force shuffle join.
There is not enough memory to store the broadcast relation <relationClassName>. Relation Size = <relationSize>. StorageLevel = <storageLevel>. [sparkPlanId: <sparkPlanId>] Disable broadcasts for this query using 'set spark.sql.autoBroadcastJoinThreshold=-1' or using join hint to force shuffle join.
The USING clause of this EXECUTE IMMEDIATE command contained multiple arguments with same alias (<aliases>), which is invalid; please update the command to specify unique aliases and then try it again.
'<operation>' expects a permanent table but <tableName> is a temporary table. Please specify a permanent table instead.
'<operation>' expects a permanent view but <viewName> is a temp view.
'<operation>' expects a table but <viewName> is a view.
For more details see EXPECT_TABLE_NOT_VIEW
EXPECT_VIEW_NOT_TABLEâThe table <tableName> does not support <operation>.
For more details see EXPECT_VIEW_NOT_TABLE
EXPRESSION_DECODING_FAILEDâFailed to decode a row to a value of the expressions: <expressions>.
Failed to encode a value of the expressions: <expressions> to a row.
Column expression <expr> cannot be sorted because its type <exprType> is not orderable.
Failed to run the operation on the source table <sourceTable> because the shallow clone <targetTable> still exists and its status is invalid. If you indeed want to proceed with this operation, please clean up the shallow clone by explicitly running DROP command.
External tables don't support the <scheme> scheme.
Error running 'REFRESH FOREIGN <scope> <name>'. Cannot refresh a Fabric <scope> directly, please use 'REFRESH FOREIGN CATALOG <catalogName>' to refresh the Fabric Catalog instead.
User defined function (<functionName>: (<signature>) => <result>) failed due to: <reason>.
Failed preparing of the function <funcName> for call. Please, double check function's arguments.
Failed JDBC <url> on the operation:
For more details see FAILED_JDBC
FAILED_PARSE_STRUCT_TYPEâFailed parsing struct: <raw>.
Error while reading file <path>.
For more details see FAILED_READ_FILE
FAILED_REGISTER_CLASS_WITH_KRYOâFailed to register classes with Kryo.
FAILED_RENAME_PATHâFailed to rename <sourcePath> to <targetPath> as destination already exists.
Failed to rename temp file <srcPath> to <dstPath> as FileSystem.rename returned false.
Failed to convert the row value <value> of the class <class> to the target SQL type <sqlType> in the JSON format.
Failed to load routine <routineName>.
The statement, including potential SQL functions and referenced views, was too complex to parse.
To mitigate this error divide the statement into multiple, less complex chunks.
FEATURE_NOT_ENABLEDâThe feature <featureName> is not enabled. Consider setting the config <configKey> to <configValue> to enable this capability.
<feature> is not supported on Classic SQL warehouses. To use this feature, use a Pro or Serverless SQL warehouse.
<feature> is not supported without Unity Catalog. To use this feature, enable Unity Catalog.
<feature> is not supported in your environment. To use this feature, please contact Databricks Support.
Fine-grained access control (FGAC) on dedicated compute failed due the following exception: <message>
Cannot <op> column, because <fieldNames> already exists in <struct>.
No such struct field <fieldName> in <fields>.
File in staging path <path> already exists but OVERWRITE is not set
An error occurred in the user provided function in flatMapGroupsWithState. Reason: <reason>
Querying the data source <source> in serverless compute is not allowed. Only <allowlist> data sources are supported in serverless compute.
The query option <queryOption> cannot contain forbidden keywords. Please remove the following keywords from the query: <keywords>
The operation <statement> is not allowed on the <objectType>: <objectName>.
An error occurred in the user provided function in foreach batch sink. Reason: <reason>
An error occurred in the user provided function in foreach sink. Reason: <reason>
Foreign key parent columns <parentColumns> do not match primary key child columns <childColumns>.
Cannot execute this command because the foreign <objectType> name must be non-empty.
Table is not eligible for upgrade from UC Foreign to UC External. Reason:
For more details see FOREIGN_TABLE_CONVERSION_UNSUPPORTED
FOUND_MULTIPLE_DATA_SOURCESâDetected multiple data sources with the name '<provider>'. Please check the data source isn't simultaneously registered and located in the classpath.
from_json inference encountered conflicting schema updates at: <location>
from_json found columnNameOfCorruptRecord (<columnNameOfCorruptRecord>) present
in a JSON object and can no longer proceed. Please configure a different value for
the option 'columnNameOfCorruptRecord'.
FROM_JSON_CORRUPT_SCHEMAâfrom_json inference could not read the schema stored at: <location>
from_json was unable to infer the schema. Please provide one instead.
FROM_JSON_INFERENCE_NOT_SUPPORTEDâfrom_json inference is only supported when defining streaming tables
FROM_JSON_INVALID_CONFIGURATIONâfrom_json configuration is invalid:
For more details see FROM_JSON_INVALID_CONFIGURATION
FROM_JSON_SCHEMA_EVOLUTION_FAILEDâfrom_json could not evolve from <old> to <new>
The function <function> requires named parameters. Parameters missing names: <exprs>. Please update the function call to add names for all parameters, e.g., <function>(param_name => ...).
A column cannot have both a default value and a generation expression but column <colName> has default value: (<defaultValue>) and generation expression: (<genExpr>).
Hive 2.2 and lower versions don't support getTablesByType. Please use Hive 2.3 or higher version.
GET_WARMUP_TRACING_FAILEDâFailed to get warmup tracing. Cause: <cause>.
Function get_warmup_tracing() not allowed.
GRAPHITE_SINK_INVALID_PROTOCOLâInvalid Graphite protocol: <protocol>.
Graphite sink requires '<property>' property.
Column of grouping (<grouping>) can't be found in grouping columns <groupingColumns>.
Columns of grouping_id (<groupingIdColumn>) does not match grouping columns (<groupByColumns>).
Grouping sets size cannot be greater than <maxSize>.
Aggregate functions are not allowed in GROUP BY, but found <sqlExpr>.
For more details see GROUP_BY_AGGREGATE
GROUP_BY_POS_AGGREGATEâGROUP BY <index> refers to an expression <aggExpr> that contains an aggregate function. Aggregate functions are not allowed in GROUP BY.
GROUP BY position <index> is not in select list (valid range is [1, <size>]).
The expression <sqlExpr> cannot be used as a grouping expression because its data type <dataType> is not an orderable data type.
When attempting to read from HDFS, HTTP request failed.
For more details see HDFS_HTTP_ERROR
HINT_UNSUPPORTED_FOR_JDBC_DIALECTâThe option hint is not supported for <jdbcDialect> in JDBC data source. Supported dialects are MySQLDialect, OracleDialect and DatabricksDialect.
The query or command failed to execute because the 'spark.databricks.hive.metastore.tablePlaceholderPath' configuration provided an invalid Hive Metastore table placeholder path. Please update this configuration with a new value to provide a valid path and then re-run the query or command again.
HIVE_METASTORE_TABLE_PLACEHOLDER_PATH_NOT_SETâThe query or command failed because the Hive Metastore table placeholder path is not set, which is required when schema location is on DBFS, and table location is an object/file. Please set spark.databricks.hive.metastore.tablePlaceholderPath to a path you have access to and then re-run the query or command again.
HLL_INVALID_INPUT_SKETCH_BUFFERâInvalid call to <function>; only valid HLL sketch buffers are supported as inputs (such as those produced by the hll_sketch_agg function).
Invalid call to <function>; the lgConfigK value must be between <min> and <max>, inclusive: <value>.
Sketches have different lgConfigK values: <left> and <right>. Set the allowDifferentLgConfigK parameter to true to call <function> with different lgConfigK values.
The shallow clone path '<path>' could not be resolved to a table in Unity Catalog. Please ensure the table exists and is federated to Unity Catalog.
An failure occurred when attempting to resolve a query or command with both the legacy fixed-point analyzer as well as the single-pass resolver.
For more details see HYBRID_ANALYZER_EXCEPTION
IDENTIFIER_TOO_MANY_NAME_PARTSâ<identifier> is not a valid identifier as it has more than 2 name parts.
Duplicated IDENTITY column sequence generator option: <sequenceGeneratorOption>.
IDENTITY column step cannot be 0.
DataType <dataType> is not supported for IDENTITY columns.
Illegal input for day of week: <string>.
Illegal value provided to the State Store
For more details see ILLEGAL_STATE_STORE_VALUE
INAPPROPRIATE_URI_SCHEME_OF_CONNECTION_OPTIONâConnection can't be created due to inappropriate scheme of URI <uri> provided for the connection option '<option>'.
Allowed scheme(s): <allowedSchemes>.
Please add a scheme if it is not present in the URI, or specify a scheme from the allowed values.
INCOMPARABLE_PIVOT_COLUMNâInvalid pivot column <columnName>. Pivot columns must be comparable.
<operator> can only be performed on tables with compatible column types. The <columnOrdinalNumber> column of the <tableOrdinalNumber> table is <dataType1> type which is not compatible with <dataType2> at the same column of the first table.<hint>.
Detected an incompatible DataSourceRegister. Please remove the incompatible library from classpath or upgrade it. Error: <message>
Cannot write incompatible data for the table <tableName>:
For more details see INCOMPATIBLE_DATA_FOR_TABLE
INCOMPATIBLE_JOIN_TYPESâThe join types <joinType1> and <joinType2> are incompatible.
The SQL query of view <viewName> has an incompatible schema change and column <colName> cannot be resolved. Expected <expectedNum> columns named <colName> but got <actualCols>.
Please try to re-create the view by running: <suggestion>.
Incomplete complex type:
For more details see INCOMPLETE_TYPE_DEFINITION
INCONSISTENT_BEHAVIOR_CROSS_VERSIONâYou may get a different result due to the upgrading to
For more details see INCONSISTENT_BEHAVIOR_CROSS_VERSION
INCORRECT_NUMBER_OF_ARGUMENTSâ<failure>, <functionName> requires at least <minArgs> arguments and at most <maxArgs> arguments.
Max offset with <rowsPerSecond> rowsPerSecond is <maxSeconds>, but 'rampUpTimeSeconds' is <rampUpTimeSeconds>.
Could not determine which collation to use for string operation. Use COLLATE clause to set the collation explicitly.
Data type of <expr> has indeterminate collation. Use COLLATE clause to set the collation explicitly.
Schema contains indeterminate collation at: [<columnPaths>]. Use COLLATE clause to set the collation explicitly.
Cannot create the index <indexName> on table <tableName> because it already exists.
Cannot find the index <indexName> on table <tableName>.
Trigger type <trigger> is not supported for this cluster type.
Use a different trigger type e.g. AvailableNow, Once.
INSERT_COLUMN_ARITY_MISMATCHâCannot write to <tableName>, the reason is
For more details see INSERT_COLUMN_ARITY_MISMATCH
INSERT_PARTITION_COLUMN_ARITY_MISMATCHâCannot write to '<tableName>', <reason>:
Table columns: <tableColumns>.
Partition columns with static values: <staticPartCols>.
Data columns: <dataColumns>.
Table must be partitioned and all specified columns must represent the full set of the partition columns of the table.
The following columns are not partition columns: <nonPartitionColumns>
The following partitions columns are missing: <missingPartitionsColumns>
Please contact your Databricks representative to enable the INSERT INTO ... REPLACE USING (...) feature.
Insufficient privileges:
<report>
User <user> has insufficient privileges for external location <location>.
There is no owner for <securableName>. Ask your administrator to set an owner.
User does not own <securableName>.
User does not have permission <action> on <securableName>.
The owner of <securableName> is different from the owner of <parentSecurableName>.
Client does not have permission to set a custom retention timeout for CloudFetch results.
INSUFFICIENT_PERMISSIONS_STORAGE_CREDâStorage credential <credentialName> has insufficient privileges.
User cannot <action> on <securableName> because of permissions on underlying securables.
User cannot <action> on <securableName> because of permissions on underlying securables:
<underlyingReport>
Integer overflow while operating with intervals.
For more details see INTERVAL_ARITHMETIC_OVERFLOW
INTERVAL_DIVIDED_BY_ZEROâDivision by zero. Use try_divide to tolerate divisor being 0 and return NULL instead.
The FILTER expression <filterExpr> in an aggregate function is invalid.
For more details see INVALID_AGGREGATE_FILTER
INVALID_AGNOSTIC_ENCODERâFound an invalid agnostic encoder. Expects an instance of AgnosticEncoder but got <encoderType>. For more information consult '<docroot>/api/java/index.html?org/apache/spark/sql/Encoder.html'.
Invalid or unsupported edge interpolation algorithm value <alg>.
The index <indexValue> is out of bounds. The array has <arraySize> elements. Use the SQL function get() to tolerate accessing element at invalid index and return NULL instead.
For more details see INVALID_ARRAY_INDEX
INVALID_ARRAY_INDEX_IN_ELEMENT_ATâThe index <indexValue> is out of bounds. The array has <arraySize> elements. Use try_element_at to tolerate accessing element at invalid index and return NULL instead.
For more details see INVALID_ARRAY_INDEX_IN_ELEMENT_AT
INVALID_ATTRIBUTE_NAME_SYNTAXâSyntax error in the attribute name: <name>. Check that backticks appear in pairs, a quoted string is a complete name part and use a backtick only inside quoted name parts.
Please choose exactly one of the following authentication methods:
Provide the name of your Databricks service credential (<serviceCredential>) (as a spark stream option or as a cluster environment variable).
Provide both the AWS AccessKey (<awsAccessKey>) and SecretAccessKey (<awsSecretKey>) to use AWS keys.
Provide neither the AWS keys nor a Databricks service credential to use the default AWS credential provider chain for Kinesis authentication.
Please provide either the name of your Databricks service credential (<serviceCredential>)
OR both <awsAccessKey> and <awsSecretKey>
The 0-indexed bitmap position <bitPosition> is out of bounds. The bitmap has <bitmapNumBits> bits (<bitmapNumBytes> bytes).
Boolean statement is expected in the condition, but <invalidStatement> was found.
The boundary <boundary> is invalid: <invalidValue>.
For more details see INVALID_BOUNDARY
INVALID_BUCKET_COLUMN_DATA_TYPEâCannot use <type> for bucket column. Collated data types are not supported for bucketing.
Number of buckets should be greater than 0 but less than or equal to bucketing.maxBuckets (<bucketingMaxBuckets>). Got <numBuckets>.
Invalid bucket file: <path>.
The expected format is ByteString, but was <unsupported> (<class>).
The datasource <datasource> cannot save the column <columnName> because its name contains some characters that are not allowed in file paths. Please, use an alias to rename it.
Column or field <name> is of type <type> while it's required to be <expectedType>.
The value '<confValue>' in the config "<confName>" is invalid.
For more details see INVALID_CONF_VALUE
INVALID_CONSTRAINT_CHARACTERISTICSâConstraint characteristics [<characteristics>] are duplicated or conflict with each other.
The column <columnName> for corrupt records must have the nullable STRING type, but got <actualType>.
Invalid or unsupported CRS (coordinate reference system) value <crs>.
current_recipient function can only be used in the CREATE VIEW statement or the ALTER VIEW statement to define a share only view in Unity Catalog.
The cursor is invalid.
For more details see INVALID_CURSOR
INVALID_DATASOURCE_FORMAT_FOR_CONNECTION_OPTIONS_INJECTIONâConnection with name <connectionName> and type <connectionType> does not support the format <actualFormat>. Supported format: <expectedFormat>.
Unrecognized datetime pattern: <pattern>.
For more details see INVALID_DATETIME_PATTERN
INVALID_DEFAULT_VALUEâFailed to execute <statement> command because the destination column or variable <colName> has a DEFAULT value <defaultValue>,
For more details see INVALID_DEFAULT_VALUE
INVALID_DELIMITER_VALUEâInvalid value for delimiter.
For more details see INVALID_DELIMITER_VALUE
INVALID_DEST_CATALOGâDestination catalog of the SYNC command must be within Unity Catalog. Found <catalog>.
System memory <systemMemory> must be at least <minSystemMemory>.
Please increase heap size using the --driver-memory option or "<config>" in Spark configuration.
Options passed <option_list> are forbidden for foreign table <table_name>.
The location name cannot be empty string, but <location> was given.
The environment settings dependencies parameter is missing or it couldn't be parsed to a list of strings. Expected format: ["dep1", "dep2"]
INVALID_ERROR_CONDITION_DECLARATIONâInvalid condition declaration.
For more details see INVALID_ERROR_CONDITION_DECLARATION
INVALID_ESCâFound an invalid escape string: <invalidEscape>. The escape string must contain only one character.
EscapeChar should be a string literal of length one, but got <sqlExpr>.
Executor memory <executorMemory> must be at least <minSystemMemory>.
Please increase executor memory using the --executor-memory option or "<config>" in Spark configuration.
Found an invalid expression encoder. Expects an instance of ExpressionEncoder but got <encoderType>. For more information consult '<docroot>/api/java/index.html?org/apache/spark/sql/Encoder.html'.
The external type <externalType> is not valid for the type <type> at the expression <expr>.
Can't extract a value from <base>. Need a complex type [STRUCT, ARRAY, MAP] but got <other>.
Cannot extract <field> from <expr>.
Field name should be a non-null string literal, but it's <extraction>.
Field name <fieldName> is invalid: <path> is not a struct.
The format is invalid: <format>.
For more details see INVALID_FORMAT
INVALID_FRACTION_OF_SECONDâValid range for seconds is [0, 60] (inclusive), but the provided value is <secAndMicros>. To avoid this error, use try_make_timestamp, which returns NULL on error.
If you do not want to use the session default timestamp version of this function, use try_make_timestamp_ntz or try_make_timestamp_ltz.
Invalid usage of GET DIAGNOSTICS statement.
For more details see INVALID_GET_DIAGNOSTICS_USAGE
INVALID_GET_DIAGNOSTICS_USAGE_CONDITION_NUMBER_MUST_BE_ONEâInvalid usage of GET DIAGNOSTICS statement. The only supported value for a condition number in the GET DIAGNOSTICS statement is 1.
The handle <handle> is invalid.
For more details see INVALID_HANDLE
INVALID_HANDLER_DECLARATIONâInvalid handler declaration.
For more details see INVALID_HANDLER_DECLARATION
INVALID_HTTP_REQUEST_METHODâThe input parameter: method, value: <paramValue> is not a valid parameter for http_request because it is not a valid HTTP method.
The input parameter: path, value: <paramValue> is not a valid parameter for http_request because path traversal is not allowed.
The unquoted identifier <ident> is invalid and must be back quoted as: <ident>.
Unquoted identifiers can only contain ASCII letters ('a' - 'z', 'A' - 'Z'), digits ('0' - '9'), and underbar ('_').
Unquoted identifiers must also not start with a digit.
Different data sources and meta stores may impose additional restrictions on valid identifiers.
INVALID_INDEX_OF_ZEROâThe index 0 is invalid. An index shall be either < 0 or > 0 (the first element has index 1).
Invalid inline table.
For more details see INVALID_INLINE_TABLE
INVALID_INTERVAL_FORMATâError parsing '<input>' to interval. Please ensure that the value provided is in a valid format for defining an interval. You can reference the documentation for the correct format.
For more details see INVALID_INTERVAL_FORMAT
INVALID_INTERVAL_WITH_MICROSECONDS_ADDITIONâCannot add an interval to a date because its microseconds part is not 0. To resolve this, cast the input date to a timestamp, which supports the addition of intervals with non-zero microseconds.
INVALID_JAVA_IDENTIFIER_AS_FIELD_NAMEâ<fieldName> is not a valid identifier of Java and cannot be used as field name
<walkedTypePath>.
The option <optionKey> is not a valid parameter for this jdbc connection.
The option <optionKey> with a value <optionValue> is not a valid option for this jdbc connection.
Invalid join type in joinWith: <joinType>.
Failed to convert the JSON string '<invalidType>' to a data type. Please enter a valid data type.
Collations can only be applied to string types, but the JSON data type is <jsonType>.
Detected an invalid type of a JSON record while inferring a common schema in the mode <failFastMode>. Expected a STRUCT type, but found <invalidType>.
Cannot convert JSON root field to target Spark type.
INVALID_JSON_SCHEMA_MAP_TYPEâInput schema <jsonSchema> can only contain STRING as a key type for a MAP.
The value of the config "<bufferSizeConfKey>" must be less than 2048 MiB, but got <bufferSizeConfValue> MiB.
The usage of the label <labelName> is invalid.
For more details see INVALID_LABEL_USAGE
INVALID_LAMBDA_FUNCTION_CALLâInvalid lambda function call.
For more details see INVALID_LAMBDA_FUNCTION_CALL
INVALID_LATERAL_JOIN_TYPEâThe <joinType> JOIN with LATERAL correlation is not allowed because an OUTER subquery cannot correlate to its join partner. Remove the LATERAL correlation or use an INNER JOIN, or LEFT OUTER JOIN instead.
The limit like expression <expr> is invalid.
For more details see INVALID_LIMIT_LIKE_EXPRESSION
INVALID_LOG_VERSIONâUnsupportedLogVersion.
For more details see INVALID_LOG_VERSION
INVALID_NON_ABSOLUTE_PATHâThe provided non absolute path <path> can not be qualified. Please update the path to be a valid dbfs mount location.
The operator expects a deterministic expression, but the actual expression is <sqlExprs>.
Numeric literal <rawStrippedQualifier> is outside the valid range for <typeName> with minimum value of <minValue> and maximum value of <maxValue>. Please adjust the value accordingly.
Invalid observed metrics.
For more details see INVALID_OBSERVED_METRICS
INVALID_OPTIONSâInvalid options:
For more details see INVALID_OPTIONS
INVALID_PANDAS_UDF_PLACEMENTâThe group aggregate pandas UDF <functionList> cannot be invoked together with as other, non-pandas aggregate functions.
An invalid parameter mapping was provided:
For more details see INVALID_PARAMETER_MARKER_VALUE
INVALID_PARAMETER_VALUEâThe value of parameter(s) <parameter> in <functionName> is invalid:
For more details see INVALID_PARAMETER_VALUE
INVALID_PARTITION_COLUMN_DATA_TYPEâCannot use <type> for partition column.
The partition command is invalid.
For more details see INVALID_PARTITION_OPERATION
INVALID_PARTITION_VALUEâFailed to cast value <value> to data type <dataType> for partition column <columnName>. Ensure the value matches the expected data type for this partition column.
Pipeline id <pipelineId> is not valid.
A pipeline id should be a UUID in the format of 'xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx'
INVALID_PRIVILEGEâPrivilege <privilege> is not valid for <securable>.
<key> is an invalid property key, please use quotes, e.g. SET <key>=<value>.
<value> is an invalid property value, please use quotes, e.g. SET <key>=<value>
The column name <columnName> is invalid because it is not qualified with a table name or consists of more than 4 name parts.
Parameterized query must either use positional, or named parameters, but not both.
INVALID_RECURSIVE_CTEâInvalid recursive definition found. Recursive queries must contain an UNION or an UNION ALL statement with 2 children. The first child needs to be the anchor term without any recursive references.
Invalid recursive reference found inside WITH RECURSIVE clause.
For more details see INVALID_RECURSIVE_REFERENCE
INVALID_REGEXP_REPLACEâCould not perform regexp_replace for source = "<source>", pattern = "<pattern>", replacement = "<replacement>" and position = <position>.
Expected format is 'RESET' or 'RESET key'. If you want to include special characters in key, please use quotes, e.g., RESET key.
RESIGNAL when handler not active. RESIGNAL statement can only be used inside Exception Handler body.
COPY INTO credentials must include AWS_ACCESS_KEY, AWS_SECRET_KEY, and AWS_SESSION_TOKEN.
The specified save mode <mode> is invalid. Valid save modes include "append", "overwrite", "ignore", "error", "errorifexists", and "default".
The input schema <inputSchema> is not a valid schema string.
For more details see INVALID_SCHEMA
INVALID_SCHEMA_OR_RELATION_NAMEâ<name> is not a valid name for tables/schemas. Valid names only contain alphabet characters, numbers and _.
Invalid schema type. Expect a struct type, but got <dataType>.
Unity catalog does not support <name> as the default file scheme.
Invalid secret lookup:
For more details see INVALID_SECRET_LOOKUP
INVALID_SET_SYNTAXâExpected format is 'SET', 'SET key', or 'SET key=value'. If you want to include special characters in key, or include semicolon in value, please use backquotes, e.g., SET key=value.
The <sharedObjectType> alias name must be of the form "schema.name".
User specified schema <schema> is invalid when the singleVariantColumn option is enabled. The schema must either be a variant field, or a variant field plus a corrupt column field.
Source catalog must not be within Unity Catalog for the SYNC command. Found <catalog>.
The source of filtering service MERGE operation can only contain projections and filters.
Please adjust the MERGE command or use a staging table as the source instead.
<stmt>
Invalid Spark config:
For more details see INVALID_SPARK_CONFIG
INVALID_SQLSTATEâInvalid SQLSTATE value: '<sqlState>'. SQLSTATE must be exactly 5 characters long and contain only A-Z and 0-9. SQLSTATE must not start with '00', '01', or 'XX'.
The argument <name> of sql() is invalid. Consider to replace it either by a SQL literal or by collection constructor functions such as map(), array(), struct().
Invalid SQL syntax:
For more details see INVALID_SQL_SYNTAX
INVALID_STAGING_PATH_IN_STAGING_ACCESS_QUERYâInvalid staging path in staging <operation> query: <path>
The INTO clause of EXECUTE IMMEDIATE is only valid for queries but the given statement is not a query: <sqlString>.
The statement or clause: <operation> is not valid.
Invalid version for rate source: <version>. The version must be either 1 or 2.
The real-time trigger interval is set to <interval> ms. This is less than the <minBatchDuration> ms minimum specified by spark.databricks.streaming.realTimeMode.minBatchDuration.
The real-time trigger's checkpoint interval of <interval> could not be parsed. Please verify you have passed a positive integer.
Invalid subquery:
For more details see INVALID_SUBQUERY_EXPRESSION
INVALID_TARGET_FOR_ALTER_COMMANDâALTER <commandTableType> ... <command> does not support <tableName>. Please use ALTER <targetTableType> ... <command> instead.
ALTER <commandTableType> ... SET TBLPROPERTIES does not support <tableName>. Please use ALTER <targetTableType> ... SET TBLPROPERTIES instead.
Cannot create the persistent object <objName> of the type <obj> because it references to the temporary object <tempObjName> of the type <tempObj>. Please make the temporary object <tempObjName> persistent, or make the persistent object <objName> temporary.
The provided timestamp <timestamp> doesn't match the expected syntax <format>.
The timezone: <timeZone> is invalid. The timezone must be either a region-based zone ID or a zone offset. Region IDs must have the form 'area/city', such as 'America/Los_Angeles'. Zone offsets must be in the format '(+|-)HH', '(+|-)HH:mm' or '(+|-)HH:mm:ss', e.g '-08' , '+01:00' or '-13:33:33', and must be in the range from -18:00 to +18:00. 'Z' and 'UTC' are accepted as synonyms for '+00:00'.
Cannot specify both version and timestamp when time travelling the table.
INVALID_TIME_TRAVEL_TIMESTAMP_EXPRâThe time travel timestamp expression <expr> is invalid.
For more details see INVALID_TIME_TRAVEL_TIMESTAMP_EXPR
INVALID_TYPED_LITERALâThe value of the typed literal <valueType> is invalid: <value>.
Function <funcName> does not implement a ScalarFunction or AggregateFunction.
<command> <supportedOrNot> the source table is in Hive Metastore and the destination table is in Unity Catalog.
The url is invalid: <url>. Use try_parse_url to tolerate invalid URL and return NULL instead.
Invalid usage of <elem> in <prettyName>.
Invalid UTF8 byte sequence found in string: <str>.
Input <uuidInput> is not a valid UUID.
The UUID should be in the format of 'xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx'
Please check the format of the UUID.
INVALID_VARIABLE_DECLARATIONâInvalid variable declaration.
For more details see INVALID_VARIABLE_DECLARATION
INVALID_VARIABLE_TYPE_FOR_QUERY_EXECUTE_IMMEDIATEâVariable type must be string type but got <varType>.
The variant value <value> cannot be cast into <dataType>. Please use try_variant_get instead.
Invalid variant.
For more details see INVALID_VARIANT_FROM_PARQUET
INVALID_VARIANT_GET_PATHâThe path <path> is not a valid variant extraction path in <functionName>.
A valid path should start with $ and is followed by zero or more segments like [123], .name, ['name'], or ["name"].
The schema <schema> is not a valid variant shredding schema.
The WHERE condition <condition> contains invalid expressions: <expressionList>.
Rewrite the query to avoid window functions, aggregate functions, and generator functions in the WHERE clause.
Cannot specify ORDER BY or a window frame for <aggFunc>.
Invalid function <funcName> with WITHIN GROUP.
For more details see INVALID_WITHIN_GROUP_EXPRESSION
INVALID_WRITER_COMMIT_MESSAGEâThe data source writer has generated an invalid number of commit messages. Expected exactly one writer commit message from each task, but received <detail>.
The requested write distribution is invalid.
For more details see INVALID_WRITE_DISTRIBUTION
ISOLATED_COMMAND_FAILUREâFailed to execute <command>. Command output:
<output>
Failed to execute <command>.
JDBC external engine syntax error. The error was caused by the query <jdbcQuery>.
For more details see JDBC_EXTERNAL_ENGINE_SYNTAX_ERROR
JOIN_CONDITION_IS_NOT_BOOLEAN_TYPEâThe join condition <joinCondition> has the invalid type <conditionType>, expected "BOOLEAN".
Some data may have been lost because they are not available in Kafka any more;
either the data was aged out by Kafka or the topic may have been deleted before all the data in the
topic was processed.
If you don't want your streaming query to fail on such cases, set the source option failOnDataLoss to false.
Reason:
For more details see KAFKA_DATA_LOSS
KINESIS_COULD_NOT_READ_SHARD_UNTIL_END_OFFSETâCould not read until the desired sequence number <endSeqNum> for shard <shardId> in
kinesis stream <stream> with consumer mode <consumerMode>. The query will fail due to
potential data loss. The last read record was at sequence number <lastSeqNum>.
This can happen if the data with endSeqNum has already been aged out, or the Kinesis stream was
deleted and reconstructed with the same name. The failure behavior can be overridden
by setting spark.databricks.kinesis.failOnDataLoss to false in spark configuration.
KINESIS_EFO_CONSUMER_NOT_FOUNDâFor kinesis stream <streamId>, the previously registered EFO consumer <consumerId> of the stream has been deleted.
Restart the query so that a new consumer will be registered.
KINESIS_EFO_SUBSCRIBE_LIMIT_EXCEEDEDâFor shard <shard>, the previous call of subscribeToShard API was within the 5 seconds of the next call.
Restart the query after 5 seconds or more.
KINESIS_FETCHED_SHARD_LESS_THAN_TRACKED_SHARDâThe minimum fetched shardId from Kinesis (<fetchedShardId>)
is less than the minimum tracked shardId (<trackedShardId>).
This is unexpected and occurs when a Kinesis stream is deleted and recreated with the same name,
and a streaming query using this Kinesis stream is restarted using an existing checkpoint location.
Restart the streaming query with a new checkpoint location, or create a stream with a new name.
KINESIS_POLLING_MODE_UNSUPPORTEDâKinesis polling mode is unsupported.
KINESIS_RECORD_SEQ_NUMBER_ORDER_VIOLATIONâFor shard <shard>, the last record read from Kinesis in previous fetches has sequence number <lastSeqNum>,
which is greater than the record read in current fetch with sequence number <recordSeqNum>.
This is unexpected and can happen when the start position of retry or next fetch is incorrectly initialized, and may result in duplicate records downstream.
KINESIS_SOURCE_MUST_BE_IN_EFO_MODE_TO_CONFIGURE_CONSUMERSâTo read from Kinesis Streams with consumer configurations (consumerName, consumerNamePrefix, or registeredConsumerId), consumerMode must be efo.
To read from Kinesis Streams with registered consumers, you must specify both the registeredConsumerId and registeredConsumerIdType options.
To read from Kinesis Streams, you must configure either (but not both) of the streamName or streamARN options as a comma-separated list of stream names/ARNs.
To read from Kinesis Streams with registered consumers, do not configure consumerName or consumerNamePrefix options as they will not take effect.
The number of registered consumer ids should be equal to the number of Kinesis streams but got <numConsumerIds> consumer ids and <numStreams> streams.
The registered consumer <consumerId> provided cannot be found for streamARN <streamARN>. Verify that you have registered the consumer or do not provide the registeredConsumerId option.
The registered consumer type <consumerType> is invalid. It must be either name or ARN.
Kryo serialization failed: <exceptionMsg>. To avoid this, increase "<bufferSizeConfKey>" value.
Begin label <beginLabel> does not match the end label <endLabel>.
The label <label> already exists. Choose another name or rename the existing label.
The label name <label> is forbidden.
Lakehouse federation data source '<provider>' requires newer Databricks Runtime version.
For more details see LAKEHOUSE_FEDERATION_DATA_SOURCE_REQUIRES_NEWER_DBR_VERSION
LOAD_DATA_PATH_NOT_EXISTSâLOAD DATA input path does not exist: <path>.
LOCAL must be used together with the schema of file, but got: <actualSchema>.
Cannot name the managed table as <identifier>, as its associated location <location> already exists. Please pick a different table name, or remove the existing location first.
Some of partitions in Kafka topic(s) have been lost during running query with Trigger.AvailableNow. The error could be transient - restart your query, and report if you still see the same issue.
topic-partitions for latest offset: <tpsForLatestOffset>, topic-partitions for end offset: <tpsForEndOffset>
Malformed Avro messages are detected in message deserialization. Parse Mode: <mode>. To process malformed Avro message as null result, try setting the option 'mode' as 'PERMISSIVE'.
Invalid value found when performing <function> with <charset>
Malformed CSV record: <badRecord>
Log file was malformed: failed to read correct log version from <text>.
Malformed Protobuf messages are detected in message deserialization. Parse Mode: <failFastMode>. To process malformed protobuf message as null result, try setting the option 'mode' as 'PERMISSIVE'.
Malformed records are detected in record parsing: <badRecord>.
Parse Mode: <failFastMode>. To process malformed records as null result, try setting the option 'mode' as 'PERMISSIVE'.
For more details see MALFORMED_RECORD_IN_PARSING
MALFORMED_STATE_IN_RATE_PER_MICRO_BATCH_SOURCEâMalformed state in RatePerMicroBatch source.
For more details see MALFORMED_STATE_IN_RATE_PER_MICRO_BATCH_SOURCE
MALFORMED_VARIANTâVariant binary is malformed. Please check the data source is valid.
MANAGED_ICEBERG_ATTEMPTED_TO_ENABLE_CLUSTERING_WITHOUT_DISABLING_DVS_OR_ROW_TRACKINGâAttempted to enable Liquid clustering on a Managed Apache Iceberg table without disabling both deletion vectors and row tracking. Deletion vectors and row tracking are not supported for Managed Apache Iceberg tables, but are required for row-level concurrency with Liquid tables. To enable Liquid clustering on a Managed Apache Iceberg table with reduced concurrency control, deletion vectors and row tracking must be disabled for this table.
MANAGED_ICEBERG_OPERATION_NOT_SUPPORTEDâManaged Apache Iceberg tables do not support <operation>.
Create managed table with storage credential is not supported.
MATERIALIZED_VIEW_MESA_REFRESH_WITHOUT_PIPELINE_IDâCannot <refreshType> the materialized view because it predates having a pipelineId. To enable <refreshType> please drop and recreate the materialized view.
The materialized view operation <operation> is not allowed:
For more details see MATERIALIZED_VIEW_OPERATION_NOT_ALLOWED
MATERIALIZED_VIEW_OUTPUT_WITHOUT_EXPLICIT_ALIASâOutput expression <expression> in a materialized view must be explicitly aliased.
materialized view <name> could not be created with streaming query. Please use CREATE [OR REFRESH] STREAMING TABLE or remove the STREAM keyword to your FROM clause to turn this relation into a batch query instead.
Operation <operation> is currently not supported on materialized views.
Cannot create the new variable <variableName> because the number of variables in the session exceeds the maximum allowed number (<maxNumVariables>).
maxRecordsPerFetch needs to be a positive integer less than or equal to <kinesisRecordLimit>
The ON search condition of the MERGE statement matched a single row from the target table with multiple rows of the source table.
This could result in the target row being operated on more than once with an update or delete operation and is not allowed.
MERGE_WITHOUT_WHENâThere must be at least one WHEN clause in a MERGE statement.
METRIC CONSTRAINT is not enabled.
Provided value "<argValue>" is not supported by argument "<argName>" for the METRIC_STORE table function.
For more details see METRIC_STORE_INVALID_ARGUMENT_VALUE_ERROR
METRIC_STORE_UNSUPPORTED_ERRORâMetric Store routine <routineName> is currently disabled in this environment.
The metric view definition contains a join with an ambiguous criteria: <expr>. [Either use the using join criteria or explicitly qualify columns with the <sourceAlias> alias.]
The metric view is not allowed to use cache tables.
METRIC_VIEW_FEATURE_DISABLEDâThe metric view feature is disabled. Please make sure "spark.databricks.sql.metricView.enabled" is set to true.
METRIC_VIEW_INVALID_MEASURE_FUNCTION_INPUTâThe MEASURE() function only takes an attribute as input, but got <expr>
The metric view definition is invalid. Reason: <reason>.
The metric view is not allowed in CTE definitions. plan: <plan>
The metric view is not allowed to use joins. plan: <plan>
Metric view materializations are disabled. Please make sure "spark.databricks.sql.metricView.materializations.enabled" is set to true.
METRIC_VIEW_MISSING_MEASURE_FUNCTIONâThe usage of measure column <column> of a metric view requires a MEASURE() function to produce results.
The metric view <oldName> is not allowed to rename to a different catalog or schema: <newName>.
The metric view snowflake join feature is disabled. Please make sure "spark.databricks.sql.metricView.snowflake.join.enable" is set to true.
METRIC_VIEW_UNSUPPORTED_USAGEâThe metric view usage is not supported. plan: <plan>
The metric view is not allowed to use window function <expr>.
<table> is not supported for migrating to UC managed table because it is not a <tableKind> table.
Make sure that the table being migrated is a UC external delta table and
it is referenced by its name instead of path.
MIGRATION_ROLLBACK_NOT_SUPPORTEDâ<table> is not supported for rollback from to managed to external table because it is not a <tableKind> table.
Kafka data source in Trigger.AvailableNow should provide the same topic partitions in pre-fetched offset to end offset for each microbatch. The error could be transient - restart your query, and report if you still see the same issue.
topic-partitions for pre-fetched offset: <tpsForPrefetched>, topic-partitions for end offset: <tpsForEndOffset>.
The non-aggregating expression <expression> is based on columns which are not participating in the GROUP BY clause.
Add the columns or the expression to the GROUP BY, aggregate the expression, or use <expressionAnyValue> if you do not care which of the values within a group is returned.
For more details see MISSING_AGGREGATION
MISSING_CLAUSES_FOR_OPERATIONâMissing clause <clauses> for operation <operation>. Please add the required clauses.
Connections of type '<connectionType>' must include the following option(s): <requiredOptions>.
Database name is not specified in the v1 session catalog. Please ensure to provide a valid database name when interacting with the v1 catalog.
MISSING_GROUP_BYâThe query does not include a GROUP BY clause. Add GROUP BY or turn it into the window functions using OVER clauses.
CHECK constraint must have a name.
Parameter <parameterName> is required for Kafka, but is not specified in <functionName>.
Parameter <parameterName> is required, but is not specified in <functionName>.
A schedule definition must be provided following SCHEDULE.
The operation has timed out, but no timeout duration is configured. To set a processing time-based timeout, use 'GroupState.setTimeoutDuration()' in your 'mapGroupsWithState' or 'flatMapGroupsWithState' operation. For event-time-based timeout, use 'GroupState.setTimeoutTimestamp()' and define a watermark using 'Dataset.withWatermark()'.
MISSING_WINDOW_SPECIFICATIONâWindow specification is not defined in the WINDOW clause for <windowName>. For more information about WINDOW clauses, please refer to '<docroot>/sql-ref-syntax-qry-select-window.html'.
Modifying built-in catalog <catalogName> is not supported.
Databricks Delta does not support multiple input paths in the load() API.
paths: <pathList>. To build a single DataFrame by loading
multiple paths from the same Delta table, please load the root path of
the Delta table with the corresponding partition filters. If the multiple paths
are from different Delta tables, please use Dataset's union()/unionByName() APIs
to combine the DataFrames generated by separate load() API calls.
MULTIPLE_MATCHING_CONSTRAINTSâFound at least two matching constraints with the given condition.
MULTIPLE_QUERY_RESULT_CLAUSES_WITH_PIPE_OPERATORSâ<clause1> and <clause2> cannot coexist in the same SQL pipe operator using '|>'. Please separate the multiple result clauses into separate pipe operators and then retry the query again.
Cannot specify time travel in both the time travel clause and options.
MULTIPLE_XML_DATA_SOURCEâDetected multiple data sources with the name <provider> (<sourceNames>). Please specify the fully qualified class name or remove <externalSource> from the classpath.
Multi part aliasing (<names>) is not supported with <expr> as it is not a generator function.
The expression <expr> does not support more than one source.
Change Data Feed cannot be enabled in a Multi Statement Transaction because a table contains a reserved column name (<column_name>).
To proceed, make sure the table uses only non-reserved column names.
MULTI_STATEMENT_TRANSACTION_CDF_SETTING_HIGH_WATERMARK_NOT_ALLOWEDâManually setting the CDC Identities high watermark is not allowed.
MULTI_STATEMENT_TRANSACTION_CONCURRENT_CATALOG_METADATA_CHANGEâA concurrent metadata change has been detected on table/view <table>. Please run ROLLBACK and then retry this transaction. Details:
For more details see MULTI_STATEMENT_TRANSACTION_CONCURRENT_CATALOG_METADATA_CHANGE
MULTI_STATEMENT_TRANSACTION_CONTEXT_MISMATCHâTransaction context inconsistency was detected between the current thread and the Spark session. This typically occurs when a Spark session is shared across multiple threads. Please use a dedicated session and thread for each transaction, and commit/rollback the transaction in its thread before reusing the session and thread for a new transaction. Details:
For more details see MULTI_STATEMENT_TRANSACTION_CONTEXT_MISMATCH
MULTI_STATEMENT_TRANSACTION_NOT_SUPPORTEDâFailed to execute the statement.
For more details see MULTI_STATEMENT_TRANSACTION_NOT_SUPPORTED
MULTI_STATEMENT_TRANSACTION_NO_ACTIVE_TRANSACTIONâThere is no active transaction to <action>.
The current transaction has been aborted. Please run ROLLBACK TRANSACTION before continuing. Abort reason:
For more details see MULTI_STATEMENT_TRANSACTION_ROLLBACK_REQUIRED_AFTER_ABORT
MULTI_UDF_INTERFACE_ERRORâNot allowed to implement multiple UDF interfaces, UDF class <className>.
Mutually exclusive clauses or options <clauses>. Please remove one of these clauses.
The input query expects a <expectedType>, but the underlying table is a <givenType>.
Named parameters are not supported for function <functionName>; please retry the query with positional arguments to the function call instead.
Cannot call function <functionName> because named argument references are not supported. In this case, the named argument reference was <argument>.
Cannot call function <functionName> because named argument references are not enabled here.
In this case, the named argument reference was <argument>.
Set "spark.sql.allowNamedFunctionArguments" to "true" to turn on feature.
NAMESPACE_ALREADY_EXISTSâCannot create namespace <nameSpaceName> because it already exists.
Choose a different name, drop the existing namespace, or add the IF NOT EXISTS clause to tolerate pre-existing namespace.
Cannot drop a namespace <nameSpaceNameName> because it contains objects.
Use DROP NAMESPACE ... CASCADE to drop the namespace and all its objects.
The namespace <nameSpaceName> cannot be found. Verify the spelling and correctness of the namespace.
If you did not qualify the name with, verify the current_schema() output, or qualify the name with the correctly.
To tolerate the error on drop use DROP NAMESPACE IF EXISTS.
Native request failed. requestId: <requestId>, cloud: <cloud>, operation: <operation>
request: [https: <https>, method = <method>, path = <path>, params = <params>, host = <host>, headers = <headers>, bodyLen = <bodyLen>],
error: <error>
Native XML Data Source is not enabled in this cluster.
NEGATIVE_SCALE_DISALLOWEDâNegative scale is not allowed: '<scale>'. Set the config <sqlConf> to "true" to allow it.
Found the negative value in <frequencyExpression>: <negativeValue>, but expected a positive integral value.
It is not allowed to use an aggregate function in the argument of another aggregate function. Please use the inner aggregate function in a sub-query.
NESTED_EXECUTE_IMMEDIATEâNested EXECUTE IMMEDIATE commands are not allowed. Please ensure that the SQL query provided (<sqlString>) does not contain another EXECUTE IMMEDIATE command.
Detected outer scope references <expression> in the subquery which is not supported.
Field(s) <nonExistFields> do(es) not exist. Available fields: <fieldNames>
The function <funcName> requires the parameter <paramName> to be a foldable expression of the type <paramType>, but the actual argument is a non-foldable.
When there are more than one MATCHED clauses in a MERGE statement, only the last MATCHED clause can omit the condition.
When there are more than one NOT MATCHED BY SOURCE clauses in a MERGE statement, only the last NOT MATCHED BY SOURCE clause can omit the condition.
When there are more than one NOT MATCHED [BY TARGET] clauses in a MERGE statement, only the last NOT MATCHED [BY TARGET] clause can omit the condition.
Literal expressions required for pivot values, found <expression>.
PARTITION clause cannot contain the non-partition column: <columnName>.
Window function is not supported in <windowFunc> (as column <columnName>) on streaming DataFrames/Datasets.
Structured Streaming only supports time-window aggregation using the WINDOW function. (window specification: <windowSpec>)
Not allowed in the FROM clause:
For more details see NOT_ALLOWED_IN_FROM
NOT_ALLOWED_IN_PIPE_OPERATOR_WHEREâNot allowed in the pipe WHERE clause:
For more details see NOT_ALLOWED_IN_PIPE_OPERATOR_WHERE
NOT_A_CONSTANT_STRINGâThe expression <expr> used for the routine or clause <name> must be a constant STRING which is NOT NULL.
For more details see NOT_A_CONSTANT_STRING
NOT_A_PARTITIONED_TABLEâOperation <operation> is not allowed for <tableIdentWithDB> because it is not a partitioned table.
<functionName> appears as a scalar expression here, but the function was defined as a table function. Please update the query to move the function call into the FROM clause, or redefine <functionName> as a scalar function instead.
<functionName> appears as a table function here, but the function was defined as a scalar function. Please update the query to move the function call outside the FROM clause, or redefine <functionName> as a table function instead.
NULL value appeared in non-nullable field: <walkedTypePath>If the schema is inferred from a Scala tuple/case class, or a Java bean, please try to use scala.Option[_] or other nullable types (such as java.lang.Integer instead of int/scala.Int).
Assigning a NULL is not allowed here.
For more details see NOT_NULL_CONSTRAINT_VIOLATION
NOT_SUPPORTED_CHANGE_COLUMNâALTER TABLE ALTER/CHANGE COLUMN is not supported for changing <table>'s column <originName> with type <originType> to <newName> with type <newType>.
ALTER TABLE ALTER/CHANGE COLUMN is not supported for changing <table>'s column <fieldName> including its nested fields multiple times in the same command.
<cmd> is not supported for v2 tables.
<cmd> is not supported, if you want to enable it, please set "spark.sql.catalogImplementation" to "hive".
Not supported command in JDBC catalog:
For more details see NOT_SUPPORTED_IN_JDBC_CATALOG
NOT_SUPPORTED_WITH_DB_SQLâ<operation> is not supported on a SQL <endpoint>.
<operation> is not supported on serverless compute.
Unresolved encoder expected, but <attr> was found.
Can't determine the default value for <colName> because it is not nullable and it has no default value.
No handler for UDAF '<functionName>'. Use sparkSession.udf.register(...) instead.
df.mergeInto needs to be followed by at least one of whenMatched/whenNotMatched/whenNotMatchedBySource.
NO_PARENT_EXTERNAL_LOCATION_FOR_PATHâSQLSTATE: none assigned
No parent external location was found for path '<path>'. Please create an external location on one of the parent paths and then retry the query or command again.
Cannot find <catalystFieldPath> in Protobuf schema.
SQLSTATE: none assigned
No storage location was found for table '<tableId>' when generating table credentials. Please verify the table type and the table location URL and then retry the query or command again.
Catalog '<catalog>' was not found. Please verify the catalog name and then retry the query or command again.
SQLSTATE: none assigned
The clean room '<cleanroom>' does not exist. Please verify that the clean room name is spelled correctly and matches the name of a valid existing clean room and then retry the query or command again.
The credential '<credential>' does not exist. Please verify that the credential name is spelled correctly and matches the name of a valid existing credential and then retry the query or command again.
SQLSTATE: none assigned
The external location '<externalLocation>' does not exist. Please verify that the external location name is correct and then retry the query or command again.
SQLSTATE: none assigned
The metastore was not found. Please ask your account administrator to assign a metastore to the current workspace and then retry the query or command again.
NO_SUCH_PROVIDER_EXCEPTIONâSQLSTATE: none assigned
The share provider '<providerName>' does not exist. Please verify the share provider name is spelled correctly and matches the name of a valid existing provider name and then retry the query or command again.
SQLSTATE: none assigned
The recipient '<recipient>' does not exist. Please verify that the recipient name is spelled correctly and matches the name of a valid existing recipient and then retry the query or command again.
SQLSTATE: none assigned
The share '<share>' does not exist. Please verify that the share name is spelled correctly and matches the name of a valid existing share and then retry the query or command again.
SQLSTATE: none assigned
The storage credential '<storageCredential>' does not exist. Please verify that the storage credential name is spelled correctly and matches the name of a valid existing storage credential and then retry the query or command again.
SQLSTATE: none assigned
The user '<userName>' does not exist. Please verify that the user to whom you grant permission or alter ownership is spelled correctly and matches the name of a valid existing user and then retry the query or command again.
UDF class <className> doesn't implement any UDF interface.
Column or field <name> is nullable while it's required to be non-nullable.
Row ID attributes cannot be nullable: <nullableRowIdAttrs>.
Data source read/write option <option> cannot have null value.
Cannot use null as map key.
NULL_QUERY_STRING_EXECUTE_IMMEDIATEâExecute immediate requires a non-null variable as the query string, but the provided variable <varName> is null.
Signal statement arguments require non-null values, but <argument> received a null value.
The value <value> cannot be interpreted as a numeric because it has more than 38 digits.
For more details see NUMERIC_VALUE_OUT_OF_RANGE
NUM_COLUMNS_MISMATCHâ<operator> can only be performed on inputs with the same number of columns, but the first input has <firstNumColumns> columns and the <invalidOrdinalNum> input has <invalidNumColumns> columns.
Number of given aliases does not match number of output columns.
Function name: <funcName>; number of aliases: <aliasesNum>; number of output columns: <outColsNum>.
No custom identity claim was provided.
ONLY_SECRET_FUNCTION_SUPPORTED_HEREâCalling function <functionName> is not supported in this <location>; <supportedFunctions> supported here.
SQL operation <operation> is only supported on Databricks SQL connectors with Unity Catalog support.
Operation has been canceled.
OPERATION_REQUIRES_UNITY_CATALOGâOperation <operation> requires Unity Catalog enabled.
<plan> is not supported in read-only session mode.
ORDER BY position <index> is not in select list (valid range is [1, <size>]).
Unable to create a Parquet converter for the data type <dataType> whose Parquet type is <parquetType>.
For more details see PARQUET_CONVERSION_FAILURE
PARQUET_TYPE_ILLEGALâIllegal Parquet type: <parquetType>.
Unrecognized Parquet type: <field>.
Parquet type not yet supported: <parquetType>.
Syntax error, unexpected empty statement.
PARSE_MODE_UNSUPPORTEDâThe function <funcName> doesn't support the <mode> mode. Acceptable modes are PERMISSIVE and FAILFAST.
Syntax error at or near <error> <hint>.
Cannot ADD or RENAME TO partition(s) <partitionList> in table <tableName> because they already exist.
Choose a different name, drop the existing partition, or add the IF NOT EXISTS clause to tolerate a pre-existing partition.
The partition(s) <partitionList> cannot be found in table <tableName>.
Verify the partition specification and table name.
To tolerate the error on drop use ALTER TABLE ⦠DROP IF EXISTS PARTITION.
Partition column <column> not found in schema <schema>. Please provide the existing column for partitioning.
Partition location <locationPath> already exists in table <tableName>.
Failed to execute the ALTER TABLE SET PARTITION LOCATION statement, because the
partition location <location> is not under the table directory <table>.
To fix it, please set the location of partition to a subdirectory of <table>.
<action> is not allowed on table <tableName> because storing partition metadata is not supported in Unity Catalog.
Number of values (<partitionNumber>) did not match schema size (<partitionSchemaSize>): values are <partitionValues>, schema is <partitionSchema>, file path is <urlEncodedPath>.
Please re-materialize the table or contact the owner.
PARTITION_TRANSFORM_EXPRESSION_NOT_IN_PARTITIONED_BYâThe expression <expression> must be inside 'partitionedBy'.
Path <outputPath> already exists. Set mode as "overwrite" to overwrite the existing path.
Path does not exist: <path>.
Deserializing the Photon protobuf plan requires at least <size> bytes, which exceeds the
limit of <limit> bytes. This could be due to a very large plan or the presence of a very
wide schema. Try to simplify the query, remove unnecessary columns, or disable Photon.
PHOTON_SERIALIZED_PROTOBUF_MEMORY_LIMIT_EXCEEDEDâThe serialized Photon protobuf plan has size <size> bytes, which exceeds the limit of
<limit> bytes. The serialized size of data types in the plan is <dataTypeSize> bytes.
This could be due to a very large plan or the presence of a very wide schema.
Consider rewriting the query to remove unwanted operations and columns or disable Photon.
PIPELINE_DOES_NOT_EXISTâPipeline '<pipelineId>' does not exist
For more details see PIPELINE_DOES_NOT_EXIST
PIPE_OPERATOR_AGGREGATE_EXPRESSION_CONTAINS_NO_AGGREGATE_FUNCTIONâNon-grouping expression <expr> is provided as an argument to the |> AGGREGATE pipe operator but does not contain any aggregate function; please update it to include an aggregate function and then retry the query again.
Aggregate function <expr> is not allowed when using the pipe operator |> <clause> clause; please use the pipe operator |> AGGREGATE clause instead.
Invalid pivot value '<value>': value data type <valueType> does not match pivot column data type <pivotType>.
Not enough memory to grow pointer array
POLICY_ALREADY_EXISTSâCannot create policy <policyName> because it already exists.
Choose a different name or drop the existing policy to tolerate pre-existing connections.
POLICY_NOT_FOUNDâCannot execute <commandType> command because the policy <policyName> on <securableFullname> cannot be found.
Please verify the spelling and correctness.
POLICY_ON_SECURABLE_TYPE_NOT_SUPPORTEDâCannot create policy on securable type <securableType>. Supported securable types: <allowedTypes>.
Procedure <procedureName> expects <expected> arguments, but <actual> were provided.
CREATE PROCEDURE with an empty routine definition is not allowed.
The parameter <parameterName> is defined with parameter mode <parameterMode>. OUT and INOUT parameter cannot be omitted when invoking a routine and therefore do not support a DEFAULT expression. To proceed, remove the DEFAULT clause or change the parameter mode to IN.
Stored procedure is not supported
PROCEDURE_NOT_SUPPORTED_WITH_HMSâStored procedure is not supported with Hive Metastore. Please use Unity Catalog instead.
PROTOBUF_DEPENDENCY_NOT_FOUNDâCould not find dependency: <dependencyName>.
Error reading Protobuf descriptor file at path: <filePath>.
Searching for <field> in Protobuf schema at <protobufSchema> gave <matchSize> matches. Candidates: <matches>.
Found <field> in Protobuf schema but there is no match in the SQL schema.
Type mismatch encountered for field: <field>.
Java classes are not supported for <protobufFunction>. Contact Databricks Support about alternate options.
Unable to locate Message <messageName> in Descriptor.
Cannot call the <functionName> SQL function because the Protobuf data source is not loaded.
Please restart your job or session with the 'spark-protobuf' package loaded, such as by using the --packages argument on the command line, and then retry your query or command again.
PROTOBUF_TYPE_NOT_SUPPORTâProtobuf type not yet supported: <protobufType>.
Task in pubsub fetch stage cannot be retried. Partition <partitionInfo> in stage <stageInfo>, TID <taskId>.
<key> cannot be an empty string.
Invalid key type for PubSub dedup: <key>.
The option <key> is not supported by PubSub. It can only be used in testing.
Invalid type for <key>. Expected type of <key> to be type <type>.
Invalid read limit on PubSub stream: <limit>.
Invalid UnsafeRow to decode to PubSubMessageMetadata, the desired proto schema is: <protoSchema>. The input UnsafeRow might be corrupted: <unsafeRow>.
The query or command failed because of an invalid read option: in spark.readStream.format("pubsub").option("workloadIdentityFederation.audience", <audience>). Update <audience> to match the following format: //iam.googleapis.com/projects/{PROJECT_NUMBER}/locations/global/workloadIdentityPools/{POOL_ID}/providers/{PROVIDER_ID} and then retry the query or command again.
Failed to find complete PubSub authentication information.
PS_MISSING_REQUIRED_OPTIONâCould not find required option: <key>.
Fail to move raw data checkpoint files from <src> to destination directory: <dest>.
Please provide either your Databricks service credential or your GCP service account credentials.
PS_MULTIPLE_FAILED_EPOCHSâPubSub stream cannot be started as there is more than one failed fetch: <failedEpochs>.
<key> must be within the following bounds (<min>, <max>) exclusive of both bounds.
Shared clusters do not support authentication with instance profiles. Provide credentials to the stream directly using .option().
PS_SPARK_SPECULATION_NOT_SUPPORTEDâPubSub source connector is only available in cluster with spark.speculation disabled.
An error occurred while trying to create subscription <subId> on topic <topicId>. Please check that there are sufficient permissions to create a subscription and try again.
Unable to parse serialized bytes to generate proto.
PS_UNSUPPORTED_GET_OFFSET_CALLâgetOffset is not supported without supplying a limit.
PYTHON_DATA_SOURCE_ERRORâFailed to <action> Python data source <type>: <msg>
Failed when Python streaming data source perform <action>: <msg>
Unable to access referenced table because a previously assigned column mask is currently incompatible with the table schema; to continue, please contact the owner of the table to update the policy:
For more details see QUERIED_TABLE_INCOMPATIBLE_WITH_COLUMN_MASK_POLICY
QUERIED_TABLE_INCOMPATIBLE_WITH_ROW_LEVEL_SECURITY_POLICYâUnable to access referenced table because a previously assigned row level security policy is currently incompatible with the table schema; to continue, please contact the owner of the table to update the policy:
For more details see QUERIED_TABLE_INCOMPATIBLE_WITH_ROW_LEVEL_SECURITY_POLICY
QUERY_EXECUTION_TIMEOUT_EXCEEDEDâQuery execution was cancelled due to exceeding the timeout (<timeoutSec>s). You can increase the limit in seconds by setting <config>.
Query execution was rejected.
QUERY_RESULT_WRITE_TO_CLOUD_STORE_PERMISSION_ERRORâThe workspace internal storage configuration prevents Databricks from accessing the cloud store.
READ_CURRENT_FILE_NOT_FOUNDâ<message>
It is possible the underlying files have been updated. You can explicitly invalidate the cache in Spark by running 'REFRESH TABLE tableName' command in SQL or by recreating the Dataset/DataFrame involved.
The invocation of function <functionName> has <parameterName> and <alternativeName> set, which are aliases of each other. Please set only one of them.
An error occurred while parsing the temporary credentials of the read_files() function.
For more details see READ_FILES_CREDENTIALS_PARSE_ERROR
READ_TVF_UNEXPECTED_REQUIRED_PARAMETERâThe function <functionName> required parameter <parameterName> must be assigned at position <expectedPos> without the name.
Only TIMESTAMP/TIMESTAMP_LTZ/TIMESTAMP_NTZ types are supported for recipient expiration timestamp.
Recursion level limit <levelLimit> reached but query has not exhausted, try increasing it like 'WITH RECURSIVE t(col) MAX RECURSION LEVEL 200'.
Recursion row limit <rowLimit> reached but query has not exhausted, try setting a larger LIMIT value when querying the CTE relation.
Recursive definitions cannot be used in legacy CTE precedence mode (spark.sql.legacy.ctePrecedencePolicy=LEGACY).
Recursive definitions cannot be used when legacy inline flag is set to true (spark.sql.legacy.inlineCTEInCommands=true).
RECURSIVE_PROTOBUF_SCHEMAâFound recursive reference in Protobuf schema, which can not be processed by Spark by default: <fieldDescriptor>. try setting the option recursive.fields.max.depth 1 to 10. Going beyond 10 levels of recursion is not allowed.
Recursive view <viewIdent> detected (cycle: <newPath>).
References to DEFAULT column values are not allowed within the PARTITION clause.
Can not build a <relationName> that is larger than 8G.
The remote HTTP request failed with code <errorCode>, and error message <errorMessage>
Failed to evaluate the <functionName> SQL function due to inability to parse the JSON result from the remote HTTP response; the error message is <errorMessage>. Check API documentation: <docUrl>. Please fix the problem indicated in the error message and retry the query again.
Failed to evaluate the <functionName> SQL function due to inability to process the unexpected remote HTTP response; the error message is <errorMessage>. Check API documentation: <docUrl>. Please fix the problem indicated in the error message and retry the query again.
The remote request failed after retrying <N> times; the last failed HTTP error code was <errorCode> and the message was <errorMessage>
Failed to evaluate the <functionName> SQL function because <errorMessage>. Check requirements in <docUrl>. Please fix the problem indicated in the error message and retry the query again.
Parameters <parameterNames> are not supported for the remote_query function, which queries a connection of type '<connectionType>'.
For more details see REMOTE_QUERY_FUNCTION_UNSUPPORTED_CONNECTOR_PARAMETERS
RENAME_SRC_PATH_NOT_FOUNDâFailed to rename as <sourcePath> was not found.
The <clause> clause may be used at most once per <operation> operation.
The routine <routineName> required parameter <parameterName> has been assigned at position <positionalIndex> without the name.
Please update the function call to either remove the named argument with <parameterName> for this parameter or remove the positional
argument at <positionalIndex> and then try the query again.
Cannot invoke routine <routineName> because the parameter named <parameterName> is required, but the routine call did not supply a value. Please update the routine call to supply an argument value (either positionally at index <index> or by name) and retry the query again.
<sessionCatalog> requires a single-part namespace, but got <namespace>.
The 'rescuedDataColumn' DataFrame API reader option is mutually exclusive with the 'singleVariantColumn' DataFrame API option.
Please remove one of them and then retry the DataFrame operation again.
RESERVED_CDC_COLUMNS_ON_WRITEâThe write contains reserved columns <columnList> that are used
internally as metadata for Change Data Feed. To write to the table either rename/drop
these columns or disable Change Data Feed on the table by setting
<config> to false.
The option <option> has restricted values on Shared clusters for the <source> source.
For more details see RESTRICTED_STREAMING_OPTION_PERMISSION_ENFORCED
ROUTINE_ALREADY_EXISTSâCannot create the <newRoutineType> <routineName> because a <existingRoutineType> of that name already exists.
Choose a different name, drop or replace the existing <existingRoutineType>, or add the IF NOT EXISTS clause to tolerate a pre-existing <newRoutineType>.
The routine <routineName> cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema and catalog, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP ... IF EXISTS.
The routine <routineName> does not support the parameter <parameterName> specified at position <pos>.<suggestion>
The function <routineName> cannot be created because the specified classname '<className>' is reserved for system use. Please rename the class and try again.
Row filters could not be resolved on <tableName> because there was a mismatch between row filters inherited from policies and explicitly defined row filters. To proceed, please disable Attribute Based Access Control (ABAC) and contact Databricks support.
Creating CHECK constraint on table <tableName> with row level security policies is not supported.
A column with name <objectName> referenced in a row filter or column mask function parameter cannot be resolved.
This may happen if the underlying table schema has changed and the referenced column no longer exists.
For example, this can occur if the column was removed in an external system (for example, a federated table), or if a REPLACE operation on the table dropped the column.
To resolve this, users with management privileges on the table can inspect the current row filters and column masks using DESCRIBE TABLE EXTENDED, and drop or re-create any that reference non-existent columns using ALTER TABLE ... SET/DROP ROW FILTER or MASK.
Note: Databricks introduced a safety improvement to preserve column masks during REPLACE operations when the new schema includes the same column, even if the mask is not specified. This prevents unintentional policy loss on tables.
A <statementType> statement attempted to assign a row level security policy to a table, but two or more referenced columns had the same name <columnName>, which is invalid.
Row level security policies for <tableName> are not supported:
For more details see ROW_LEVEL_SECURITY_FEATURE_NOT_SUPPORTED
ROW_LEVEL_SECURITY_INCOMPATIBLE_SCHEMA_CHANGEâUnable to <statementType> <columnName> from table <tableName> because it's referenced in a row level security policy. The table owner must remove or alter this policy before proceeding.
MERGE INTO operations do not support row level security policies in source table <tableName>.
MERGE INTO operations do not support writing into table <tableName> with row level security policies.
This statement attempted to assign a row level security policy to a table, but referenced column <columnName> had multiple name parts, which is invalid.
Row level security policies are only supported in Unity Catalog.
ROW_LEVEL_SECURITY_SHOW_PARTITIONS_UNSUPPORTEDâSHOW PARTITIONS command is not supported for<format> tables with row level security policy.
<mode> clone from table <tableName> with row level security policy is not supported.
<mode> clone to table <tableName> with row level security policy is not supported.
Using a constant as a parameter in a row level security policy is not supported. Please update your SQL command to remove the constant from the row filter definition and then retry the command again.
ROW_LEVEL_SECURITY_UNSUPPORTED_DATA_TYPEâFunction <functionName> used for row level security policy has parameter with unsupported data type <dataType>.
Failed to execute <statementType> command because assigning row level security policy is not supported for target data source with table provider: "<provider>".
More than one row returned by a subquery used as a row.
ROW_VALUE_IS_NULLâFound NULL in a row at the index <index>, expected a non-NULL value.
Not found an id for the rule name "<ruleName>". Please modify RuleIdCollection.scala if you are adding a new rule.
Authorization to the Salesforce Data Share API failed. Verify that the Databricks connection details are provided to the appropriate Salesforce data share target.
SAMPLE_TABLE_PERMISSIONSâPermissions not supported on sample databases/tables.
SCALAR_FUNCTION_NOT_COMPATIBLEâScalarFunction <scalarFunc> not overrides method 'produceResult(InternalRow)' with custom implementation.
ScalarFunction <scalarFunc> not implements or overrides method 'produceResult(InternalRow)'.
The correlated scalar subquery '<sqlExpr>' is neither present in GROUP BY, nor in an aggregate function.
Add it to GROUP BY using ordinal position or wrap it in first() (or first_value) if you don't care which value you get.
More than one row returned by a subquery used as an expression.
SCHEDULE_ALREADY_EXISTSâCannot add <scheduleType> to a table that already has <existingScheduleType>. Please drop the existing schedule or use ALTER TABLE ... ALTER <scheduleType> ... to alter it.
The schedule period for <timeUnit> must be an integer value between 1 and <upperBound> (inclusive). Received: <actual>.
Cannot create schema <schemaName> because it already exists.
Choose a different name, drop the existing schema, or add the IF NOT EXISTS clause to tolerate pre-existing schema.
Cannot drop a schema <schemaName> because it contains objects.
Use DROP SCHEMA ... CASCADE to drop the schema and all its objects.
The schema <schemaName> cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a catalog, verify the current_schema() output, or qualify the name with the correct catalog.
To tolerate the error on drop use DROP SCHEMA IF EXISTS.
Schema from schema registry could not be initialized. <reason>.
The second argument of <functionName> function needs to be an integer.
Cannot execute <commandType> command with one or more non-encrypted references to the SECRET function; please encrypt the result of each such function call with AES_ENCRYPT and try the command again
The seed expression <seedExpr> of the expression <exprWithSeed> must be foldable.
The server is busy and could not handle the request. Please wait a moment and try again.
SFTP_DEPRECATED_SSH_RSA_KEY_ALGORITHMâThe SFTP server <host>:<port> is using the deprecated SSH RSA algorithm for key exchange.
Consider upgrade the SFTP server to use a more secure algorithm such as ECDSA or ED25519.
Alternatively, bypass this error by setting <escapeHatchConf> to true
Failed to connect to SFTP server <host> on port <port> with username <user>.
<error>
The host key of the SFTP server <host> is unknown or changed.
Verify the SSH fingerprint matching error message below during the connection attempt:
<error>
Then extract the fingerprint hash and provide it as part of the connection creation options with option name key_fingerprint.
For example, if the message states 'ECDSA key fingerprint is SHA256:XXX/YYY', submit 'SHA256:XXX/YYY' as part of the connection options.
The user retrieved from the credential <credentialUser> does not match that of the one specified in SFTP path <path>.
SHOW COLUMNS with conflicting namespaces: <namespaceA> != <namespaceB>.
sortBy must be used together with bucketBy.
SPARK_JOB_CANCELLEDâJob <jobId> cancelled <reason>
A CREATE TABLE without explicit column list cannot specify bucketing information.
Please use the form with explicit column list and specify bucketing information.
Alternatively, allow bucketing information to be inferred by omitting the clause.
SPECIFY_CLUSTER_BY_WITH_BUCKETING_IS_NOT_ALLOWEDâCannot specify both CLUSTER BY and CLUSTERED BY INTO BUCKETS.
Cannot specify both CLUSTER BY and PARTITIONED BY.
A CREATE TABLE without explicit column list cannot specify PARTITIONED BY.
Please use the form with explicit column list and specify PARTITIONED BY.
Alternatively, allow partitioning to be inferred by omitting the PARTITION BY clause.
Error while calling spill() on <consumerToSpill> : <message>
The SQL config <sqlConf> cannot be found. Please verify that the config exists.
SQL Scripts in EXECUTE IMMEDIATE commands are not allowed. Please ensure that the SQL query provided (<sqlString>) is not SQL Script. Make sure the sql_string is a well-formed SQL statement and does not contain BEGIN and END.
Maximum number of characters in a SQL Script (id: <scriptId>) has been exceeded. The maximum number of characters allowed is <maxChars>, and the script had <chars> characters.
Maximum number of lines in a SQL Script (id: <scriptId>) has been exceeded. The maximum number of lines allowed is <maxLines>, and the script had <lines> lines.
Maximum number of local variable declarations in a SQL Script (id: <scriptId>) has been exceeded. The maximum number of declarations allowed is <maxDeclarations>, and the script had <declarations>.
Maximum number of nested procedure calls has been exceeded with procedure (name: <procedureName>, callId: <procedureCallId>). The maximum allowed number of nested procedure calls is <limit>.
Transient error while accessing target staging path <path>, please try in a few minutes
Star (*) is not allowed in a select list when GROUP BY an ordinal position is used.
Failed to perform stateful processor operation=<operationType> with invalid handle state=<handleState>.
Failed to perform stateful processor operation=<operationType> with invalid timeMode=<timeMode>
State variable with name <stateVarName> has already been defined in the StatefulProcessor.
Cannot use TTL for state=<stateName> in timeMode=<timeMode>, use TimeMode.ProcessingTime() instead.
TTL duration must be greater than zero for State store operation=<operationType> on state=<stateName>.
Unknown time mode <timeMode>. Accepted timeMode modes are 'none', 'processingTime', 'eventTime'
Failed to create column family with unsupported starting character and name=<colFamilyName>.
Failed to perform column family operation=<operationName> with invalid name=<colFamilyName>. Column family name cannot be empty or include leading/trailing spaces or use the reserved keyword=default
Incompatible schema transformation with column family=<colFamilyName>, oldSchema=<oldSchema>, newSchema=<newSchema>.
StateStore <inputClass> does not support reusable iterator.
The handle has not been initialized for this StatefulProcessor.
Please only use the StatefulProcessor within the transformWithState operator.
STATE_STORE_INCORRECT_NUM_ORDERING_COLS_FOR_RANGE_SCANâIncorrect number of ordering ordinals=<numOrderingCols> for range scan encoder. The number of ordering ordinals cannot be zero or greater than number of schema columns.
Incorrect number of prefix columns=<numPrefixCols> for prefix scan encoder. Prefix columns cannot be zero or greater than or equal to num of schema columns.
Cannot change <configName> from <oldConfig> to <newConfig> between restarts. Please set <configName> to <oldConfig>, or restart with a new checkpoint directory.
The given State Store Provider <inputClass> does not extend org.apache.spark.sql.execution.streaming.state.StateStoreProvider.
Cannot change <stateVarName> to <newType> between query restarts. Please set <stateVarName> to <oldType>, or restart with a new checkpoint directory.
The provided key schema does not match existing schema in operator state.
Existing schema=<storedKeySchema>; provided schema=<newKeySchema>.
To run the query without schema validation, set spark.sql.streaming.stateStore.stateSchemaCheck to false.
Note that running without schema validation can have non-deterministic behavior.
STATE_STORE_NATIVE_ROCKSDB_TIMEOUTâWhen accessing RocksDB state store for stateful streaming operation, calling native RocksDB function <funcName> timed out after waiting timeout=<timeoutMs> ms. Please try again and restart the cluster if error persists.
Null type ordering column with name=<fieldName> at index=<index> is not supported for range scan encoder.
The given State Store Provider <inputClass> does not extend org.apache.spark.sql.execution.streaming.state.SupportsFineGrainedReplay.
Therefore, it does not support option snapshotStartBatchId or readChangeFeed in state data source.
STATE_STORE_STATE_SCHEMA_FILES_THRESHOLD_EXCEEDEDâThe number of state schema files <numStateSchemaFiles> exceeds the maximum number of state schema files for this query: <maxStateSchemaFiles>.
Added: <addedColumnFamilies>, Removed: <removedColumnFamilies>
Please set 'spark.sql.streaming.stateStore.stateSchemaFilesThreshold' to a higher number, or revert state schema modifications
STATE_STORE_UNSUPPORTED_OPERATION_ON_MISSING_COLUMN_FAMILYâState store operation=<operationType> not supported on missing column family=<colFamilyName>.
The number of state schema evolutions <numSchemaEvolutions> exceeds the maximum number of state schema evolutions, <maxSchemaEvolutions>, allowed for this column family.
Offending column family: <colFamilyName>
Please set 'spark.sql.streaming.stateStore.valueStateSchemaEvolutionThreshold' to a higher number, or revert state schema modifications
STATE_STORE_VALUE_SCHEMA_NOT_COMPATIBLEâThe provided value schema does not match existing schema in operator state.
Existing schema=<storedValueSchema>; provided schema=<newValueSchema>.
To run the query without schema validation, set spark.sql.streaming.stateStore.stateSchemaCheck to false.
Note that running without schema validation can have non-deterministic behavior.
STATE_STORE_VARIABLE_SIZE_ORDERING_COLS_NOT_SUPPORTEDâVariable size ordering column with name=<fieldName> at index=<index> is not supported for range scan encoder.
Static partition column <staticName> is also specified in the column list.
No committed batch found, checkpoint location: <checkpointLocation>. Ensure that the query has run and committed any microbatch before stopping.
The options <options> cannot be specified together. Please specify the one.
Failed to read the operator metadata for checkpointLocation=<checkpointLocation> and batchId=<batchId>.
Either the file does not exist, or the file is corrupted.
Rerun the streaming query to construct the operator metadata, and report to the corresponding communities or vendors if the error persists.
STDS_FAILED_TO_READ_STATE_SCHEMAâFailed to read the state schema. Either the file does not exist, or the file is corrupted. options: <sourceOptions>.
Rerun the streaming query to construct the state schema, and report to the corresponding communities or vendors if the error persists.
STDS_INVALID_OPTION_VALUEâInvalid value for source option '<optionName>':
For more details see STDS_INVALID_OPTION_VALUE
STDS_NO_PARTITION_DISCOVERED_IN_STATE_STOREâThe state does not have any partition. Please double check that the query points to the valid state. options: <sourceOptions>
The offset log for <batchId> does not exist, checkpoint location: <checkpointLocation>.
Please specify the batch ID which is available for querying - you can query the available batch IDs via using state metadata data source.
STDS_OFFSET_METADATA_LOG_UNAVAILABLEâMetadata is not available for offset log for <batchId>, checkpoint location: <checkpointLocation>.
The checkpoint seems to be only run with older Spark version(s). Run the streaming query with the recent Spark version, so that Spark constructs the state metadata.
STDS_REQUIRED_OPTION_UNSPECIFIEDâ'<optionName>' must be specified.
Adaptive Query Execution is not supported for stateful operators in Structured Streaming.
STREAMING_FROM_MATERIALIZED_VIEWâCannot stream from materialized view <viewName>. Streaming from materialized views is not supported.
Invalid streaming output mode: <outputMode>.
For more details see STREAMING_OUTPUT_MODE
STREAMING_RATE_SOURCE_OFFSET_VERSION_MISMATCHâExpect rate source offset version <expectedVersion>, but got version <actualVersion>. To continue, set the option "version" to <expectedVersion> in the rate source options. For example, spark.readStream.format("rate").option("version", "<expectedVersion>").
The option "rampUpTime" is not supported by rate version 2. To use this option, set option "version" to 1. For example, spark.readStream.format("rate").option("version", "1").
STREAMING_REAL_TIME_MODEâStreaming real-time mode has the following limitation:
For more details see STREAMING_REAL_TIME_MODE
STREAMING_SINK_DELIVERY_MODEâInvalid streaming sink delivery mode: <deliveryMode>.
For more details see STREAMING_SINK_DELIVERY_MODE
STREAMING_STATEFUL_OPERATOR_NOT_MATCH_IN_STATE_METADATAâStreaming stateful operator name does not match with the operator in state metadata. This likely to happen when user adds/removes/changes stateful operator of existing streaming query.
Stateful operators in the metadata: [<OpsInMetadataSeq>]; Stateful operators in current batch: [<OpsInCurBatchSeq>].
streaming table <tableName> needs to be refreshed to execute <operation>.
If the table is created from DBSQL, please run REFRESH STREAMING TABLE.
If the table is created by a pipeline in DLTs, please run a pipeline update.
STREAMING_TABLE_NOT_SUPPORTEDâstreaming tables can only be created and refreshed in DLTs and Databricks SQL Warehouses.
STREAMING_TABLE_OPERATION_NOT_ALLOWEDâThe operation <operation> is not allowed:
For more details see STREAMING_TABLE_OPERATION_NOT_ALLOWED
STREAMING_TABLE_QUERY_INVALIDâstreaming table <tableName> can only be created from a streaming query. Please add the STREAM keyword to your FROM clause to turn this relation into a streaming query.
Kinesis stream <streamName> in <region> not found.
Please start a new query pointing to the correct stream name.
STRUCT_ARRAY_LENGTH_MISMATCHâInput row doesn't have expected number of values required by the schema. <expected> fields are required while <actual> values are provided.
The sum of the LIMIT clause and the OFFSET clause must not be greater than the maximum 32-bit integer value (2,147,483,647) but found limit = <limit>, offset = <offset>.
Repair table sync metadata command is only supported for delta table.
SYNC_SRC_TARGET_TBL_NOT_SAMEâSource table name <srcTable> must be same as destination table name <destTable>.
Support of the clause or keyword: <clause> has been discontinued in this context.
For more details see SYNTAX_DISCONTINUED
TABLE_OR_VIEW_ALREADY_EXISTSâCannot create table or view <relationName> because it already exists.
Choose a different name, drop the existing object, add the IF NOT EXISTS clause to tolerate pre-existing objects, add the OR REPLACE clause to replace the existing materialized view, or add the OR REFRESH clause to refresh the existing streaming table.
The table or view <relationName> cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS.
For more details see TABLE_OR_VIEW_NOT_FOUND
TABLE_VALUED_ARGUMENTS_NOT_YET_IMPLEMENTED_FOR_SQL_FUNCTIONSâCannot <action> SQL user-defined function <functionName> with TABLE arguments because this functionality is not yet implemented.
Failed to analyze the Python user defined table function: <msg>
Failed to evaluate the table function <functionName> because its table metadata <requestedMetadata>, but the function call <invalidFunctionCallProperty>.
Failed to evaluate the table function <functionName> because its table metadata was invalid; <reason>.
There are too many table arguments for table-valued function.
It allows one table argument, but got: <num>.
If you want to allow it, please set "spark.sql.allowMultipleTableArguments.enabled" to "true"
TABLE_WITH_ID_NOT_FOUNDâTable with ID <tableId> cannot be found. Verify the correctness of the UUID.
Task failed while writing rows to <path>.
Implicit temporary streaming checkpoint locations are not supported in the current workspace, please specify a checkpoint location explicitly.
For display(), set the checkpoint location using:
display(df, checkpointLocation = "your_path")
For all other streaming queries, use:
.option("checkpointLocation", "your_path").
TEMP_TABLE_CREATION_LEGACY_WITH_QUERYâCREATE TEMPORARY TABLE ... AS ... is not supported here, please use CREATE TEMPORARY VIEW instead
CREATE TEMPORARY TABLE does not support specifying <unsupportedSpec>, please create a permanent table instead.
Creating a session-local temporary table requires a single part table name, but got <tableName>. Please update the command to use a single part table name and retry again.
DROP TEMPORARY TABLE does not support specifying <unsupportedSpec>, please remove this specification, or drop a permanent table instead using DROP TABLE command.
Dropping a session-local temporary table requires a single part table name, but got <tableName>. Please update the DROP TEMPORARY TABLE command to use a single part table name to drop a temporary table, or use DROP TABLE command instead to drop a permanent table.
DROP TEMPORARY TABLE requires turning on V2 commands. Please set configuration "spark.sql.legacy.useV1Command" to false and retry.
Temporary table <tableName> cannot be found in the current session. Verify the spelling and correctness of the table name, and retry the query or command again.
To tolerate the error on drop use DROP TEMP TABLE IF EXISTS.
Temporary table is not yet supported in Databricks Jobs. Please use in Databricks Notebooks instead and contact Databricks Support for more information.
TEMP_TABLE_NOT_SUPPORTED_WITH_HMSâTemporary table operation <operation> is not supported in Hive Metastore.
Operations on the session-local temporary table <tableName> are not supported:
For more details see TEMP_TABLE_OPERATION_NOT_SUPPORTED
TEMP_TABLE_OR_VIEW_ALREADY_EXISTSâCannot create the temporary table or view <relationName> because it already exists.
Choose a different name, drop the existing object, or add the IF NOT EXISTS clause to tolerate pre-existing objects.
Operations on session-local temporary tables requires Delta catalog to be enabled. Please turn on the Delta catalog and retry.
TEMP_TABLE_REQUIRES_UCâOperations on session-local temporary tables require Unity Catalog. Please enable Unity Catalog in your running environment and retry.
TEMP_VIEW_NAME_TOO_MANY_NAME_PARTSâCREATE TEMPORARY VIEW or the corresponding Dataset APIs only accept single-part view names, but got: <actualName>.
Trailing comma detected in SELECT clause. Remove the trailing comma before the FROM clause.
Transaction cannot commit as max commit timestamp is exceeded. maxCommitTimestamp:<maxCommitTimestampMs> commitTimestamp:<commitTimestampMs>
An error occurred in the user-defined function <function> of the StatefulProcessor. Reason: <reason>.
Number of rows exceeds the allowed limit of <maxValues> for TRANSPOSE. If this was intended, set <config> to at least the current row count.
Invalid index column for TRANSPOSE because: <reason>
Transpose requires non-index columns to share a least common type, but <dt1> and <dt2> do not.
The trigger interval must be a positive duration that can be converted into whole seconds. Received: <actual> seconds.
Due to Scala's limited support of tuple, empty tuple is not supported.
TUPLE_SIZE_EXCEEDS_LIMITâDue to Scala's limited support of tuple, tuples with more than 22 elements are not supported.
UC_BUCKETED_TABLESâBucketed tables are not supported in Unity Catalog.
UC_CATALOG_NAME_NOT_PROVIDEDâFor Unity Catalog, please specify the catalog name explicitly. E.g. SHOW GRANT your.address@email.com ON CATALOG main.
The command(s): <commandName> are not supported in Unity Catalog.
For more details see UC_COMMAND_NOT_SUPPORTED
UC_COMMAND_NOT_SUPPORTED_IN_SERVERLESSâThe command(s): <commandName> are not supported for Unity Catalog clusters in serverless. Use single user or shared clusters instead.
The command(s): <commandName> are not supported for Unity Catalog clusters in shared access mode. Use single user access mode instead.
Could not find a valid UC connection for accessing <path> after evaluating <connectionNames>.
Ensure that at least one valid UC connection is available for accessing the target path.
Detailed errors for the connections evaluated:
<connectionErrors>
The specified credential kind is not supported.
UC_DATASOURCE_NOT_SUPPORTEDâData source format <dataSourceFormatName> is not supported in Unity Catalog.
Data source options are not supported in Unity Catalog.
UC_DEPENDENCY_DOES_NOT_EXISTâDependency does not exist in Unity Catalog:
<errorMessage>
LOCATION clause must be present for external volume. Please check the syntax 'CREATE EXTERNAL VOLUME ... LOCATION ...' for creating an external volume.
The query failed because it attempted to refer to table <tableName> but was unable to do so: <failureReason>. Please update the table <tableName> to ensure it is in an Active provisioning state and then retry the query again.
Creating table in Unity Catalog with file scheme <schemeName> is not supported.
Instead, please create a federated data source connection using the CREATE CONNECTION command for the same table provider, then create a catalog based on the connection with a CREATE FOREIGN CATALOG command to reference the tables therein.
The operation attempted to use Hive Metastore, which is disabled due to legacy access being turned off in your account or workspace. Please double check the default catalog in current session and default namespace setting. If you need to access the Hive Metastore, please ask your admin to set up Hive Metastore federation through Unity Catalog.
UC_HIVE_METASTORE_FEDERATION_CROSS_CATALOG_VIEW_NOT_SUPPORTEDâHive Metastore Federation view does not support dependencies across multiple catalogs. View <view> in Hive Metastore Federation catalog must use dependency from hive_metastore or spark_catalog catalog but its dependency <dependency> is in another catalog <referencedCatalog>. Please update the dependencies to satisfy this constraint and then retry your query or command again.
Hive Metastore federation is not enabled on this cluster.
Accessing the catalog <catalogName> is not supported on this cluster
Dependencies of <viewName> are recorded as <storedDeps> while being parsed as <parsedDeps>. This likely occurred through improper use of a non-SQL API. You can repair dependencies in Databricks Runtime by running ALTER VIEW <viewName> AS <viewText>.
Nested or empty namespaces are not supported in Unity Catalog.
UC_INVALID_REFERENCEâNon-Unity-Catalog object <name> can't be referenced in Unity Catalog objects.
Unity Catalog Lakehouse Federation write support is not enabled for provider <provider> on this cluster.
Managed volume does not accept LOCATION clause. Please check the syntax 'CREATE VOLUME ...' for creating a managed volume.
Unity Catalog is not enabled on this cluster.
UC_QUERY_FEDERATION_NOT_ENABLEDâUnity Catalog Query Federation is not enabled on this cluster.
UC_RESOLVED_DBFS_PATH_MISMATCHâThe query failed because it attempted to refer to <objectType> <name> but was unable to do so: Resolved DBFS path <resolvedHmsPath> does not match Unity Catalog storage location <ucStorageLocation>.
Service credentials are not enabled on this cluster.
UC_VOLUMES_NOT_ENABLEDâSupport for Unity Catalog Volumes is not enabled on this instance.
UC_VOLUMES_SHARING_NOT_ENABLEDâSupport for Volume Sharing is not enabled on this instance.
UC_VOLUME_NOT_FOUNDâVolume <name> does not exist. Please use 'SHOW VOLUMES' to list available volumes.
Failed to install UDF dependencies for <udfName> due to a system error.
For more details see UDF_ENVIRONMENT_ERROR
UDF_ENVIRONMENT_USER_ERRORâFailed to install UDF dependencies for <udfName>.
For more details see UDF_ENVIRONMENT_USER_ERROR
UDF_ERRORâSQLSTATE: none assigned
Execution of function <fn> failed
For more details see UDF_ERROR
UDF_LIMITSâOne or more UDF limits were breached.
For more details see UDF_LIMITS
UDF_MAX_COUNT_EXCEEDEDâExceeded query-wide UDF limit of <maxNumUdfs> UDFs (limited during public preview). Found <numUdfs>. The UDFs were: <udfNames>.
Python worker exited unexpectedly
For more details see UDF_PYSPARK_ERROR
UDF_PYSPARK_UNSUPPORTED_TYPEâPySpark UDF <udf> (<eval-type>) is not supported on clusters in Shared access mode.
Execution failed.
For more details see UDF_PYSPARK_USER_CODE_ERROR
UDF_UNSUPPORTED_PARAMETER_DEFAULT_VALUEâParameter default value is not supported for user-defined <functionType> function.
Execution of function <fn> failed.
For more details see UDF_USER_CODE_ERROR
UDTF_ALIAS_NUMBER_MISMATCHâThe number of aliases supplied in the AS clause does not match the number of columns output by the UDTF.
Expected <aliasesSize> aliases, but got <aliasesNames>.
Please ensure that the number of aliases provided matches the number of columns output by the UDTF.
UDTF_INVALID_ALIAS_IN_REQUESTED_ORDERING_STRING_FROM_ANALYZE_METHODâFailed to evaluate the user-defined table function because its 'analyze' method returned a requested OrderingColumn whose column name expression included an unnecessary alias <aliasName>; please remove this alias and then try the query again.
Failed to evaluate the user-defined table function because its 'analyze' method returned a requested 'select' expression (<expression>) that does not include a corresponding alias; please update the UDTF to specify an alias there and then try the query again.
Unable to acquire <requestedBytes> bytes of memory, got <receivedBytes>.
Unable to convert SQL type <toType> to Protobuf type <protobufType>.
Unable to fetch tables of Hive database: <dbName>. Error Class Name: <className>.
Unable to infer schema for <format>. It must be specified manually.
Unauthorized access:
<report>
Found the unbound parameter: <name>. Please, fix args and provide a mapping of the parameter to either a SQL literal or collection constructor functions such as map(), array(), struct().
Found an unclosed bracketed comment. Please, append */ at the end of the comment.
UNEXPECTED_INPUT_TYPEâParameter <paramIndex> of function <functionName> requires the <requiredType> type, however <inputSql> has the type <inputType>.
The <namedParamKey> parameter of function <functionName> requires the <requiredType> type, however <inputSql> has the type <inputType>.<hint>
Unexpected operator <op> in the CREATE VIEW statement as a streaming source.
A streaming view query must consist only of SELECT, WHERE, and UNION ALL operations.
Cannot invoke routine <routineName> because it contains positional argument(s) following the named argument assigned to <parameterName>; please rearrange them so the positional arguments come first and then retry the query again.
The class <className> has an unexpected expression serializer. Expects "STRUCT" or "IF" which returns "STRUCT" but found <expr>.
The UNION operator is not yet supported within recursive common table expressions (WITH clauses that refer to themselves, directly or indirectly). Please use UNION ALL instead.
Unique constraint feature is disabled. To enable it, set "spark.databricks.sql.dsv2.unique.enabled" as true.
UNKNOWN_FIELD_EXCEPTIONâEncountered <changeType> during parsing: <unknownFieldBlob>, which can be fixed by an automatic retry: <isRetryable>
For more details see UNKNOWN_FIELD_EXCEPTION
UNKNOWN_POSITIONAL_ARGUMENTâThe invocation of routine <routineName> contains an unknown positional argument <sqlExpr> at position <pos>. This is invalid.
Unknown primitive type with id <id> was found in a variant value.
Attempting to treat <descriptorName> as a Message, but it was <containingType>.
UNPIVOT requires all given <given> expressions to be columns when no <empty> expressions are given. These are not columns: [<expressions>].
At least one value column needs to be specified for UNPIVOT, all columns specified as ids.
Unpivot value columns must share a least common type, some types do not: [<types>].
All unpivot value columns must have the same size as there are value column names (<names>).
Cannot invoke routine <routineName> because the routine call included a named argument reference for the argument named <argumentName>, but this routine does not include any signature containing an argument with this name. Did you mean one of the following? [<proposal>].
Unrecognized SQL type - name: <typeName>, id: <jdbcType>.
The statistic <stats> is not recognized. Valid statistics include count, count_distinct, approx_count_distinct, mean, stddev, min, max, and percentile values. Percentile must be a numeric value followed by '%', within the range 0% to 100%.
Could not resolve <name> to a table-valued function.
Please make sure that <name> is defined as a table-valued function and that all required parameters are provided correctly.
If <name> is not defined, please create the table-valued function before using it.
For more information about defining table-valued functions, please refer to the Apache Spark documentation.
UNRESOLVED_ALL_IN_GROUP_BYâCannot infer grouping columns for GROUP BY ALL based on the select clause. Please explicitly specify the grouping columns.
A column, variable, or function parameter with name <objectName> cannot be resolved.
For more details see UNRESOLVED_COLUMN
UNRESOLVED_FIELDâA field with name <fieldName> cannot be resolved with the struct-type column <columnPath>.
For more details see UNRESOLVED_FIELD
UNRESOLVED_INSERT_REPLACE_USING_COLUMNâREPLACE USING column <colName> cannot be resolved in the <relationType>.
Did you mean one of the following column(s)? [<suggestion>].
Cannot resolve column <objectName> as a map key. If the key is a string literal, add the single quotes '' around it.
For more details see UNRESOLVED_MAP_KEY
UNRESOLVED_ROUTINEâCannot resolve routine <routineName> on search path <searchPath>.
Verify the spelling of <routineName>, check that the routine exists, and confirm you have USE privilege on the catalog and schema, and EXECUTE on the routine.
For more details see UNRESOLVED_ROUTINE
UNRESOLVED_USING_COLUMN_FOR_JOINâUSING column <colName> cannot be resolved on the <side> side of the join. The <side>-side columns: [<suggestion>].
Cannot resolve variable <variableName> on search path <searchPath>.
Unstructured file format <format> is not supported. Supported file formats are <supportedFormats>.
Please update the format from your <expr> expression to one of the supported formats and then retry the query again.
Unstructured model option ('<option>' -> '<value>') is not supported. Supported values are: <supportedValues>.
Switch to one of the supported values and then retry the query again.
UNSTRUCTURED_OCR_COLUMN_NOT_ALLOWED_WITH_METADATA_MODEL_OPTIONâThe function parameter 'ocrText' must be NULL or omitted when the 'metadataModel' option is specified. A specified 'metadataModel' option triggers metadata extraction, where a provided 'ocrText' is forbidden.
Don't support add file.
For more details see UNSUPPORTED_ADD_FILE
UNSUPPORTED_ALTER_COLUMN_PARAMETERâSpecifying <parameter> with ALTER <commandTableType> is not supported.
Unsupported arrow type <typeName>.
The function <funcName> does not support batch queries.
Cannot call the method "<methodName>" of the class "<className>".
For more details see UNSUPPORTED_CALL
UNSUPPORTED_CHAR_OR_VARCHAR_AS_STRINGâThe char/varchar type can't be used in the table schema.
If you want Spark treat them as string type as same as Spark 3.0 and earlier, please set "spark.sql.legacy.charVarcharAsString" to "true".
UNSUPPORTED_CHAR_OR_VARCHAR_COLLATIONâThe char/varchar type <type> cannot have collation specified.
The <clause> is not supported for <operation>.
Collation <collationName> is not supported for:
For more details see UNSUPPORTED_COLLATION
UNSUPPORTED_COMMON_ANCESTOR_LOC_FOR_FILE_STREAM_SOURCEâThe common ancestor of source path and sourceArchiveDir should be registered with UC.
If you see this error message, it's likely that you register the source path and sourceArchiveDir in different external locations.
Please put them into a single external location.
UNSUPPORTED_CONNECT_FEATUREâFeature is not supported in Spark Connect:
For more details see UNSUPPORTED_CONNECT_FEATURE
UNSUPPORTED_CONSTRAINT_CHARACTERISTICâConstraint characteristic '<characteristic>' is not supported for constraint type '<constraintType>'.
Constraint clauses <clauses> are unsupported.
Unsupported constraint type. Only <supportedConstraintTypes> are supported
Unsupported data source type for direct query on files: <dataSourceType>
Unsupported data type <typeName>.
The data source "<source>" cannot be written in the <createMode> mode. Please use either the "Append" or "Overwrite" mode instead.
The <format> datasource doesn't support the column <columnName> of the type <columnType>.
Cannot create encoder for <dataType>. Please use a different output data type for your UDF or DataFrame.
DEFAULT column values is not supported.
For more details see UNSUPPORTED_DEFAULT_VALUE
UNSUPPORTED_DESERIALIZERâThe deserializer is not supported:
For more details see UNSUPPORTED_DESERIALIZER
UNSUPPORTED_EXPRESSION_GENERATED_COLUMNâCannot create generated column <fieldName> with generation expression <expressionStr> because <reason>.
A query operator contains one or more unsupported expressions.
Consider to rewrite it to avoid window functions, aggregate functions, and generator functions in the WHERE clause.
Invalid expressions: [<invalidExprSqls>]
A query parameter contains unsupported expression.
Parameters can either be variables or literals.
Invalid expression: [<invalidExprSql>]
Expression <sqlExpr> not supported within a window function.
The feature is not supported:
For more details see UNSUPPORTED_FEATURE
UNSUPPORTED_FN_TYPEâUnsupported user defined function type: <language>
The generator is not supported:
For more details see UNSUPPORTED_GENERATOR
UNSUPPORTED_GROUPING_EXPRESSIONâgrouping()/grouping_id() can only be used with GroupingSets/Cube/Rollup.
UNSUPPORTED_INITIAL_POSITION_AND_TRIGGER_PAIR_FOR_KINESIS_SOURCEâ<trigger> with initial position <initialPosition> is not supported with the Kinesis source
Can't insert into the target.
For more details see UNSUPPORTED_INSERT
UNSUPPORTED_JOIN_TYPEâUnsupported join type '<typ>'. Supported join types include: <supported>.
Creating a managed table <tableName> using datasource <dataSource> is not supported. You need to use datasource DELTA or create an external table using CREATE EXTERNAL TABLE <tableName> ... USING <dataSource> ...
MERGE operation contains unsupported <condName> condition.
For more details see UNSUPPORTED_MERGE_CONDITION
UNSUPPORTED_NESTED_ROW_OR_COLUMN_ACCESS_POLICYâTable <tableName> has a row level security policy or column mask which indirectly refers to another table with a row level security policy or column mask; this is not supported. Call sequence: <callSequence>
Operation <operation> is not supported for continuous memory sink. If you are writing a test for Streaming Real-Time Mode, consider using CheckAnswerWithTimeout over other checks.
Can't overwrite the target that is also being read from.
For more details see UNSUPPORTED_OVERWRITE
UNSUPPORTED_PARTITION_TRANSFORMâUnsupported partition transform: <transform>. The supported transforms are identity, bucket, and clusterBy. Ensure your transform expression uses one of these.
Procedure <procedureName> must specify or inherit DEFAULT COLLATION UTF8_BINARY. Use CREATE PROCEDURE <procedureName> (...) DEFAULT COLLATION UTF_BINARY ....
The save mode <saveMode> is not supported for:
For more details see UNSUPPORTED_SAVE_MODE
UNSUPPORTED_SHOW_CREATE_TABLEâUnsupported a SHOW CREATE TABLE command.
For more details see UNSUPPORTED_SHOW_CREATE_TABLE
UNSUPPORTED_SINGLE_PASS_ANALYZER_FEATUREâThe single-pass analyzer cannot process this query or command because it does not yet support <feature>.
Using SQL function <functionName> in <nodeName> is not supported.
<outputMode> output mode not supported for <statefulOperator> on streaming DataFrames/DataSets without watermark.
Unsupported for streaming a view. Reason:
For more details see UNSUPPORTED_STREAMING_OPTIONS_FOR_VIEW
UNSUPPORTED_STREAMING_OPTIONS_PERMISSION_ENFORCEDâStreaming options <options> are not supported for data source <source> on a shared cluster. Please confirm that the options are specified and spelled correctly, and check https://docs.databricks.com/en/compute/access-mode-limitations.html#streaming-limitations-and-requirements-for-unity-catalog-shared-access-mode for limitations.
Data source <sink> is not supported as a streaming sink on a shared cluster.
Data source <source> is not supported as a streaming source on a shared cluster.
The function <funcName> does not support streaming. Please remove the STREAM keyword
<streamReadLimit> is not supported with the Kinesis source
Unsupported subquery expression:
For more details see UNSUPPORTED_SUBQUERY_EXPRESSION_CATEGORY
UNSUPPORTED_TABLE_CHANGE_IN_JDBC_CATALOGâThe table change <change> is not supported for the JDBC catalog on table <tableName>. Supported changes include: AddColumn, RenameColumn, DeleteColumn, UpdateColumnType, UpdateColumnNullability.
Creating primary key with timeseries columns is not supported
UNSUPPORTED_TIMESERIES_WITH_MORE_THAN_ONE_COLUMNâCreating primary key with more than one timeseries column <colSeq> is not supported
The seconds precision <precision> of the TIME data type is out of the supported range [0, 6].
The data type TIME is not supported.
UNSUPPORTED_TRIGGER_FOR_KINESIS_SOURCEâ<trigger> is not supported with the Kinesis source
Literals of the type <unsupportedType> are not supported. Supported types are <supportedTypes>.
The function <function> uses the following feature(s) that require a newer version of Databricks runtime: <features>. Please consult <docLink> for details.
UDF types cannot be used together: <types>
You're using untyped Scala UDF, which does not have the input type information.
Spark may blindly pass null to the Scala closure with primitive-type argument, and the closure will see the default value of the Java type for the null argument, e.g. udf((x: Int) => x, IntegerType), the result is 0 for null input. To get rid of this error, you could:
use typed Scala UDF APIs(without return type parameter), e.g. udf((x: Int) => x).
use Java UDF APIs, e.g. udf(new UDF1[String, Integer] { override def call(s: String): Integer = s.length() }, IntegerType), if input types are all non primitive.
set "spark.sql.legacy.allowUntypedScalaUDF" to "true" and use this API with caution.
Table is not eligible for upgrade from Hive Metastore to Unity Catalog. Reason:
For more details see UPGRADE_NOT_SUPPORTED
USER_DEFINED_FUNCTIONSâUser defined function is invalid:
For more details see USER_DEFINED_FUNCTIONS
USER_RAISED_EXCEPTIONâ<errorMessage>
The raise_error() function was used to raise error class: <errorClass> which expects parameters: <expectedParms>.
The provided parameters <providedParms> do not match the expected parameters.
Please make sure to provide all expected parameters.
USER_RAISED_EXCEPTION_UNKNOWN_ERROR_CLASSâThe raise_error() function was used to raise an unknown error class: <errorClass>
Cannot create the variable <variableName> because it already exists.
Choose a different name, or drop or replace the existing variable.
VARIABLE_NOT_FOUNDâThe variable <variableName> cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema and catalog, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VARIABLE IF EXISTS.
Cannot construct a Variant larger than 16 MiB. The maximum allowed size of a Variant value is 16 MiB.
VARIANT_DUPLICATE_KEYâFailed to build variant because of a duplicate object key <key>.
Cannot build variant bigger than <sizeLimit> in <functionName>.
Please avoid large input strings to this expression (for example, add function calls(s) to check the expression size and convert it to NULL first if it is too big).
The source table history contains table feature(s) not supported by versioned clone in this DBR version: <unsupportedFeatureNames>.
Please upgrade to a newer DBR version.
VIEW_ALREADY_EXISTSâCannot create view <relationName> because it already exists.
Choose a different name, drop or replace the existing object, or add the IF NOT EXISTS clause to tolerate pre-existing objects.
The depth of view <viewName> exceeds the maximum view resolution depth (<maxNestedDepth>).
Analysis is aborted to avoid errors. If you want to work around this, please try to increase the value of "spark.sql.view.maxNestedViewDepth".
VIEW_NOT_FOUNDâThe view <relationName> cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS.
Cannot create volume <relationName> because it already exists.
Choose a different name, drop or replace the existing object, or add the IF NOT EXISTS clause to tolerate pre-existing objects.
Streaming watermark advancement strategy has the following limitation:
For more details see WATERMARK_ADVANCEMENT_STRATEGY
WINDOW_FUNCTION_AND_FRAME_MISMATCHâ<funcName> function can only be evaluated in an ordered row-based window frame with a single offset: <windowExpr>.
Window function <funcName> requires an OVER clause.
WITH CREDENTIAL syntax is not supported for <type>.
writeStream can be called only on streaming Dataset/DataFrame.
Failed to execute the command because DEFAULT values are not supported when adding new
columns to previously existing Delta tables; please add the column without a default
value first, then run a second ALTER TABLE ALTER COLUMN SET DEFAULT command to apply
for future inserted rows instead.
WRONG_COLUMN_DEFAULTS_FOR_DELTA_FEATURE_NOT_ENABLEDâFailed to execute <commandType> command because it assigned a column DEFAULT value,
but the corresponding table feature was not enabled. Please retry the command again
after executing ALTER TABLE tableName SET
TBLPROPERTIES('delta.feature.allowColumnDefaults' = 'supported').
The operation <operation> requires a <requiredType>. But <objectName> is a <foundType>. Use <alternative> instead.
The <functionName> requires <expectedNum> parameters but the actual number is <actualNum>.
For more details see WRONG_NUM_ARGS
XML_ROW_TAG_MISSINGâ<rowTag> option is required for reading/writing files in XML format.
XML doesn't support <innerDataType> as inner type of <dataType>. Please wrap the <innerDataType> within a StructType field when using it inside <dataType>.
Rescued data and wildcard column cannot be simultaneously enabled. Remove the wildcardColumnName option.
ZORDERBY_COLUMN_DOES_NOT_EXISTâZOrderBy column <columnName> doesn't exist.
Could not find active SparkSession.
DELTA_ACTIVE_TRANSACTION_ALREADY_SETâCannot set a new txn as active when one is already active.
DELTA_ADDING_COLUMN_WITH_INTERNAL_NAME_FAILEDâFailed to add column <colName> because the name is reserved.
The current operation attempted to add a deletion vector to a table that does not permit the creation of new deletion vectors. Please file a bug report.
DELTA_ADDING_DELETION_VECTORS_WITH_TIGHT_BOUNDS_DISALLOWEDâAll operations that add deletion vectors should set the tightBounds column in statistics to false. Please file a bug report.
DELTA_ADD_COLUMN_AT_INDEX_LESS_THAN_ZEROâIndex <columnIndex> to add column <columnName> is lower than 0.
Cannot add <columnName> because its parent is not a StructType. Found <other>.
Struct not found at position <position>.
Please use ALTER TABLE ADD CONSTRAINT to add CHECK constraints.
Found <sqlExpr>. A generated column cannot use an aggregate expression.
Aggregate functions are not supported in the <operation> <predicate>.
Failed to change the collation of column <column> because it has a bloom filter index. Please either retain the existing collation or else drop the bloom filter index and then retry the command again to change the collation.
Failed to change the collation of column <column> because it is a clustering column. Please either retain the existing collation or else change the column to a non-clustering column with an ALTER TABLE command and then retry the command again to change the collation.
ALTER TABLE CHANGE COLUMN is not supported for changing column <currentType> to <newType>.
ALTER TABLE CLUSTER BY is supported only for Delta table with Liquid clustering.
ALTER TABLE CLUSTER BY cannot be applied to a partitioned table.
Operation not allowed: ALTER TABLE RENAME TO is not allowed for managed Delta tables on S3, as eventual consistency on S3 may corrupt the Delta transaction log. If you insist on doing so and are sure that there has never been a Delta table with the new name <newName> before, you can enable this by setting <key> to be true.
Cannot enable <tableFeature> table feature using ALTER TABLE SET TBLPROPERTIES. Please use CREATE OR REPLACE TABLE CLUSTER BY to create a Delta table with clustering.
ALTER TABLE...SET MANAGED does not support Uniform Apache Iceberg table. Disable Uniform and try again.
ALTER TABLE <table> SET MANAGED failed.
For more details see DELTA_ALTER_TABLE_SET_MANAGED_FAILED
DELTA_ALTER_TABLE_SET_MANAGED_NOT_ENABLEDâALTER TABLE ... SET MANAGED command is not enabled. Contact your Databricks support team for assistance.
ALTER TABLE...UNSET MANAGED does not support Uniform. Disable Uniform and try again.
<table> cannot be rolled back from managed to external table.
For more details see DELTA_ALTER_TABLE_UNSET_MANAGED_FAILED
DELTA_ALTER_TABLE_UNSET_MANAGED_NOT_ENABLEDâALTER TABLE ... UNSET MANAGED command is not enabled. Contact your Databricks support team for assistance.
Cannot change data type of <column> from <from> to <to>. This change contains column removals and additions, therefore they are ambiguous. Please make these changes individually using ALTER TABLE [ADD | DROP | RENAME] COLUMN.
Ambiguous partition column <column> can be <colMatches>.
CREATE TABLE contains two different locations: <identifier> and <location>.
You can remove the LOCATION clause from the CREATE TABLE statement, or set
<config> to true to skip this check.
Table <table> does not contain enough records in non-archived files to satisfy specified LIMIT of <limit> records.
Found <numArchivedFiles> potentially archived file(s) in table <table> that need to be scanned as part of this query.
Archived files cannot be accessed. The current time until archival is configured as <archivalTime>.
Please adjust your query filters to exclude any archived files.
DELTA_BLOCK_COLUMN_MAPPING_AND_CDC_OPERATIONâOperation "<opName>" is not allowed when the table has enabled change data feed (CDF) and has undergone schema changes using DROP COLUMN or RENAME COLUMN.
Cannot drop bloom filter indices for the following non-existent column(s): <unknownColumns>.
OutOfMemoryError occurred while writing bloom filter indices for the following column(s): <columnsWithBloomFilterIndices>.
You can reduce the memory footprint of bloom filter indices by choosing a smaller value for the 'numItems' option, a larger value for the 'fpp' option, or by indexing fewer columns.
DELTA_CANNOT_CHANGE_DATA_TYPEâCannot change data type: <dataType>.
Cannot change the 'location' of the Delta table using SET TBLPROPERTIES. Please use ALTER TABLE SET LOCATION instead.
'provider' is a reserved table property, and cannot be altered.
DELTA_CANNOT_CREATE_BLOOM_FILTER_NON_EXISTING_COLâCannot create bloom filter indices for the following non-existent column(s): <unknownCols>.
Cannot create <path>.
Cannot describe the history of a view.
DELTA_CANNOT_DROP_BLOOM_FILTER_ON_NON_INDEXED_COLUMNâCannot drop bloom filter index on a non indexed column: <columnName>.
Cannot drop the CHECK constraints table feature.
The following constraints must be dropped first: <constraints>.
Cannot drop the collations table feature.
Columns with non-default collations must be altered to using UTF8_BINARY first: <colNames>.
Cannot drop the geospatial table feature. Recreate the table or drop columns with geometry/geography types: <colNames> and try again.
Cannot evaluate expression: <expression>.
Expecting a bucketing Delta table but cannot find the bucket spec in the table.
DELTA_CANNOT_GENERATE_CODE_FOR_EXPRESSIONâCannot generate code for expression: <expression>.
This table is configured to only allow appends. If you would like to permit updates or deletes, use 'ALTER TABLE <table_name> SET TBLPROPERTIES (<config> =false)'.
Cannot override or unset in-commit timestamp table properties because this table is catalog-owned. Remove "delta.enableInCommitTimestamps", "delta.inCommitTimestampEnablementVersion", and "delta.inCommitTimestampEnablementTimestamp" from the TBLPROPERTIES clause and then retry the command.
<Command> cannot override or unset in-commit timestamp table properties because coordinated commits is enabled in this table and depends on them. Please remove them ("delta.enableInCommitTimestamps", "delta.inCommitTimestampEnablementVersion", "delta.inCommitTimestampEnablementTimestamp") from the TBLPROPERTIES clause and then retry the command again.
The Delta table configuration <prop> cannot be specified by the user.
<Command> cannot override coordinated commits configurations for an existing target table. Please remove them ("delta.coordinatedCommits.commitCoordinator-preview", "delta.coordinatedCommits.commitCoordinatorConf-preview", "delta.coordinatedCommits.tableConf-preview") from the TBLPROPERTIES clause and then retry the command again.
A uri (<uri>) which can't be turned into a relative path was found in the transaction log.
A path (<path>) which can't be relativized with the current input found in the
transaction log. Please re-run this as:
%%scala com.databricks.delta.Delta.fixAbsolutePathsInLog("<userPath>", true)
and then also run:
%%scala com.databricks.delta.Delta.fixAbsolutePathsInLog("<path>")
Cannot rename <currentPath> to <newPath>.
Table <tableName> cannot be replaced as it does not exist. Use CREATE OR REPLACE TABLE to create the table.
Cannot resolve the clustering column <columnName> in <schema> due to an unexpected error. Run ALTER TABLE ... CLUSTER BY ... to repair Delta clustering metadata.
Can't resolve column <columnName> in <schema>
Cannot restore table to version <version>. Available versions: [<startVersion>, <endVersion>].
Cannot restore table to timestamp (<requestedTimestamp>) as it is before the earliest version available. Please use a timestamp after (<earliestTimestamp>).
Cannot restore table to timestamp (<requestedTimestamp>) as it is after the latest version available. Please use a timestamp before (<latestTimestamp>).
<Command> cannot set in-commit timestamp table properties together with coordinated commits, because the latter depends on the former and sets the former internally. Please remove them ("delta.enableInCommitTimestamps", "delta.inCommitTimestampEnablementVersion", "delta.inCommitTimestampEnablementTimestamp") from the TBLPROPERTIES clause and then retry the command again.
Cannot change the location of a path based table.
DELTA_CANNOT_SET_MANAGED_STATS_COLUMNS_PROPERTYâCannot set delta.managedDataSkippingStatsColumns on non-Lakeflow Declarative Pipelines table.
DELTA_CANNOT_SET_UC_COMMIT_COORDINATOR_CONF_IN_COMMANDâWhen enabling 'unity-catalog' as the commit coordinator, configuration "<configuration>" cannot be set from the command. Please remove it from the TBLPROPERTIES clause and then retry the command again.
When enabling 'unity-catalog' as the commit coordinator, configuration "<configuration>" cannot be set from the SparkSession configurations. Please unset it by running spark.conf.unset("<configuration>") and then retry the command again.
ALTER cannot unset coordinated commits configurations. To downgrade a table from coordinated commits, please try again using ALTER TABLE[table-name]DROP FEATURE 'coordinatedCommits-preview'.
Cannot update <tableName> field <fieldName> type: update the element by updating <fieldName>.element`.
Cannot update <tableName> field <fieldName> type: update a map by updating <fieldName>.keyor<fieldName>.value.
Cannot update <tableName> field of type <typeName>.
Cannot update <tableName> field <fieldName> type: update struct by adding, deleting, or updating its fields.
Cannot use all columns for partition columns.
DELTA_CANNOT_VACUUM_LITEâVACUUM LITE cannot delete all eligible files as some files are not referenced by the Delta log. Please run VACUUM FULL.
<table> is a view. Writes to a view are not supported.
Failed to write a value of <sourceType> type into the <targetType> type column <columnName> due to an overflow.
Use try_cast on the input value to tolerate overflow and return NULL instead.
If necessary, set <storeAssignmentPolicyFlag> to "LEGACY" to bypass this error or set <updateAndMergeCastingFollowsAnsiEnabledFlag> to true to revert to the old behaviour and follow <ansiEnabledFlag> in UPDATE and MERGE.
Configuration delta.enableChangeDataFeed cannot be set. Change data feed from Delta is not yet available.
DELTA_CDC_READ_NULL_RANGE_BOUNDARYâCDC read start/end parameters cannot be null. Please provide a valid version or timestamp.
DELTA_CHANGE_DATA_FEED_INCOMPATIBLE_DATA_SCHEMAâRetrieving table changes between version <start> and <end> failed because of an incompatible data schema.
Your read schema is <readSchema> at version <readVersion>, but we found an incompatible data schema at version <incompatibleVersion>.
If possible, please retrieve the table changes using the end version's schema by setting <config> to endVersion, or contact support.
Retrieving table changes between version <start> and <end> failed because of an incompatible schema change.
Your read schema is <readSchema> at version <readVersion>, but we found an incompatible schema change at version <incompatibleVersion>.
If possible, please query table changes separately from version <start> to <incompatibleVersion> - 1, and from version <incompatibleVersion> to <end>.
File <filePath> referenced in the transaction log cannot be found. This can occur when data has been manually deleted from the file system rather than using the table DELETE statement. This request appears to be targeting Change Data Feed, if that is the case, this error can occur when the change data file is out of the retention period and has been deleted by the VACUUM statement. For more information, see <faqPath>
Cannot write to table with delta.enableChangeDataFeed set. Change data feed from Delta is not available.
DELTA_CHECKPOINT_NON_EXIST_TABLEâCannot checkpoint a non-existing table <path>. Did you manually delete files in the _delta_log directory?
Two paths were provided as the CLONE target so it is ambiguous which to use. An external
location for CLONE was provided at <externalLocation> at the same time as the path
<targetIdentifier>.
The clone source has valid format, but has unsupported feature with Delta.
For more details see DELTA_CLONE_INCOMPATIBLE_SOURCE
DELTA_CLONE_INCOMPLETE_FILE_COPYâFile (<fileName>) not copied completely. Expected file size: <expectedSize>, found: <actualSize>. To continue with the operation by ignoring the file size check set <config> to false.
Unsupported <mode> clone source '<name>', whose format is <format>.
The supported formats are 'delta', 'iceberg' and 'parquet'.
DELTA_CLONE_WITH_HISTORY_UNSUPPORTED_SOURCEâUnsupported source table:
For more details see DELTA_CLONE_WITH_HISTORY_UNSUPPORTED_SOURCE
DELTA_CLONE_WITH_HISTORY_UNSUPPORTED_TARGETâUnsupported target table:
For more details see DELTA_CLONE_WITH_HISTORY_UNSUPPORTED_TARGET
DELTA_CLONE_WITH_ROW_TRACKING_WITHOUT_STATSâCannot shallow clone a table without statistics and with row tracking enabled.
If you want to enable row tracking you need to first collect statistics on the source table by running:
ANALYZE TABLE table_name COMPUTE DELTA STATISTICS
CLONE is not supported for Delta table with Liquid clustering for DBR version < 14.0.
CLUSTER BY is not supported because the following column(s): <columnsWithDataTypes> don't support data skipping.
The provided clustering columns do not match the existing table's.
provided: <providedClusteringColumns>
existing: <existingClusteringColumns>
Liquid clustering requires clustering columns to have stats. Couldn't find clustering column(s) '<columns>' in stats schema:
<schema>
Creating an external table without liquid clustering from a table directory with liquid clustering is not allowed; path: <path>.
'<operation>' does not support clustering.
Cannot finish the <phaseOutType> of the table with <tableFeatureToAdd> table feature (reason: <reason>). Please try the OPTIMIZE command again.
== Error ==
<error>
REPLACE a Delta table with Liquid clustering with a partitioned table is not allowed.
SHOW CREATE TABLE is not supported for Delta table with Liquid clustering without any clustering columns.
Transition a Delta table with Liquid clustering to a partitioned table is not allowed for operation: <operation>, when the existing table has non-empty clustering columns.
Please run ALTER TABLE CLUSTER BY NONE to remove the clustering columns first.
Dynamic partition overwrite mode is not allowed for Delta table with Liquid clustering.
DELTA_CLUSTERING_WITH_PARTITION_PREDICATEâOPTIMIZE command for Delta table with Liquid clustering doesn't support partition predicates. Please remove the predicates: <predicates>.
OPTIMIZE command for Delta table with Liquid clustering cannot specify ZORDER BY. Please remove ZORDER BY (<zOrderBy>).
The provided clusterByAuto value does not match that of the existing table.
DELTA_CLUSTER_BY_INVALID_NUM_COLUMNSâCLUSTER BY for Liquid clustering supports up to <numColumnsLimit> clustering columns, but the table has <actualNumColumns> clustering columns. Please remove the extra clustering columns.
It is not allowed to specify CLUSTER BY when the schema is not defined. Please define schema for table <tableName>.
Clustering and bucketing cannot both be specified. Please remove CLUSTERED BY INTO BUCKETS / bucketBy if you want to create a Delta table with clustering.
Clustering and partitioning cannot both be specified. Please remove PARTITIONED BY / partitionBy / partitionedBy if you want to create a Delta table with clustering.
Collations are not supported in Delta Lake.
DELTA_COLUMN_DATA_SKIPPING_NOT_SUPPORTED_PARTITIONED_COLUMNâData skipping is not supported for partition column '<column>'.
Data skipping is not supported for column '<column>' of type <type>.
The max column id property (<prop>) is not set on a column mapping enabled table.
The max column id property (<prop>) on a column mapping enabled table is <tableMax>, which cannot be smaller than the max column id for all fields (<fieldMax>).
The data type of the column <colName> was not provided.
Unable to find the column <columnName> given [<columnList>].
Unable to find the column '<targetCol>' of the target table from the INSERT columns: <colNames>. INSERT clause must specify value for all the columns of the target table.
Couldn't find column <columnName> in:
<tableSchema>
Expected <columnPath> to be a nested data type, but found <other>. Was looking for the
index of <column> in a nested field.
Schema:
<schema>
Struct column <source> cannot be inserted into a <targetType> field <targetField> in <targetTable>.
Cannot handle commit of table within redirect table state '<state>'.
The validation of the compaction of path <compactedPath> to <newPath> failed: Please file a bug report.
Found nested NullType in column <columName> which is of <dataType>. Delta doesn't support writing NullType in complex types.
ConcurrentAppendException: Files were added to <partition> by a concurrent update. <retryMsg> <conflictingCommit>
Refer to <docLink> for more details.
ConcurrentDeleteDeleteException: This transaction attempted to delete one or more files that were deleted (for example <file>) by a concurrent update. Please try the operation again.<conflictingCommit>
Refer to <docLink> for more details.
ConcurrentDeleteReadException: This transaction attempted to read one or more files that were deleted (for example <file>) by a concurrent update. Please try the operation again.<conflictingCommit>
Refer to <docLink> for more details.
ConcurrentTransactionException: This error occurs when multiple streaming queries are using the same checkpoint to write into this table. Did you run multiple instances of the same streaming query at the same time?<conflictingCommit>
Refer to <docLink> for more details.
ConcurrentWriteException: A concurrent transaction has written new data because the current transaction read the table. Please try the operation again.<conflictingCommit>
Refer to <docLink> for more details.
There is a conflict from these SET columns: <columnList>.
During <command>, configuration "<configuration>" cannot be set from the command. Please remove it from the TBLPROPERTIES clause and then retry the command again.
During <command>, configuration "<configuration>" cannot be set from the SparkSession configurations. Please unset it by running spark.conf.unset("<configuration>") and then retry the command again.
Constraint '<constraintName>' already exists. Please delete the old constraint first.
Old constraint:
<oldConstraint>
Column <columnName> has data type <columnType> and cannot be altered to data type <dataType> because this column is referenced by the following check constraint(s):
<constraints>
Cannot alter column <columnName> because this column is referenced by the following check constraint(s):
<constraints>
Cannot drop nonexistent constraint <constraintName> from table <tableName>. To avoid throwing an error, provide the parameter IF EXISTS or set the SQL session configuration <config> to <confValue>.
Conversion of Merge-On-Read <format> table is not supported: <path>, <hint>
Found no partition information in the catalog for table <tableName>. Have you run "MSCK REPAIR TABLE" on your table to discover partitions?
Cannot convert Parquet table with collated partition column <colName> to Delta.
The configuration '<config>' cannot be set to <mode> when using CONVERT TO DELTA.
Unsupported schema changes found for <format> table: <path>, <hint>
CONVERT TO DELTA only supports parquet tables, but you are trying to convert a <sourceName> source: <tableId>.
Cannot enable row tracking without collecting statistics.
If you want to enable row tracking, do the following:
SET <statisticsCollectionPropertyKey> = true
CONVERT TO DELTA without the NO STATISTICS option.If you do not want to collect statistics, disable row tracking:
RESET <rowTrackingTableFeatureDefaultKey>
SET <rowTrackingDefaultPropertyKey> = false
COPY INTO target must be a Delta table.
You are trying to create an external table <tableName>
from <path> using Delta, but the schema is not specified when the
input path is empty.
To learn more about Delta, see <docLink>
You are trying to create an external table <tableName> from <path> using Delta, but there is no transaction log present at <logPath>. Check the upstream job to make sure that it is writing using format("delta") and that the path is the root of the table.
To learn more about Delta, see <docLink>
Creating path-based Delta table with a different location isn't supported. Identifier: <identifier>, Location: <location>.
Table name or location has to be specified.
DELTA_CREATE_TABLE_SCHEME_MISMATCHâThe specified schema does not match the existing schema at <path>.
== Specified ==
<specifiedSchema>
== Existing ==
<existingSchema>
== Differences ==
<schemaDifferences>
If your intention is to keep the existing schema, you can omit the
schema from the create table command. Otherwise please ensure that
the schema matches.
DELTA_CREATE_TABLE_SET_CLUSTERING_TABLE_FEATURE_NOT_ALLOWEDâCannot enable <tableFeature> table feature using TBLPROPERTIES. Please use CREATE OR REPLACE TABLE CLUSTER BY to create a Delta table with clustering.
The specified clustering columns do not match the existing clustering columns at <path>.
== Specified ==
<specifiedColumns>
== Existing ==
<existingColumns>
The specified partitioning does not match the existing partitioning at <path>.
== Specified ==
<specifiedColumns>
== Existing ==
<existingColumns>
The specified properties do not match the existing properties at <path>.
== Specified ==
<specifiedProperties>
== Existing ==
<existingProperties>
Cannot create table ('<tableId>'). The associated location ('<tableLocation>') is not empty and also not a Delta table.
Cannot change table metadata because the 'dataChange' option is set to false. Attempted operation: '<op>'.
File <filePath> referenced in the transaction log cannot be found. This parquet file may be deleted under Delta's data retention policy.
Default Delta data retention duration: <logRetentionPeriod>. Modification time of the parquet file: <modificationTime>. Deletion time of the parquet file: <deletionTime>. Deleted on Delta version: <deletionVersion>.
It is invalid to commit files with deletion vectors that are missing the numRecords statistic.
DELTA_DISABLE_SOURCE_MATERIALIZATION_IN_INSERT_REPLACE_ON_OR_USING_NOT_ALLOWEDâDisabling source materialization in INSERT REPLACE ON/USING by setting 'spark.databricks.delta.insertReplaceOnOrUsing.materializeSource' to 'none' is not allowed.
Disabling source materialization in MERGE by setting 'spark.databricks.delta.merge.materializeSource' to 'none' is not allowed.
Detected DomainMetadata action(s) for domains <domainNames>, but DomainMetadataTableFeature is not enabled.
Index <columnIndex> to drop column is lower than 0.
Cannot drop column from a schema with a single column. Schema:
<schema>
File operation '<actionType>' for path <path> was specified several times.
It conflicts with <conflictingPath>.
It is not valid for multiple file operations with the same path to exist in a single commit.
DELTA_DUPLICATE_COLUMNS_FOUNDâFound duplicate column(s) <coltype>: <duplicateCols>.
Duplicate column names in INSERT clause.
<message>
Please remove duplicate columns before you update your table.
DELTA_DUPLICATE_DATA_SKIPPING_COLUMNSâDuplicated data skipping columns found: <columns>.
Internal error: two DomainMetadata actions within the same transaction have the same domain <domainName>.
The Delta log is in an illegal state: <numDuplicates> paths have duplicate entries in version <version>. RESTORE to a version before the commit that introduced the duplication or contact support for assistance.
Could not deserialize the deleted record counts histogram during table integrity verification.
DELTA_DYNAMIC_PARTITION_OVERWRITE_DISABLEDâDynamic partition overwrite mode is specified by session config or write options, but it is disabled by spark.databricks.delta.dynamicPartitionOverwrite.enabled=false.
Data used in creating the Delta table doesn't have any columns.
DELTA_EMPTY_DIRECTORYâNo file found in the directory: <directory>.
Value "<value>" exceeds char/varchar type length limitation. Failed check: <expr>.
Failed to cast partition value <value> to <dataType>.
Could not find <newAttributeName> among the existing target output <targetOutputColumns>.
Failed to infer schema from the given list of files.
DELTA_FAILED_MERGE_SCHEMA_FILEâFailed to merge schema of file <file>:
<schema>
Failed to run the operation on the source table <sourceTable> because the shallow clone <targetTable> still exists and the following error occurred in the shallow clone: <message>
Could not read footer for file: <currentFile>.
Cannot recognize the predicate '<predicate>'.
Expect a full scan of the latest version of the Delta source, but found a historical scan of version <historicalVersion>.
Failed to merge fields '<currentField>' and '<updateField>'.
Unable to operate on this table because the following table features are enabled in metadata but not listed in protocol: <features>.
Your table schema requires manually enablement of the following table feature(s): <unsupportedFeatures>.
To do this, run the following command for each of features listed above:
ALTER TABLE table_name SET TBLPROPERTIES ('delta.feature.feature_name' = 'supported')
Replace "table_name" and "feature_name" with real values.
Current supported feature(s): <supportedFeatures>.
Could not drop the Checkpoint Protection feature.
This feature can only be dropped by truncating history.
Please try again with the TRUNCATE HISTORY option:
ALTER TABLE table_name DROP FEATURE checkpointProtection TRUNCATE HISTORY
Dropping <featureName> failed due to a failure in checkpoint creation.
Please try again later. It the issue persists, contact Databricks support.
DELTA_FEATURE_DROP_CHECKPOINT_PROTECTION_WAIT_FOR_RETENTION_PERIODâThe operation did not succeed because there are still traces of dropped features
in the table history. CheckpointProtection cannot be dropped until these historical
versions have expired.
To drop CheckpointProtection, please wait for the historical versions to
expire, and then repeat this command. The retention period for historical versions is
currently configured to <truncateHistoryLogRetentionPeriod>.
Cannot drop feature because a concurrent transaction modified the table.
Please try the operation again.
<concurrentCommit>
Cannot drop table feature <feature> because some other features (<dependentFeatures>) in this table depends on <feature>.
Consider dropping them first before dropping this feature.
DELTA_FEATURE_DROP_FEATURE_IS_DELTA_PROPERTYâCannot drop <property> from this table because this is a delta table property and not a table feature.
Cannot drop <feature> from this table because it is not currently present in the table's protocol.
Cannot drop <feature> because the Delta log contains historical versions that use the feature.
Please wait until the history retention period (<logRetentionPeriodKey>=<logRetentionPeriod>)
has passed because the feature was last active.
Alternatively, please wait for the TRUNCATE HISTORY retention period to expire (<truncateHistoryLogRetentionPeriod>)
and then run:
ALTER TABLE table_name DROP FEATURE feature_name TRUNCATE HISTORY
The particular feature does not require history truncation.
DELTA_FEATURE_DROP_NONREMOVABLE_FEATUREâCannot drop <feature> because dropping this feature is not supported.
Please contact Databricks support.
DELTA_FEATURE_DROP_UNSUPPORTED_CLIENT_FEATUREâCannot drop <feature> because it is not supported by this Databricks version.
Consider using Databricks with a higher version.
DELTA_FEATURE_DROP_WAIT_FOR_RETENTION_PERIODâDropping <feature> was partially successful.
The feature is now no longer used in the current version of the table. However, the feature
is still present in historical versions of the table. The table feature cannot be dropped
from the table protocol until these historical versions have expired.
To drop the table feature from the protocol, please wait for the historical versions to
expire, and then repeat this command. The retention period for historical versions is
currently configured as <logRetentionPeriodKey>=<logRetentionPeriod>.
Alternatively, please wait for the TRUNCATE HISTORY retention period to expire (<truncateHistoryLogRetentionPeriod>)
and then run:
ALTER TABLE table_name DROP FEATURE feature_name TRUNCATE HISTORY
Unable to enable table feature <feature> because it requires a higher reader protocol version (current <current>). Consider upgrading the table's reader protocol version to <required>, or to a version which supports reader table features. Refer to <docLink> for more information on table protocol versions.
Unable to enable table feature <feature> because it requires a higher writer protocol version (current <current>). Consider upgrading the table's writer protocol version to <required>, or to a version which supports writer table features. Refer to <docLink> for more information on table protocol versions.
Existing file path <path>.
Cannot specify both file list and pattern string.
DELTA_FILE_NOT_FOUNDâFile path <path>.
File <filePath> referenced in the transaction log cannot be found. This occurs when data has been manually deleted from the file system rather than using the table DELETE statement. For more information, see <faqPath>
No such file or directory: <path>.
File (<path>) to be rewritten not found among candidate files:
<pathList>
A MapType was found. In order to access the key or value of a MapType, specify one
of:
<key> or
<value>
followed by the name of the column (only if that column is a struct type).
e.g. mymap.key.mykey
If the column is a basic type, mymap.key or mymap.value is sufficient.
Schema:
<schema>
Column <columnName> has data type <columnType> and cannot be altered to data type <dataType> because this column is referenced by the following generated column(s):
<generatedColumns>.
Cannot alter column <columnName> because this column is referenced by the following generated column(s):
<generatedColumns>.
The expression type of the generated column <columnName> is <expressionType>, but the column type is <columnType>.
Column <currentName> is a generated column or a column used by a generated column. The data type is <currentDataType> and cannot be converted to data type <updateDataType>.
Geospatial types are not supported in this version of Delta Lake.
DELTA_GEOSPATIAL_SRID_NOT_SUPPORTEDâGeospatial type has an unsupported srid: <srid>. Delta tables only support non-negative srid values.
The validation of IcebergCompatV<version> has failed.
For more details see DELTA_ICEBERG_COMPAT_VIOLATION
DELTA_ICEBERG_WRITER_COMPAT_VIOLATIONâThe validation of IcebergWriterCompatV<version> has failed.
For more details see DELTA_ICEBERG_WRITER_COMPAT_VIOLATION
DELTA_IDENTITY_COLUMNS_ALTER_COLUMN_NOT_SUPPORTEDâALTER TABLE ALTER COLUMN is not supported for IDENTITY columns.
ALTER TABLE ALTER COLUMN SYNC IDENTITY is only supported by Delta.
ALTER TABLE ALTER COLUMN SYNC IDENTITY cannot be called on non IDENTITY columns.
Providing values for GENERATED ALWAYS AS IDENTITY column <colName> is not supported.
IDENTITY column step cannot be 0.
IDENTITY columns are only supported by Delta.
PARTITIONED BY IDENTITY column <colName> is not supported.
ALTER TABLE REPLACE COLUMNS is not supported for table with IDENTITY columns.
DataType <dataType> is not supported for IDENTITY columns.
UPDATE on IDENTITY column <colName> is not supported.
IDENTITY column cannot be specified with a generated column expression.
Invalid value '<input>' for option '<name>', <explain>
The usage of <option> is not allowed when <operation> a Delta table.
BucketSpec on Delta bucketed table does not match BucketSpec from metadata. Expected: <expected>. Actual: <actual>.
(<setKeys>) cannot be set to different values. Please only set one of them, or set them to the same value.
Incorrectly accessing an ArrayType. Use arrayname.element.elementname position to
add to an array.
DELTA_INCORRECT_ARRAY_ACCESS_BY_NAMEâAn ArrayType was found. In order to access elements of an ArrayType, specify
<rightName> instead of <wrongName>.
Schema:
<schema>
Use getConf() instead of conf.getConf().
The error typically occurs when the default LogStore implementation, that
is, HDFSLogStore, is used to write into a Delta table on a non-HDFS storage system.
In order to get the transactional ACID guarantees on table updates, you have to use the
correct implementation of LogStore that is appropriate for your storage system.
See <docLink> for details.
Index <index> to drop column equals to or is larger than struct length: <length>.
Index <index> to add column <columnName> is larger than struct length: <length>.
Cannot write to '<tableName>', <columnName>; target table has <numColumns> column(s) but the inserted data has <insertColumns> column(s).
Column <columnName> is not specified in INSERT.
Column(s) <columnNames> are ambiguous in the condition of INSERT REPLACE ON. Consider specifying an alias for these columns.
Please contact your Databricks representative to enable the INSERT INTO ... REPLACE ON ... SQL and DataFrame APIs.
Column(s) <columnNames> cannot be resolved in the condition of INSERT REPLACE ON.
Invalid auto-compact type: <value>. Allowed values are: <allowed>.
Invalid bucket count: <invalidBucketCount>. Bucket count should be a positive number that is power of 2 and at least 8. You can use <validBucketCount> instead.
Cannot find the bucket column in the partition columns.
DELTA_INVALID_CALENDAR_INTERVAL_EMPTYâInterval cannot be null or blank.
DELTA_INVALID_CDC_RANGEâCDC range from start <start> to end <end> was invalid. End cannot be before start.
Attribute name "<columnName>" contains invalid character(s) among " ,;{}()\\n\\t=". Please use alias to rename it.
Found invalid character(s) among ' ,;{}()\n\t=' in the column names of your schema.
Invalid column names: <invalidColumnNames>.
Please use other characters and try again.
Alternatively, enable Column Mapping to keep using these characters.
DELTA_INVALID_CLONE_PATHâThe target location for CLONE needs to be an absolute path or table name. Use an
absolute path instead of <path>.
Found invalid character(s) among ' ,;{}()\n\t=' in the column names of your schema.
Invalid column names: <invalidColumnNames>.
Column mapping cannot be removed when there are invalid characters in the column names.
Please rename the columns to remove the invalid characters and execute this command again.
DELTA_INVALID_FORMATâIncompatible format detected.
A transaction log for Delta was found at <deltaRootPath>/_delta_log,
but you are trying to <operation> <path> using format("<format>"). You must use
'format("delta")' when reading and writing to a delta table.
To learn more about Delta, see <docLink>
A generated column cannot use a non-existent column or another generated column.
DELTA_INVALID_IDEMPOTENT_WRITES_OPTIONSâInvalid options for idempotent Dataframe writes: <reason>
<interval> is not a valid INTERVAL.
The schema for the specified INVENTORY does not contain all of the required fields. Required fields are: <expectedSchema>
invalid isolation level '<isolationLevel>'.
(<classConfig>) and (<schemeConfig>) cannot be set at the same time. Please set only one group of them.
You are trying to create a managed table <tableName>
using Delta, but the schema is not specified.
To learn more about Delta, see <docLink>
<columnName> is not a valid partition column in table <tableName>.
Found partition columns having invalid character(s) among " ,;{}()\n\t=". Please change the name to your partition columns. This check can be turned off by setting spark.conf.set("spark.databricks.delta.partitionColumnValidity.enabled", false) however this is not recommended as other features of Delta may not work properly.
Using column <name> of type <dataType> as a partition column is not supported.
A partition path fragment should be the form like part1=foo/part2=bar. The partition path: <path>.
Protocol version cannot be downgraded from (<oldProtocol>) to (<newProtocol>).
Unsupported Delta protocol version: table "<tableNameOrPath>" requires reader version <readerRequired> and writer version <writerRequired>, but this version of Databricks supports reader versions <supportedReaders> and writer versions <supportedWriters>. Please upgrade to a newer release.
Function <function> is an unsupported table valued function for CDC reads.
The provided timestamp <timestamp> does not match the expected syntax <format>.
A Delta log already exists at <path>.
Unable to retrieve the delta log files to construct table version <version> starting from checkpoint version <checkpointVersion> at <logPath>.
If you never deleted it, it's likely your query is lagging behind. Please delete its checkpoint to restart from scratch. To avoid this happening again, you can update your retention policy of your Delta table.
DELTA_MATERIALIZED_ROW_TRACKING_COLUMN_NAME_MISSINGâMaterialized <rowTrackingColumn> column name missing for <tableName>.
Please use a limit less than Int.MaxValue - 8.
DELTA_MAX_COMMIT_RETRIES_EXCEEDEDâThis commit has failed as it has been tried <numAttempts> times but did not succeed.
This can be caused by the Delta table being committed continuously by many concurrent
commits.
Commit started at version: <startVersion>
Commit failed at version: <failVersion>
Number of actions attempted to commit: <numActions>
Total time spent attempting this commit: <timeSpent> ms
File list must have at most <maxFileListSize> entries, had <numFiles>.
Cannot add column <newColumn> with type VOID. Please explicitly specify a non-void type.
Failed to merge incompatible data types <currentDataType> and <updateDataType>.
Failed to merge decimal types with incompatible <decimalRanges>.
Keeping the source of the MERGE statement materialized has failed repeatedly.
There must be at least one WHEN clause in a MERGE statement.
Resolved attribute(s) <missingAttributes> missing from <input> in operator <merge>.
The MERGE operation failed because (part of) the source plan was cached while the MERGE operation was running.
Unexpected assignment key: <unexpectedKeyClass> - <unexpectedKeyObject>.
Cannot resolve <sqlExpr> in <clause> given columns <cols>.
MetadataChangedException: The metadata of the Delta table has been changed by a concurrent update. Please try the operation again.<conflictingCommit>
Refer to <docLink> for more details.
Error getting change data for range [<startVersion> , <endVersion>] as change data was not
recorded for version [<version>]. If you've enabled change data feed on this table,
use DESCRIBE HISTORY to see when it was first enabled.
Otherwise, to start recording change data, use ALTER TABLE table_name SET TBLPROPERTIES
(<key>=true)`.
Cannot find <columnName> in table columns: <columnList>.
This table has the feature <featureName> enabled which requires the presence of the CommitInfo action in every commit. However, the CommitInfo action is missing from commit version <version>.
This table has the feature <featureName> enabled which requires the presence of commitTimestamp in the CommitInfo action. However, this field has not been set in commit version <version>.
<tableName> is not a Delta table.
Table doesn't exist. Create an empty Delta table first using CREATE TABLE <tableName>.
Apache Iceberg class was not found. Please ensure Delta Apache Iceberg support is installed.
Please refer to <docLink> for more details.
Column <columnName>, which has a NOT NULL constraint, is missing from the data being written into the table.
Partition column <columnName> not found in schema <columnList>.
Couldn't find all part files of the checkpoint version: <version>.
CONVERT TO DELTA only supports parquet tables. Please rewrite your target as parquet.<path> if it's a parquet directory.
SET column <columnName> not found given columns: <columnList>.
Incompatible format detected.
You are trying to <operation> <path> using Delta, but there is no
transaction log present. Check the upstream job to make sure that it is writing
using format("delta") and that you are trying to %1$s the table base path.
To learn more about Delta, see <docLink>
Specified mode '<mode>' is not supported. Supported modes are: <supportedModes>.
Multiple <startingOrEnding> arguments provided for CDC read. Please provide one of either <startingOrEnding>Timestamp or <startingOrEnding>Version.
Multiple bloom filter index configurations passed to command for column: <columnName>.
Cannot perform Merge as multiple source rows matched and attempted to modify the same target row in the Delta table in possibly conflicting ways. By SQL semantics of Merge, when multiple source rows match on the same target row, the result may be ambiguous as it is unclear which source row should be used to update or delete the matching target row. You can preprocess the source table to eliminate the possibility of multiple matches. Please refer to
<usageReference>
During <command>, either both coordinated commits configurations ("delta.coordinatedCommits.commitCoordinator-preview", "delta.coordinatedCommits.commitCoordinatorConf-preview") are set in the command or neither of them. Missing: "<configuration>". Please specify this configuration in the TBLPROPERTIES clause or remove the other configuration, and then retry the command again.
During <command>, either both coordinated commits configurations ("coordinatedCommits.commitCoordinator-preview", "coordinatedCommits.commitCoordinatorConf-preview") are set in the SparkSession configurations or neither of them. Missing: "<configuration>". Please set this configuration in the SparkSession or unset the other configuration, and then retry the command again.
The following column name(s) are reserved for Delta bucketed table internal usage only: <names>.
The input schema contains nested fields that are capitalized differently than the target table.
They need to be renamed to avoid the loss of data in these fields while writing to Delta.
Fields:
<fields>.
Original schema:
<schema>
The <nestType> type of the field <parent> contains a NOT NULL constraint. Delta does not support NOT NULL constraints nested within arrays or maps. To suppress this error and silently ignore the specified constraints, set <configKey> = true.
Parsed <nestType> type:
<nestedPrettyJson>
Nested subquery is not supported in the <operation> condition.
<numRows> rows in <tableName> violate the new CHECK constraint (<checkConstraint>).
<numRows> rows in <tableName> violate the new NOT NULL constraint on <colName>.
CHECK constraint '<name>' (<expr>) should be a boolean expression.
Found <expr>. A generated column cannot use a non deterministic expression.
Non-deterministic functions are not supported in the <operation> <expression>.
When there are more than one MATCHED clauses in a MERGE statement, only the last MATCHED clause can omit the condition.
When there are more than one NOT MATCHED BY SOURCE clauses in a MERGE statement, only the last NOT MATCHED BY SOURCE clause can omit the condition.
When there are more than one NOT MATCHED clauses in a MERGE statement, only the last NOT MATCHED clause can omit the condition.
Could not parse tag <tag>.
File tags are: <tagList>.
Data written into Delta needs to contain at least one non-partitioned column.<details>
Predicate references non-partition column '<columnName>'. Only the partition columns may be referenced: [<columnList>].
Non-partitioning column(s) <columnList> are specified where only partitioning columns are expected: <fragment>.
Delta catalog requires a single-part namespace, but <identifier> is multi-part.
Setting commit coordinator to '<nonUcCoordinatorName>' from command is not supported, because UC-managed tables can only have 'unity-catalog' as the commit coordinator. Please either change it to 'unity-catalog' or remove all Coordinated Commits table properties from the TBLPROPERTIES clause, and then retry the command again.
Setting commit coordinator to '<nonUcCoordinatorName>' from SparkSession configurations is not supported, because UC-managed tables can only have 'unity-catalog' as the commit coordinator. Please either change it to 'unity-catalog' by running spark.conf.set("<coordinatorNameDefaultKey>", "unity-catalog"), or remove all Coordinated Commits table properties from the SparkSession configurations by running spark.conf.unset("<coordinatorNameDefaultKey>"), spark.conf.unset("<coordinatorConfDefaultKey>"), spark.conf.unset("<tableConfDefaultKey>"), and then retry the command again.
<table> is not a Delta table. Please drop this table first if you would like to create it with Databricks Delta.
<tableName> is not a Delta table. Please drop this table first if you would like to recreate it with Delta Lake.
Not nullable column not found in struct: <struct>.
NOT NULL constraint violated for column: <columnName>.
A non-nullable nested field can't be added to a nullable parent. Please set the nullability of the parent column accordingly.
DELTA_NO_COMMITS_FOUNDâNo commits found at <logPath>.
No recreatable commits found at <logPath>.
Operation not allowed: <operation> cannot be performed on a table with redirect feature.
The no redirect rules are not satisfied <noRedirectRules>.
Table <tableIdent> not found.
No startingVersion or startingTimestamp provided for CDC read.
DELTA_NULL_SCHEMA_IN_STREAMING_WRITEâDelta doesn't accept NullTypes in the schema for streaming writes.
DELTA_ONEOF_IN_TIMETRAVELâPlease either provide 'timestampAsOf' or 'versionAsOf' for time travel.
DELTA_ONLY_OPERATIONâ<operation> is only supported for Delta tables.
Please provide the path or table identifier for <operation>.
Operation not allowed: <operation> is not supported for Delta tables.
Operation not allowed: <operation> is not supported for Delta tables: <tableName>.
<operation> is not supported for column <colName> with non-default collation <collation>.
<operation> is not supported for data types: <dataTypeList>.
<operation> is not supported for expression <exprText> because it uses non-default collation.
<operation> command on a temp view referring to a Delta table that contains generated columns is not supported. Please run the <operation> command on the Delta table directly.
Operation not allowed: <operation> cannot be performed on a view.
OPTIMIZE FULL is only supported for clustered tables with non-empty clustering columns.
Copy option overwriteSchema cannot be specified without setting OVERWRITE = 'true'.
'overwriteSchema' cannot be used in dynamic partition overwrite mode.
DELTA_PARTITION_COLUMN_CAST_FAILEDâFailed to cast value <value> to <dataType> for partition column <columnName>.
Partition column <columnName> not found in schema [<schemaMap>].
Partition schema cannot be specified when converting Apache Iceberg tables. It is automatically inferred.
DELTA_PATH_BASED_ACCESS_TO_TABLE_BLOCKEDâThe table at <path> has been migrated to a Unity Catalog managed table and can no longer be accessed by path. Update the client to access the table by name.
<path> doesn't exist, or is not a Delta table.
Cannot write to already existent path <path> without setting OVERWRITE = 'true'.
Committing to the Delta table version <version> succeeded but error while executing post-commit hook <name> <message>
ProtocolChangedException: The protocol version of the Delta table has been changed by a concurrent update. <additionalInfo> <conflictingCommit>
Refer to <docLink> for more details.
Protocol property <key> needs to be an integer. Found <value>.
Unable to upgrade only the reader protocol version to use table features. Writer protocol version must be at least <writerVersion> to proceed. Refer to <docLink> for more information on table protocol versions.
You are trying to read a Delta table <tableName> that does not have any columns.
Write some new data with the option mergeSchema = true to be able to read the table.
Redirect to a table with row filter or column mask is not supported. Update your code to reference the target table <tableIdent> directly.
Please recheck your syntax for '<regExpOption>'.
Relation path '<relation>' mismatches with <targetType>'s path '<targetPath>'.
You can't use replaceWhere in conjunction with an overwrite by filter.
DELTA_REPLACE_WHERE_MISMATCHâWritten data does not conform to partial table overwrite condition or constraint '<replaceWhere>'.
<message>
A 'replaceWhere' expression and 'partitionOverwriteMode'='dynamic' cannot both be set in the DataFrameWriter options.
DELTA_REPLACE_WHERE_WITH_FILTER_DATA_CHANGE_UNSETâ'replaceWhere' cannot be used with data filters when 'dataChange' is set to false. Filters: <dataFilters>.
Cannot assign row IDs without row count statistics.
Collect statistics for the table by running the ANALYZE TABLE command:
ANALYZE TABLE tableName COMPUTE DELTA STATISTICS
Detected schema change:
streaming source schema: <readSchema>
data file schema: <dataSchema>
Please try restarting the query. If this issue repeats across query restarts without
making progress, you have made an incompatible schema change and need to start your
query from scratch using a new checkpoint directory.
DELTA_SCHEMA_CHANGED_WITH_STARTING_OPTIONSâDetected schema change in version <version>:
streaming source schema: <readSchema>
data file schema: <dataSchema>
Please try restarting the query. If this issue repeats across query restarts without
making progress, you have made an incompatible schema change and need to start your
query from scratch using a new checkpoint directory. If the issue persists after
changing to a new checkpoint directory, you may need to change the existing
'startingVersion' or 'startingTimestamp' option to start from a version newer than
<version> with a new checkpoint directory.
Detected schema change in version <version>:
streaming source schema: <readSchema>
data file schema: <dataSchema>
Please try restarting the query. If this issue repeats across query restarts without
making progress, you have made an incompatible schema change and need to start your
query from scratch using a new checkpoint directory.
DELTA_SCHEMA_CHANGE_SINCE_ANALYSISâThe schema of your Delta table has changed in an incompatible way because your DataFrame
or DeltaTable object was created. Please redefine your DataFrame or DeltaTable object.
Changes:
<schemaDiff> <legacyFlagMessage>
Table schema is not provided. Please provide the schema (column definition) of the table when using REPLACE table and an AS SELECT query is not provided.
Table schema is not set. Write data into it or use CREATE TABLE to set the schema.
The schema of the new Delta location is different than the current table schema.
original schema:
<original>
destination schema:
<destination>
If this is an intended change, you may turn this check off by running:
%%sql set <config> = true
File <filePath> referenced in the transaction log cannot be found. This can occur when data has been manually deleted from the file system rather than using the table DELETE statement. This table appears to be a shallow clone, if that is the case, this error can occur when the original table from which this table was cloned has deleted a file that the clone is still using. If you want any clones to be independent of the original table, use a DEEP clone instead.
Pre-defined properties that start with <prefix> cannot be modified.
The data is restricted by recipient property <property> that do not apply to the current recipient in the session.
For more details see DELTA_SHARING_CURRENT_RECIPIENT_PROPERTY_UNDEFINED
<operation> cannot be used in Delta Sharing views that are shared cross account.
Illegal authentication type <authenticationType> for provider <provider>.
Illegal authentication type <authenticationType> for recipient <recipient>.
Invalid name to reference a <type> inside a Share. You can either use <type>'s name inside the share following the format of [schema].[<type>], or you can also use table's original full name following the format of [catalog].[schema].[>type>].
If you are unsure about what name to use, you can run "SHOW ALL IN SHARE [share]" and find the name of the <type> to remove: column "name" is the <type>'s name inside the share and column "shared_object" is the <type>'s original full name.
There are more than two tokens for recipient <recipient>.
Recipient property <property> does not exist.
Recipient tokens are missing for recipient <recipient>.
Non-partitioning column(s) <badCols> are specified for SHOW PARTITIONS.
SHOW PARTITIONS is not allowed on a table that is not partitioned: <tableName>.
Detected deleted data (for example <removedFile>) from streaming source at version <version>. This is currently not supported. If you'd like to ignore deletes, set the option 'ignoreDeletes' to 'true'. The source table can be found at path <dataPath>.
Detected a data update (for example <file>) in the source table at version <version>. This is currently not supported. If this is going to happen regularly and you are okay to skip changes, set the option 'skipChangeCommits' to 'true'. If you would like the data update to be reflected, please restart this query with a fresh checkpoint directory or do a full refresh if you are using Lakeflow Declarative Pipelines. If you need to handle these changes, please switch to MVs. The source table can be found at path <dataPath>.
Please either provide '<version>' or '<timestamp>'.
<statsType> stats not found for column in Parquet metadata: <columnPath>.
We've detected one or more non-additive schema change(s) (<opType>) between Delta version <previousSchemaChangeVersion> and <currentSchemaChangeVersion> in the Delta streaming source.
Changes:
<columnChangeDetails>
Please check if you want to manually propagate the schema change(s) to the sink table before we proceed with stream processing using the finalized schema at version <currentSchemaChangeVersion>.
Once you have fixed the schema of the sink table or have decided there is no need to fix, you can set the following configuration(s) to unblock the non-additive schema change(s) and continue stream processing.
Using dataframe reader option(s):
To unblock for this particular stream just for this series of schema change(s):
<unblockChangeOptions>
To unblock for this particular stream:
<unblockStreamOptions>
Using SQL configuration(s):
To unblock for this particular stream just for this series of schema change(s):
<unblockChangeConfs>
To unblock for this particular stream:
<unblockStreamConfs>
To unblock for all streams:
<unblockAllConfs>
Failed to obtain Delta log snapshot for the start version when checking column mapping schema changes. Please choose a different start version, or force enable streaming read at your own risk by setting '<config>' to 'true'.
Streaming read is not supported on tables with read-incompatible schema changes (e.g. rename or drop or datatype changes).
For further information and possible next steps to resolve this issue, please review the documentation at <docLink>
Read schema: <readSchema>. Incompatible data schema: <incompatibleSchema>.
Streaming read is not supported on tables with read-incompatible schema changes (e.g. rename or drop or datatype changes).
Please provide a 'schemaTrackingLocation' to enable non-additive schema evolution for Delta stream processing.
See <docLink> for more details.
Read schema: <readSchema>. Incompatible data schema: <incompatibleSchema>.
The schema, table configuration or protocol of your Delta table has changed during streaming.
The schema or metadata tracking log has been updated.
Please restart the stream to continue processing using the updated metadata.
Updated schema: <schema>.
Updated table configurations: <config>.
Updated table protocol: <protocol>
Streaming from source table <tableId> with schema tracking does not support row filters or column masks.
Please drop the row filters or column masks, or disable schema tracking.
DELTA_STREAMING_SCHEMA_LOCATION_CONFLICTâDetected conflicting schema location '<loc>' while streaming from table or table located at '<table>'.
Another stream may be reusing the same schema location, which is not allowed.
Please provide a new unique schemaTrackingLocation path or streamingSourceTrackingId as a reader option for one of the streams from this table.
Schema location '<schemaTrackingLocation>' must be placed under checkpoint location '<checkpointLocation>'.
Incomplete log file in the Delta streaming source schema log at '<location>'.
The schema log may have been corrupted. Please pick a new schema location.
DELTA_STREAMING_SCHEMA_LOG_INCOMPATIBLE_DELTA_TABLE_IDâDetected incompatible Delta table id when trying to read Delta stream.
Persisted table id: <persistedId>, Table id: <tableId>
The schema log might have been reused. Please pick a new schema location.
DELTA_STREAMING_SCHEMA_LOG_INCOMPATIBLE_PARTITION_SCHEMAâDetected incompatible partition schema when trying to read Delta stream.
Persisted schema: <persistedSchema>, Delta partition schema: <partitionSchema>
Please pick a new schema location to reinitialize the schema log if you have manually changed the table's partition schema recently.
DELTA_STREAMING_SCHEMA_LOG_INIT_FAILED_INCOMPATIBLE_METADATAâWe could not initialize the Delta streaming source schema log because
we detected an incompatible schema or protocol change while serving a streaming batch from table version <a> to <b>.
Failed to parse the schema from the Delta streaming source schema log.
The schema log may have been corrupted. Please pick a new schema location.
DELTA_TABLE_ALREADY_CONTAINS_CDC_COLUMNSâUnable to enable Change Data Capture on the table. The table already contains
reserved columns <columnList> that will
be used internally as metadata for the table's Change Data Feed. To enable
Change Data Feed on the table rename/drop these columns.
DELTA_TABLE_ALREADY_EXISTSâTable <tableName> already exists.
Currently DeltaTable.forPath only supports hadoop configuration keys starting with <allowedPrefixes> but got <unsupportedOptions>.
The Delta table at <tableLocation> has been replaced while this command was using the table.
Table id was <oldId> but is now <newId>.
Please retry the current command to ensure it reads a consistent view of the table.
DELTA_TABLE_INVALID_REDIRECT_STATE_TRANSITIONâUnable to update table redirection state: Invalid state transition attempted.
The Delta table '<table>' cannot change from '<oldState>' to '<newState>'.
Unable to SET or UNSET redirect property on <table>: current property '<currentProperty>' mismatches with new property '<newProperty>'.
The location of the existing table <tableName> is <existingTableLocation>. It doesn't match the specified location <tableLocation>.
Delta table <tableName> doesn't exist.
Table is not supported in <operation>. Please use a path instead.
<tableName> is not a Delta table. <operation> is only supported for Delta tables.
The Delta log contains unrecognized table redirect spec '<spec>'.
Target table final schema is empty.
DELTA_TIMESTAMP_GREATER_THAN_COMMITâThe provided timestamp (<providedTimestamp>) is after the latest version available to this
table (<tableName>). Please use a timestamp before or at <maximumTimestamp>.
The provided timestamp (<expr>) cannot be converted to a valid timestamp.
<timeTravelKey> needs to be a valid begin value.
Failed to list files (<numFiles>) in the Delta table due to insufficient memory. Required memory: <estimatedMemory>, available memory: <maxMemory>.
<path>: Unable to reconstruct state at version <version> as the transaction log has been truncated due to manual deletion or the log retention policy (<logRetentionKey>=<logRetention>) and checkpoint retention policy (<checkpointRetentionKey>=<checkpointRetention>).
Operation not allowed: TRUNCATE TABLE on Delta tables does not support partition predicates; use DELETE to delete specific partitions or rows.
Found <udfExpr>. A generated column cannot use a user-defined function.
Unexpected action expression <expression>.
Expecting <expectedColsSize> partition column(s): <expectedCols>, but found <parsedColsSize> partition column(s): <parsedCols> from parsing the file name: <path>.
Expect a full scan of Delta sources, but found a partial scan. Path: <path>.
Expecting partition column <expectedCol>, but found partition column <parsedCol> from parsing the file name: <path>.
CONVERT TO DELTA was called with a partition schema different from the partition schema inferred from the catalog, please avoid providing the schema so that the partition schema can be chosen from the catalog.
catalog partition schema:
<catalogPartitionSchema>
provided partition schema:
<userPartitionSchema>
delta.universalFormat.compatibility.location cannot be changed.
DELTA_UNIFORM_COMPATIBILITY_LOCATION_NOT_REGISTEREDâdelta.universalFormat.compatibility.location is not registered in the catalog.
DELTA_UNIFORM_COMPATIBILITY_MISSING_OR_INVALID_LOCATIONâMissing or invalid location for Uniform compatibility format. Please set an empty directory for delta.universalFormat.compatibility.location.
Failed reason:
For more details see DELTA_UNIFORM_COMPATIBILITY_MISSING_OR_INVALID_LOCATION
DELTA_UNIFORM_ICEBERG_INGRESS_VIOLATIONâRead Apache Iceberg with Delta Uniform has failed.
For more details see DELTA_UNIFORM_ICEBERG_INGRESS_VIOLATION
DELTA_UNIFORM_INGRESS_AMBIGUOUS_FORMATâMultiple Delta Uniform ingress formats (<formats>) are found, at most one can be set.
Create or Refresh Uniform ingress table is not supported.
DELTA_UNIFORM_INGRESS_NOT_SUPPORTED_FORMATâFormat <fileFormat> is not supported. Only iceberg and hudi as original file format are supported.
Read Delta Uniform fails:
For more details see DELTA_UNIFORM_INGRESS_VIOLATION
DELTA_UNIFORM_NOT_SUPPORTEDâUniversal Format is only supported on Unity Catalog tables.
DELTA_UNIFORM_REFRESH_INVALID_ARGUMENTâREFRESH TABLE with invalid argument:
For more details see DELTA_UNIFORM_REFRESH_INVALID_ARGUMENT
DELTA_UNIFORM_REFRESH_NOT_SUPPORTEDâREFRESH identifier SYNC UNIFORM is not supported for reason:
For more details see DELTA_UNIFORM_REFRESH_NOT_SUPPORTED
DELTA_UNIFORM_REFRESH_NOT_SUPPORTED_FOR_MANAGED_ICEBERG_TABLE_WITH_METADATA_PATHâREFRESH TABLE with METADATA_PATH is not supported for managed Apache Iceberg tables.
Failed to convert the table version <version> to the universal format <format>. <message>
The validation of Universal Format (<format>) has failed: <violation>.
Unknown configuration was specified: <config>.
To disable this check, set <disableCheckConfig>=true in the Spark session configuration.
Unknown privilege: <privilege>.
Unknown ReadLimit: <limit>.
Unrecognized column change <otherClass>. You may be running an out-of-date Delta Lake version.
Unrecognized invariant. Please upgrade your Spark version.
DELTA_UNRECOGNIZED_LOGFILEâUnrecognized log file <filename>.
Attempted to unset non-existent property '<property>' in table <tableName>.
<path> does not support adding files with an absolute path.
ALTER TABLE CHANGE COLUMN is not supported for changing column <fieldPath> from <oldField> to <newField>.
Unsupported ALTER TABLE REPLACE COLUMNS operation. Reason: <details>
Failed to change schema from:
<oldSchema>
to:
<newSchema>
You tried to REPLACE an existing table (<tableName>) with CLONE. This operation is
unsupported. Try a different target for CLONE or delete the table at the current target.
Changing column mapping mode from '<oldMode>' to '<newMode>' is not supported.
Failed to perform Column Mapping operation <opName> on column(s) <quotedColumnNames>
because these column(s) have Bloom Filter Index(es).
If you want to perform Column Mapping operation on column(s)
with Bloom Filter Index(es),
please remove the Bloom Filter Index(es) first:
DROP BLOOMFILTER INDEX ON TABLE tableName FOR COLUMNS(<columnNames>)
If you want instead to remove all Bloom Filter Indexes on the table, use:
DROP BLOOMFILTER INDEX ON TABLE tableName
Your current table protocol version does not support changing column mapping modes
using <config>.
Required Delta protocol version for column mapping:
<requiredVersion>
Your table's current Delta protocol version:
<currentVersion>
<advice>
Schema change is detected:
old schema:
<oldTableSchema>
new schema:
<newTableSchema>
Schema changes are not allowed during the change of column mapping mode.
DELTA_UNSUPPORTED_COLUMN_MAPPING_WRITEâWriting data with column mapping mode is not supported.
DELTA_UNSUPPORTED_COLUMN_TYPE_IN_BLOOM_FILTERâCreating a bloom filter index on a column with type <dataType> is unsupported: <columnName>.
Can't add a comment to <fieldPath>. Adding a comment to a map key/value or array element is not supported.
Found columns using unsupported data types: <dataTypeList>. You can set '<config>' to 'false' to disable the type check. Disabling this type check may allow users to create unsupported Delta tables and should only be used when trying to read/write legacy tables.
<dataType> cannot be the result of a generated column.
Deep clone is not supported by this Delta version.
DELTA_UNSUPPORTED_DESCRIBE_DETAIL_VIEWâ<view> is a view. DESCRIBE DETAIL is only supported for tables.
Dropping clustering columns (<columnList>) is not allowed.
DROP COLUMN is not supported for your Delta table. <advice>
Can only drop nested columns from StructType. Found <struct>.
Dropping partition columns (<columnList>) is not allowed.
Unsupported expression type(<expType>) for <causedBy>. The supported types are [<supportedTypes>].
<expression> cannot be used in a generated column.
Unsupported Delta read feature: table "<tableNameOrPath>" requires reader table feature(s) that are unsupported by this version of Databricks: <unsupported>. Please refer to <link> for more information on Delta Lake feature compatibility.
Unsupported Delta write feature: table "<tableNameOrPath>" requires writer table feature(s) that are unsupported by this version of Databricks: <unsupported>. Please refer to <link> for more information on Delta Lake feature compatibility.
Table feature(s) configured in the following Spark configs or Delta table properties are not recognized by this version of Databricks: <configs>.
Expecting the status for table feature <feature> to be "supported", but got "<status>".
Updating nested fields is only supported for StructType, but you are trying to update a field of <columnName>, which is of type: <dataType>.
The 'FSCK REPAIR TABLE' command is not supported on table versions with missing deletion vector files.
Please contact support.
DELTA_UNSUPPORTED_GENERATE_WITH_DELETION_VECTORSâThe 'GENERATE symlink_format_manifest' command is not supported on table versions with deletion vectors.
In order to produce a version of the table without deletion vectors, run 'REORG TABLE table APPLY (PURGE)'. Then re-run the 'GENERATE' command.
Make sure that no concurrent transactions are adding deletion vectors again between REORG and GENERATE.
If you need to generate manifests regularly, or you cannot prevent concurrent transactions, consider disabling deletion vectors on this table using 'ALTER TABLE table SET TBLPROPERTIES (delta.enableDeletionVectors = false)'.
Invariants on nested fields other than StructTypes are not supported.
DELTA_UNSUPPORTED_IN_SUBQUERYâIn subquery is not supported in the <operation> condition.
listKeywithPrefix not available.
DELTA_UNSUPPORTED_MANIFEST_GENERATION_WITH_COLUMN_MAPPINGâManifest generation is not supported for tables that leverage column mapping, as external readers cannot read these Delta tables. See Delta documentation for more details.
DELTA_UNSUPPORTED_MERGE_SCHEMA_EVOLUTION_WITH_CDCâMERGE INTO operations with schema evolution do not currently support writing CDC output.
Multi-column In predicates are not supported in the <operation> condition.
Creating a bloom filer index on a nested column is currently unsupported: <columnName>.
Nested field is not supported in the <operation> (field = <fieldName>).
The clone destination table is non-empty. Please TRUNCATE or DELETE FROM the table before running CLONE.
Data source <dataSource> does not support <mode> output mode.
Creating a bloom filter index on a partitioning column is unsupported: <columnName>.
Column rename is not supported for your Delta table. <advice>
Delta does not support specifying the schema at read time.
DELTA_UNSUPPORTED_SORT_ON_BUCKETED_TABLESâSORTED BY is not supported for Delta bucketed tables.
<operation> destination only supports Delta sources.
<plan>
Specifying static partitions in the partition spec is currently not supported during inserts.
DELTA_UNSUPPORTED_STRATEGY_NAMEâUnsupported strategy name: <strategy>.
Subqueries are not supported in the <operation> (condition = <cond>).
Subquery is not supported in partition predicates.
DELTA_UNSUPPORTED_TIME_TRAVEL_MULTIPLE_FORMATSâCannot specify time travel in multiple formats.
DELTA_UNSUPPORTED_TIME_TRAVEL_VIEWSâCannot time travel views, subqueries, streams or change data feed queries.
DELTA_UNSUPPORTED_TRUNCATE_SAMPLE_TABLESâTruncate sample tables is not supported.
DELTA_UNSUPPORTED_TYPE_CHANGE_IN_SCHEMAâUnable to operate on this table because an unsupported type change was applied. Field <fieldName> was changed from <fromType> to <toType>.
Failed to change data type of column(s) <quotedColumnNames>
because these columns have Bloom Filter Index(es).
If you want to change the data type of column(s) with Bloom Filter Index(es),
please remove the Bloom Filter Index(es) first:
DROP BLOOMFILTER INDEX ON TABLE tableName FOR COLUMNS(<columnNames>)
If you want instead to remove all Bloom Filter Indexes on the table, use:
DROP BLOOMFILTER INDEX ON TABLE tableName
Please provide the base path (<baseDeltaPath>) when Vacuuming Delta tables. Vacuuming specific partitions is currently not supported.
Table implementation does not support writes: <tableName>.
You are trying to perform writes on a table which has been registered with the commit coordinator <coordinatorName>. However, no implementation of this coordinator is available in the current environment and writes without coordinators are not allowed.
Write to sample tables is not supported.
DELTA_UPDATE_SCHEMA_MISMATCH_EXPRESSIONâCannot cast <fromCatalog> to <toCatalog>. All nested columns must match.
CHECKPOINT operation requires V2 Checkpoints to be enabled on table.
VACUUM on data files succeeded, but COPY INTO state garbage collection failed.
Versions (<versionList>) are not contiguous.
A gap in the delta log between versions <startVersion> and <endVersion> was detected while trying to load version <versionToLoad>.
For more details see DELTA_VERSIONS_NOT_CONTIGUOUS
DELTA_VERSION_INVALIDâThe provided version (<version>) is not a valid version.
CHECK constraint <constraintName> <expression> violated by row with values:
<values>.
The validation of the properties of table <table> has been violated:
For more details see DELTA_VIOLATE_TABLE_PROPERTY_VALIDATION_FAILED
DELTA_WRITE_INTO_VIEW_NOT_SUPPORTEDâ<viewIdentifier> is a view. You may not write data into a view.
Z-Ordering column <columnName> does not exist in data schema.
Z-Ordering on <cols> will be ineffective, because we currently do not collect stats for these columns. Please refer to <link> for more information on data skipping and z-ordering. You can disable this check by setting
SET <zorderColStatKey> = false
<colName> is a partition column. Z-Ordering can only be performed on data columns.
SQLSTATE: none assigned
Activation nonce not found. The activation link you used is invalid or has expired. Regenerate the activation link and try again.
SQLSTATE: none assigned
Sharing between <regionHint> regions and regions outside of it is not supported.
SQLSTATE: none assigned
The view defined with the current_recipient function is for sharing only and can only be queried from the data recipient side. The provided securable with id <securableId> is not a Delta Sharing View.
SQLSTATE: none assigned
The provided securable kind <securableKind> does not support mutability in Delta Sharing.
SQLSTATE: none assigned
The provided securable kind <securableKind> does not support rotate token action initiated by Marketplace service.
SQLSTATE: none assigned
<dsError>: Authentication type not available in provider entity <providerEntity>.
SQLSTATE: none assigned
<dsError>: Unable to access change data feed for <tableName>. CDF is not enabled on the original delta table for version <version>. Please contact your data provider.
SQLSTATE: none assigned
<dsError>: Unable to access change data feed for <tableName>. CDF is not shared on the table. Please contact your data provider.
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: Cloud vendor is temporarily unavailable for <rpcName>, please retry.<traceId>
SQLSTATE: none assigned
<dsError>: Data materialization task run <runId> from org <orgId> failed at command <command>
SQLSTATE: none assigned
<dsError>: Data materialization task run <runId> from org <orgId> does not support command <command>
SQLSTATE: none assigned
<dsError>: <featureName> is not supported because serverless is not supported or enabled in the provider workspace. Please contact your data provider to enable serverless.
SQLSTATE: none assigned
<dsError>: Could not find valid namespace to create materialization for <tableName>. Please contact your data provider to fix this.
SQLSTATE: none assigned
<dsError>: Data materialization task run <runId> from org <orgId> does not exist
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: Couldn't find all part files of the checkpoint at version: <version>. <suggestion>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: The provided securable kind <securableKind> does not support expire token action initiated by Marketplace service.
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: <feature> is only enabled for Databricks to Databricks Delta sharing.
SQLSTATE: none assigned
<dsError>: <storage>: <message>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: <key> is not set by the caller.
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: Invalid Azure path: <path>.
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: Invalid parameter for <rpcName> due to <cause>.
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: Query failed for <schema>.<table> from Share <share>.
SQLSTATE: none assigned
<dsError>: Query timed out for <schema>.<table> from Share <share> after <timeoutInSec> seconds.
SQLSTATE: none assigned
<dsError>: The UC RPC <rpcName> failed.
SQLSTATE: none assigned
<dsError>: Idempotency key is require when query <schema>.<table> from Share <share> asynchronously.
SQLSTATE: none assigned
<dsError>: Please only provide one of: <parameters>.
SQLSTATE: none assigned
<dsError>: Network connection closed for <rpcName> due to <errorCause>, please retry.<traceId>
SQLSTATE: none assigned
<dsError>: Network connection timeout for <rpcName> due to <errorCause>, please retry.<traceId>
SQLSTATE: none assigned
<dsError>: Network error for <rpcName> due to <errorCause>, please retry.<traceId>
SQLSTATE: none assigned
<dsError>: No metastore assigned for the current workspace (workspaceId: <workspaceId>).
SQLSTATE: none assigned
<dsError>: Generating workload identity token for O2D OIDC provider failed: <message>.
SQLSTATE: none assigned
<dsError>: Pagination or query arguments mismatch.
SQLSTATE: none assigned
<dsError>: Partition column [<renamedColumns>] renamed on the shared table. Please contact your data provider to fix this.
SQLSTATE: none assigned
<dsError>: You can only query table data since version <startVersion>.
SQLSTATE: none assigned
<dsError>: Provided end version(<endVersion>) for reading data is invalid. Ending version cannot be greater than the latest version of the table(<latestVersion>).
SQLSTATE: none assigned
<dsError>: Provided start version(<startVersion>) for reading data is invalid. Starting version cannot be greater than the latest version of the table(<latestVersion>).
SQLSTATE: none assigned
<dsError>: A timeout occurred when processing <queryType> on <tableName> after <numActions> updates across <numIter> iterations.<progressUpdate> <suggestion> <traceId>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: UC RPC <rpcName> failed, converting to INTERNAL_ERROR.
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: The <resource> exceeded limit: [<limitSize>]<suggestion>.<traceId>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: Delta Sharing SAP connector is not supported on DBR <dbrVersion>. The minimum supported versions are: <supportedVersions>.
SQLSTATE: none assigned
<dsError>: Catalog <catalogName> already contains schema names that are found in share <shareName>. <description> of conflicting schema names: <schemaNamesInCommon>.
SQLSTATE: none assigned
<dsError>: Server timeout for <rpcName> due to <errorCause>, please retry.<traceId>
SQLSTATE: none assigned
<dsError>: The request was denied as the service is under too much load. Please try again later after a while.
SQLSTATE: none assigned
<dsError>: Share <shareName> from provider <providerName> is already mounted to catalog <catalogName>.
SQLSTATE: none assigned
Cannot grant privileges on <securableType> to system generated group <principal>.
SQLSTATE: none assigned
<dsError>: Time travel query is not permitted unless history is shared on <tableName>. Please contact your data provider.
SQLSTATE: none assigned
<dsError>: Unauthorized.
SQLSTATE: none assigned
<dsError>: Unauthorized D2O OIDC Recipient: <message>.
SQLSTATE: none assigned
<dsError>: <traceId>
SQLSTATE: none assigned
<dsError>: Unknown query id <queryID> for <schema>.<table> from Share <share>.
SQLSTATE: none assigned
<dsError>: Unknown query status for query id <queryID> for <schema>.<table> from Share <share>.
SQLSTATE: none assigned
<dsError>: Unknown rpc <rpcName>.
SQLSTATE: none assigned
<dsError>: Delta protocol reader version <tableReaderVersion> is higher than <supportedReaderVersion> and cannot be supported in the delta sharing server.
SQLSTATE: none assigned
<dsError>: Table features <tableFeatures> are found in table<versionStr> <historySharingStatusStr> <optionStr>
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: Unsupported storage scheme: <scheme>.
SQLSTATE: none assigned
<dsError>: Could not retrieve <schema>.<table> from Share <share> because table with type [<tableType>] is currently unsupported in <queryType> queries.
SQLSTATE: none assigned
<dsError>: <message>
SQLSTATE: none assigned
<dsError>: The following function(s): <functions> are not allowed in the view sharing query.
SQLSTATE: none assigned
<dsError>: Workspace <workspaceId> domain is not set.
SQLSTATE: none assigned
<dsError>: Workspace <workspaceId> was not found.
Schema evolution mode <addNewColumnsMode> is not supported when the schema is specified. To use this mode, you can provide the schema through cloudFiles.schemaHints instead.
Found notification-setup authentication options for the (default) directory
listing mode:
<options>
If you wish to use the file notification mode, please explicitly set:
.option("cloudFiles.<useNotificationsKey>", "true")
Alternatively, if you want to skip the validation of your options and ignore these
authentication options, you can set:
.option("cloudFiles.ValidateOptionsKey>", "false")
CF_AMBIGUOUS_INCREMENTAL_LISTING_MODE_ERRORâIncremental listing mode (cloudFiles.<useIncrementalListingKey>)
and file notification (cloudFiles.<useNotificationsKey>)
have been enabled at the same time.
Please make sure that you select only one.
CF_AZURE_AUTHENTICATION_MISSING_OPTIONSâPlease provide either a Databricks service credential or both a clientId and clientSecret for authenticating with Azure.
CF_AZURE_AUTHENTICATION_MULTIPLE_OPTIONSâWhen a Databricks service credential is provided, no other credential options (e.g. clientId, clientSecret, or connectionString) should be provided.
CF_AZURE_STORAGE_SUFFIXES_REQUIREDâRequire adlsBlobSuffix and adlsDfsSuffix for Azure
CF_BUCKET_MISMATCHâThe <storeType> in the file event <fileEvent> is different from expected by the source: <source>.
Cannot evolve schema when the schema log is empty. Schema log location: <logPath>
Cannot parse the following queue message: <message>
Cannot resolve container name from path: <path>, Resolved uri: <uri>
Cannot run directory listing when there is an async backfill thread running
CF_CLEAN_SOURCE_ALLOW_OVERWRITES_BOTH_ONâCannot turn on cloudFiles.cleanSource and cloudFiles.allowOverwrites at the same time.
CF_CLEAN_SOURCE_CANNOT_MOVE_FILES_INSIDE_SOURCE_PATHâMoving files to a directory under the path that is being ingested from is not supported.
CF_CLEAN_SOURCE_NOT_ENABLEDâCleanSource has not been enabled for this workspace. Please contact Databricks support for assistance.
CF_CLEAN_SOURCE_UNAUTHORIZED_WRITE_PERMISSIONâAuto Loader cannot archive processed files because it does not have write permissions to the source directory or the move destination.
<reason>
To fix you can either:
Grant write permissions to the source directory and move destination OR
Set cleanSource to 'OFF'
You could also unblock your stream by setting the SQLConf spark.databricks.cloudFiles.cleanSource.disabledDueToAuthorizationErrors to 'true'.
CF_DUPLICATE_COLUMN_IN_DATAâThere was an error when trying to infer the partition schema of your table. You have the same column duplicated in your data and partition paths. To ignore the partition value, please provide your partition columns explicitly by using: .option("cloudFiles.<partitionColumnsKey>", "{comma-separated-list}")
Cannot infer schema when the input path <path> is empty. Please try to start the stream when there are files in the input path, or specify the schema.
Failed to create an Event Grid subscription. Please make sure that your service
principal has <permissionType> Event Grid Subscriptions. See more details at:
<docLink>
Failed to create event grid subscription. Please ensure that Microsoft.EventGrid is
registered as resource provider in your subscription. See more details at:
<docLink>
Failed to create an Event Grid subscription. Please make sure that your storage
account (<storageAccount>) is under your resource group (<resourceGroup>) and that
the storage account is a "StorageV2 (general purpose v2)" account. See more details at:
<docLink>
Auto Loader event notification mode is not supported for <cloudStore>.
Failed to check if the stream is new
CF_FAILED_TO_CREATED_PUBSUB_SUBSCRIPTIONâFailed to create subscription: <subscriptionName>. A subscription with the same name already exists and is associated with another topic: <otherTopicName>. The desired topic is <proposedTopicName>. Either delete the existing subscription or create a subscription with a new resource suffix.
Failed to create topic: <topicName>. A topic with the same name already exists.<reason> Remove the existing topic or try again with another resource suffix
Failed to delete notification with id <notificationId> on bucket <bucketName> for topic <topicName>. Please retry or manually remove the notification through the GCP console.
Failed to deserialize persisted schema from string: '<jsonSchema>'
Cannot evolve schema without a schema log.
CF_FAILED_TO_FIND_PROVIDERâFailed to find provider for <fileFormatInput>
Failed to infer schema for format <fileFormatInput> from existing files in input path <path>.
For more details see CF_FAILED_TO_INFER_SCHEMA
CF_FAILED_TO_WRITE_TO_SCHEMA_LOGâFailed to write to the schema log at location <path>.
Could not find required option: cloudFiles.format.
CF_FOUND_MULTIPLE_AUTOLOADER_PUBSUB_SUBSCRIPTIONSâFound multiple (<num>) subscriptions with the Auto Loader prefix for topic <topicName>:
<subscriptionList>
There should only be one subscription per topic. Please manually ensure that your topic does not have multiple subscriptions.
CF_GCP_AUTHENTICATIONâPlease either provide all of the following: <clientEmail>, <client>,
<privateKey>, and <privateKeyId> or provide <serviceCredential> to use your Databricks service credential.
Alternatively, provide none of them in order to use the default GCP credential provider chain for authenticating with GCP resources.
CF_GCP_LABELS_COUNT_EXCEEDEDâReceived too many labels (<num>) for GCP resource. The maximum label count per resource is <maxNum>.
Received too many resource tags (<num>) for GCP resource. The maximum resource tag count per resource is <maxNum>, as resource tags are stored as GCP labels on resources, and Databricks specific tags consume some of this label quota.
Incomplete log file in the schema log at path <path>
Incomplete metadata file in the Auto Loader checkpoint
CF_INCORRECT_BATCH_USAGEâCloudFiles is a streaming source. Please use spark.readStream instead of spark.read. To disable this check, set <cloudFilesFormatValidationEnabled> to false.
The cloud_files method accepts two required string parameters: the path to load from, and the file format. File reader options must be provided in a string key-value map. e.g. cloud_files("path", "json", map("option1", "value1")). Received: <params>
To use 'cloudFiles' as a streaming source, please provide the file format with the option 'cloudFiles.format', and use .load() to create your DataFrame. To disable this check, set <cloudFilesFormatValidationEnabled> to false.
Internal error.
For more details see CF_INTERNAL_ERROR
CF_INVALID_ARNâInvalid ARN: <arn>
The private key provided with option cloudFiles.certificate cannot be parsed. Please provide a valid public key in PEM format.
CF_INVALID_AZURE_CERT_PRIVATE_KEYâThe private key provided with option cloudFiles.certificatePrivateKey cannot be parsed. Please provide a valid private key in PEM format.
CF_INVALID_CHECKPOINTâThis checkpoint is not a valid CloudFiles source
CF_INVALID_CLEAN_SOURCE_MODEâInvalid mode for clean source option <value>.
Invalid resource tag key for GCP resource: <key>. Keys must start with a lowercase letter, be within 1 to 63 characters long, and contain only lowercase letters, numbers, underscores (_), and hyphens (-).
Invalid resource tag value for GCP resource: <value>. Values must be within 0 to 63 characters long and must contain only lowercase letters, numbers, underscores (_), and hyphens (-).
Auto Loader does not support the following options when used with managed file events:
<optionList>
We recommend that you remove these options and then restart the stream.
CF_INVALID_MANAGED_FILE_EVENTS_RESPONSEâInvalid response from managed file events service. Please contact Databricks support for assistance.
For more details see CF_INVALID_MANAGED_FILE_EVENTS_RESPONSE
CF_INVALID_SCHEMA_EVOLUTION_MODEâcloudFiles.<schemaEvolutionModeKey> must be one of
<addNewColumns>"<failOnNewColumns>"<rescue>"<noEvolution>"Schema hints can only specify a particular column once.
In this case, redefining column: <columnName>
multiple times in schemaHints:
<schemaHints>
Schema hints can not be used to override maps' and arrays' nested types.
Conflicted column: <columnName>
latestOffset should be called with a ReadLimit on this source.
CF_LOG_FILE_MALFORMEDâLog file was malformed: failed to read correct log version from <fileName>.
You have requested Auto Loader to ignore existing files in your external location by setting includeExistingFiles to false. However, the managed file events service is still discovering existing files in your external location. Please try again after managed file events has completed discovering all files in your external location.
CF_MANAGED_FILE_EVENTS_ENDPOINT_NOT_FOUNDâYou are using Auto Loader with managed file events, but it appears that the external location for your input path '<path>' does not have file events enabled or the input path is invalid. Please request your Databricks Administrator to enable file events on the external location for your input path.
You are using Auto Loader with managed file events, but you do not have access to the external location or volume for input path '<path>' or the input path is invalid. Please request your Databricks Administrator to grant read permissions for the external location or volume or provide a valid input path within an existing external location or volume.
Auto Loader with managed file events is preview functionality. To continue, please contact Databricks Support or turn off the cloudFiles.useManagedFileEvents option.
CF_MAX_MUST_BE_POSITIVEâmax must be positive
CF_METADATA_FILE_CONCURRENTLY_USEDâMultiple streaming queries are concurrently using <metadataFile>
The metadata file in the streaming source checkpoint directory is missing. This metadata
file contains important default options for the stream, so the stream cannot be restarted
right now. Please contact Databricks support for assistance.
CF_MISSING_PARTITION_COLUMN_ERRORâPartition column <columnName> does not exist in the provided schema:
<schema>
Please specify a schema using .schema() if a path is not provided to the CloudFiles source while using file notification mode. Alternatively, to have Auto Loader to infer the schema please provide a base path in .load().
CF_MULTIPLE_PUBSUB_NOTIFICATIONS_FOR_TOPICâFound existing notifications for topic <topicName> on bucket <bucketName>:
notification,id
<notificationList>
To avoid polluting the subscriber with unintended events, please delete the above notifications and retry.
CF_NEW_PARTITION_ERRORâNew partition columns were inferred from your files: [<filesList>]. Please provide all partition columns in your schema or provide a list of partition columns which you would like to extract values for by using: .option("cloudFiles.partitionColumns", "{comma-separated-list|empty-string}")
There was an error when trying to infer the partition schema of the current batch of files. Please provide your partition columns explicitly by using: .option("cloudFiles.<partitionColumnOption>", "{comma-separated-list}")
Cannot read files when the input path <path> does not exist. Please make sure the input path exists and re-try.
Periodic backfill is not supported if asynchronous backfill is disabled. You can enable asynchronous backfill/directory listing by setting spark.databricks.cloudFiles.asyncDirListing to true
Found mismatched event: key <key> doesn't have the prefix: <prefix>
<message>
If you don't need to make any other changes to your code, then please set the SQL
configuration: '<sourceProtocolVersionKey> = <value>'
to resume your stream. Please refer to:
<docLink>
for more details.
CF_REGION_NOT_FOUND_ERRORâCould not get default AWS Region. Please specify a region using the cloudFiles.region option.
CF_RESOURCE_SUFFIX_EMPTYâFailed to create notification services: the resource suffix cannot be empty.
CF_RESOURCE_SUFFIX_INVALID_CHAR_AWSâFailed to create notification services: the resource suffix can only have alphanumeric characters, hyphens (-) and underscores (_).
CF_RESOURCE_SUFFIX_INVALID_CHAR_AZUREâFailed to create notification services: the resource suffix can only have lowercase letter, number, and dash (-).
CF_RESOURCE_SUFFIX_INVALID_CHAR_GCPâFailed to create notification services: the resource suffix can only have alphanumeric characters, hyphens (-), underscores (_), periods (.), tildes (~) plus signs (+), and percent signs (<percentSign>).
Failed to create notification services: the resource suffix cannot have more than <limit> characters.
Failed to create notification services: the resource suffix must be between <lowerLimit> and <upperLimit> characters.
Found restricted GCP resource tag key (<key>). The following GCP resource tag keys are restricted for Auto Loader: [<restrictedKeys>]
cloudFiles.cleanSource.retentionDuration cannot be greater than cloudFiles.maxFileAge.
CF_SAME_PUB_SUB_TOPIC_NEW_KEY_PREFIXâFailed to create notification for topic: <topic> with prefix: <prefix>. There is already a topic with the same name with another prefix: <oldPrefix>. Try using a different resource suffix for setup or delete the existing setup.
Failed to clone and migrate any schema log entries from the source schema log.
CF_SFTP_MISSING_PASSWORD_OR_KEY_FILEâEither password or key file must be specified for SFTP.
Please specify the password in the source uri or via <passwordOption>, or specify the key file content via <keyFileOption>.
Accessing SFTP files is not enabled. Please contact Databricks support for assistance.
CF_SFTP_REQUIRE_FULL_PATHâSpecify the full path components for an SFTP source in the form of sftp://$user@$host:$port/$path to ensure accurate UC connection look up.
CF_SFTP_REQUIRE_UC_CLUSTERâAn UC-enabled cluster is required to access SFTP files. Please contact Databricks support for assistance.
CF_SFTP_USERNAME_NOT_FOUNDâUsername must be specified for SFTP.
Please provide the username in the source uri or via <option>.
Please provide the source directory path with option path
The cloud files source only supports S3, Azure Blob Storage (wasb/wasbs) and Azure Data Lake Gen1 (adl) and Gen2 (abfs/abfss) paths right now. path: '<path>', resolved uri: '<uri>'
The cloud_files_state function accepts a string parameter representing the checkpoint directory of a cloudFiles stream or a multi-part tableName identifying a streaming table, and an optional second integer parameter representing the checkpoint version to load state for. The second parameter may also be 'latest' to read the latest checkpoint. Received: <params>
The input checkpoint path <path> is invalid. Either the path does not exist or there are no cloud_files sources found.
The specified version <version> does not exist, or was removed during analysis.
<threadName> thread is dead.
Unable to derive the stream checkpoint location from the source checkpoint location: <checkPointLocation>
Unable to detect the source file format from <fileSize> sampled file(s), found <formats>. Please specify the format.
Unable to extract bucket information. Path: '<path>', resolved uri: '<uri>'.
Unable to extract key information. Path: '<path>', resolved uri: '<uri>'.
Unable to extract storage account information; path: '<path>', resolved uri: '<uri>'
Received a directory rename event for the path <path>, but we are unable to list this directory efficiently. In order for the stream to continue, set the option 'cloudFiles.ignoreDirRenames' to true, and consider enabling regular backfills with cloudFiles.backfillInterval for this data to be processed.
Unexpected ReadLimit: <readLimit>
Found unknown option keys:
<optionList>
Please make sure that all provided option keys are correct. If you want to skip the
validation of your options and ignore these unknown options, you can set:
.option("cloudFiles.<validateOptions>", "false")
Unknown ReadLimit: <readLimit>
cleanSource 'move' mode configuration unsupported.
For more details see CF_UNSUPPORTED_CLEAN_SOURCE_MOVE
CF_UNSUPPORTED_CLOUD_FILES_SQL_FUNCTIONâThe SQL function 'cloud_files' to create an Auto Loader streaming source is supported only in a DLTs pipeline. See more details at:
<docLink>
Schema inference is not supported for format: <format>. Please specify the schema.
UnsupportedLogVersion: maximum supported log version is v<maxVersion>, but encountered v<version>. The log file was produced by a newer version of DBR and cannot be read by this version. Please upgrade.
Schema evolution mode <mode> is not supported for format: <format>. Please set the schema evolution mode to 'none'.
Reading from a Delta table is not supported with this syntax. If you would like to consume data from Delta, please refer to the docs: read a Delta table (<deltaDocLink>), or read a Delta table as a stream source (<streamDeltaDocLink>). The streaming source from Delta is already optimized for incremental consumption of data.
Error parsing EWKB: <parseError> at position <pos>
Error parsing GeoJSON: <parseError> at position <pos>
For more details see GEOJSON_PARSE_ERROR
GEO_ENCODER_SRID_MISMATCH_ERRORâFailed to encode <type> value because provided SRID <valueSrid> of a value to encode does not match type SRID: <typeSrid>.
<h3Cell> is not a valid H3 cell ID
For more details see H3_INVALID_CELL_ID
H3_INVALID_GRID_DISTANCE_VALUEâH3 grid distance <k> must be non-negative
For more details see H3_INVALID_GRID_DISTANCE_VALUE
H3_INVALID_RESOLUTION_VALUEâH3 resolution <r> must be between <minR> and <maxR>, inclusive
For more details see H3_INVALID_RESOLUTION_VALUE
H3_NOT_ENABLEDâ<h3Expression> is disabled or unsupported. Consider switching to a tier that supports H3 expressions
For more details see H3_NOT_ENABLED
H3_PENTAGON_ENCOUNTERED_ERRORâA pentagon was encountered while computing the hex ring of <h3Cell> with grid distance <k>
H3 grid distance between <h3Cell1> and <h3Cell2> is undefined
Arguments to "<sqlFunction>" must have the same SRID value. SRID values found: <srid1>, <srid2>
"<sqlFunction>": <reason>
Argument to "<sqlFunction>" must be of type <validTypes>
<sqlFunction>: Invalid or unsupported CRS transformation from SRID <srcSrid> to SRID <trgSrid>
Endianness '<e>' must be either 'NDR' (little-endian) or 'XDR' (big-endian)
<sqlFunction>: Invalid geohash value: '<geohash>'. Geohash values must be valid lowercase base32 strings as described in https://en.wikipedia.org/wiki/Geohash#Textual_representation
<sqlFunction>: Invalid index <index> for the provided geospatial value.
Precision <p> must be between <minP> and <maxP>, inclusive
Invalid or unsupported SRID <srid>
<stExpression> is disabled or unsupported. Consider switching to a tier that supports ST expressions
The GEOGRAPHY and GEOMETRY data types cannot be returned in queries. Use one of the following SQL expressions to convert them to standard interchange formats: <projectionExprs>.
Error parsing WKB: <parseError> at position <pos>
For more details see WKB_PARSE_ERROR
WKT_PARSE_ERRORâError parsing WKT: <parseError> at position <pos>
For more details see WKT_PARSE_ERROR
Unity Catalogâ CONFLICTING_COLUMN_NAMES_ERRORâColumn <columnName> conflicts with another column with the same name but with/without trailing whitespaces (for example, an existing column named <columnName>). Please rename the column with a different name.
Invalid request to get connection-level credentials for connection of type <connectionType>. Such credentials are only available for managed PostgreSQL connections.
Connection type '<connectionType>' is not enabled. Please enable the connection to use it.
The shared entity '<securableFullName>' is currently not usable, because it has not been fully synchronized with the corresponding source entity yet. Caused by: <reason>.
There is already a Recipient object '<existingRecipientName>' with the same sharing identifier '<existingMetastoreId>'.
Data of a Delta Sharing Securable Kind <securableKindName> are read-only and can not be created, modified or deleted.
Credential vending is rejected for non Databricks Compute environment due to External Data Access being disabled for metastore <metastoreName>. Please contact your metastore admin to enable 'External Data Access' configuration on the metastore.
Table with id <tableId> cannot be accessed from outside of Databricks Compute Environment due to its kind being <securableKind>. Only 'TABLE_EXTERNAL', 'TABLE_DELTA_EXTERNAL' and 'TABLE_DELTA' table kinds can be accessed externally.
Privilege EXTERNAL USE SCHEMA is not applicable to this entity <assignedSecurableType> and can only be assigned to a schema or catalog. Please remove the privilege from the <assignedSecurableType> object and assign it to a schema or catalog instead.
Table with id <tableId> cannot be written from outside of Databricks Compute Environment due to its kind being <securableKind>. Only 'TABLE_EXTERNAL' and 'TABLE_DELTA_EXTERNAL' table kinds can be written externally.
The storage location for a foreign catalog of type <catalogType> will be used for unloading data and can not be read-only.
The number of <resourceType>s for input path <url> exceeds the allowed limit (<overlapLimit>) for overlapping HMS <resourceType>s.
Delta Sharing requests are not supported using resource names
INVALID_RESOURCE_NAME_ENTITY_TYPEâThe provided resource name references entity type <provided> but expected <expected>
The provided resource name references a metastore that is not in scope for the current request
LOCATION_OVERLAPâInput path url '<path>' overlaps with <overlappingLocation> within '<caller>' call. <conflictingSummary>. <permissionErrorSuggestion>
Creating or updating a MongoDB connection is not allowed because MongoDB SRV connection string does not require port.
Please remove port, because SRV connection string does not require port.
REDSHIFT_FOREIGN_CATALOG_STORAGE_ROOT_MUST_BE_S3âThe storage root for Redshift foreign catalog has to be AWS S3.
SECURABLE_KIND_DOES_NOT_SUPPORT_LAKEHOUSE_FEDERATIONâSecurable with kind <securableKind> does not support Lakehouse Federation.
Securable kind '<securableKind>' is not enabled. If this is a securable kind associated with a preview feature, please enable it in workspace settings.
Securable with type <securableType> does not support Lakehouse Federation.
The source table has more than <columnCount> columns. Please reduce the number of columns to <columnLimitation> or fewer.
Exchanged AAD token lifetime is <lifetime> which is configured too short. Please check your Azure AD setting to make sure temporary access token has at least an hour lifetime. https://learn.microsoft.com/azure/active-directory/develop/active-directory-configurable-token-lifetimes
Dependency '<dependency>' is referenced multiple times and resulted in differing ABAC row filters or column masks.
Error evaluating ABAC policies on '<resource>'. Policy '<policyName>' failed with message: <message>.
Unable to access securable because it resides in a workspace-bound catalog, and the user is not assigned to the associated workspace.
UC_ALTER_DLT_VIEW_OUTSIDE_DEFINING_PIPELINEâAltering the view '<viewFullName>' outside of the pipeline that defined it is not allowed. Instead, update the view definition from the pipeline that defined it (Pipeline ID: <owningPipelineId>).
Atlas is not enabled for the calling service <serviceName>.
Authorizing <actionName> is not supported; please check that the RPC invoked is implemented for this resource type
Cannot create a connection for a builtin hive metastore because user: <userId> is not the admin of the workspace: <workspaceId>
Attempt to modify a restricted field in built-in HMS connection '<connectionName>'. Only 'warehouse_directory' can be updated.
Failed to rename table column <originalLogicalColumn> because it's used for partition filtering in <sharedTableName>. In order to proceed, you can remove the table from the share, rename the column, and share it with the desired partition filtering columns again. Though, this may break the streaming query for your recipient.
Cannot create <securableType> '<securable>' under <parentSecurableType> '<parentSecurable>' because the request is not from a UC cluster.
Cannot create a connection with both username/password and oauth authentication options. Please choose one.
UC_CONNECTION_CREDENTIALS_MAXIMUM_REACHEDâThe maximum number of credentials for connection name '<connectionName>' has been reached. Please delete existing credentials before creating a new one.
Credential for user identity('<userIdentity>') is not found for the connection '<connectionName>'. Please login first to the connection by visiting <connectionPage>
Creating credentials for securable type '<securableType>' is not supported. Supported securable types: <allowedSecurableType>.
Credential '<credentialName>' has one or more dependent connections. You may use force option to continue to update or delete the credential, but the connections using this credential may not work anymore.
The access token associated with the connection is expired. Please update the connection to restart the OAuth flow to retrieve a token.
UC_CONNECTION_EXPIRED_REFRESH_TOKENâThe refresh token associated with the connection is expired. Please update the connection to restart the OAuth flow to retrieve a fresh token.
UC_CONNECTION_IN_FAILED_STATEâThe connection is in the FAILED state. Please update the connection with valid credentials to reactivate it.
Connections of securable type '<securableType>' must include the following option(s): <requiredOptions>.
There is no refresh token associated with the connection. Please update the OAuth client integration in your identity provider to return refresh tokens, and update or recreate the connection to restart the OAuth flow and retrieve the necessary tokens.
UC_CONNECTION_OAUTH_EXCHANGE_FAILEDâThe OAuth token exchange failed with HTTP status code <httpStatus>. The returned server response or exception message is: <response>
Connections of securable type '<securableType>' do not support the following option(s): <optionsNotSupported>. Supported options: <allowedOptions>.
Supports for coordinated commits is not enabled. Please contact Databricks support.
UC_CREATE_FORBIDDEN_UNDER_INACTIVE_SECURABLEâCannot create <securableType> '<securableName>' because it is under a <parentSecurableType> '<parentSecurableName>' that is not active. Please delete the parent securable and recreate the parent.
Failed to parse the provided access connector ID: <accessConnectorId>. Please verify its formatting and try again.
Failed to obtain an AAD token to perform cloud permission validation on an access connector. Please retry the action.
UC_CREDENTIAL_INVALID_CLOUD_PERMISSIONSâSQLSTATE: none assigned
Registering a credential requires the contributor role over the corresponding access connector with ID <accessConnectorId>. Please contact your account admin.
Credential type '<credentialType>' is not supported for purpose '<credentialPurpose>'
SQLSTATE: none assigned
Only the account admin can create or update a credential with type <storageCredentialType>.
The trust policy of the IAM role to allow Databricks Account to assume the role should require an external id. Please contact your account admin to add the external id condition. This behavior is to guard against the Confused Deputy problem (https://docs.aws.amazon.com/IAM/latest/UserGuide/confused-deputy.html).
UC_CREDENTIAL_WORKSPACE_API_PROHIBITEDâCreating or updating a credential as a non-account admin is not supported in the account-level API. Please use the workspace-level API instead.
UC_DBR_TRUST_VERSION_TOO_OLDâThe Databricks Runtime being used no longer supports this operation. Please use the latest version (you may just need to restart your cluster).
UC_DELTA_UNIVERSAL_FORMAT_CANNOT_PARSE_ICEBERG_VERSIONâUnable to parse Apache Iceberg table version from metadata location <metadataLocation>.
A concurrent update to the same iceberg metadata version was detected.
UC_DELTA_UNIVERSAL_FORMAT_INVALID_METADATA_LOCATIONâThe committed metadata location <metadataLocation> is invalid. It is not a subdirectory of the table's root directory <tableRoot>.
The provided delta iceberg format conversion information is missing required fields.
UC_DELTA_UNIVERSAL_FORMAT_NON_CREATE_CONSTRAINTâSetting delta iceberg format information on create is unsupported.
UC_DELTA_UNIVERSAL_FORMAT_TOO_LARGE_CONSTRAINTâThe provided delta iceberg format conversion information is too large.
UC_DELTA_UNIVERSAL_FORMAT_UPDATE_INVALIDâUniform metadata can only be updated on Delta tables with uniform enabled.
UC_DEPENDENCY_DEPTH_LIMIT_EXCEEDEDâ<resourceType> '<ref>' depth exceeds limit (or has a circular reference).
<resourceType> '<ref>' is invalid because one of the underlying resources does not exist. <cause>
<resourceType> '<ref>' does not have sufficient privilege to execute because the owner of one of the underlying resources failed an authorization check. <cause>
A connection called '<connectionName>' with the same URL already exists. Please ask the owner for permission to use that connection instead of creating a duplicate.
Attempted to create a Fabric catalog with url '<storageLocation>' that matches an existing catalog, which is not allowed.
Tag assignment with tag key <tagKey> already exists
Entity <securableType> <entityId> does not have a corresponding online cluster.
There are more than <maxFileResults> files. Please specify [max_results] to limit the number of files returned.
Cannot <opName> <extLoc> <reason>. <suggestion>.
<featureName> is currently disabled in UC.
Creation of a foreign catalog for connection type '<connectionType>' is not supported. This connection type can only be used to create managed ingestion pipelines. Please reference Databricks documentation for more information.
Only READ credentials can be retrieved for foreign tables.
UC_FOREIGN_HMS_SHALLOW_CLONE_MISMATCHâThe base table and clone table must be in the same catalog for shallow clones created in foreign Hive Metastore catalogs. Base table '<baseTableName>' is in catalog '<baseCatalogName>' and clone table '<cloneTableName>' is in catalog '<cloneCatalogName>'.
Foreign key <constraintName> child columns and parent columns are of different sizes.
The foreign key parent columns do not match the referenced primary key child columns. Foreign key parent columns are (<parentColumns>) and primary key child columns are (<primaryKeyChildColumns>).
The foreign key child column type does not match the parent column type. Foreign key child column <childColumnName> has type <childColumnType> and parent column <parentColumnName> has type <parentColumnType>.
Access denied. Cause: service account private key is invalid.
UC_GCP_INVALID_PRIVATE_KEY_JSON_FORMATâGoogle Server Account OAuth Private Key has to be a valid JSON object with required fields, please make sure to provide the full JSON file generated from 'KEYS' section of service account details page.
UC_GCP_INVALID_PRIVATE_KEY_JSON_FORMAT_MISSING_FIELDSâGoogle Server Account OAuth Private Key has to be a valid JSON object with required fields, please make sure to provide the full JSON file generated from 'KEYS' section of service account details page. Missing fields are <missingFields>
The IAM role for this storage credential was found to be non self-assuming. Please check your role's trust and IAM policies to ensure that your IAM role can assume itself according to the Unity Catalog storage credential documentation.
UC_ICEBERG_COMMIT_CONFLICTâCannot commit <tableName>: metadata location <baseMetadataLocation> has changed from <catalogMetadataLocation>.
Cannot perform Managed Apache Iceberg commit to a non Managed Apache Iceberg table: <tableName>.
The provided Managed Apache Iceberg commit information is missing required fields.
UC_ID_MISMATCHâThe <type> <name> does not have ID <wrongId>. Please retry the operation.
Invalid access to database instance. <reason>
Invalid access of <securableType> <securableName> in the federated catalog <catalogName>. <reason>
Invalid Cloudflare account ID.
UC_INVALID_CREDENTIAL_CLOUDâInvalid credential cloud provider '<cloud>'. Allowed cloud provider '<allowedCloud>'.
Invalid value '<value>' for credential's 'purpose'. Allowed values '<allowedValues>'.
Cannot update a connection from <startingCredentialType> to <endingCredentialType>. The only valid transition is from a username/password based connection to an OAuth token based connection.
Invalid cron string. Found: '<cronString>' with parse exception: '<message>'
Invalid direct access managed table <tableName>. Make sure source table & pipeline definition are not defined.
Unexpected empty storage location for <securableType> '<securableName>' in catalog '<catalogName>'. In order to fix this error, please run DESCRIBE SCHEMA <catalogName>.<securableName> and refresh this page.
Invalid options provided for update. Invalid options: <invalidOptions>. Allowed options: <allowedOptions>.
Invalid value '<value>' for '<option>'. Allowed values '<allowedValues>'.
'<option>' cannot be empty. Please enter a non-empty value.
Invalid condition in policy '<policyName>'. Compilation error with message '<message>'.
Invalid R2 access key ID.
UC_INVALID_R2_SECRET_ACCESS_KEYâInvalid R2 secret access key.
UC_INVALID_UPDATE_ON_SYSTEM_WORKSPACE_ADMIN_GROUP_OWNED_SECURABLEâCannot update <securableType> '<securableName>' as it's owned by an internal group. Please contact Databricks support for additional details.
Provided Storage Credential <storageCredentialName> is not associated with DBFS Root, creation of wasbs External Location is prohibited.
Storage location has invalid URI scheme: <scheme>.
The response from the token server was missing the field <missingField>. The returned server response is: <response>
'<metastoreAssignmentStatus>' cannot be assigned. Only MANUALLY_ASSIGNABLE and AUTO_ASSIGNMENT_ENABLED are supported.
Metastore certification is not enabled.
UC_METASTORE_HAS_ACTIVE_MANAGED_ONLINE_CATALOGSâSQLSTATE: none assigned
The metastore <metastoreId> has <numberManagedOnlineCatalogs> managed online catalog(s). Please explicitly delete them, then retry the metastore deletion.
Metastore root credential cannot be defined when updating the metastore root location. The credential will be fetched from the metastore parent external location.
UC_METASTORE_STORAGE_ROOT_DELETION_INVALIDâDeletion of metastore storage root location failed. <reason>
The root <securableType> for a metastore cannot be read-only.
Metastore storage root cannot be updated once it is set.
UC_MODEL_INVALID_STATEâCannot generate temporary '<opName>' credentials for model version <modelVersion> with status <modelVersionStatus>. '<opName>' credentials can only be generated for model versions with status <validStatus>
Attempted to access org ID (or workspace ID), but context has none.
UC_ONLINE_CATALOG_NOT_MUTABLEâSQLSTATE: none assigned
The <rpcName> request updates <fieldName>. Use the online store compute tab to modify anything other than comment, owner and isolationMode of an online catalog.
Cannot create more than <quota> online stores in the metastore and there is already <currentCount>. You may not have access to any existing online stores. Contact your metastore admin to be granted access or for further instructions.
SQLSTATE: none assigned
online index catalogs must be <action> via the /vector-search API.
SQLSTATE: none assigned
The <rpcName> request updates <fieldName>. Use the /vector-search API to modify anything other than comment, owner and isolationMode of an online index catalog.
Cannot create more than <quota> online index catalogs in the metastore and there is already <currentCount>. You may not have access to any existing online index catalogs. Contact your metastore admin to be granted access or for further instructions.
online indexes must be <action> via the /vector-search API.
SQLSTATE: none assigned
online stores must be <action> via the online store compute tab.
The source table column name <columnName> is too long. The maximum length is <maxLength> characters.
Column <columnName> cannot be used as a primary key column of the online table because it is not part of the existing PRIMARY KEY constraint of the source table. For details, please see <docLink>
Column <columnName> cannot be used as a timeseries key of the online table because it is not a timeseries column of the existing PRIMARY KEY constraint of the source table. For details, please see <docLink>
Cannot create more than <quota> online table(s) per source table.
Accessing resource <resourceName> requires use of a Serverless SQL warehouse. Please ensure the warehouse being used to execute a query or view a database catalog in the UI is serverless. For details, please see <docLink>
Cannot create more than <quota> continuous online views in the online store, and there is already <currentCount>. You may not have access to any existing online views. Contact your online store admin to be granted access or for further instructions.
SQLSTATE: none assigned
<tableKind> can not be created under storage location with Databricks Managed Keys. Please choose a different schema/catalog in a storage location without Databricks Managed Keys encryption.
Invalid catalog <catalogName> with kind <catalogKind> to create <tableKind> within. <tableKind> can only be created under catalogs of kinds: <validCatalogKinds>.
Invalid schema <schemaName> with kind <schemaKind> to create <tableKind> within. <tableKind> can only be created under schemas of kinds: <validSchemaKinds>.
Column <columnName> of type <columnType> cannot be used as a TTL time column. Allowed types are <supportedTypes>.
Operation not supported by Unity Catalog. <detailedMessage>
Authorized Path Error. The <securableType> location <location> is not defined within the authorized paths for catalog: <catalogName>. Please ask the catalog owner to add the path to the list of authorized paths defined on the catalog.
The 'authorized_paths' option contains overlapping paths: <overlappingPaths>. Ensure each path is unique and does not intersect with others in the list.
The query argument '<arg>' is set to '<received>' which is different to the value used in the first pagination call ('<expected>')
The credential '<credentialName>' is a workspace default credential that is only allowed to access data in the following paths: '<allowlist>'. Please ensure that any path accessed using this credential is under one of these paths.
The credential '<credentialName>' is a workspace default credential that cannot access data in the following restricted path: '<targetPath>'.
The input path is too long. Allowed length: <maxLength>. Input length: <inputLength>. Input: <path>...
Concurrency limit exceeded for metastore <metastoreId>. Please try again later. If the problem persists, please reach out to support. Error code #UC-<errorCodeArbitraryFiveLettersUpperCase>
Cannot create more than <quota> synced database table(s) per source table.
Cannot create the primary key <constraintName> because its child column(s) <childColumnNames> is nullable. Please change the column nullability and retry.
This operation took too long.
UC_ROOT_STORAGE_S3_BUCKET_NAME_CONTAINS_DOTâRoot storage S3 bucket name containing dots is not supported by Unity Catalog: <uri>
Unexpected empty storage location for schema '<schemaName>' in catalog '<catalogName>'. Please make sure the schema uses a path scheme of <validPathSchemesListStr>.
Serverless notebooks cannot retrieve temporary storage credentials from Unity Catalog.
UC_STORAGE_CREDENTIALS_WITH_EXTERNAL_LOCATION_DELETION_DENIEDâStorage credential '<credentialName>' has <extTablesCount> directly dependent external table(s) and <extLocationsCount> dependent storage location(s). You may use force option to delete it but the managed storage data using this storage credential cannot be purged by Unity Catalog anymore.
Storage credential '<credentialName>' has <extTablesCount> directly dependent external table(s) and <extLocationsCount> dependent storage location(s); use force option to update anyway.
Failed to parse the provided access connector ID: <accessConnectorId>. Please verify its formatting and try again.
Cannot create a storage credential for DBFS root because user: <userId> is not the admin of the workspace: <workspaceId>
DBFS root storage credential is not yet supported for workspaces with Firewall-enabled DBFS
UC_STORAGE_CREDENTIAL_DBFS_ROOT_PRIVATE_NOT_SUPPORTEDâDBFS root storage credential for current workspace is not yet supported
UC_STORAGE_CREDENTIAL_DBFS_ROOT_WORKSPACE_DISABLEDâDBFS root is not enabled for workspace <workspaceId>
Failed to obtain an AAD token to perform cloud permission validation on an access connector. Please retry the action.
UC_STORAGE_CREDENTIAL_INVALID_CLOUD_PERMISSIONSâRegistering a storage credential requires the contributor role over the corresponding access connector with ID <accessConnectorId>. Please contact your account admin.
Storage credential '<credentialName>' cannot be deleted because it is configured as this metastore's root credential. Please update the metastore's root credential before attempting deletion.
Only the account admin can create or update a storage credential with type <storageCredentialType>.
Missing validation token for service principal. Please provide a valid ARM-scoped Entra ID token in the 'X-Databricks-Azure-SP-Management-Token' request header and retry. For details, check https://docs.databricks.com/api/workspace/storagecredentials
UC_STORAGE_CREDENTIAL_TRUST_POLICY_IS_OPENâThe trust policy of the IAM role to allow Databricks Account to assume the role should require an external id. Please contact your account admin to add the external id condition. This behavior is to guard against the Confused Deputy problem (https://docs.aws.amazon.com/IAM/latest/UserGuide/confused-deputy.html).
UC_STORAGE_CREDENTIAL_WASBS_NOT_DBFS_ROOTâLocation <location> is not inside the DBFS root, because of that we can't create an storage credential <storageCredentialName>
Creating or updating a storage credential as a non-account admin is not supported in the account-level API. Please use the workspace-level API instead.
UC_STORAGE_CREDENTIAL_WS_BUCKET_INVALID_LOCATIONâLocation <requestedLocation> is not inside the allowed context <allowedLocation>
Workspace internal catalog storage credential for current workspace is not yet supported
UC_SYSTEM_WORKSPACE_GROUP_PERMISSION_UNSUPPORTEDâCannot grant privileges on <securableType> to system generated group <principal>.
Request to perform commit/getCommits for table '<tableId>' requires enabling Catalog owned feature on the table.
Tag assignment with tag key <tagKey> does not exist
Temporary credential operation is not supported.
UC_UNDROP_RESOURCE_ID_ALREADY_EXISTSâCannot undrop '<resourceType>' because a '<resourceType>' with id '<resourceId>' already exists.
Cannot undrop '<resourceType>' because a '<resourceType>' with name '<resourceName>' already exists.
Cannot undrop '<resourceType>' because the '<resourceType>' with id '<resourceId>' is not ready to be restored, please retry later.
Cannot undrop '<resourceType>' because the '<resourceType>' with id '<resourceId>' is beyond the supported restoration period of '<maxRestorationPeriodDay>' days.
Failed to create UNIQUE constraint <newConstraintName>: table <tableName> already has a UNIQUE constraint: <existingConstraintName>, that has the same set of child columns.
Failed to operate with UNIQUE constraint <constraintName>: UNIQUE constraint is not enabled.
Invalid base path provided, base path should be something like /api/resources/v1. Unsupported path: <path>
Invalid host name provided, host name should be something like https://www.databricks.com without path suffix. Unsupported host: <host>
Only basic Latin/Latin-1 ASCII chars are supported in external location/volume/table paths. Unsupported path: <path>
Cannot update <securableType> '<securableName>' because it is being provisioned.
The <type> <name> has been modified by another request. Please retry the operation.
Request to perform commit/getCommits for table '<tableId>' from outside of Databricks Unity Catalog enabled compute environment is denied for security. Please contact Databricks support for integrations with Unity Catalog.
Request to create staging table '<tableFullName>' from outside of Databricks Unity Catalog enabled compute environment is denied for security. Please contact Databricks support for integrations with Unity Catalog.
Request to create table '<tableFullName>' from outside of Databricks Unity Catalog enabled compute environment is denied. Column masks are not supported when creating tables externally.
Request to create table '<tableFullName>' from outside of Databricks Unity Catalog enabled compute environment is denied. Data source format must be DELTA to create table externally, instead it is '<dataSourceFormat>'.
Request to create table '<tableFullName>' from outside of Databricks Unity Catalog enabled compute environment is denied. Table type must be EXTERNAL to create table externally, instead it is '<tableType>'.
External table creation only allows these fields: [name, catalogName, schemaName, tableType, dataSourceFormat, columnInfos, storageLocation, propertiesKvpairs].
UNITY_CATALOG_EXTERNAL_CREATE_TABLE_REQUEST_FOR_NON_EXTERNAL_TABLE_DENIEDâRequest to create non-external table '<tableFullName>' from outside of Databricks Unity Catalog enabled compute environment is denied for security. Please contact Databricks support for integrations with Unity Catalog.
Request to delete non-external table '<tableFullName>' from outside of Databricks Unity Catalog enabled compute environment is not supported.
Request to generate access credential for path '<path>' from outside of Databricks Unity Catalog enabled compute environment is denied for security. Please contact Databricks support for integrations with Unity Catalog.
Request to generate access credential for table '<tableId>' from outside of Databricks Unity Catalog enabled compute environment is denied for security. Please contact Databricks support for integrations with Unity Catalog.
Request to generate temporary path credential from outside of Databricks Unity Catalog enabled compute environment is denied. Credential ID must not be defined when generating temporary path credentials externally.
UNITY_CATALOG_EXTERNAL_GENERATE_TEMP_PATH_CRED_FAILED_VALIDATION_MAKE_PATH_ONLY_PARENT_DEFINEDâRequest to generate temporary path credential from outside of Databricks Unity Catalog enabled compute environment is denied. make_path_only_parent must not be defined when generating temporary path credentials externally.
UNITY_CATALOG_EXTERNAL_GET_FOREIGN_CREDENTIALS_DENIEDâRequest to get foreign credentials for securables from outside of Databricks Unity Catalog enabled compute environment is denied for security.
UNITY_CATALOG_EXTERNAL_UPDATA_METADATA_SNAPSHOT_DENIEDâRequest to update metadata snapshots from outside of Databricks Unity Catalog enabled compute environment is denied for security.
WRITE_CREDENTIALS_NOT_SUPPORTED_FOR_LEGACY_MANAGED_ONLINE_TABLEâInvalid request to get write credentials for managed online table in an online catalog.
Files APIâ FILES_API_API_IS_NOT_ENABLEDâSQLSTATE: none assigned
<api_name> API is not enabled
SQLSTATE: none assigned
Requested method of Files API is not supported for cloud paths
FILES_API_AWS_ACCESS_DENIEDâSQLSTATE: none assigned
Access to the storage bucket is denied by AWS.
FILES_API_AWS_ALL_ACCESS_DISABLEDâSQLSTATE: none assigned
All access to the storage bucket has been disabled in AWS.
FILES_API_AWS_BUCKET_DOES_NOT_EXISTâSQLSTATE: none assigned
The storage bucket does not exist in AWS.
FILES_API_AWS_FORBIDDENâSQLSTATE: none assigned
Access to the storage bucket is forbidden by AWS.
SQLSTATE: none assigned
The workspace is misconfigured: it must be in the same region as the AWS workspace root storage bucket.
FILES_API_AWS_INVALID_BUCKET_NAMEâSQLSTATE: none assigned
The storage bucket name is invalid.
FILES_API_AWS_KMS_KEY_DISABLEDâSQLSTATE: none assigned
The configured KMS keys to access the storage bucket are disabled in AWS.
FILES_API_AWS_UNAUTHORIZEDâSQLSTATE: none assigned
Access to AWS resource is unauthorized.
FILES_API_AZURE_ACCOUNT_IS_DISABLEDâSQLSTATE: none assigned
The storage account is disabled in Azure.
FILES_API_AZURE_AUTHORIZATION_PERMISSION_MISMATCHâSQLSTATE: none assigned
The authorization permission mismatch.
FILES_API_AZURE_CONTAINER_DOES_NOT_EXISTâSQLSTATE: none assigned
The Azure container does not exist.
FILES_API_AZURE_FORBIDDENâSQLSTATE: none assigned
Access to the storage container is forbidden by Azure.
FILES_API_AZURE_HAS_A_LEASEâSQLSTATE: none assigned
Azure responded that there is currently a lease on the resource. Try again later.
FILES_API_AZURE_INSUFFICIENT_ACCOUNT_PERMISSIONâSQLSTATE: none assigned
The account being accessed does not have sufficient permissions to execute this operation.
FILES_API_AZURE_INVALID_STORAGE_ACCOUNT_CONFIGURATIONâSQLSTATE: none assigned
The configuration of the account being accessed is not supported.
FILES_API_AZURE_INVALID_STORAGE_ACCOUNT_NAMEâSQLSTATE: none assigned
Cannot access storage account in Azure: invalid storage account name.
FILES_API_AZURE_KEY_BASED_AUTHENTICATION_NOT_PERMITTEDâSQLSTATE: none assigned
The key vault vault is not found in Azure. Check your customer-managed keys settings.
FILES_API_AZURE_KEY_VAULT_KEY_NOT_FOUNDâSQLSTATE: none assigned
The Azure key vault key is not found in Azure. Check your customer-managed keys settings.
FILES_API_AZURE_KEY_VAULT_VAULT_NOT_FOUNDâSQLSTATE: none assigned
The key vault vault is not found in Azure. Check your customer-managed keys settings.
FILES_API_AZURE_MI_ACCESS_CONNECTOR_NOT_FOUNDâSQLSTATE: none assigned
Azure Managed Identity Credential with Access Connector not found. This could be because IP access controls rejected your request.
FILES_API_AZURE_OPERATION_TIMEOUTâSQLSTATE: none assigned
The operation could not be completed within the permitted time.
FILES_API_AZURE_PATH_INVALIDâSQLSTATE: none assigned
The requested path is not valid for Azure.
FILES_API_AZURE_PATH_IS_IMMUTABLEâSQLSTATE: none assigned
The requested path is immutable.
SQLSTATE: none assigned
One of the headers specified in operation is not supported.
FILES_API_CANNOT_PARSE_URL_PARAMETERâSQLSTATE: none assigned
The URL parameter cannot be parsed.
FILES_API_CATALOG_NOT_FOUNDâSQLSTATE: none assigned
<unity_catalog_error_message>
SQLSTATE: none assigned
<message>
SQLSTATE: none assigned
There's a connection issue reaching <cloud_storage_provider>. Please try again later.
SQLSTATE: none assigned
the ':' character is not supported in paths
FILES_API_CONSUMER_NETWORK_ZONE_NOT_ALLOWEDâSQLSTATE: none assigned
Consumer network zone "<consumer_network_zone>" is not allowed from requester network zone "<requester_network_zone>".
SQLSTATE: none assigned
Databricks Control plane network zone not allowed.
FILES_API_CREDENTIAL_NOT_FOUNDâSQLSTATE: none assigned
The credential was not found.
FILES_API_DIRECTORIES_CANNOT_HAVE_BODIESâSQLSTATE: none assigned
A body was provided but directories cannot have a file body
FILES_API_DIRECTORY_IS_NOT_EMPTYâSQLSTATE: none assigned
The directory is not empty. This operation is not supported on non-empty directories.
FILES_API_DIRECTORY_IS_NOT_FOUNDâSQLSTATE: none assigned
The directory being accessed is not found.
FILES_API_DMK_ENCRYPTION_ROOT_KEY_DISABLEDâSQLSTATE: none assigned
The root key for the customer-managed encryption is disabled.
SQLSTATE: none assigned
The request contained multiple copies of a header that is only allowed once.
FILES_API_DUPLICATE_QUERY_PARAMETERâSQLSTATE: none assigned
Query parameter '<parameter_name>' must be present exactly once but was provided multiple times.
SQLSTATE: none assigned
The DBFS bucket name is empty.
FILES_API_ENCRYPTION_KEY_PERMISSION_DENIEDâSQLSTATE: none assigned
User does not have access to the encryption key.
FILES_API_ENCRYPTION_KEY_RETRIEVAL_OPERATION_TIMEOUTâSQLSTATE: none assigned
The operation to retrieve encryption key could not be completed within the permitted time.
FILES_API_ENTITY_TOO_LARGEâSQLSTATE: none assigned
Your object exceeds the maximum allowed object size.
FILES_API_ERROR_EXPIRED_TTLâSQLSTATE: none assigned
The TTL has expired.
FILES_API_ERROR_INVALID_TTLâSQLSTATE: none assigned
The TTL is invalid.
FILES_API_ERROR_KEY_FOR_WORKSPACE_IS_NOT_FOUNDâSQLSTATE: none assigned
The key for the workspace is not found.
FILES_API_ERROR_MISSING_REQUIRED_PARAMâSQLSTATE: none assigned
The URL is missing a required parameter.
FILES_API_ERROR_TTL_IN_THE_FUTUREâSQLSTATE: none assigned
The TTL is in the future.
FILES_API_ERROR_URL_INVALID_ISSUER_SHARD_NAMEâSQLSTATE: none assigned
The issuer shard name is invalid.
FILES_API_EXPIRATION_TIME_MUST_BE_PRESENTâSQLSTATE: none assigned
expiration time must be present
FILES_API_EXPIRED_TOKENâSQLSTATE: none assigned
The provided token has expired.
FILES_API_EXPIRE_TIME_MUST_BE_IN_THE_FUTUREâSQLSTATE: none assigned
ExpireTime must be in the future
FILES_API_EXPIRE_TIME_TOO_FAR_IN_FUTUREâSQLSTATE: none assigned
Requested TTL is longer than supported (1 hour)
FILES_API_EXTERNAL_LOCATION_PATH_OVERLAP_OTHER_UC_STORAGE_ENTITYâSQLSTATE: none assigned
<unity_catalog_error_message>
SQLSTATE: none assigned
The file being created already exists.
FILES_API_FILE_NOT_FOUNDâSQLSTATE: none assigned
The file being accessed is not found.
FILES_API_FILE_OR_DIRECTORY_ENDS_IN_DOTâSQLSTATE: none assigned
Files or directories ending in the '.' character are not supported.
FILES_API_FILE_SIZE_EXCEEDEDâSQLSTATE: none assigned
File size shouldn't exceed <max_download_size_in_bytes> bytes, but <size_in_bytes> bytes were found.
SQLSTATE: none assigned
Access to the storage bucket has been disabled in GCP.
FILES_API_GCP_BUCKET_DOES_NOT_EXISTâSQLSTATE: none assigned
The storage bucket does not exist in GCP.
FILES_API_GCP_FORBIDDENâSQLSTATE: none assigned
Access to the bucket is forbidden by GCP.
FILES_API_GCP_KEY_DISABLED_OR_DESTROYEDâSQLSTATE: none assigned
The customer-managed encryption key configured for that location is either disabled or destroyed.
FILES_API_GCP_REQUEST_IS_PROHIBITED_BY_POLICYâSQLSTATE: none assigned
The GCP requests to the bucket are prohibited by policy, check the VPC service controls.
FILES_API_HOST_TEMPORARILY_NOT_AVAILABLEâSQLSTATE: none assigned
Cloud provider host is temporarily not available; please try again later.
FILES_API_INVALID_CONTENT_LENGTHâSQLSTATE: none assigned
The value of the content-length header must be an integer greater than or equal to 0.
FILES_API_INVALID_CONTINUATION_TOKENâSQLSTATE: none assigned
The provided page token is not valid.
FILES_API_INVALID_HOSTNAMEâSQLSTATE: none assigned
The hostname is invalid.
FILES_API_INVALID_HTTP_METHODâSQLSTATE: none assigned
Invalid http method. Expected '<expected>' but got '<actual>'.
SQLSTATE: none assigned
The metastore ID header is invalid.
FILES_API_INVALID_PAGE_TOKENâSQLSTATE: none assigned
invalid page token
FILES_API_INVALID_PATHâSQLSTATE: none assigned
Invalid path: <validation_error>
SQLSTATE: none assigned
The range header is invalid.
FILES_API_INVALID_RESOURCE_FULL_NAMEâSQLSTATE: none assigned
<unity_catalog_error_message>
SQLSTATE: none assigned
Invalid session token
FILES_API_INVALID_SESSION_TOKEN_TYPEâSQLSTATE: none assigned
Invalid session token type. Expected '<expected>' but got '<actual>'.
SQLSTATE: none assigned
The timestamp is invalid.
FILES_API_INVALID_UPLOAD_TYPEâSQLSTATE: none assigned
Invalid upload type. Expected '<expected>' but got '<actual>'.
SQLSTATE: none assigned
Invalid URL
FILES_API_INVALID_URL_PARAMETERâSQLSTATE: none assigned
The URL passed as parameter is invalid
FILES_API_INVALID_VALUE_FOR_OVERWRITE_QUERY_PARAMETERâSQLSTATE: none assigned
Query parameter 'overwrite' must be one of: true,false but was: <got_values>
SQLSTATE: none assigned
Query parameter '<parameter_name>' must be one of: <expected> but was: <actual>
SQLSTATE: none assigned
Malformed request body
FILES_API_MANAGED_CATALOG_FEATURE_DISABLEDâSQLSTATE: none assigned
<unity_catalog_error_message>
SQLSTATE: none assigned
<unity_catalog_error_message>
SQLSTATE: none assigned
Requested method of Files API is not supported for Jobs Background Compute Artifact Storage.
FILES_API_MISSING_CONTENT_LENGTHâSQLSTATE: none assigned
The content-length header is required in the request.
FILES_API_MISSING_QUERY_PARAMETERâSQLSTATE: none assigned
Query parameter '<parameter_name>' is required but is missing from the request.
SQLSTATE: none assigned
The request is missing a required parameter.
FILES_API_MLFLOW_PERMISSION_DENIEDâSQLSTATE: none assigned
<mlflow_error_message>
SQLSTATE: none assigned
Model version is not ready yet
FILES_API_MULTIPART_UPLOAD_ABORT_PRESIGNED_URL_NOT_SUPPORTEDâSQLSTATE: none assigned
Presigned URLs for aborting multipart uploads are not supported for files stored on <cloud_storage_provider>.
SQLSTATE: none assigned
The list of parts must have at least one element but was empty.
FILES_API_MULTIPART_UPLOAD_INVALID_PARTâSQLSTATE: none assigned
One or more of the specified parts could not be found. The part may not have been uploaded, or the specified entity tag may not match the part's entity tag.
FILES_API_MULTIPART_UPLOAD_INVALID_PART_NUMBERâSQLSTATE: none assigned
Part numbers must be greater than or equal to <min> and smaller than or equal to <max>.
SQLSTATE: none assigned
ETags must be provided for files stored on <cloud_storage_provider>. At least one ETag was not provided or empty.
SQLSTATE: none assigned
The internal state of the storage entity has been modified because the upload was initiated, e.g. because the file path does not point to the same underlying cloud storage location. Proceed by initiating a new upload session.
FILES_API_MULTIPART_UPLOAD_NON_TRAILING_PARTS_WITH_DIFFERENT_SIZESâSQLSTATE: none assigned
The parts uploaded as part of a multipart upload session must be of the same size for files stored on <cloud_storage_provider>, except for the last part which can be smaller.
SQLSTATE: none assigned
The size of the parts uploaded as part of a multipart upload session must be greater than or equal to <min> and smaller than or equal to <max>.
SQLSTATE: none assigned
The upload session is not found. It may have been aborted or completed.
FILES_API_MULTIPART_UPLOAD_UNORDERED_PART_LISTâSQLSTATE: none assigned
The list of part must be ordered by the part number but was unordered.
FILES_API_NON_ZERO_CONTENT_LENGTHâSQLSTATE: none assigned
The content-length header must be zero for this request.
FILES_API_NOT_ENABLED_FOR_PLACEâSQLSTATE: none assigned
Files API for <place> is not enabled for this workspace/account
SQLSTATE: none assigned
Requested method of Files API is not supported for Internal Workspace Storage
FILES_API_OPERATION_MUST_BE_PRESENTâSQLSTATE: none assigned
operation must be present
FILES_API_OPERATION_TIMEOUTâSQLSTATE: none assigned
The operation timed out.
FILES_API_PAGE_SIZE_MUST_BE_GREATER_OR_EQUAL_TO_ZEROâSQLSTATE: none assigned
page_size must be greater than or equal to 0
FILES_API_PATH_BASED_ACCESS_TO_TABLE_WITH_FILTER_NOT_ALLOWEDâSQLSTATE: none assigned
<unity_catalog_error_message>
SQLSTATE: none assigned
Paths ending in the '/' character represent directories. This API does not support operations on directories.
FILES_API_PATH_IS_A_DIRECTORYâSQLSTATE: none assigned
The given path points to an existing directory. This API does not support operations on directories.
FILES_API_PATH_IS_A_FILEâSQLSTATE: none assigned
The given path points to an existing file. This API does not support operations on files.
FILES_API_PATH_IS_NOT_A_VALID_UTF8_ENCODED_URLâSQLSTATE: none assigned
the given path was not a valid UTF-8 encoded URL
FILES_API_PATH_IS_NOT_ENABLED_FOR_DATAPLANE_PROXYâSQLSTATE: none assigned
Given path is not enabled for data plane proxy
FILES_API_PATH_MUST_BE_PRESENTâSQLSTATE: none assigned
path must be present
FILES_API_PATH_NOT_SUPPORTEDâSQLSTATE: none assigned
<rejection_message>
SQLSTATE: none assigned
Provided file path is too long.
FILES_API_PRECONDITION_FAILEDâSQLSTATE: none assigned
The request failed due to a precondition.
FILES_API_PRESIGNED_URLS_FOR_MODELS_NOT_SUPPORTEDâSQLSTATE: none assigned
Files API for presigned URLs for models are not supported at the moment
FILES_API_R2_CREDENTIALS_DISABLEDâSQLSTATE: none assigned
R2 is unsupported at the moment.
FILES_API_RANGE_NOT_SATISFIABLEâSQLSTATE: none assigned
The range requested is not satisfiable.
FILES_API_RECURSIVE_LIST_IS_NOT_SUPPORTEDâSQLSTATE: none assigned
Recursively listing files is not supported.
FILES_API_REQUESTER_NETWORK_ZONE_UNKNOWNâSQLSTATE: none assigned
Can't infer requester network zone.
FILES_API_REQUEST_GOT_ROUTED_INCORRECTLYâSQLSTATE: none assigned
Request got routed incorrectly
FILES_API_REQUEST_MUST_INCLUDE_ACCOUNT_INFORMATIONâSQLSTATE: none assigned
Request must include account information
FILES_API_REQUEST_MUST_INCLUDE_RECIPIENT_INFORMATIONâSQLSTATE: none assigned
Request must include recipient information.
FILES_API_REQUEST_MUST_INCLUDE_USER_INFORMATIONâSQLSTATE: none assigned
Request must include user information
FILES_API_REQUEST_MUST_INCLUDE_WORKSPACE_INFORMATIONâSQLSTATE: none assigned
Request must include workspace information
FILES_API_RESOURCE_IS_READONLYâSQLSTATE: none assigned
Resource is read-only.
FILES_API_RESOURCE_NOT_FOUNDâSQLSTATE: none assigned
<unity_catalog_error_message>
SQLSTATE: none assigned
<unity_catalog_error_message>
SQLSTATE: none assigned
The URL can't be accessed.
FILES_API_SIGNATURE_VERIFICATION_FAILEDâSQLSTATE: none assigned
The signature verification failed.
FILES_API_STORAGE_ACCESS_CONTEXT_INVALIDâSQLSTATE: none assigned
Storage access context is invalid.
FILES_API_STORAGE_CONTEXT_IS_NOT_SETâSQLSTATE: none assigned
Storage configuration for this workspace is not accessible.
FILES_API_STORAGE_CREDENTIAL_NOT_FOUNDâSQLSTATE: none assigned
<unity_catalog_error_message>
SQLSTATE: none assigned
Files API is not supported for <table_type>
SQLSTATE: none assigned
<unity_catalog_error_message>
SQLSTATE: none assigned
<unity_catalog_error_message>
SQLSTATE: none assigned
<unity_catalog_error_message>
SQLSTATE: none assigned
<unity_catalog_error_message>
SQLSTATE: none assigned
<message>
SQLSTATE: none assigned
<unity_catalog_error_message>
SQLSTATE: none assigned
<unity_catalog_error_message>
SQLSTATE: none assigned
Unable to renew Azure managed identity.
FILES_API_UNEXPECTED_ERROR_WHILE_PARSING_URIâSQLSTATE: none assigned
Unexpected error when parsing the URI
FILES_API_UNEXPECTED_QUERY_PARAMETERSâSQLSTATE: none assigned
Unexpected query parameters: <unexpected_query_parameters>
SQLSTATE: none assigned
Unknown method <method>
SQLSTATE: none assigned
Unknown server error.
FILES_API_UNKNOWN_URL_HOSTâSQLSTATE: none assigned
The URL host is unknown.
FILES_API_UNSUPPORTED_AUTHENTICATION_METHODâSQLSTATE: none assigned
The request was not authenticated correctly.
FILES_API_UNSUPPORTED_HTTP_METHODâSQLSTATE: none assigned
The httpMethod is not supported.
FILES_API_UNSUPPORTED_PARAMETERS_COMBINATIONâSQLSTATE: none assigned
The combination of parameters is not supported.
FILES_API_UNSUPPORTED_PATHâSQLSTATE: none assigned
The provided path is not supported by the Files API. Make sure the provided path does not contain instances of '../' or './' sequences. Make sure the provided path does not use multiple consecutive slashes (e.g. '///').
FILES_API_UPLOAD_PART_URLS_COUNT_MUST_BE_GREATER_THAN_ZEROâSQLSTATE: none assigned
Input parameter 'count' must be greater than 0.
FILES_API_URL_GENERATION_DISABLEDâSQLSTATE: none assigned
Presigned URL generation is not enabled for <cloud>.
SQLSTATE: none assigned
Files API is not supported for <volume_type>.
SQLSTATE: none assigned
The workspace has been canceled.
FILES_API_WORKSPACE_IS_NOT_FOUNDâSQLSTATE: none assigned
Storage configuration for this workspace is not accessible.
Lakeflow Declarative Pipelinesâ ABAC_POLICIES_NOT_SUPPORTEDâABAC policies are not supported on tables defined within a pipeline.
Remove the policies or contact Databricks support.
ACTIVE_UPDATE_EXISTS_FOR_LINKED_PIPELINEâAn active update '<updateId>' already exists for linked pipeline '<linkedPipelineId>'.
An active update '<updateId>' already exists for pipeline '<pipelineId>'.
ALTER is not allowed on tables managed by a
For more details see ALTER_NOT_ALLOWED_FOR_PIPELINE_TABLE
ALTER_SCHEDULE_SCHEDULE_DOES_NOT_EXISTâCannot alter <type> on a table without an existing schedule or trigger. Please add a schedule or trigger to the table before attempting to alter it.
<apiName> is not supported for pipelines in Workspace.
You have exceeded the API quota for the data source <sourceName>.
For more details see API_QUOTA_EXCEEDED
APPLY_CHANGES_ERRORâAn error occurred during the AUTO CDC operation.
For more details see APPLY_CHANGES_ERROR
APPLY_CHANGES_FROM_SNAPSHOT_ERRORâAn error occurred during the AUTO CDC FROM SNAPSHOT operation.
For more details see APPLY_CHANGES_FROM_SNAPSHOT_ERROR
APPLY_CHANGES_FROM_SNAPSHOT_EXPECTATIONS_NOT_SUPPORTEDâDataset <datasetName> has expectations defined, but expectations are not currently supported for datasets using AUTO CDC FROM SNAPSHOT.
Remove the expectations to resolve this error. As an alternative, consider using the following structure to apply expectations by combining AUTO CDC and AUTO CDC FROM SNAPSHOT:
Apply changes from snapshot using SCD type 1 to an intermediate table without expectations.
Read changes from the intermediate table using spark.readStream.option("readChangeFeed", "true").table.
Apply changes from the intermediate table to the final target table using dlt.create_auto_cdc_flow with the following parameters in addition to those currently used with dlt.acreate_auto_cdc_flow_from_snapshot:
To handle changes: apply_as_deletes = "_change_type == 'delete'"
To remove columns added by the CDF: except_column_list = ["_change_type", "_commit_version", "_commit_timestamp"]
dlt.create_auto_cdc_flow.Feature COLUMNS TO UPDATE is in preview and not enabled for your workspace. Please reach out to your Databricks representative to learn more about this feature and access the private preview.
For more details see ARCHITECTURE_MIGRATION_FAILURE
ARCLIGHT_REQUIRES_SERVERLESSâPipelines targeting catalogs using Default Storage must use serverless compute. If you don't have access to serverless compute, please contact Databricks to enable this feature for your workspace.
BIGQUERY_DATA_CONNECTOR_SOURCE_CATALOG_MISSINGâAn error occurred in the BigQuery data connector.
The 'source catalog' (GCP Project ID) is missing in your ingestion specification.
Please specify the source catalog (project ID) in your ingestion specification to resolve this issue.
CANNOT_ADD_COLUMN_TO_INCLUDE_COLUMNSâNew columns (<columnNames>) are added to include_columns field in pipeline definition for the table <qualifiedTableName>. Please full refresh the table to avoid potential data loss or remove these columns from include_columns.
Cannot add storage location to an existing pipeline with defined catalog, if you want to set a storage location create a new pipeline.
Existing catalog: '<catalog>'.
Requested storage location: <storageLocation>.
SQLSTATE: none assigned
The @<decoratorName>decorator cannot be composed with<otherDecorators>.
Pipeline definition excludes columns (<columnNames>) that do not exist in the table <qualifiedTableName> of source <sourceType>. Please remove these columns from the exclude_columns field.
Pipeline definition does not include required columns (<columnNames>) in the table <qualifiedTableName> of source <sourceType> for ingestion. Please add them to include_columns or remove them from exclude_columns.
Pipeline definition includes columns (<columnNames>) that do not exist in the table <qualifiedTableName> of source <sourceType>. Please remove these columns from the include_columns field.
The table <qualifiedTableName> in the <sourceType> source doesn't have a primary key.
Please specify a primary key in connector configuration to ingest the table if it exists.
CANNOT_MODIFY_PIPELINE_OWNER_FOR_UC_PIPELINESâChanging owner for non-UC pipelines is not supported yet.
CANNOT_MODIFY_PIPELINE_OWNER_PERMISSION_DENIEDâOnly workspace admins can change pipeline owner.
CANNOT_MODIFY_PIPELINE_OWNER_WHEN_MISSINGâNew owner does not exist.
CANNOT_MODIFY_PIPELINE_TYPEâpipeline_type cannot be updated.
Current pipeline_type: <currentPipelineType>.
Updated pipeline_type: <requestedPipelineType>.
Cannot modify storage location of an existing pipeline.
Existing storage location: '<existingStorageLocation>'.
Requested storage location: <requestedStorageLocation>.
Columns (<columnNames>) are removed from exclude_columns field in pipeline definition for the table <qualifiedTableName>. Please full refresh the table to avoid potential data loss or add these columns back to exclude_columns.
Cannot add catalog to an existing pipeline with defined storage location, if you want to use UC create a new pipeline and set catalog.
Existing storage location: '<storageLocation>'
Requested catalog: '<catalog>'
Pipeline ids are the same, setting the linked pipeline ids will cause deadlock.
CANNOT_SET_SCHEMA_FOR_EXISTING_PIPELINEâSpecified 'schema' field in the pipeline settings for pipeline '<pipelineName>' is illegal. Reason:
For more details see CANNOT_SET_SCHEMA_FOR_EXISTING_PIPELINE
CANNOT_SET_TOGETHERâSQLSTATE: none assigned
<argList> are mutually exclusive and can't be set together.
Pipeline definition specifies both include_columns and exclude_columns for <identifier>. Please remove one of them.
Cannot update clustering columns for table <tableName> because it is using partition columns. A table can either use partition columns or clustering columns, but not both.
To switch between liquid clustering and partitioning, trigger a full refresh of this table.
CANNOT_UPDATE_PARTITION_COLUMNSâCannot update partition columns for streaming table <tableName>.
Current: <existingPartitionColumns>,
Requested: <requestedPartitionColumns>
To apply this partition change, trigger a full refresh of this table and any other streaming tables that have updated partition columns.
Alternatively revert this change to continue using the existing partition columns.
CANNOT_UPDATE_TABLE_SCHEMAâFailed to merge the current and new schemas for table <tableName>.
To proceed with this schema change, you can trigger a full refresh of this table.
Depending on your use case and the schema changes, you may be able to obviate the schema change -- you can update your queries so the output schema is compatible with the existing schema (e.g, by explicitly casting columns to the correct data type).
CANNOT_WRITE_TO_INACTIVE_COLUMNSâ<details>
However, the destination table(s) already has inactive column(s) with this name; the columns are inactive because they were previously deleted from the source tables.
To proceed with the update, run a FULL REFRESH on the tables or drop these inactive columns using the ALTER TABLE DROP COLUMN command.
The following tables in the destination are inactive and conflict with the current source tables: <tables>.
These tables remain inactive because they were previously deleted from the source or unselected from the connector.
To proceed with the update, please perform a FULL REFRESH on the tables or or drop these inactive tables from the destination in Catalog Explorer or via DROP TABLE command, and retry the update.
The following tables in the destination are not reset correctly in the previous full refresh: <tables>.
Please trigger a full refresh on them to recover.
CATALOG_MAPPING_NOT_AVAILABLE_IN_UCâUC catalog doesn't have the mapping for the catalog '<sourceCatalog>'.
Please check if catalog is registered in the UC catalog.
CATALOG_SCHEMA_MISMATCH_WITH_DESTINATION_PIPELINEâThe catalog <destPipelineCatalog> and schema <destPipelineSchema> of the destination pipeline with ID '<destPipelineId>' do not match the catalog and schema of the table <tableName>. The destination pipeline should have the same catalog and schema as the table or the destination pipeline must be using the Direct Publishing Mode.
CatalogSpecs are not supported by the database connectors currently. Please remove the catalog spec.
CDC_APPLIER_COLUMN_UOID_NOT_SUPPORTEDâColumns with UOID <columnNames> for table <tableName> are not supported in CDC managed ingestion pipelines.
Please check if the ingestion pipeline supports column UOID, or request a full refresh.
CDC_APPLIER_FATAL_FAILURE_FROM_GATEWAYâThe Gateway Pipeline encountered a fatal error:
<errorMessage>
Review the pipeline update failure here: <link>.
Replicated table metadata for table <tableName> is not ready.
The existing job request timestamp is <existingRequestTs>, but we expect <expectedRequestTs> or later.
Full refresh of one destination table and normal update of another destination table from the same source is not supported.
Please full refresh both tables to continue if possible.
Full refresh tables: <fullRefreshTables>
Destination tables for source <sourceTable>: <destinationTables>
Schema version <dataSchemaVersion> is different from read schema version <readSchemaVersion>.
DLT will retry the update.
CDC_APPLIER_SEQUENCE_BY_COLUMN_NOT_FOUNDâThe column <columnName> for table <tableName> specified in sequenceBy does not exist in <columns>.
The column <columnName> for table <tableName> specified in sequenceBy is of type <typeName> that is not supported.
Supported types for sequenceBy columns are <allowedTypes>.
At most one column can be specified in sequenceBy of CDC managed ingestion pipeline.
Specified columns: <columns> for table <tableName>.
We encountered an incompatible schema change (<cause>) from schema version <previousSchemaVersion> to <currentSchemaVersion>.
Therefore we cannot proceed on applying changes for <tableName>. Please request a full refresh of the table.
Previous schema: <previousSchema>
Current schema: <currentSchema>
Found multiple source tables: <source_tables> mapped to same destination table <destination_table>.
Please map them to different destination table name or to different destination schema.
CDC_POTENTIAL_DATA_GAPSâFollowing tables [<needFullRefreshTableList>] does not have a successful update for <retention> days.
Please do a full refresh on these tables or the whole pipeline.
CDC_SAME_TABLE_FROM_MULTIPLE_SOURCESâFound the same table name <table> from multiple sources: <sources>.
Please split them into different pipelines to avoid conflict.
CDC_TABLE_NOT_FOUND_IN_ALL_TABLESâTable <table> is not found in the all tables snapshot of the source database.
Table spec details:
<tableSpec>
Changing a HMS pipeline to a UC pipeline is not allowed.
CHANGES_UC_PIPELINE_TO_HMS_NOT_ALLOWEDâChanging a UC pipeline to a HMS pipeline is not allowed.
CHANGING_CATALOG_NOT_ALLOWEDâCannot modify catalog of an existing pipeline. Existing catalog: '<existingCatalog>'. Requested catalog: '<requestedCatalog>'.
Changing target schema is not allowed. Reason: <reason>.
Failed to create a cluster because the pipeline's budget policy has exceeded the limit. Please use a different policy or reach out to your billing admin.
CLUSTER_CREATION_CLIENT_ERRORâFailed to create a pipeline cluster: <errorMessage>
This error is likely due to a misconfiguration in the pipeline.
Check the pipeline cluster configuration and associated cluster policy.
CLUSTER_CREATION_CREDITS_EXHAUSTEDâFailed to create a cluster because you've exhausted your available credits. Please add a payment method to upgrade your account.
CLUSTER_CREATION_RESOURCE_EXHAUSTEDâFailed to create a cluster because you've exceeded resource limits: <errorMessage>
Failed to launch pipeline cluster <clusterId>: <clusterStateMessage>
This error is likely due to a misconfiguration in the pipeline.
Check the pipeline cluster configuration and associated cluster policy.
CLUSTER_LAUNCH_CLOUD_FAILUREâFailed to launch pipeline cluster <clusterId>: <clusterStateMessage>
This error could be transient - restart your pipeline and report if you still see the same issue.
CLUSTER_SETUP_CLIENT_ERRORâFor more details see CLUSTER_SETUP_CLIENT_ERROR
CLUSTER_UNREACHABLEâCommunication lost with driver. Cluster <clusterId> was not reachable for <timeoutSeconds> seconds.
Column mask found for column '<columnName>' which doesn't exist in MV/ST schema. If this is because of a change to the base table's schema,
please drop the old mask with ALTER TABLE [table_name] ALTER COLUMN [column where mask is applied] DROP MASK; or restore the column.
Column <column> specified in COLUMNS TO UPDATE not found in source Dataframe.
Started update '<upgradedUpdateId>' for an upgrade but failed to stop the previous update '<oldUpdateId>'.
This error is likely transient. The pipeline will be automatically retried and the issue should resolve itself.
Report this error to Databricks if you continue to still see the same issue.
CREATE_APPEND_ONCE_FLOW_FROM_BATCH_QUERY_NOT_ALLOWEDâCannot create a streaming table append once flow from a batch query.
This prevents incremental ingestion from the source and may result in incorrect behavior.
Offending table: '<table>'.
To fix this, use the STREAM() or readStream operator to declare the source as a streaming input.
Example: SELECT ... FROM STREAM(<source table name>) or spark.readStream.table(<source table name>)
SQLSTATE: none assigned
Dataset <datasetName> already exists. Ensure that the query function has only been marked as a view or table once.
Failed to read dataset '<datasetName>'. This dataset is not defined in the pipeline.
If this table is managed by another pipeline, then do not use dlt.read / dlt.readStream to read the table or prepend the name with the LIVE keyword.
DBFS is not enabled for this workspace; please publish to Unity Catalog or specify a different storage location for the pipeline.
DBSQL_PIPELINE_IS_MISSINGâA DBSQL pipeline is missing. Please refresh your materialized view or streaming table to create the DBSQL pipeline.
A DBSQL pipeline must have exactly one materialized view or streaming table, but found <tablesSize> tables: <tables>
The destination pipeline with ID '<pipelineId>' can not be found. Make sure you are in the same workspace as the pipeline, you are the owner of the pipeline, and the pipeline ran at least once.
The destination pipeline with ID '<pipelineId>' is not using the Direct Publishing Mode.
You are not allowed to perform this operation, you are not the owner of the destination pipeline with ID '<pipelineId>'. Only owners can change the pipeline of a table.
The destination pipeline with ID '<pipelineId>' is not an ETL pipeline.
Error while handling '<action>' request.
Cannot drop SCHEDULE on a table without an existing schedule or trigger.
Duplicated from_json schema location key: <schemaLocationKey>.
Please pick unique schema location keys for each from_json query in the pipeline
DUPLICATED_INGESTION_CONFIG_TABLE_SPECSâIngestion pipeline configuration contains duplicate tables. Please ensure that each table is unique.
EMPTY_INGESTION_CONFIG_OBJECTSâIngestion config objects are empty.
ENHANCED_AUTOSCALING_REQUIRES_ADVANCED_EDITIONâEnhanced Autoscaling 'spare_capacity_fraction' setting is only supported in the Advanced product edition of Lakeflow Declarative Pipelines.
Please edit your pipeline settings to set "edition": "advanced" in order to use 'spare_capacity_fraction'.
ENVIRONMENT_PIP_INSTALL_ERRORâFailed to install environment dependency: '<pipDependency>'. Please check the driver's stdout logs on the cluster for more details.
Publishing the event log to Unity Catalog is not supported for this pipeline. If this is unexpected, please contact Databricks support.
EXPECTATION_VIOLATIONâFlow '<flowName>' failed to meet the expectation.
For more details see EXPECTATION_VIOLATION
EXPLORE_ONLY_CANNOT_BE_SET_WITH_VALIDATE_ONLYâexplore_only and validate_only cannot be both set to true.
EXPLORE_ONLY_IS_NOT_ENABLEDâexplore_only update is not enabled. Please contact Databricks support.
FAILED_TO_CREATE_EVENT_LOGâFailed to create pipeline (id=<pipelineId>) event log with identifier <eventLogIdentifier>. See exception below for more details.
Failed to publish view <viewName> to the metastore because <reason>.
Failed to update pipeline (id=<pipelineId>) event log identifier to <newEventLogIdentifier>. See exception below for more details.
Flow <flowName> has terminated because it encountered a schema change during execution.
The schema change is compatible with existing target schema and the next run of the flow can resume with the new schema.
FOREACH_BATCH_SINK_ONLY_SUPPORTED_IN_PREVIEW_CHANNELâDLT ForeachBatch Sink is not currently supported.
The private preview for DLT ForeachBatch sink requires the PREVIEW channel.
DLT sinks: <sinkNames>
The Gateway pipeline does not allow cluster init scripts. Please remove it from <from>.
The Gateway pipeline does not allow spark config [<configs>]. Please remove them from <from>.
Number of requested org IDs exceeds the maximum allowed limit of <limit>
An error occurred in Google Analytics raw data connector.
The 'source catalog' (GCP Project ID) is missing in your ingestion specification.
Please specify the source catalog (project ID) in your ingestion specification to resolve this issue.
HMS_NOT_ENABLEDâHive Metastore is not enabled for this workspace; please publish to Unity Catalog.
ILLEGAL_COLUMN_TO_UPDATE_DATA_TYPEâThe data type of the column specified in COLUMNS TO UPDATE must be a string array but found <illegalDataType>.
The settings must not contain '<fieldName>'.
Specified 'schema' field in the pipeline settings is illegal. Reason: <reason>.
Root path '<rootPath>' must be a directory but found <objectType>.
Ingestion pipeline configuration contains duplicate schemas. Please ensure that each schema is unique.
INGESTION_GATEWAY_AUTHENTICATION_FAILUREâAuthentication failure
For more details see INGESTION_GATEWAY_AUTHENTICATION_FAILURE
INGESTION_GATEWAY_BREAKING_SCHEMA_CHANGE_FAILUREâA schema mismatch has been detected between the source and target tables. To resolve this issue, a full refresh of the table '<entityName>' is required on the Ingestion Pipeline.
CDC is not enabled on <entityType> '<entityName>'. Enable CDC and perform a full table refresh on the Ingestion Pipeline. Error message: '<errorMessage>'.
Database version is not supported.
For more details see INGESTION_GATEWAY_DB_VERSION_NOT_SUPPORTED
INGESTION_GATEWAY_DDL_OBJECTS_MISSINGâDDL objects missing on <entityType> '<entityName>'. Execute the DDL objects script and full refresh the table on the Ingestion Pipeline. Error message: '<errorMessage>'.
Ingestion gateway configuration is missing a connection.
Please add a reference to the Unity Catalog connection containing your credentials.
Ingestion gateway pipeline definition details:
<definition>
Ingestion gateway configuration is missing the internal storage location catalog.
Please add the internal storage location catalog.
Ingestion gateway pipeline definition details:
<definition>
Ingestion gateway configuration is missing the internal storage location name.
Please add the internal storage location name.
Ingestion gateway pipeline definition details:
<definition>
Ingestion gateway configuration is missing the internal storage location schema.
Please add the internal storage location schema.
Ingestion gateway pipeline definition details:
<definition>
Table '<entityName>' does not exist in the source database or has been dropped. Resolve the issue and full refresh the table on the Managed Ingestion pipeline. Error message: '<errorMessage>'.
Failed to alter replication publication for <entityType> '<entityName>'
Error message: <errorMessage>
For more details see INGESTION_GATEWAY_PG_PUBLICATION_ALTER_FAILED
INGESTION_GATEWAY_PG_PUBLICATION_CREATION_FAILEDâFailed to create replication publication for <entityType> '<entityName>'
Error message: <errorMessage>
For more details see INGESTION_GATEWAY_PG_PUBLICATION_CREATION_FAILED
INGESTION_GATEWAY_PG_PUBLICATION_DROP_FAILEDâFailed to drop replication publication for <entityType> '<entityName>'
Error message: <errorMessage>
For more details see INGESTION_GATEWAY_PG_PUBLICATION_DROP_FAILED
INGESTION_GATEWAY_PG_SLOT_CONSUMED_BY_OTHER_PROCESSâFailed to create replication slot for <entityType> '<entityName>' due to replication slot is being used by another PID.
Error message: <errorMessage>
Failed to create replication slot for <entityType> '<entityName>'
Error message: <errorMessage>
For more details see INGESTION_GATEWAY_PG_SLOT_CREATION_FAILED
INGESTION_GATEWAY_SOURCE_INSUFFICIENT_PERMISSION_FAILUREâThe user does not have the required permissions to access this object or execute the stored procedure. Please ensure that all necessary privileges are granted. Refer to the following documentation: https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/sql-server/database-user-requirements.
INGESTION_GATEWAY_SOURCE_SCHEMA_MISSING_ENTITYâNo tables are available for replication from the source.
Verify that the tables are correctly selected and defined in the ingestion pipeline
and user has the necessary catalog and schema access.
INGESTION_GATEWAY_UNREACHABLE_HOST_OR_PORT_FAILUREâConnection failed due to an incorrect hostname <host> and/or port <port> of the source database.
For more details see INGESTION_GATEWAY_UNREACHABLE_HOST_OR_PORT_FAILURE
INGESTION_GATEWAY_XA_TRANSACTION_NOT_SUPPORTEDâFailed to replicate <entityType> '<entityName>' because it is part of an XA transaction.
Error message: <errorMessage>
AUTO CDC command is invalid. <reason>.
SQLSTATE: none assigned
Value of invalid type passed to parameter '<paramName>'. Expected <expectedType>. <additionalMsg>.
The table options specified for table <table> are invalid since
For more details see INVALID_COMPATIBILITY_OPTIONS
INVALID_DECORATOR_USAGEâSQLSTATE: none assigned
The first positional argument passed to @<decoratorName> must be callable. Either add @<decoratorName> with no parameters to your function, or pass options to @<decoratorName> using keyword arguments (e.g. <exampleUsage>).
Invalid destination pipeline ID: '<pipelineId>'. Pipeline IDs must be valid UUIDs.
Verify that you're using the correct pipeline ID, not the pipeline name.
INVALID_EVENT_LOG_CONFIGURATIONâInvalid event log configuration found in pipeline spec: <message>
Invalid name '<name>' in <command> command. Reason: <reason>
You can only specify 'pipeline_id' and 'pipeline_type' when calling 'dry_run' for a DBSQL pipeline.
For more details see INVALID_REFRESH_SELECTION
INVALID_REFRESH_SELECTION_REQUEST_FOR_CONTINUOUS_PIPELINEâRefresh selection is not supported for the continuous mode.
INVALID_REFRESH_SELECTION_REQUEST_WITH_FULL_REFRESHâfull_refresh should not be set to true for a refresh selection request.
INVALID_ROOT_PATHâInvalid root_path '<rootPath>': only absolute directory paths are currently supported. Directory paths must begin with '/' and not end with '/'.
Invalid schema '<schemaName>' specified in the pipeline setting. Reason: <reason>.
SQLSTATE: none assigned
snapshot_and_version for flow with target '<target>' returned unsupported type. <additionalMsg>.
The trigger interval configuration specified in the <configurationType> is invalid
Error encountered while calling Jira APIs. Please make sure to give the connecting user the Jira admin permissions for your Jira instance.
JIRA_AUTHORIZATION_FAILEDâAuthorization failed while calling Jira APIs. Kindly re-authenticate the UC connection created and try again.
JIRA_CONNECTOR_ENTITY_MAPPING_PARSING_FAILEDâAn error occurred in Jira connector.
An issue occurred while trying to parse the entity mapping for the entity type: <entityType>. Check if your entity is part of the supported types.
If the error persists, file a ticket.
JIRA_SITE_MISSINGâCould not find cloudId corresponding to the provided Jira domain <domain>.
Please ensure that the connecting user can access this site.
JOB_DETAILS_DO_NOT_MATCHâIf both 'update_cause_details.job_details' and 'job_task' are given then they must match, but they are <details> and <jobTask>
If 'cause' is JOB_TASK then either 'job_task' or 'update_cause_details.job_details' must be given.
Referencing datasets using LIVE virtual schema outside the dataset query definition (i.e., @dlt.table annotation) is not supported.
Referencing datasets using LIVE virtual schema <identifier> outside the dataset query definition (i.e., @dlt.table annotation) is not supported.
Referencing datasets using LIVE virtual schema in spark.sql(...) API must not be called outside the dataset query definition (i.e., @dlt.table annotation). It can only be called within the dataset query definition.
SQLSTATE: none assigned
Query function for materialized view '<datasetName>' returned a streaming DataFrame.
It must return a non-streaming DataFrame.
MAX_RETRY_REACHED_BEFORE_ENZYME_RECOMPUTEâMax retry count reached. Retry count:<flowRetryCount>. maxFlowFailureRetryCountThreshold:<maxFlowRetryAttempts>. <message>
Starting a <definitionType> pipeline from UC definition is not allowed.
Stored and updated definition must be the same pipeline type but got <stored> and <updated>.
The pipeline does not have a valid definition in UC, but a refresh is requested.
MESA_PIPELINE_MISSING_DEFINITION_UNEXPECTEDâUnexpectedly missing pipeline definition from UC.
METASTORE_OPERATION_TIMED_OUTâOperations involved in updating the metastore information for <tableName> took longer than <timeout>.
This issue may be transient or could indicate bugs in the configured metastore client. Try restarting your pipeline and report this issue if it persists.
MISSING_CREATE_SCHEMA_PRIVILEGEâUser '<userName>' does not have permission to create schema in catalog <catalogName>
User '<userName>' does not have permission to create table in schema <schemaName>
No run as user was specified for the update.
MULTI_QUERY_SNAPSHOT_TARGET_NOT_SUPPORTEDâ'<tableName>' already contains a AUTO CDC FROM SNAPSHOT query '<flowName>'. Currently, this API only supports one flow per destination.
Mutually exclusive options <options>. Please remove one of these options.
SQLSTATE: none assigned
Value for <arg_name> must be greater than or equal to 0, got '<arg_value>'.
Table '<tableName>' is already managed by pipeline <otherPipelineId>.
If you want table '<tableName>' to be managed by this pipeline -
Remove the table from pipeline '<otherPipelineId>'.
Start a full refresh update for this pipeline.
If you want to continue managing the table from multiple pipelines, disable this check by setting the configuration pipelines.tableManagedByMultiplePipelinesCheck.enabled to false in your pipeline settings.
This is not recommended as concurrent operations on the table may conflict with each other and lead to unexpected results.
NOTEBOOK_NAME_LIMIT_REACHEDâInvalid notebook path: '<nameStart>...<nameEnd>'. It is longer than <maxNotebookPathLength> characters.
Unable to access the notebook '<notebookPath>'. It either does not exist, or the identity used to run this pipeline, <identity>, lacks the required permissions.
Failed to run '<pipInstallCommand>' from notebook: <notebookPath>. Please check the driver's stdout logs on the cluster for more details.
Duplicate alerts '<alertsDuplicates>' specified in [<alerts>]
Duplicate email addresses '<emailRecipientsDuplicates>' specified in [<emailRecipients>]
Invalid alerts have been specified to get notifications on: <invalidAlerts>
Invalid email address specified to receive notifications: <invalidEmailAddresses>
Please specify at least one recipient and one alert in <setting>
SQLSTATE: none assigned
Either source or snapshot_version must be set for create_auto_cdc_flow_from_snapshot with target '<target>'.
Pipelines are expected to have at least one table defined but no tables were found in your pipeline.
Please verify that you have included the expected source files, and that your source code includes table definitions (e.g., CREATE MATERIALIZED VIEW in SQL code, @dlt.table in python code).
Note that only tables are counted towards this check. You may also encounter this error if you only include views or flows in your pipeline.
OWNER_IS_MISSINGâOwner does not exist.
PAGINATION_REQUEST_HAS_NAME_AND_PAGINATIONâYou can provide a <name> or pagination, but not both.
PatchPipelineDefinition only supports the schedule field, but the provided definition had other populated fields: '<updatedDefinition>'.
Persisted views do not support reading from streaming sources.
PERSISTED_VIEW_READS_FROM_TEMPORARY_VIEWâPersisted view <persistedViewName> cannot reference temporary view <temporaryViewName> that will not be available outside the pipeline scope. Either make the persisted view temporary or persist the temporary view.
Pipeline is already being cloned to pipeline with id '<pipelineId>'.
The pipeline with ID '<pipelineId>' cannot be cloned during an active update.
Request included pipeline spec with invalid fields for clone. Allowed fields include: name, catalog, target, configuration.
PIPELINE_CLONING_INVALID_FOR_MISSING_TARGETâThe pipeline with ID '<pipelineId>' does not publish to a target schema. The source pipeline needs to publish to a target schema to be cloned. Please retry after specifying the 'target' field in the pipeline spec, and running a new update to publish to a target schema.
The pipeline with ID '<pipelineId>' is already a UC pipeline. UC pipelines cannot be cloned.
No specified clone mode.
PIPELINE_CLONING_NO_TARGET_SPECIFIEDâNo specified target catalog for cloning.
PIPELINE_CREATION_NOT_ENABLED_FOR_WORKSPACEâPipeline creation is not enabled for this workspace.
PIPELINE_DOES_NOT_EXISTâThe pipeline with ID '<pipelineId>' does not exist.
For more details see PIPELINE_DOES_NOT_EXIST
PIPELINE_ENVIRONMENT_NOT_ENABLEDâUsing environment in DLT is not enabled.
PIPELINE_ENVIRONMENT_VERSION_NOT_ALLOWEDâPipeline's environment currently does not support environment versions.
PIPELINE_FAILED_TO_UPDATE_UC_TABLE_DUE_TO_CONCURRENT_UPDATEâPipeline failed to update the UC table (<tableName>) due to concurrent alters after <attempts> attempts.
Please verify there aren't external processes modifying the table, retry the update, and contact Databricks support if this issue persists.
PIPELINE_FOR_TABLE_NEEDS_REFRESHâThe table <tableName> is not in the required state, the table has not been updated recently. The pipeline with ID '<pipelineId>' must be run once more and then retry the operation.
The pipeline with ID '<pipelineId>', managing the table <tableName>, can not be found. Make sure you are in the same workspace as the pipeline, you are the owner of the pipeline, and the pipeline ran at least once.
Either glob or notebook/file field under libraries in the pipeline settings should be set. Please change the pipeline settings.
PIPELINE_GLOB_INCLUDES_NOT_SUPPORTEDâUsing glob field to include source files is a preview feature and is disabled.
Re-select each source file to include for the pipeline to fix this error.
Reach out to Databricks support to learn more about this feature and enroll in the preview.
PIPELINE_GLOB_UNSUPPORTED_SPECIAL_CHARACTERâSpecial characters <specialChar> are reserved and should not be used in included path '<path>' in pipeline settings. Remove these characters to fix the error
Name cannot be longer than <maxPipelineNameLength> characters.
Pipeline failed to analyze the source tables (<tables>) due to non-retryable errors after partial execution.
A new pipeline update will not be created.
<flowErrors>
Check the event log and fix the issues accordingly.
PIPELINE_NOT_ELIGIBLE_FOR_RESTORATIONâPipeline '<pipelineId>' is past restoration window.
The pipeline with ID '<pipelineId>', managing the table <tableName>, is not using the Direct Publishing Mode.
The table is not ready for refresh yet
For more details see PIPELINE_NOT_READY_FOR_SCHEDULED_UPDATE
PIPELINE_PERMISSION_DENIED_NOT_OWNERâYou are not allowed to perform this operation. You are not the owner of the pipeline with ID '<pipelineId>', managing the table <tableName>.
Pipeline failed to analyze the source tables (<tables>) due to retryable errors after partial execution.
A new pipeline update will be created to retry processing. If the error persists, please check the event log and address the issues accordingly.
PIPELINE_SETTINGS_FIELD_CANNOT_BE_EDITEDâ'<uneditableFieldName>' cannot be modified by users. If users want to add or modify the <settingName>, please use the '<editableFieldName>' field instead.
Pipeline settings were modified concurrently.
PIPELINE_SETTINGS_UNSUPPORTED_CONFIGURATIONSâThe configurations <configurations> are not supported by Lakeflow Declarative Pipelines. Please remove these configurations.
Starting an update with the 'development' setting is not supported.
PIPELINE_SHOULD_NOT_HAVE_MULTIPLE_TABLESâThe pipeline must have exactly one table, but found <tablesSize> tables: <tables>
The number of source files, including files declared in folders, exceeds the limit of <limit>.
Remove or merge excessive files and change corresponding pipeline spec if needed,
or contact Databricks support to request a limit increase.
PIPELINE_SOURCE_FOLDER_DEPTH_EXCEEDEDâThe folder '<folder_path>' exceeds the maximum allowed directory nesting level of <limit>. Reduce the folder nesting level or contact Databricks support to request a limit increase.
Modifying following parameter <param> in pipeline settings is not allowed
Pipeline type '<pipelineType>' is not supported.
The pipeline with ID '<pipelineId>', managing the table <tableName>, is not an ETL pipeline.
Cannot start update '<updateId>' because the limit for active pipelines of type '<pipelineType>' has been reached.
The pipeline with ID '<pipelineId>', managing the table <tableName>, is running. Please stop the pipeline before running the operation.
Pipeline creation of type '<pipelineType>' blocked because the workspace '<orgId>' already has '<countLimit>' pipelines. Please contact Databricks support to adjust this limit.
Found cells containing %pip install that are not at the top of the notebook for '<notebookPath>'
Move all %pip install cells to the start of the notebook.
PY4J_BLOCKED_APIâSQLSTATE: none assigned
You are using a Python API that is not supported in the current environment.
Please check Databricks documentation for alternatives.
<additionalInfo>
Error happened in query-based ingestion connector for <sourceName>.
For more details see QUERY_BASED_INGESTION_CONNECTOR_ERROR
REFERENCE_DLT_DATASET_OUTSIDE_QUERY_DEFINITIONâReferencing DLT dataset <identifier> outside the dataset query definition (i.e., @dlt.table annotation) is not supported. Please read it instead inside the dataset query definition.
The refresh must be initiated in workspace <homeWorkspaceId>, where the resource was created.
The refresh was attempted in workspace <userWorkspaceId>.
Cannot add <type> to a table that already has <existingType>. Please drop the existing schedule or use ALTER TABLE ... ALTER <type> ... to alter it.
Required parameter <param> is not found.
USE CATALOG '<reservedKeyword>' is illegal because '<reservedKeyword>' is a reserved keyword in DLT.
USE SCHEMA '<reservedKeyword>' is illegal because '<reservedKeyword>' is a reserved keyword in DLT.
Pipeline resources are being provisioned for pipeline '<pipelineId>'.
Pipeline '<pipelineId>' is not deleted. Restoration is only applicable for deleted pipelines.
Unable access root path '<rootPath>'. Please ensure you have the required access privileges.
The specified run as user '<runAsUserId>' for the update does not exist in the workspace.
Failed to make a connection to the <sourceName> source. Error code: <saasConnectionErrorCode>.
For more details see SAAS_CONNECTION_ERROR
SAAS_CONNECTOR_REFRESH_TOKEN_EXPIREDâThe refresh token for connection <connectionName> has expired. Edit the connection, re-authenticate, and re-run your pipeline.
A schema change has occurred in table <tableName> of the <sourceName> source.
For more details see SAAS_CONNECTOR_SCHEMA_CHANGE_ERROR
SAAS_CONNECTOR_SOURCE_API_ERRORâAn error occurred in the <sourceName> API call. Source API type: <saasSourceApiType>. Error code: <saasSourceApiErrorCode>.
Try refreshing the destination table. If the issue persists, please file a ticket.
SAAS_CONNECTOR_UNSUPPORTED_ERRORâUnsupported error happened in data source <sourceName>.
For more details see SAAS_CONNECTOR_UNSUPPORTED_ERROR
SAAS_INCOMPATIBLE_SCHEMA_CHANGES_DURING_INITâWe have detected incompatible schema changes when initializing the pipeline:
<details>
Please perform a full refresh on the impacted tables.
SAAS_PARTIAL_ANALYSIS_INPUT_CREATION_ERRORâError encountered while creating input for partial analysis. A new pipeline update will not be created.
Please check the event log and fix the issues accordingly.
SAAS_SCHEMA_DIVERGED_DURING_ANALYSISâThe source table (<table>)'s analyzed schema has diverged from its expected schema.
Please retry the pipeline update and see if the issue is resolved.
If this issue persists, please perform a full refresh on the tables mentioned above
Expected schema:
<expectedSchema>
Actual schema:
<actualSchema>
The provided Connection <connectionName> is inaccessible. Please check the connection and try again.
For more details see SAAS_UC_CONNECTION_INACCESSIBLE
SCHEMA_SPEC_EMPTY_CATALOGâSchemaSpec has an empty string in the catalog field.
Please remove the empty string or add the catalog name. (If this schema doesn't belong to a catalog in the source, do not set the field.)
Schema spec details:
<schemaSpec>
SchemaSpec has an empty string in the schema field.
Please remove the empty string or add the schema name. (If this table doesn't belong to a schema in the source, do not set the field.)
Schema spec details:
<schemaSpec>
At least one of source catalog and source schema must be present. But both are empty.
Schema spec details:
<schemaSpec>
The provided budget policy with id '<budgetPolicyId>' can not be used in this workspace due to policy workspace binding constraints.
Serverless budget policy with id '<budgetPolicyId>' is invalid.
Serverless budget policy with id '<budgetPolicyId>' does not exist.
Serverless budget policy is not enabled, please contact Databricks support.
SERVERLESS_BUDGET_POLICY_NOT_ENABLED_FOR_ACCOUNTâServerless budget policy is not enabled for this account. The user cannot specify a budget policy for this pipeline. Account admin should try to enroll through the feature preview portal. If the problem persists, please contact Databricks support.
SERVERLESS_BUDGET_POLICY_NOT_SUPPORTED_FOR_NON_SERVERLESS_PIPELINEâServerless budget policy cannot be assigned to a non-serverless pipeline.
SERVERLESS_BUDGET_POLICY_NOT_SUPPORTED_FOR_PIPELINE_TYPEâServerless budget policy is not supported for pipeline type <pipelineType>.
User does not have permission to use serverless budget policy with id '<budgetPolicyId>'.
Serverless compute is not available. Please contact Databricks for more information.
SERVERLESS_NOT_ENABLEDâYou can't use serverless compute with Lakeflow Declarative Pipelines. Please contact Databricks to enable this feature for your workspace.
SERVERLESS_NOT_ENABLED_FOR_USERâServerless compute is not enabled for caller. Please contact your workspace admin to enable this feature.
SERVERLESS_NOT_ENABLED_FOR_WORKSPACEâServerless compute is not available for this workspace and/or region. Please contact Databricks for more information.
SERVERLESS_REQUIREDâYou must use serverless compute in this workspace.
SERVICENOW_CONNECTION_ERRORâAn error occurred in ServiceNow. Source API type: <saasSourceApiType>.
For more details see SERVICENOW_CONNECTION_ERROR
SERVICENOW_CONNECTOR_EMPTY_CURSOR_KEY_ERRORâAn error occurred in the ServiceNow. Source API type: <saasSourceApiType>.
At this time, the ingestion pipeline cannot ingest the table '<tableName>' because the cursor key in a row contains an empty field.
To continue running your pipeline, remove this table. If the error persists, file a ticket.
SERVICENOW_CONNECTOR_INSTANCE_HIBERNATION_ERRORâAn error occurred in ServiceNow. Source API type: <saasSourceApiType>.
Failed to connect to the ServiceNow instance. The instance appears to be hibernating or inactive.
Log into your ServiceNow admin portal and wait for some time until the instance fully wakes up.
If the error persists, file a ticket.
SERVICENOW_CONNECTOR_INSTANCE_OFFLINE_ERRORâAn error occurred in ServiceNow. Source API type: <saasSourceApiType>.
Failed to connect to the ServiceNow instance. The instance is offline.
Log into your ServiceNow admin portal and wait for some time until the instance restores.
If the error persists, file a ticket.
SERVICENOW_CONNECTOR_INVALID_TABLE_ERRORâAn error occurred in ServiceNow. Source API type: <saasSourceApiType>.
Failed to query the schema of the table '<tableName>'. The table does not exist in the ServiceNow account for this user.
Verify the table name for any typos and ensure that the user has the necessary permissions to access the table.
If the error persists, file a ticket.
SERVICENOW_CONNECTOR_IP_ADDRESS_RESTRICTED_ERRORâAn error occurred in ServiceNow. Source API type: <saasSourceApiType>.
Failed to connect to the ServiceNow instance. The instance has IP address access control restrictions.
To resolve this, either disable the IP address restrictions by navigating to ServiceNow >> All >> System Security >> IP Address Access Control or use serverless stable IPs
If the error persists, file a ticket.
SERVICENOW_CONNECTOR_MALFORMED_ENDPOINT_URL_ERRORâAn error occurred in ServiceNow. Source API type: <saasSourceApiType>.
Invalid ServiceNow API endpoint URL detected. The URL structure does not match the expected ServiceNow format.
Check the ServiceNow instance configuration in the UC connection credentials.
For more details see SERVICENOW_CONNECTOR_MALFORMED_ENDPOINT_URL_ERROR
SERVICENOW_CONNECTOR_MAX_FAILED_ATTEMPTS_REACHEDâAn error occurred in ServiceNow. Source API type: <saasSourceApiType>.
This often happens when the data fetch for a table takes too long. As a first step, work with your ServiceNow administrator to enable indexing on the cursor column.
The cursor column is selected from the following list, in order of availability and preference: sys_updated_on (first choice), sys_created_on (second choice), sys_archived (third choice)
For instructions on enabling indexing in ServiceNow, see here: https://docs.databricks.com/ingestion/lakeflow-connect/servicenow-overview#why-is-my-servicenow-ingestion-performance-slow.
We also recommend increasing the REST API query timeout to more than 60 seconds to allow more time to fetch records.
Then, retry your ingestion pipeline. If the issue persists, file a ticket.
SERVICENOW_CONNECTOR_SCHEMA_FIELD_TYPE_MISMATCHâAn error occurred in ServiceNow while fetching the table schema.
Found two conflicting data types for field '<fieldName>': '<firstDataType>' and '<secondDataType>'.
To continue running your pipeline, remove this table. If the error persists, file a ticket.
SERVICENOW_CONNECTOR_UNAUTHORIZED_ACCESS_ERRORâAn error occurred in ServiceNow. Source API type: <saasSourceApiType>.
For more details see SERVICENOW_CONNECTOR_UNAUTHORIZED_ACCESS_ERROR
SET_TBLPROPERTIES_NOT_ALLOWED_FOR_PIPELINE_TABLEâALTER <commandTableType> ... SET TBLPROPERTIES is not supported. To modify table properties, please change the original definition and run an update.
Ingestion for object <objName> is incomplete because the Salesforce API query job took too long, failed, or was manually cancelled.
For more details see SFDC_CONNECTOR_BULK_QUERY_JOB_INCOMPLETE
SFDC_CONNECTOR_BULK_QUERY_NOT_FOUNDâIngestion for object <objName> failed because Salesforce bulk API query job is not found.
The bulk query job being referenced for ingesting this object was deleted either in the UI or by Salesforce after 7 days of its creation.
To trigger a new bulk job, please perform a FULL REFRESH on the specific destination table.
An error occurred in the Salesforce API call: API limit exceeded
Please wait for your API limits to reset. Then try refreshing the destination table.
If the error persists, file a ticket.
SFDC_CONNECTOR_CREATE_BULK_QUERY_JOB_FAILEDâIngestion for object <objName> is incomplete because creation of Salesforce bulk API query job failed. Error code: <saasSourceApiErrorCode>.
<actionText>.
DLT sinks in pipeline are not supported in serverless egress control enabled workspaces. Supported DLT Sinks are Kafka and Delta.
The following unsupported sinks are found: <sinkNames>, their corresponding formats are: <sinkFormats>.
Failed to read dependent dataset '<sourceTableName>' because it is not materialized. Run the entire pipeline to materialize all dependent datasets.
Creating a standalone PRIVATE MV/ST is not supported. Please remove the PRIVATE modifier
Cannot find target table <target> for the <command> command. Target table <target> is not defined in the pipeline.
Synced table pipeline user error.
For more details see SYNCED_TABLE_USER_ERROR
TABLE_CHANGED_DURING_OPERATIONâThe table <tableName> was modified outside of this transaction, and this transaction has been rolled back. Retry the operation.
Pipeline update for pipeline: <pipelineId> detected a cyclic chain of foreign key constraints: <tables>.
TableSpec is missing one of the source catalog and/or source schema.
Table spec details:
<tableSpec>
TableSpec has an empty string in the catalog field.
Please remove the empty string or add the catalog name. (If this table doesn't belong to a catalog in the source, do not set the field.)
Table spec details:
<tableSpec>
TableSpec has an empty string in the schema field.
Please remove the empty string or add the schema name. (If this table doesn't belong to a schema in the source, do not set the field.)
Table spec details:
<tableSpec>
Table name is empty. Please provide a table name.
Table spec details:
<tableSpec>
Schema evolution cannot be enabled due to missing metadata. Please trigger a full refresh.
Reason: Snapshot table token must be defined when schema evolution is enabled.
TRIGGER_INTERVAL_VALUE_INVALIDâThe trigger interval must be a positive duration, the maximum acceptable value is 2,147,483,647 seconds. Received: <actual> seconds.
The source <source> is a view that reads from a file location, which is not currently supported by trigger.
The source <source> with type <type> is currently not supported by trigger.
Clearing the target schema field in is not allowed for UC pipelines. Reason: <reason>.
Using UC catalog in DLT is not enabled.
UC_PIPELINE_CANNOT_PUBLISH_TO_HMSâUC enabled pipelines cannot publish to Hive Metastore. Please choose a different target catalog.
UC_TARGET_SCHEMA_REQUIREDâThe target schema field is required for UC pipelines. Reason: <reason>.
Failed to infer the schema for table <tableName> from its upstream flows.
Please modify the flows that write to this table to make their schemas compatible.
Inferred schema so far:
<inferredDataSchema>
Incompatible schema:
<incompatibleDataSchema>
Unexpected error while checking schema permissions for pipeline <pipelineId>. Please contact Databricks support.
Uniform compatibility cannot be set on materialized views or streaming tables that have a row filter or column masks applied.
UNITY_CATALOG_INITIALIZATION_FAILEDâEncountered an error with Unity Catalog while setting up the pipeline on cluster <clusterId>.
Ensure that your Unity Catalog configuration is correct, and that required resources (e.g., catalog, schema) exist and are accessible.
Also verify that the cluster has appropriate permissions to access Unity Catalog.
Details: <ucErrorMessage>
Storage path for sink <identifier> cannot be resolved. Please contact Databricks support.
The following tables were found in the pipeline definition but could not be resolved during maintenance. Please run a pipeline update execution with the latest pipeline definition to materialize all tables in the pipeline definition and unblock maintenance, or contact Databricks support if the problem persists.
<unresolvedTableIdentifiersSet>
Storage path for table <identifier> cannot be resolved. Please contact Databricks support.
ALTER <commandTableType> ... <command> is not supported.
Unsupported channel for Direct Publishing Mode. Expect either 'CURRENT' or 'PREVIEW' channel, but got 'PREVIOUS'
<command> only supported in direct publishing mode enabled Lakeflow Declarative Pipelines
'<command>' is not supported in query definition. Please move the command outside of the query definition. If it is a pipeline in Python, move the '<command>' outside of @dlt.table()/@dlt.view() decorator. If it is a pipeline in Scala, move the '<command>' outside of 'query' method.
Custom DBR version '<v>' is not supported in SHIELD and HIPAA workspaces. Expected one of [<supportedDbrVersions>]
The custom schema private preview is disabled.
Please create a new pipeline with default publishing mode, using the 'schema' field in the pipeline specification, and move the datasets from this pipeline to the new pipeline.
UNSUPPORTED_CUSTOM_SCHEMA_PREVIEW_ENABLEMENTâThe custom schema private preview is disabled and you cannot create
Please remove <sparkConfKeys> from the pipeline configuration
DBR version '<v>' is not supported. Expected one of [<supportedDbrVersions>]
<featureName> is not supported in your workspace. Please contact Databricks support to enable this feature for your workspace.
Failed to load <language> notebook '<notebookPath>'. Only <supportedLanguages> notebooks are supported currently.
The file at <path> does not have .py or .sql suffix. Only Python and SQL files are supported in pipelines.
Unsupported language <language> for notebook <path>. Only Python and SQL are supported in pipelines
The included at path <path> is of type <objectType> which is not supported. Currently, only notebooks and files can be used as libraries. To resolve this issue, remove the unsupported object or update the libraries configured for this pipeline so only supported object types are included.
Invalid managed ingestion pipeline definition, unsupported source type: <sourceType>.
The provided ingestion type <ingestionType> is not supported.
Please contact Databricks support if this issue persists.
UNSUPPORTED_SPARK_SQL_COMMANDâ'<command>' is not supported in spark.sql("...") API in DLT Python. Supported command: <supportedCommands>.
Unsupported SQL statement for <datasetType> '<datasetName>': <operation> is not supported.
Only DBSQL pipelines can have updated_definition.
USE CATALOG only supported in UC-enabled Lakeflow Declarative Pipelines
Cannot refresh table <tableName> as it does not have a query saved in Unity Catalog. Please contact Databricks support.
An error occurred in Workday Reports. Source API type: <saasSourceApiType>.
The report URL '<reportUrl>' is incorrect. Please check for any typos in either the base URL or the report name to resolve the issue.
If the issue persists, file a ticket.
WORKDAY_REPORTS_CONNECTOR_REPORT_SIZE_EXCEEDED_ERRORâAn error occurred in Workday Reports. Source API type: <saasSourceApiType>.
The size of the report with URL '<reportUrl>' is greater than 2GB. Please ensure that the report size does not exceed this limit.
If the issue persists, file a ticket.
WORKDAY_REPORTS_CONNECTOR_UNAUTHORIZED_ACCESS_ERRORâAn error occurred in Workday Reports. Source API type: <saasSourceApiType>.
For more details see WORKDAY_REPORTS_CONNECTOR_UNAUTHORIZED_ACCESS_ERROR
WORKDAY_REPORT_URL_EMPTYâWorkday report URL is empty. At least one report must be provided.
WORKSPACE_QUOTA_EXCEEDEDâCannot start update '<updateId>' because there are already '<maxActiveUpdates>' active pipelines running in this workspace.
SQLSTATE: none assigned
Base environment YAML file is missing. Please ensure the file exists in the specified path.
Description: Occurs when the required base environment YAML file cannot be found at the expected location.
Suggested Action: Ensure the base environment YAML file exists in the specified path and retry the installation.
ERROR_BASE_ENVIRONMENT_FILE_READâSQLSTATE: none assigned
Failed to read base environment file due to incorrect syntax or format of YAML file. Please review the file contents.
Description: Occurs when the base environment YAML file contains syntax or format errors.
Suggested Action: Validate and fix the YAML syntax in the environment file, then retry the installation.
ERROR_CONNECTION_REFUSEDâSQLSTATE: none assigned
Cannot connect to package repository. Check network connectivity, firewall settings, or repository availability.
Description: Occurs when pip cannot establish a connection to the remote package repository due to network issues, firewall restrictions, or repository downtime.
Suggested Action: Verify network connectivity, check firewall or proxy settings, confirm the repository URL is accessible, and try again later if the repository may be temporarily unavailable.
ERROR_CORE_PACKAGE_VERSION_CHANGEâSQLSTATE: none assigned
Installed package is incompatible with Databricks core packages. Please align the package versions with the preinstalled library versions, and retry the installations.
Description: Occurs when a Databricks core dependency (e.g., pyspark) version is changed.
Suggested Action: Align the installed package versions with the preinstalled libraries and retry the installation.
ERROR_CRAN_PACKAGE_NOT_AVAILABLEâSQLSTATE: none assigned
The CRAN package is not available for the preinstalled R version on this compute.
Description: Occurs when an R package is not published for the installed R version on the compute.
Suggested Action: Switch to a compute with a compatible R version, or choose a different package version.
ERROR_DBFS_DISABLEDâSQLSTATE: none assigned
Public DBFS root access is disabled. Please use an alternative storage.
Description: Occurs when attempting to install libraries from DBFS, but the public DBFS root is disabled in the workspace.
Suggested Action: Use alternative storage locations like UC volumes, workspace files or remote storage.
ERROR_DIRECTORY_NOT_INSTALLABLEâSQLSTATE: none assigned
Directory is unsinstallable due to invalid Python package structure. Please check that the directory is properly set up.
Description: Occurs when pip install is run against a directory without a valid Python package structure.
Suggested Action: Ensure the directory contains a setup.py or pyproject.toml and retry, or package it as a wheel.
ERROR_DUPLICATE_INSTALLATIONâSQLSTATE: none assigned
Duplicate package installation detected. Try removing the duplicate package entry for the package and restart the cluster.
Description: Occurs when the same package is already installed on the cluster and a duplicate installation is attempted.
Suggested Action: Remove the duplicate package entries and restart the cluster.
ERROR_FEATURE_DISABLEDâSQLSTATE: none assigned
Unity Catalog volumes are disabled in the workspace. Please contact the workspace admin to enable this feature.
Description: Occurs when Unity Catalog volumes are disabled in the workspace, preventing installation from UC volumes.
Suggested Action: Contact your workspace administrator to enable Unity Catalog volumes, or use alternative storage.
ERROR_INVALID_FILEâSQLSTATE: none assigned
The specified file cannot be installed due to incorrect file type. Please verify you are using the valid and supported file type.
Description: Occurs when the specified library file cannot be installed due to incorrect file type or format.
Suggested Action: Use a supported library file type (e.g., wheel, jar) and verify the path validity.
ERROR_INVALID_REQUIREMENTâSQLSTATE: none assigned
Incorrect syntax or malformed entries in requirements file or package dependencies. Check and correct the requirements file and package dependencies contents.
Description: Invalid or malformed requirement format detected in either your requirements file or in a package's dependency specifications.
Suggested Action: Use the correct format (e.g., 'library-name==version') in requirements files, verify package dependency formats are valid, and check for typos or unsupported version specifiers.
ERROR_INVALID_SCRIPT_ENTRY_POINTâSQLSTATE: none assigned
Invalid script entry point. Please check the package entry points or the setup.py file.
Description: Occurs when the specified console script entry point does not exist in the package metadata.
Suggested Action: Verify the entry point name in setup.py or pyproject.toml, or contact the package maintainer.
ERROR_INVALID_STORAGE_CONFIGURATIONâSQLSTATE: none assigned
Invalid storage configuration value detected for the cloud storage account. Please check the storage configuration, account settings and credentials.
Description: Occurs when the cloud storage account configuration is malformed or incorrect.
Suggested Action: Correct the storage configuration for the account and retry installation.
ERROR_INVALID_USER_INPUTâSQLSTATE: none assigned
Invalid package syntax or arguments provided. Please verify that the input and options for library installation are valid.
Description: Occurs when pip is invoked with invalid options or arguments.
Suggested Action: Verify pip options and command syntax, correct the input, and retry installation.
ERROR_INVALID_WHEELâSQLSTATE: none assigned
Corrupted, malformed, or invalid wheel file detected. Please check the wheel file or retry the installation.
Description: Occurs when pip encounters a corrupted, incomplete, or malformed wheel file during installation.
Suggested Action: Clear pip cache, re-download or rebuild the wheel, resintall, and verify its integrity before retrying.
ERROR_JAR_EVICTEDâSQLSTATE: none assigned
The JAR package got evicted by the resolver due to version conflicts. Please resolve dependency version conflicts.
Description: Occurs when Maven dependency resolution evicts a jar because of version conflicts with other dependencies.
Suggested Action: Resolve conflicts in your dependency configuration, or use explicit version overrides.
ERROR_MAVEN_LIBRARY_RESOLUTIONâSQLSTATE: none assigned
Cannot resolve Maven library coordinates. Verify library details, repository access, or Maven repository availability.
Description: Occurs when Maven cannot find or resolve the specified library due to incorrect coordinates, network issues, or repository downtime.
Suggested Action: Verify the groupId:artifactId:version format, check repository URLs and credentials, try alternative repositories, or try again later if the repository may be temporarily unavailable.
ERROR_NO_MATCHING_DISTRIBUTIONâSQLSTATE: none assigned
Unable to download or access the specified cloud storage assets, typically due to misconfigurations, missing dependencies or connectivity issues. Please review cloud storage setup.
Description: Occurs when cluster cannot download or install library files from cloud storage, typically due to misconfigurations, missing dependencies, or network issues.
Suggested Action: Ensure the cloud storage URIs are correct, credentials are valid, and any required network proxies or libraries are properly configured, then retry the installation.
ERROR_NO_SUCH_FILE_OR_DIRECTORYâSQLSTATE: none assigned
The library file does not exist or the user does not have permission to read the library file. Please check if the library file exists and the user has the right permissions to access the file.
Description: Occurs when the specified file is missing or inaccessible at the given path during library installation.
Suggested Action: Verify that the file exists at the specified path, correct the path or upload the missing file, and ensure proper permissions.
ERROR_OPERATION_NOT_SUPPORTEDâSQLSTATE: none assigned
Library installation is unsupported for this file type from the requested filesystem. Please check the library type and refer to the user guide about the supported library on the current compute.
Description: Occurs when the target filesystem, file type, or compute type does not support the requested operation during installation.
Suggested Action: Use a supported filesystem, file type, or compute type, or adjust installation target to a supported location.
ERROR_PERMISSION_DENIEDâSQLSTATE: none assigned
The user does not have the sufficient permission to install the package. Please check the file and directory access rights for the user.
Description: Occurs when the installing user lacks permission to read or write a file or directory during installation.
Suggested Action: Verify and grant proper permissions on the target directory, or contact your system administrator.
ERROR_PIP_CONFIGâSQLSTATE: none assigned
User tried to install a Python library, but the cluster's or the workspace-level pip configuration file has syntax errors or is malformed. Please check and fix the pip config file.
Description: Occurs when pip's configuration file has syntax errors or is malformed.
Suggested Action: Fix the syntax errors in the pip configuration file, remove the config file to use default settings, restart the cluster, and retry the installation.
ERROR_REQUIREMENTS_FILE_INSTALLATIONâSQLSTATE: none assigned
requirements.txt files that contain a Unity Catalog volume or workspace file reference are not supported on non-UC enabled clusters. Please use a UC enabled cluster to install requirements.txt that refers to a UC volume or workspace file.
Description: Occurs when requirements.txt includes UC volumes or workspace file references on a non-UC enabled cluster.
Suggested Action: Use a UC-enabled cluster for requirements.txt that references workspace or UC files, or remove those references.
ERROR_REQUIRE_HASHESâSQLSTATE: none assigned
Missing hashes when pip is run in --require-hashes mode and a requirement lacks a hash. Please address hash requirements or disable hash checking.
Description: Occurs when pip is run in --require-hashes mode and a requirement lacks a hash.
Suggested Action: Add hashes for all packages in requirements.txt or remove --require-hashes flag.
ERROR_RESTART_PYTHONâSQLSTATE: none assigned
Failed to restart Python process. This may be due to updating the version of a package that conflicts with the preinstalled runtime libraries. Please check and align the package dependencies and their versions.
Description: Occurs when the Python environment cannot be restarted after library installation, often due to conflicts between installed packages and preinstalled Databricks Runtime libraries.
Suggested Action: Align installed package versions with the preinstalled Databricks Runtime libraries to avoid conflicts and Python restart errors.
ERROR_RESTART_SCALAâSQLSTATE: none assigned
Failed to restart Scala process. This may be due to Scala version mismatch in scala JARs (e.g., running 2.12 jar on a 2.13 kernel). Please check and align the Scala versions.
Description: Occurs when the Scala environment cannot be restarted, often due to conflicts of Scala version mismatch in scala JARs.
Suggested Action: Align JAR scala versions with kernel scala version to avoid conflicts and Scala restart errors.
ERROR_S3_FORBIDDENâSQLSTATE: none assigned
Access denied to S3 resource. Check the IAM permissions and bucket policies.
Description: The cluster's AWS credentials do not have sufficient permissions to access the specified S3 resource.
Suggested Action: Verify and update the S3 bucket policies or IAM roles to grant the necessary read access to the cluster.
ERROR_SETUP_PY_FAILUREâSQLSTATE: none assigned
The Python package's setup.py did not run successfully due to compatibility issues, missing dependencies, or configuration errors. Please check the setup file of your dependencies.
Description: Occurs when the package's setup.py script fails due to compatibility issues, missing dependencies, or configuration errors.
Suggested Action: Update package versions, install missing dependencies, replace deprecated packages, and verify the setup.py script.
ERROR_SSL_VIOLATIONâSQLSTATE: none assigned
Pip encountered SSL handshake or certificate verification issues. Please review the SSL configurations and certificates on your compute or workspace.
Description: Occurs when pip encounters SSL handshake or certificate verification issues when connecting to package repositories.
Suggested Action: Verify SSL certificates are valid, configure trusted hosts in pip, or check network SSL setting.
ERROR_UC_ASSET_NOT_FOUNDâSQLSTATE: none assigned
Unity Catalog object not found. Verify catalog, schema, and volume exist.
Description: Occurs when the specified Unity Catalog volume, catalog, or schema does not exist or is inaccessible
Suggested Action: Verify the Unity Catalog object path is correct and the object exists in your account.
ERROR_UNSUPPORTED_LIBRARY_TYPEâSQLSTATE: none assigned
The library type is unsupported on this compute. Please check the supported libraries for the compute type.
Description: Occurs when attempting to install a library type that is not compatible with the selected compute.
Suggested Action: Use a supported library type for this compute or switch to a compute that supports this libraryType.
ERROR_UNSUPPORTED_PYTHON_VERSIONâSQLSTATE: none assigned
The Python library is incompatible with the Python version on this compute. Please use a compute with a compatible Python version.
Description: Occurs when a package's python_requires constraint does not match the Python version running on the compute.
Suggested Action: Install a package version that supports the current Python version, or change the compute version.
ERROR_UNSUPPORTED_SSL_ENABLEDâSQLSTATE: none assigned
Installation fails when spark.ssl.enabled configuration is turned on, which is unsupported for library installation. Disable SSL configuration and restart the cluster.
Description: Occurs when the spark.ssl.enabled configuration is turned on, which is unsupported for library installation.
Suggested Action: Disable SSL configuration (e.g. set spark.ssl.enabled=false or set spark.databricks.libraries.ignoreSSL=true) and restart the cluster.
ERROR_USER_NOT_FOUND_IN_WORKSPACEâSQLSTATE: none assigned
Library installation failed because the user was not found in the workspace. This typically happens when a user has been removed from the workspace but their token is still being used.
Description: Occurs when a user's access token is in use but the user no longer exists in the specified workspace.
Suggested Action: Ensure the user has access to the workspace, or update the cluster configuration to use a valid user's credentials.
ERROR_VOLUME_PERMISSION_DENIEDâSQLSTATE: none assigned
Insufficient permissions on Unity Catalog volume. Please check the UC volume access rights or request access the UC Volume owner.
Description: Occurs when the user lacks permissions on the specified UC volume.
Suggested Action: Request READ permissions on the Unity Catalog volume from the volume owner or administrator.
ERROR_WHEEL_BUILDâSQLSTATE: none assigned
Pip could not successfully build the wheel due to missing build dependencies or errors. Please check the wheel package contents and dependencies.
Description: Occurs when pip fails to build a wheel for the package due to missing build dependencies or errors.
Suggested Action: Ensure build tools and headers are installed, or install a prebuilt wheel with --no-binary.
ERROR_WHEEL_INSTALLATIONâSQLSTATE: none assigned
The wheel is incompatible with the current compute due to platform tag mismatch or an invalid wheel file. Please check the wheel package contents, dependencies, and their compatibility with the compute.
Description: Occurs when the wheel file is invalid or the platform tags do not match.
Suggested Action: Use a wheel built for the current platform or rebuild the wheel with appropriate tags.
FAULT_CLOUD_STORAGE_INSTALLATIONâSQLSTATE: none assigned
Unable to download or access the specified cloud storage assets, typically due to misconfigurations or connectivity issues. Please review the cloud storage setup.
Description: Occurs when the compute cannot download or install library files from cloud storage, typically due to misconfigurations or network issues.
Suggested Action: Ensure the cloud storage URIs are correct, credentials are valid, and any required network proxies or libraries are properly configured, then retry the installation.
FAULT_DBR_VERSION_EOSâSQLSTATE: none assigned
The Databricks Runtime version on the compute has reached its end-of-support and is no longer supported. Please use a supported Databricks runtime version.
Description: Occurs when the library is installed on a Databricks Runtime version that no longer receives updates or support.
Suggested Action: Upgrade the cluster to a supported Databricks Runtime version and retry the installation.
FAULT_POLLER_ALLOWLIST_VALIDATIONâSQLSTATE: none assigned
Library installation is blocked due to missing from the allowlist. This can happen if a library is removed from the allowlist after it has been added to a cluster. Check the library allowlist, request the administrator to add libraries to the allowlist or remove unauthorized packages from the cluster.
Description: Occurs when one or more requested libraries are not approved in the metastore allowlist and are blocked from installation. This can also happen if a library was previously allowed but later removed from the allowlist.
Suggested Action: Check the metastore allowlist, request your administrator to add the missing libraries to the allowlist, or remove unauthorized libraries from the cluster.
FAULT_POLLER_DBR_UNSUPPORTEDâSQLSTATE: none assigned
The Databricks Runtime version on the cluster has reached its end-of-support and is no longer supported. Please use a supported Databricks runtime version.
Description: Occurs when the library is installed on a Databricks Runtime version that no longer receives updates or support.
Suggested Action: Change the cluster to use a supported Databricks Runtime version and retry the installation.
FAULT_POLLER_LIBRARY_STORAGE_FORMAT_UNSUPPORTEDâSQLSTATE: none assigned
The selected Databricks Runtime version may not support certain library storage formats, such as gs:// or abfss:// paths. Please upgrade Databricks Runtime or refer to the user guide regarding the capabilities for different Databricks Runtime version.
Description: Occurs when the Databricks Runtime version does not support the specified library storage format or protocol.
Suggested Action: Use a supported storage scheme or upgrade to a Databricks Runtime version that supports the desired storage format.
FAULT_POLLER_UNITY_CATALOG_NOT_AVAILABLE_ERRORâSQLSTATE: none assigned
Library installation requires Unity Catalog but Unity Catalog is unavailable in the cluster or workspace. Please contact the workspace admin to enable this feature.
Description: Occurs when a library installation requires Unity Catalog but Unity Catalog is unavailable in the workspace.
Suggested Action: Request administration to enable Unity Catalog in your workspace or use a cluster that supports Unity Catalog.
FAULT_STORAGE_ACCESS_FAILUREâSQLSTATE: none assigned
Unable to access cloud storage resources due to credential, network, or permission issues. Please check the cloud storage access configuration.
Description: Occurs when the compute cannot access the cloud storage resources due to credential, network, or permission issues.
Suggested Action: Verify storage credentials, network connectivity, and access permissions, then retry the installation.
Miscellaneousâ ABAC_POLICIES_NOT_SUPPORTED_FOR_RUNTIME_VERSIONâSQLSTATE: none assigned
DBR version <abacDBRMajorVersion>.<abacDBRMinorVersion> or higher is required to query table <tableFullName>, due to it being protected by an ABAC policy.
SQLSTATE: none assigned
Azure Entra (aka Azure Active Directory) credentials missing.
Ensure you are either logged in with your Entra account
or have setup an Azure DevOps personal access token (PAT) in User Settings > Git Integration.
If you are not using a PAT and are using Azure DevOps with the Repos API,
you must use an Azure Entra access token.
See https://docs.microsoft.com/azure/databricks/dev-tools/api/latest/aad/app-aad-token for steps to acquire an Azure Entra access token.
AZURE_ENTRA_CREDENTIALS_PARSE_FAILUREâSQLSTATE: none assigned
Encountered an error with your Azure Entra (Azure Active Directory) credentials. Please try logging out of
Entra (https://portal.azure.com) and logging back in.
Alternatively, you may also visit User Settings > Git Integration to set
up an Azure DevOps personal access token.
AZURE_ENTRA_LOGIN_ERRORâSQLSTATE: none assigned
Encountered an error with your Azure Active Directory credentials. Please try logging out of
Azure Active Directory (https://portal.azure.com) and logging back in.
AZURE_ENTRA_WORKLOAD_IDENTITY_ERRORâSQLSTATE: none assigned
Encountered an error with Azure Workload Identity with Azure Exception: <azureWorkloadIdentityExceptionMessage>
SQLSTATE: none assigned
Credential generation for clean room delta sharing securable cannot be requested.
CLEAN_ROOM_HIDDEN_SECURABLE_PERMISSION_DENIEDâSQLSTATE: none assigned
Securable <securableName> with type <securableType> and kind <securableKind> is clean room system managed, user does not have access.
SQLSTATE: none assigned
Constraint with name <constraintName> already exists, choose a different name.
SQLSTATE: none assigned
Constraint <constraintName> does not exist.
SQLSTATE: none assigned
Could not read remote repository (<repoUrl>).
Please go to your remote Git provider to ensure that:
Your remote Git repo URL is valid.
Your personal access token or app password has the correct repo access.
SQLSTATE: none assigned
Could not resolve host for <repoUrl>.
SQLSTATE: none assigned
Parameter beginning_of_time cannot be true.
SQLSTATE: none assigned
Requested objects could not be found for the continuation token.
CSMS_INVALID_CONTINUATION_TOKENâSQLSTATE: none assigned
Continuation token invalid. Cause: <msg>
SQLSTATE: none assigned
Invalid value <value> for parameter max_objects, expected value in [<minValue>, <maxValue>]
SQLSTATE: none assigned
Subscription ID invalid. Cause: <msg>
SQLSTATE: none assigned
Invalid URI format. Expected a volume (e.g. â/Volumes/catalog/schema/volumeâ) or cloud storage path (e.g. âs3://some-uriâ)
CSMS_KAFKA_TOPIC_MISSINGâSQLSTATE: none assigned
Must provide a Kafka topic
CSMS_LOCATION_ERRORâSQLSTATE: none assigned
Failed to list objects. There are problems on the location that need to be resolved. Details: <msg>
SQLSTATE: none assigned
No location found for uri <path>
SQLSTATE: none assigned
Must provide a metastore uuid
CSMS_METASTORE_RESOLUTION_FAILEDâSQLSTATE: none assigned
Unable to determine a metastore for the request.
CSMS_RESOLVE_LOCAL_SHARD_NAME_FAILEDâSQLSTATE: none assigned
CSMS failed to resolve the local shard name
CSMS_SERVICE_DISABLEDâSQLSTATE: none assigned
Service is disabled
CSMS_SHARD_NAME_MISSING_IN_REQUESTâSQLSTATE: none assigned
Shard name is missing from a rpc request to CSMS
CSMS_SUBSCRIPTION_ID_MISSING_IN_REQUESTâSQLSTATE: none assigned
Subscription id is missing in request.
CSMS_SUBSCRIPTION_NOT_FOUNDâSQLSTATE: none assigned
Subscription with id <id> not found.
SQLSTATE: none assigned
Unity catalog is disabled for this workspace
CSMS_UNITY_CATALOG_ENTITY_NOT_FOUNDâSQLSTATE: none assigned
Unity Catalog entity not found. Ensure that the catalog, schema, volume and/or external location exists.
CSMS_UNITY_CATALOG_EXTERNAL_LOCATION_DOES_NOT_EXISTâSQLSTATE: none assigned
Unity Catalog external location does not exist.
CSMS_UNITY_CATALOG_EXTERNAL_STORAGE_OVERLAPâSQLSTATE: none assigned
URI overlaps with other volumes
CSMS_UNITY_CATALOG_METASTORE_DOES_NOT_EXISTâSQLSTATE: none assigned
Unable to determine a metastore for the request. Metastore does not exist
CSMS_UNITY_CATALOG_PATH_BASED_ACCESS_TO_TABLE_WITH_FILTER_NOT_ALLOWEDâSQLSTATE: none assigned
URI points to table with row-level filter or column mask. Path-based access to this table is not allowed.
CSMS_UNITY_CATALOG_PERMISSION_DENIEDâSQLSTATE: none assigned
Permission denied
CSMS_UNITY_CATALOG_TABLE_DOES_NOT_EXISTâSQLSTATE: none assigned
Unity Catalog table does not exist.
CSMS_UNITY_CATALOG_VOLUME_DOES_NOT_EXISTâSQLSTATE: none assigned
Unity Catalog volume does not exist.
CSMS_UNSUPPORTED_SECURABLEâSQLSTATE: none assigned
Unsupported securable
CSMS_URI_MISSINGâSQLSTATE: none assigned
Must provide uri
CSMS_URI_TOO_LONGâSQLSTATE: none assigned
Provided uri is too long. Maximum permitted length is <maxLength>.
SQLSTATE: none assigned
Databricks Default Storage cannot be accessed using Classic Compute. Please use Serverless compute to access data in Default Storage
GITHUB_APP_COULD_NOT_REFRESH_CREDENTIALSâSQLSTATE: none assigned
Operation failed because linked GitHub app credentials could not be refreshed.
Please try again or go to User Settings > Git Integration and try relinking your Git provider account.
If the problem persists, please file a support ticket.
GITHUB_APP_CREDENTIALS_NO_ACCESSâSQLSTATE: none assigned
The link to your GitHub account does not have access. To fix this error:
Alternatively, a GitHub account owner can install the app on the account to give access to the account's repositories.
Refer to https://docs.databricks.com/en/repos/get-access-tokens-from-git-provider.html#link-github-account-using-databricks-github-app for more information.
If the problem persists, please file a support ticket.
GITHUB_APP_EXPIRED_CREDENTIALSâSQLSTATE: none assigned
Linked GitHub app credentials expired after 6 months of inactivity.
Go to User Settings > Git Integration and try relinking your credentials.
If the problem persists, please file a support ticket.
GITHUB_APP_INSTALL_ON_DIFFERENT_USER_ACCOUNTâSQLSTATE: none assigned
The link to your GitHub account does not have access. To fix this error:
GitHub user <gitCredentialUsername> should go to https://github.com/apps/databricks/installations/new and install the app on the account <gitCredentialUsername> to allow access.
If user <gitCredentialUsername> already installed the app and they are using scoped access with the 'Only select repositories' option, they should ensure they have included access to this repository by selecting it.
Refer to https://docs.databricks.com/en/repos/get-access-tokens-from-git-provider.html#link-github-account-using-databricks-github-app for more information.
If the problem persists, please file a support ticket.
GITHUB_APP_INSTALL_ON_ORGANIZATIONâSQLSTATE: none assigned
The link to your GitHub account does not have access. To fix this error:
An owner of the GitHub organization <organizationName> should go to https://github.com/apps/databricks/installations/new and install the app on the organization <organizationName> to allow access.
If the app is already installed on GitHub organization <organizationName>, have an owner of this organization ensure that if using scoped access with the 'Only select repositories' option, they have included access to this repository by selecting it.
Refer to https://docs.databricks.com/en/repos/get-access-tokens-from-git-provider.html#link-github-account-using-databricks-github-app for more information.
If the problem persists, please file a support ticket.
GITHUB_APP_INSTALL_ON_YOUR_ACCOUNTâSQLSTATE: none assigned
The link to your GitHub account does not have access. To fix this error:
Go to https://github.com/apps/databricks/installations/new and install the app on your account <gitCredentialUsername> to allow access.
If the app is already installed, and you are using scoped access with the 'Only select repositories' option, ensure that you have included access to this repository by selecting it.
Refer to https://docs.databricks.com/en/repos/get-access-tokens-from-git-provider.html#link-github-account-using-databricks-github-app for more information.
If the problem persists, please file a support ticket.
GIT_CLUSTER_NOT_READYâSQLSTATE: none assigned
Git cluster is not ready.
GIT_CREDENTIAL_GENERIC_INVALIDâSQLSTATE: none assigned
Invalid Git provider credentials for repository URL <repoUrl>.
Your current Git credentials provider is <gitCredentialProvider> and username is <gitCredentialUsername>.
Go to User Settings > Git Integration to view your credential.
Please go to your remote Git provider to ensure that:
You have entered the correct Git user email or username with your Git provider credentials.
Your token or app password has the correct repo access.
Your token has not expired.
If you have SSO enabled with your Git provider, be sure to authorize your token.
SQLSTATE: none assigned
Invalid Git provider Personal Access Token credentials for repository URL <repoUrl>.
Your current Git credentials provider is <gitCredentialProvider> and username is <gitCredentialUsername>.
Go to User Settings > Git Integration to view your credential.
Please go to your remote Git provider to ensure that:
You have entered the correct Git user email or username with your Git provider credentials.
Your token or app password has the correct repo access.
Your token has not expired.
If you have SSO enabled with your Git provider, be sure to authorize your token.
SQLSTATE: none assigned
No Git credential configured, but credential required for this repository (<repoUrl>).
Go to User Settings > Git Integration to set up your Git credentials.
GIT_CREDENTIAL_NO_WRITE_PERMISSIONâSQLSTATE: none assigned
Write access to <gitCredentialProvider> repository (<repoUrl>) not granted.
Make sure you (<gitCredentialUsername>) have write access to this remote repository.
SQLSTATE: none assigned
Incorrect Git credential provider for repository.
Your current Git credential's provider (<gitCredentialProvider>) does not match that of the repository's Git provider <repoUrl>.
Try a different repository or go to User Settings > Git Integration to update your Git credentials.
GIT_FILE_NAME_TOO_LONGâSQLSTATE: none assigned
File or folder name(s) in path <path> exceed the <maxComponentBytes>-byte maximum per component.
Unix-based systems only support up to <maxComponentBytes> bytes per file or folder name.
Violations: <violations>
Please shorten the offending component(s) to proceed.
GIT_PROXY_CLUSTER_NOT_READYâSQLSTATE: none assigned
Git proxy cluster is not ready.
GIT_PROXY_CONNECTION_FAILEDâSQLSTATE: none assigned
Failed to connect to Git Proxy, please check if Git Proxy is up and running.
Error: <error>
SQLSTATE: none assigned
Secrets found in the commit. Detail: <secretDetail>. To fix this error:
Remove the secret and try committing again.
If the problem persists, please file a support ticket.
HIERARCHICAL_NAMESPACE_NOT_ENABLEDâSQLSTATE: none assigned
The Azure storage account does not have hierarchical namespace enabled.
INVALID_FIELD_LENGTHâSQLSTATE: none assigned
<rpcName> <fieldName> too long. Maximum length is <maxLength> characters.
SQLSTATE: none assigned
<msg>
For more details see INVALID_PARAMETER_VALUE
JOBS_TASK_FRAMEWORK_TASK_RUN_OUTPUT_NOT_FOUNDâSQLSTATE: none assigned
Task Framework: Task Run Output for Task with runId <runId> and orgId <orgId> could not be found.
SQLSTATE: none assigned
Task Framework: Task Run State for Task with runId <runId> and orgId <orgId> could not be found.
SQLSTATE: none assigned
RPC ClientConfig for Task with ID <taskId> does not exist.
SQLSTATE: none assigned
Task with ID <taskId> does not exist.
SQLSTATE: none assigned
Task Registry: Unsupported or unknown JobTask with class <taskClassName>.
SQLSTATE: none assigned
Path-based access to external shallow clone table <tableFullName> is not supported. Please use table names to access the shallow clone instead.
SQLSTATE: none assigned
Fabric table located at url '<url>' is not found. Please use the REFRESH FOREIGN CATALOG command to populate Fabric tables.
SQLSTATE: none assigned
Path-based access to table <tableFullName> with row filter or column mask not supported.
SQLSTATE: none assigned
User does not have <msg> on <resourceType> '<resourceName>'.
SQLSTATE: none assigned
Unable to parse delete object request: <invalidInputMsg>
SQLSTATE: none assigned
Unable to delete object <resourceName> that is not in trash
SQLSTATE: none assigned
Could not find or have permission to access resource <resourceId>
SQLSTATE: none assigned
Unable to find the resource from query id <queryId>
SQLSTATE: none assigned
Unable to create new query snippet
REDASH_QUERY_SNIPPET_QUOTA_EXCEEDEDâSQLSTATE: none assigned
The quota for the number of query snippets has been reached. The current quota is <quota>.
SQLSTATE: none assigned
The specified trigger <trigger> is already in use by another query snippet in this workspace.
SQLSTATE: none assigned
The requested resource <resourceName> does not exist
SQLSTATE: none assigned
Unable to parse delete object request: <invalidInputMsg>
SQLSTATE: none assigned
Unable to restore object <resourceName> that is not in trash
SQLSTATE: none assigned
Unable to trash already-trashed object <resourceName>
SQLSTATE: none assigned
Could not generate resource name from id <id>
SQLSTATE: none assigned
Unable to create new visualization
REDASH_VISUALIZATION_NOT_FOUNDâSQLSTATE: none assigned
Could not find visualization <visualizationId>
SQLSTATE: none assigned
The quota for the number of visualizations on query <query_id> has been reached. The current quota is <quota>.
SQLSTATE: none assigned
Remote repository (<repoUrl>) not found.
Your current Git credentials provider is <gitCredentialProvider> and username is <gitCredentialUsername>.
Please go to your remote Git provider to ensure that:
Your remote Git repo URL is valid.
Your personal access token or app password has the correct repo access.
SQLSTATE: none assigned
<resourceType> '<resourceIdentifier>' already exists
SQLSTATE: none assigned
<resourceType> '<resourceIdentifier>' does not exist.
SQLSTATE: none assigned
Query on table <tableFullName> with row filter or column mask not supported on assigned clusters.
SQLSTATE: none assigned
Table <tableFullName> is being shared with Delta Sharing, and cannot use row/column security.
SQLSTATE: none assigned
The <serviceName> service is temporarily under maintenance. Please try again later.
SQLSTATE: none assigned
Table <tableFullName> cannot have both row/column security and online materialized views.
SQLSTATE: none assigned
Too many rows to update, aborting update.
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4