Comments (5)
I've had the same error with deployments to Azure based databricks with terraform version 1.4.6 and databricks provider version 1.46 running from linux based gitlab runners.
from terraform-provider-databricks.
I have tried but could not confirm the error. The error looks like caused by cluster policy validation. Similar issue will happen if specify the policy_id and restricted.
Configuration
resource "databricks_job" "job" {
format = "SINGLE_TASK"
max_concurrent_runs = 2
name = "test"
new_cluster {
num_workers = 0
spark_version = "11.3.x-scala2.12"
data_security_mode = "SINGLE_USER"
node_type_id = "i3.xlarge"
driver_node_type_id = null
custom_tags = {
"ResourceClass" = "SingleNode"
}
spark_conf = {
"spark.databricks.cluster.profile" : "singleNode"
"spark.databricks.dataLineage.enabled" : "true"
"spark.databricks.delta.optimizeWrites.enabled" : "true"
"spark.master" : "local[*,4]"
"spark.scheduler.mode" : "FIFO"
"spark.sql.files.ignoreMissingFiles" : "true"
}
spark_env_vars = {
JNAME = "zulu11-ca-amd64"
}
# policy_id = ""
}
}
main.tf
terraform {
required_version = "= 1.8.4"
required_providers {
databricks = {
source = "databricks/databricks"
version = "1.46.0"
}
}
from terraform-provider-databricks.
Thanks for reaching out, we are actively working on it and will do a patch release to solve it once the fix is in
from terraform-provider-databricks.
What's going on with this provider?
from terraform-provider-databricks.
A fix for this issue has been released in v1.47.0.
from terraform-provider-databricks.
Related Issues (20)
- [FEATURE] Support for Feature Spec Creation for Online Table Serving
- [ISSUE] Importing databricks_metastore_assignment into terraform changes default_catalog_name
- [ISSUE] Issue with `databricks_mws_workspaces` resource when using oauth m2m and fetching workspace token HOT 5
- Limitations - Specific Case for Serverless- DBSQL Serverless has been imported as a PRO instance HOT 2
- [FEATURE] Support GitHub App authentication for `databricks_git_credential` in Terraform
- [ISSUE] Issue with `databricks_schema` resource - can not be managed after import
- [ISSUE] Issue with databricks provider
- [FEATURE] Default, provider-level tags
- [ISSUE] Issue with `databricks_grants` resource
- [ISSUE] `databricks_model_serving` updates traffic_config routes every time. HOT 1
- [FEATURE] Add data source support for databricks_mlflow_models
- [FEATURE] Create a databricks_group_members resource that can resolve configuration drift
- [DOC] Schedule in `databricks_job` is ambiguous
- [ISSUE] Issue with `databricks_permissions` resource in 1.49.0 HOT 3
- [ISSUE] Azure databricks Issue with `databricks_workspace_binding` , databricks workspace is not binded to the catalog HOT 2
- [DOC] No example for how to get databricks_ip_access_list
- [ISSUE] Issue with `databricks_storage_credential` resource isolation_mode not reflecting in databricks UI HOT 1
- [ISSUE] Issue with databricks_metastores Data Source HOT 1
- [ISSUE] Issue with renaming `databricks_catalog` resource.
- [ISSUE] Issue with `databricks_sql_table > cluster_keys` resource.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from terraform-provider-databricks.