dagster-hex's People
dagster-hex's Issues
422 status from Hex - Validation Failed
I should first mention that this might just be an issue with my own implementation, but I unfortunately cannot find a good way to trace the error at its root and get to the actual issue.
I have an open-source project where I'm trying to leverage the dagster-hex
library to eventually automatically refresh my Hex notebook once my data warehouse has been rebuilt. You can see my implementation here, starting at line 105:
@asset(
#non_argument_deps = {"dw_data_tests"},
description = "Hex project refresh",
group_name = "data_apps",
resource_defs = {
'hex_resource': resources.my_resources.my_hex_resource
},
)
def hex_project_refresh(context):
hex_output: HexOutput = context.resources.hex_resource.run_and_poll(
project_id = "d6824152-38b4-4f39-8f5e-c3a963cc48c8",
inputs = None,
update_cache = False,
kill_on_timeout = True,
poll_interval = DEFAULT_POLL_INTERVAL,
poll_timeout = None,
)
asset_name = ["hex", hex_output.run_response["projectId"]]
return Output(
value = asset_name,
metadata={
"run_url": MetadataValue.url(hex_output.run_response["runUrl"]),
"run_status_url": MetadataValue.url(
hex_output.run_response["runStatusUrl"]
),
"trace_id": MetadataValue.text(hex_output.run_response["traceId"]),
"run_id": MetadataValue.text(hex_output.run_response["runId"]),
"elapsed_time": MetadataValue.int(
hex_output.status_response["elapsedTime"]
),
},
)
It should be noted that the implementation doesn't follow the README instructions as I instead want to have the op
as a software-defined asset instead. That said, I did also a parallel implementation that followed the instructions to the letter, and I still end up with the same issue.
My environment details:
- The latest version of the
dagster-hex
library - Dagster version 1.0.12
- Project is contained within a Docker image that is ran on a AWS ec2 linux instance
When I launch the refresh_hex_job
...
Additionally, my hex
resource is defined on line 29 of this file...
from dagster_hex.resources import hex_resource
hex_configs = config_from_files(['configs/hex_configs.yaml'])
my_hex_resource = hex_resource.configured(hex_configs)
The config used to initiate my resource looks like...
api_key:
env: HEX_API_KEY
The HEX_API_KEY
environment variable is defined in my Dockerfile.
Please let me know if you need more info. Thank you!
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.