Comments (1)
Hi @maxfirman - definitely understand that it might not be ideal for your use case, but this is the expected behavior for how "discard" works, so I'm going to close this issue.
We're currently planning a set of changes that, among other things, will eliminate discard rules and provide more out of the box rules for controlling this behavior: https://www.notion.so/dagster/Public-RFC-auto-materialize-changes-6f8b7ffdd92847cfa96f2ed171293cb4?pvs=4#a57bbae508684a56aa468a58957e314e. Would be curious for your thoughts on this.
from dagster.
Related Issues (20)
- dagster-duckdb-polars lists polars as a dependency HOT 1
- [Documentation Feedback] Problem on /getting-started/hello-dagster page HOT 2
- Support Python multiprocessing within assets
- Spark Connect support for dagster
- Dagster webserver pages cannot be displayed due to error: "Loading chunk x failed." when using VS Code Remote Explorer HOT 24
- Reconnect Dagster to different slack account for alerts HOT 2
- dagster run in docker container hangs HOT 1
- Possibility to union partitions of multiple PartitionDefinitions
- Inconsistent behaviour for `context.asset_key_for_input` when using `deps` with `key_prefix` HOT 2
- Ability to declaratively set global concurrency key limits
- [Documentation Feedback] Problem on /getting-started/hello-dagster page HOT 1
- [Documentation Feedback] Problem on /getting-started/hello-dagster page HOT 1
- Improve loading speed for Dagit UI filters in each job
- dagster-dbt test failures not respected across asset definitions HOT 1
- Url link in ressource page is incorrect
- Incorrect / persistent new data version flag HOT 1
- Enable batch-writing materialization events during ranged run
- Error on Asset Dependency with Multiple dbt Model Tests after Updating to Dagster 1.6.4 HOT 1
- Unable to add dynamic partition in UI, ok in code
- Auto-layout the asset lineage on the UI
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dagster.