Comments (2)
The suggested workaround for users currently hitting this is to try and reduce the number of files being exported if possible - you can remove files from the target directory / container until the export reliably succeeds.
from dagger.
The code below tries to export enough files to trigger the issue consistently. If I leave /tmp/empty an empty directory, the process gets stuck. By accident it seems I've also found a workaround: If I create a file with fallocate -l 536870912 /tmp/empty/512MB.zip
or dd if=/dev/zero of=/tmp/empty/zero.file bs=512k count=1000
before starting the job, the .export transfers all files correctly and the job succeeds.
Environment specifics:
- Kubernetes v1.24.17 on EKS
- Dagger v0.9.5
- Dagger engine deployed as Daemonset comparable with the Helm deployment
- Dagger CLI is used with the
_EXPERIMENTAL_DAGGER_RUNNER_HOST=kube-pod://<pod>?namespace=<namespace>
environment variable
#!/usr/local/env python3
import sys
import anyio
import dagger
async def main():
async with dagger.Connection(dagger.Config(log_output=sys.stderr)) as client:
out = await (
client.container()
.from_("node:18-alpine3.19")
.with_directory("/host", client.host().directory("/tmp/empty/"))
.with_exec(["npm", "install", "gulp-cli", "yo", "@microsoft/generator-sharepoint", "--global"])
.directory("/usr/local/lib/node_modules")
.export("/tmp/sandbox_new_out")
)
print(out)
anyio.run(main)
from dagger.
Related Issues (20)
- Deprecate export functions? HOT 3
- A config file for my modules HOT 1
- Fix module name conflicts with core types
- dagger mod init fails with confusing error message when there is already a go.mod HOT 4
- CLI: support for `-o` flag HOT 1
- CLI: improve display of core API in `--help` and `dagger functions` output HOT 1
- CLI: update handling of various core types
- CLI: decide whether to support `id` or to continue hiding HOT 1
- CLI: enable `shell` and `up` functionality as chainable APIs
- engine: cannot enter cgroupv2 HOT 5
- Support core types implementing interfaces
- Go SDK: support objects from a user's module being passed as interface values
- Handle conflicts between user-defined fields and interface conversion `As* fields
- Document that changing secrets doesn't invalidate the cache HOT 5
- 🐞 Optional type in module field yields error HOT 1
- Update buildkit past ca71a44
- ✨ Allow pulling refs from a git repo HOT 2
- 🐞 Panic during cache export HOT 1
- 🐞 Zenith: Using secrets in SDKs results in error after re-run from cache
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dagger.