Comments (4)
lukemarsden
commented on July 21, 2024
I wonder if this relates to #35 - the blob_dto code talks about Name fields - could we end up in that codepath somehow?
from aml.
albscui
commented on July 21, 2024
This is caused by a commit not being closed in Pachyderm, which returns an error from the S3G. The problem is that the Rust S3 library doesn't understand Pachyderm specific errors, so it just returns a general error which gets propagated to rslex. Checkout https://github.com/durch/rust-s3/blob/ae166bad53c25c88b9d3784fb816783142400567/s3/src/bucket.rs#L1213
from aml.
lukemarsden
commented on July 21, 2024
See also https://pachyderm.slack.com/archives/CEY70V55G/p1625752329186100
from aml.
albscui
commented on July 21, 2024
Fixed with pachctl deploy --no-expose-docker-socket
https://github.com/pachyderm/aml/blob/main/scripts/install.sh#L42
from aml.
Related Issues (20)
- rewrite test_pachyderm.py as a rust test HOT 1
- Probably remove `blob_dto.rs` - it's all about parsing XML ourselves
- test with large number of files (pagination)
- remove ApplyCredential, replace with String
- Support deploying syncer for existing Pachyderm instance
- Update README with instruction on how to activate private preview in your account (needs collaboration with Microsoft!) HOT 1
- Update terraform code to deploy the marketplace VM
- ADLS Gen 2 spout HOT 3
- [Syncer] Fix `UnboundLocalError: local variable 'ds_new' referenced before assignment`
- [rslex] Improve how we pass `uri` into `request_builder` HOT 1
- Flatten out the `vec![ListBucketResult]` returned by `bucket.list()`
- Implement `list_directory()` and `get_entry()` in `stream_handler.rs` so that we can support mounting.
- Searcher does not recurse on subdirectories given a glob pattern
- Hide kubectl port-forward outputs
- Support migrating data from ADLS Gen2 to Pachyderm
- Programmatically define multiple AML workspaces.
- Update to Pachyderm 2.0
- Deployment uses standard storage class HOT 1
- Fix docs on configuring "Advanced: using pachctl locally" HOT 1
- pachyderm-aml-syncer.service is not enabled on startup on syncer VM HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from aml.