Comments (10)
I think the goal is to make it useful and practical. Images are one of the major usage of weed-fs, and worth special treatment. And the image related features are not really complicating the code. Of course, we will unlikely add any more complicated features.
Having a plugin layer would be ideal.
from seaweedfs.
👍 for the plugin layer! That would put weed-fs on steroids!
from seaweedfs.
+1 for a plugin layer :)
from seaweedfs.
Any idea on how to make the plugin? The Golang is statically compiled.
On Tue, Nov 11, 2014 at 9:45 AM, phal0r [email protected] wrote:
+1 for a plugin layer :)
—
Reply to this email directly or view it on GitHub
#8 (comment).
from seaweedfs.
@chrislusf
Like heka.
Via lua (or js).
from seaweedfs.
Very good to learn this!
Chris
@chrislusf https://github.com/chrislusf
Like heka.
Via lua (or js).
—
Reply to this email directly or view it on GitHub
#8 (comment).
from seaweedfs.
@chrislusf
Most of the times people seem to use net/rpc
like packer did. But I guess this would only work if the plugins would also be go binaries. Since we are talking about plugins for image processing, I don't think limiting the plugin architecture to a specific language would be a wise decision. Piping data to a second process might be a better idea, since this would be language agnostic. Perhaps the pipe package might be of interest.
Named pipes might also be a way to go, but right now Go seems to lack support for it. But that might have changed.
from seaweedfs.
An approach similar to heka's seems more feasible. We can provide an
interface to write/load/run go plugins compiled together with the original
source, and some default implementations. One of the implementation would
just use pipe for external processes.
For use cases requiring performance, it can go with a go implementation.
Chris
On Thu, Nov 13, 2014 at 12:17 PM, Jochen Breuer [email protected]
wrote:
@chrislusf https://github.com/chrislusf
Most of the times people seem to use net/rpc like packer
hashicorp/packer#1 did. But I guess this
would only work if the plugins would also be go binaries. Since we are
talking about plugins for image processing, I don't think limiting the
plugin architecture to a specific language would be a wise decision. Piping
data to a second process might be a better idea, since this would be
language agnostic. Perhaps the pipe https://labix.org/pipe package
might be of interest.
Named pipes might also be a way to go, but right now Go seems to lack
support for it. But that might have changed.—
Reply to this email directly or view it on GitHub
#8 (comment).
from seaweedfs.
A plugin layer will be nice.
There're a lot of image related features, such as ".webp" image compression, image resizing, exif info extraction, image format convert and image effect filters, etc.
Weed-fs cannot support all of these features, a plugin interface will make weed-fs more powerful.
from seaweedfs.
@chrislusf
Sounds good enough to me - as long as there is a way to pipe data somewhere else.
from seaweedfs.
Related Issues (20)
- write or admin permissions can delete S3 buckets? HOT 3
- Uploading file to storj fails with NotImplemented: NewMultipartUpload (storage class) HOT 1
- seaweedfs k8s csi and filer permission issue HOT 1
- Seaweed Cloud Monitoring website no longer works, returning http error 521 HOT 1
- metadata log write failed no free volumes left when there are 313/320 free volumes HOT 3
- Update to helm version: 3.55.0 -> version: 3.62.0 broken service definition HOT 1
- Is that possible to generate s3 credentials programmatically HOT 1
- Modifying TTL without actually uploading the file content again? HOT 2
- Occasional 500 Internal Server Error between mount and volumes resulting in Input/output error HOT 5
- Question: Does anyone know what SeaweedFS will do when a rack's disk is broken down?
- empty file upload does not return size, documentation is contradictionary
- Slowdown and Input/Output Error When Copying Large File to weed FUSE-Mounted Folder in Proxmox Linux Container HOT 2
- Filer with leveldb3 causes data loss; leveldb2 works fine
- Sporadic Input/output error on seaweed at large file sizes (100GB onwards) HOT 1
- `weed filer.copy` and `weed benchmark` sometimes shows `wrong jwt` error.
- Imbalanced volume server workload during large concurrent upload. HOT 2
- Provide a way to allow retries in FUSE, `filer.copy`, and other operations.
- Upgrade 3.62 -> 3.63 - sorted needle write error: write file.sdx: bad file descriptor HOT 7
- Export failed on volume transferred to S3 HOT 2
- Metacache: find entry error: get /xxx : leveldb: closed
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from seaweedfs.