Comments (1)
xunzhang
commented on June 2, 2024
A good way to achieve this is to think pluggable abstract: file system level wrapper + format level wrapper. The pluggable feature makes it easy for code reuse and keeps it simple for developers to add a new file system/format. For example, file system could include S3, HDFS, MFS, mysql, postgres, redis, hive and so on while format could include csv, gzip, snappy, orc and so on.
from paracel.
Related Issues (20)
- Create a new release: 0.3.0. HOT 1
- Import document of v0.3.0. HOT 1
- Fix unittest failure under osx HOT 1
- Fix the Resource leak bug for Comm HOT 1
- Fix all Uninitialized Scalar Variable defects HOT 1
- Fix all Uncaught Exception defects
- Fix all Uninitialized Scalar Field defects HOT 1
- Fix the Argument Cannot be Negative defect HOT 1
- Fix all Big Parameter Passed by Value defects HOT 1
- Fix defects from coverity scan.
- Refactor python scripts according to Pylint HOT 1
- Fix compile issue for balltree folder
- Ensure using Pymesos < 0.2.0 HOT 1
- Incorrect hostname using `socket.gethostname()` under macOS Sierra. HOT 1
- when i make the paracel, i find an error: Could NOT find MsgpackC (missing: MsgpackC_CHECK_FINE) HOT 6
- how does the paracel solve the 'last-reducer' problem of iterative tasks？ HOT 1
- i want to run the matrix_factorization example ,but return errors HOT 5
- Throw user-friendly error message when catching exceptions.
- Sync document with latest version
- i meet the same problem ,i install MsgpackC v1.4.2, but the problem still occurs HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from paracel.