Comments (2)
srinify
commented on August 30, 2024
Hi there @raywang1021 👋 we currently have a bug that might make SDV problematic to use in a distributed way: #2042
Specifically, another community member pointed out here that SDV is generating temp CSV files to store intermediate progress during model training, making it problematic with Ray (which apparently tries to serialize data across multiple processes).
Have you had a chance to use SDV with Ray? How has your experience been and have you ran into the same issue with the temp CSV file? I'd love to learn more!
from sdv.
srinify
commented on August 30, 2024
Hi there @raywang1021 hopefully this answer was helpful! I haven't heard from you in 2 weeks so I'm going to go ahead and close this issue out. Feel free to comment and tag me or open a new issue if you have more questions on this front!
from sdv.
Related Issues (20)
- Support a foreign key that references multiple tables
- Multitable Child Table Size HOT 4
- [dtypes] Numerical Formatter Fails to Learn Format of New Data Types
- [dtypes] `FixedIncrements` Fails with New Numerical Data Types HOT 1
- Sequence_index in constraint, PARSynthesizer with Range constraint HOT 2
- Unable visualize just the real data (or just the synthetic data) in a multi-table setting
- Enabling sdv logging causes tests to fail locally
- Mock every usage of `is_faker_function` to speed up the unit tests
- [dtypes] Update the NumericalFormatter to use the `learn_rounding_digits` from RDT
- SDV documentation (TVAE) HOT 2
- Error occurs with FixedCombinations constraint when NA values exist in constraint column HOT 3
- Support optional dependencies for CUDA related packages HOT 4
- ECLSK Data produces Nans and/or no correlation in HMA
- Setting random state ahead of sampling to vary synthesised data HOT 3
- PAR can't fit if Range constraint includes a `sequence_index` column HOT 2
- Metadata Detection Fails with new Data Type
- Using FixedCombinations constraint with an integer constraint column causes sampling to fail
- Error when using a datetime column as a context column with PAR Synthesizer HOT 2
- Discrete columns cause memory overflow issues during CTGAN processing. HOT 6
- Is loss_factor not used? How to compute reconstruction loss? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sdv.