Comments (2)
Hi @fatihcihant just to make sure I'm understanding your use case, I have a few quick questions!
label distribution on synthetic data is same on real data , but in some algorithms doesnt match
Are you saying that the distribution of values for the label column is very similar when comparing real data and synthetic data, except for when using TVAE Synthesizer?
One thing to double check is if if this column's metadata is set to the categorical sdtype or if it's numerical. Categorical is the way to go here because SDV will try to retain the same distribution of categories in the synthetic data for this column!
for example on real dataset target feature rate for '1' is 0.30, i wanna adjust to 0.45 on synthetic dataset.
Are you saying that the value 1 occurs 30% of the time in synthetic data but you want it to be 0.45%? Generally, SDV tries to model & learn the patterns in your real data. So if you want 45% (or 0.45) of the values in this column to be 1, I would recommend boosting your real data so that pattern is present for SDV to learn.
Alternatively, if you have very specific values for some rows you want in your synthetic data and you want SDV to "fill in the rest" -- you can explore using conditional sampling.
Also, as a side note, SDV is tested and designed to learn from raw, enterprise data, not data that's already heavily post-processed, featurized, etc. I just wanted to share that bit of design philosophy with you as well!
Let me know if these suggestions help or if I misunderstood your use case!
from sdv.
Hi there @fatihcihant I haven't heard from you in a while so I'm going to move forward with closing this issue out. Feel free to comment here and tag me or open a new issue if you still have more questions here.
from sdv.
Related Issues (20)
- Multitable Child Table Size HOT 4
- [dtypes] Numerical Formatter Fails to Learn Format of New Data Types
- [dtypes] `FixedIncrements` Fails with New Numerical Data Types HOT 1
- Sequence_index in constraint, PARSynthesizer with Range constraint HOT 2
- Unable visualize just the real data (or just the synthetic data) in a multi-table setting
- Enabling sdv logging causes tests to fail locally
- Mock every usage of `is_faker_function` to speed up the unit tests
- [dtypes] Update the NumericalFormatter to use the `learn_rounding_digits` from RDT
- SDV documentation (TVAE) HOT 2
- Error occurs with FixedCombinations constraint when NA values exist in constraint column HOT 3
- Support optional dependencies for CUDA related packages HOT 4
- ECLSK Data produces Nans and/or no correlation in HMA
- Setting random state ahead of sampling to vary synthesised data HOT 3
- PAR can't fit if Range constraint includes a `sequence_index` column HOT 2
- Metadata Detection Fails with new Data Type
- Using FixedCombinations constraint with an integer constraint column causes sampling to fail
- Error when using a datetime column as a context column with PAR Synthesizer HOT 2
- Discrete columns cause memory overflow issues during CTGAN processing. HOT 6
- Is loss_factor not used? How to compute reconstruction loss? HOT 1
- Supported data types benchmark
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sdv.