Certain attributes are mapped as Unknown SDType and we have to change the dtype using custom script about sdv

[srinify]

Hi there @ankurpuri1981

The SDV does a best guess effort during automatic metadata detection for types and table relationships and then provides convenience methods for updating the metadata to help you tweak and customize it. We've found this approach the best way to balance reducing friction (with best guess automatic metadata detection) with giving users this transparency and control over their metadata, ensuring higher quality synthetic data.

The sdtype is set to Unknown when SDV can't cleanly assign a better sdtype and these fields are treated as PII fields (or personal identifiable information).

• If the field contains freeform text (like a vehicle's description), then there isn't a clear matching sdtype in that case because the SDV doesn't have an sdtype dedicated to arbitrary text.
• In other cases, the text field might represent domain-specific concepts like social security numbers, IP addresses, street addresses, or license plate numbers. In which case, I'd recommend updating the field to the relevant sdtype. You can see a list of supported PII sdtypes here.
• In other cases, the field may actually be a numerical field but maybe has some extraneous characters and can't cleanly be cast to a numerical field. I'd recommend cleaning your data and then manually setting this column's sdtype!

It looks like you've already found the metadata updating methods, but I'm also linking here as well so you have them handy: https://docs.sdv.dev/sdv/multi-table-data/data-preparation/multi-table-metadata-api#update-api

Out of curiosity, where does your source data live that you're trying to feed into the SDV? A database? An API end point? Flat files in a file store?

[srinify]

Hi there @ankurpuri1981 I hope my response was useful! I haven't heard from you in 2 weeks so I'm going to move forward with closing this issue out.

Feel free to open a new issue if you have more questions!