Coder Social home page Coder Social logo

tables containing `Set` values are serializable but corresponding deserialized `Arrow.Table`s are inaccessible about arrow-julia HOT 3 CLOSED

apache avatar apache commented on September 2, 2024
tables containing `Set` values are serializable but corresponding deserialized `Arrow.Table`s are inaccessible

from arrow-julia.

Comments (3)

quinnj avatar quinnj commented on September 2, 2024 1

Yes, as you've discovered, the Arrow.jl implementation isn't currently very useful for "serialization" of generic objects, but focused on the limited set of types it was originally designed for. I've looked into this and the DataType cases and they're non-trivial with how the code is currently structured, but it should be much nicer if people want to "hook in" to using Arrow.jl for generic serialization. The biggest thing is making the ArrowTypes module much cleaner in terms of the contracts for the various types: what's required and then making sure hte implementation only relies on those contracts. Then people can overload the necessary methods and everything will just work, similar to the StructTypes.jl system. let me look at the NamedTuple issue and see if it's lower hanging fruit

from arrow-julia.

jrevels avatar jrevels commented on September 2, 2024

Ha, yeah - I was actually surprised that Sets were serializable in the first place 😁 Thanks for checking it out.

I'd consider it a win if the error could be moved to serialization time (and try to prevent non-deserializable content from being serialized in the first place as a general rule)

from arrow-julia.

quinnj avatar quinnj commented on September 2, 2024

I'm going to add support for this in #156

from arrow-julia.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.