Coder Social home page Coder Social logo

Comments (4)

Kelvinyu1117 avatar Kelvinyu1117 commented on June 16, 2024 1

Let me study the technical doc of Beam internal first then. For the server-side code, are you referring to the Fn API?

from beam.

Kelvinyu1117 avatar Kelvinyu1117 commented on June 16, 2024

Let me work on it. Can you provide more background information?

from beam.

laysakura avatar laysakura commented on June 16, 2024

@Kelvinyu1117 I appreciate your proposal! Although this is a refactoring issue, it requires knowledges about Beam internal.
You may want to check the post: #1 (comment)

My motivation here is that I want to separate client codes and worker (server-side) codes. Since Pipeline, PValue, and other structs with type parameters are used only from client side, I would like to separate them from the mirror types (ones without type parameters).

As you may feel, this issue is not well broken-down for now. If you feel this issue difficult, could you wait for me to create good-first issues?

from beam.

laysakura avatar laysakura commented on June 16, 2024

@Kelvinyu1117

For the server-side code, are you referring to the Fn API?

Correct.


After I talked with several people in the Beam Summit 2023, I realized we would be re-write the existing Rust codes.
It would be more important to add features than making locally-optimal refactors.
Then, let me close this issue, sorry.


For Beam internal docs, you may find some interesting ones from https://cwiki.apache.org/confluence/display/BEAM/Design+Documents.

I'm happy if you can start from #46, #47, or even add new tasks in https://github.com/laysakura/beam/wiki/Task-dependencies-graph.

from beam.

Related Issues (16)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.