Coder Social home page Coder Social logo

Comments (6)

fantarama avatar fantarama commented on August 16, 2024

JSR define this workflow! So my question is how can I handle long time partition execution if analyzer work in a unique transaction? I excpected that was the single method in transaction not the loop.

6 begin transaction // thread A
7 // Actions 9-12 run continuously until all partitions end.
8 // when collector payload arrives:
9 <->PartitionAnalyzer.analyzeCollectorData // thread A
10 // when partition ends:
11 <->PartitionAnalyzer.analyzeStatus // thread A
12. // Remaining actions run after all partitions end:
13. // if rollback condition occurs:
14. <->[PartitionReducer.rollbackPartitionedStep] // thread A
15.
16. // else not rollback
17. <->[PartitionReducer.beforePartitionedStepCompletion] // thread A
18. commit transaction // thread A

from jsr352.

chengfang avatar chengfang commented on August 16, 2024

will look into it next.

from jsr352.

chengfang avatar chengfang commented on August 16, 2024

According to the spec section you quoted above (section 11.7), all the work on the main thread by analyzer and reducer are in one single transaction. So I think you will need to adjust tx timeout to allow for time taken by analyzer and reducer processing, partition scheduling and dispatching and communication overhead. The scope of the partition main thread transaction (single-method vs loop), I will check with spec expert group to see why it is designed this way.
https://java.net/projects/jbatch/lists/public/archive/2014-08/message/1

from jsr352.

chengfang avatar chengfang commented on August 16, 2024

See RI Bug https://java.net/bugzilla/show_bug.cgi?id=6356
PartitionAnalyzer transaction boundary on partitioned chunk (and batchlet) step need clarification

from jsr352.

fantarama avatar fantarama commented on August 16, 2024

Yes they admit taht spec need a clarification. By now to solve my problem i've made a fix to jberet and I've updated my Wildfly 8.1 server installation.

from jsr352.

chengfang avatar chengfang commented on August 16, 2024

Somewhat related issue:
JBERET-117 Arjuna transaction timeout with partitioned step (there is no partition analyzer or collector)

from jsr352.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.