Coder Social home page Coder Social logo

Comments (4)

wowasa avatar wowasa commented on June 24, 2024 1

I thought it's the database issue we had already a long time ago. But instead it is a default timeout when writing to StreamingResponseBody which is exceeded for large downloads.
The net simple recommends to increase the timeout:
spring.mvc.async.request-timeout = 3600000
(see for example https://stackoverflow.com/questions/42877498/async-timeout-downloading-a-large-file-using-streamingresponsebody-on-spring-boo)

from curation-dashboard.

wowasa avatar wowasa commented on June 24, 2024

unfortunately the issue is a bit more complex. Apparently the cause of the issue is the fact that that two Stream-methods StatusDetailRepository.findAllByCategory and StatusDetailRepository.findAllByProvidergroupnameAndCategory are not behaving in the supposed way. My idea was to read the records from the database and to write each record directly to the OutputStream without any need to store the whole recordset. But from debugging and an article I found (see https://medium.com/predictly-on-tech/spring-data-jpa-batching-using-streams-af456ea611fc) its quite likely that a Stream of Objects is created in memory first, which might take a lot of time, then we iterate through the Stream and write each Object to the OutputStream

from curation-dashboard.

wowasa avatar wowasa commented on June 24, 2024

implemented in 6.1.2

from curation-dashboard.

wowasa avatar wowasa commented on June 24, 2024

for the moment the streaming only works when the Download controller uses the EntityManager directly

from curation-dashboard.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.