Coder Social home page Coder Social logo

perf counters about buda-iiif-server HOT 3 CLOSED

eroux avatar eroux commented on September 27, 2024
perf counters

from buda-iiif-server.

Comments (3)

MarcAgate avatar MarcAgate commented on September 27, 2024

I improved ldspdi usage (by caching IdentifierInfo) and added some log code (as WARN since DEBUG is a way too verbose to allow us to read anything...)
testing rapidly: I got 0.5s for the whole operation of serving one image as indicated below (and roughly less than half that time when the image is cached):

[2019-02-25 11:41:06,198 WARN] Entering endpoint getImageRepresentation: 72 [http-nio-13580-exec-4] - bdr:V1PD100944_I1PD106604::I1PD1066040210.tif
[2019-02-25 11:41:06,199 WARN] creating ldspdi connexion: 72 [http-nio-13580-exec-4] - bdr:V1PD100944_I1PD106604::I1PD1066040210.tif at 1551094866199
[2019-02-25 11:41:06,348 WARN] getting ldspdi response: 72 [http-nio-13580-exec-4] - bdr:V1PD100944_I1PD106604::I1PD1066040210.tif at 1551094866348
[2019-02-25 11:41:06,349 WARN] getting image modification date: 72 [http-nio-13580-exec-4] - bdr:V1PD100944_I1PD106604::I1PD1066040210.tif
[2019-02-25 11:41:06,350 WARN] reading from image service: 72 [http-nio-13580-exec-4] - bdr:V1PD100944_I1PD106604::I1PD1066040210.tif
[2019-02-25 11:41:06,350 WARN] Image service reading: 72 [http-nio-13580-exec-4] - bdr:V1PD100944_I1PD106604::I1PD1066040210.tif
[2019-02-25 11:41:06,351 INFO] impl.repository.S3ResourceRepositoryImpl: 97 [http-nio-13580-exec-4] - Getting input stream for resource S3Resource [filenameExtension=null, lastModified=-1, mimeType=de.digitalcollections.core.model.api.MimeType@310932a5, size=-1, uuid=d1aeb30a-6d63-42ee-881d-7cc922a380e0, readonly=false, uri=null, identifier=Works/1a/W1PD100944/images/W1PD100944-I1PD106604/I1PD1066040210.tif]
[2019-02-25 11:41:06,351 WARN] getting S3 client : 72 [http-nio-13580-exec-4] - Works/1a/W1PD100944/images/W1PD100944-I1PD106604/I1PD1066040210.tif at 1551094866351
[2019-02-25 11:41:06,430 WARN] S3 object received: 72 [http-nio-13580-exec-4] - Works/1a/W1PD100944/images/W1PD100944-I1PD106604/I1PD1066040210.tif at 1551094866430
[2019-02-25 11:41:06,430 WARN] S3 stream returned : 72 [http-nio-13580-exec-4] - Works/1a/W1PD100944/images/W1PD100944-I1PD106604/I1PD1066040210.tif at 1551094866430
[2019-02-25 11:41:06,432 WARN] Image service return reader: 72 [http-nio-13580-exec-4] - bdr:V1PD100944_I1PD106604::I1PD1066040210.tif
[2019-02-25 11:41:06,433 WARN] end reading from image service: 72 [http-nio-13580-exec-4] - bdr:V1PD100944_I1PD106604::I1PD1066040210.tif
[2019-02-25 11:41:06,435 WARN] preaparing output stream: 72 [http-nio-13580-exec-4] - bdr:V1PD100944_I1PD106604::I1PD1066040210.tif at 1551094866435
[2019-02-25 11:41:06,435 WARN] Image service reading: 72 [http-nio-13580-exec-4] - bdr:V1PD100944_I1PD106604::I1PD1066040210.tif
[2019-02-25 11:41:06,435 INFO] impl.repository.S3ResourceRepositoryImpl: 97 [http-nio-13580-exec-4] - Getting input stream for resource S3Resource [filenameExtension=null, lastModified=-1, mimeType=de.digitalcollections.core.model.api.MimeType@310932a5, size=-1, uuid=88a661b9-4b84-4a7e-a3f7-cac137fbcb95, readonly=false, uri=null, identifier=Works/1a/W1PD100944/images/W1PD100944-I1PD106604/I1PD1066040210.tif]
[2019-02-25 11:41:06,436 WARN] getting S3 client : 72 [http-nio-13580-exec-4] - Works/1a/W1PD100944/images/W1PD100944-I1PD106604/I1PD1066040210.tif at 1551094866436
[2019-02-25 11:41:06,480 WARN] S3 object received: 72 [http-nio-13580-exec-4] - Works/1a/W1PD100944/images/W1PD100944-I1PD106604/I1PD1066040210.tif at 1551094866480
[2019-02-25 11:41:06,481 WARN] S3 stream returned : 72 [http-nio-13580-exec-4] - Works/1a/W1PD100944/images/W1PD100944-I1PD106604/I1PD1066040210.tif at 1551094866481
[2019-02-25 11:41:06,482 WARN] Image service return reader: 72 [http-nio-13580-exec-4] - bdr:V1PD100944_I1PD106604::I1PD1066040210.tif
[2019-02-25 11:41:06,759 WARN] returning getImageRepresentation: 72 [http-nio-13580-exec-4] - bdr:V1PD100944_I1PD106604::I1PD1066040210.tif

from buda-iiif-server.

MarcAgate avatar MarcAgate commented on September 27, 2024

Note that the server is (apparently) getting the image twice on S3... I don't know why, yet. I'll investigate soon.

from buda-iiif-server.

MarcAgate avatar MarcAgate commented on September 27, 2024

We should also track the size of the images loaded from S3.

from buda-iiif-server.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.