Comments (7)
Hey @1Map, what Node version are you using, and are you possibly running out of memory? The 502 error is odd, I don't know what would return that, are you going through a proxy to get to the database?
from ogr2ogr.
Hi @wavded ,
I am using nodejs 6.11.4. My NodeJS app is using express and is behind NGINX Reverse Proxy. I have clients that uses the app to download data as shape files. The moment a client start a lenghty job the whole web app becomes unresponsive giving 502 errors on every other call. This is also not a memory issue as I have enough memory.
I also uses Uptime Robot to monitor my HTTP. The moment a lengthy job starts, then I will suddenly also receive emails from Uptime Robot informing me that my website is down.
from ogr2ogr.
Is the client making one large call, or multiple ones? Perhaps the thread pool is hung up waiting on ogr2ogr
to return. I'm assuming the process is hung at 100% during this time. You may want to use cluster: https://nodejs.org/api/cluster.html to get more out of the server. If you have anything duplicable I could check on my side. At this point I'm guessing.
from ogr2ogr.
Hi @wavded
No, this can be one single client accessing one single large call to ogr2ogr with no other clients online, and then it can get hung up.
from ogr2ogr.
Hmm, is the NGINX timeout too short? Seems like ogr2ogr is still processing.
from ogr2ogr.
@wavded Thanks for the help so far. Where exactly can I start looking for this in NGINX ?
What I can say is the following: The app is stable if ogr2ogr is not running. The moment ogr2ogr kicks in and do lengthy job, then all becomes unstable. The moment ogr2ogr finishes the job, then all is back to normal (without restarting any service). Also, the 502 errors (while ogr2ogr is processing) is intermittent and not the whole time.
Also, I create an ogr2ogr job in the background and immediately return a response to the client. It is not that the client have to wait for the job to finish to get a response.
from ogr2ogr.
Closing due to age, reopen if issue persists.
from ogr2ogr.
Related Issues (20)
- PRODUCTION ERROR HOT 2
- stdout maxBuffer length exceeded. HOT 3
- /vsicurl/ can not be used with all kind of http or ftp resources HOT 4
- Convert files uploaded by user HOT 4
- Module not found: Error: Can't resolve 'fs' - installation HOT 3
- Currently can't provide custom args when specifying a custom command HOT 6
- How to write -update statement ? HOT 2
- how to use on angular project? HOT 2
- OGR_XLSX_HEADERS HOT 1
- precision? HOT 5
- geoJSON features order HOT 2
- Uncaught errors when opening a bad CSV file HOT 4
- Load CSV to Postgres very slow HOT 5
- change http method HOT 3
- ogr2ogr is not a function HOT 1
- How to export postegresql table to .shp using org2org? HOT 3
- More examples of how to write data HOT 6
- Unexpected behavior with double quotes in PG connection string HOT 2
- Unknown option name '-spat' HOT 2
- Result.cmd is missing a space between command and args
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ogr2ogr.