Overpass API developpement

Text archives Help


Re: [overpass] batch query result to lot of 504 error


Chronological Thread 
  • From: Igor Brejc < >
  • To:
  • Subject: Re: [overpass] batch query result to lot of 504 error
  • Date: Mon, 9 Apr 2018 13:08:00 +0200

I don't know, it depends on where the bottleneck is. Could be the disk, the RAM or CPU. Mostly it depends on what kind of queries you are running. I'd suggest running a resource monitor to see what's going on.

On Mon, Apr 9, 2018 at 12:43 PM, yann Guillerm < > wrote:
Thanks for the answer. 

I have already change the Apache settings du 3600 but that does not help.

I think that the number of concurrent call is the problem. 
In may script if i limit the concurrent call to 20, my test programme work.
If i try the same script with a limit to 40, a got 504 errors.

i was thinking to start 4 overpass installation on my server ( one for each core)  and load balance between them ? 
do you that will do the trick ? 

Yann.


2018-04-09 11:11 GMT+02:00 Igor Brejc < >:
Hi Yann,

One problem could be that the timeout setting on your web server is set to too short of a period. I've made some notes on this when running Overpass on Apache: https://wiki.openstreetmap.org/wiki/User:Breki/Overpass_API_Installation#504_Gateway_Timeout_Error

Cheers,
Igor


On Mon, Apr 9, 2018 at 10:49 AM, < > wrote:
Hi,

i need to make a lot of query, so i create my own overpass server.
the server answer well when testing but when i launch a batch that spam
request ( more than 1000 ).

After 50-100 requests, the server return 504 responses.

what can i do to send a lot of requests without having 504 responses ?

- processor is a 25% ( one full core)
- memory stay flat at 24/30%



it's a batch so it can wait .... nobody is waiting for the result ... but i
cannot suffer 504 responses.

please help me.

Yann.






Archive powered by MHonArc 2.6.19+.

Top of page