Overpass API developpement

Text archives Help


Re: [overpass] batch query result to lot of 504 error


Chronological Thread 
  • From: yann Guillerm < >
  • To:
  • Subject: Re: [overpass] batch query result to lot of 504 error
  • Date: Mon, 9 Apr 2018 13:14:43 +0200



@Igor : I think that you are looking to my screen ! ... I just start resource monitor and see a bunch (20 or more)  of interpreter process waiting for CPU ... 

my query use is_in() to find Area, then find specific nodes in this area. 

so now : 
  - i think i don't need to create more than 1 server instance on my physical server.
  - i need to have more CPU   or  send request at a slower rate.

Yann.



2018-04-09 13:08 GMT+02:00 Igor Brejc < >:
I don't know, it depends on where the bottleneck is. Could be the disk, the RAM or CPU. Mostly it depends on what kind of queries you are running. I'd suggest running a resource monitor to see what's going on.

On Mon, Apr 9, 2018 at 12:43 PM, yann Guillerm < > wrote:
Thanks for the answer. 

I have already change the Apache settings du 3600 but that does not help.

I think that the number of concurrent call is the problem. 
In may script if i limit the concurrent call to 20, my test programme work.
If i try the same script with a limit to 40, a got 504 errors.

i was thinking to start 4 overpass installation on my server ( one for each core)  and load balance between them ? 
do you that will do the trick ? 

Yann.


2018-04-09 11:11 GMT+02:00 Igor Brejc < >:
Hi Yann,

One problem could be that the timeout setting on your web server is set to too short of a period. I've made some notes on this when running Overpass on Apache: https://wiki.openstreetmap.org/wiki/User:Breki/Overpass_API_Installation#504_Gateway_Timeout_Error

Cheers,
Igor


On Mon, Apr 9, 2018 at 10:49 AM, < > wrote:
Hi,

i need to make a lot of query, so i create my own overpass server.
the server answer well when testing but when i launch a batch that spam
request ( more than 1000 ).

After 50-100 requests, the server return 504 responses.

what can i do to send a lot of requests without having 504 responses ?

- processor is a 25% ( one full core)
- memory stay flat at 24/30%



it's a batch so it can wait .... nobody is waiting for the result ... but i
cannot suffer 504 responses.

please help me.

Yann.







Archive powered by MHonArc 2.6.19+.

Top of page