Skip to Content.
Sympa Menu

overpass - Re: [overpass] Overpass server in production

Subject: Overpass API developpement

List archive

Re: [overpass] Overpass server in production


Chronological Thread 
  • From: Arnold Szederjesi <>
  • To: "" <>
  • Subject: Re: [overpass] Overpass server in production
  • Date: Wed, 18 May 2022 10:54:37 +0000
  • Accept-language: en-US
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=octoscreen.de; dmarc=pass action=none header.from=octoscreen.de; dkim=pass header.d=octoscreen.de; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=qYKuE0noFJyxSjTzI8EMlTrp/pAljGVgdbDyPNi8NFo=; b=fhDl7KDcElNPdMGI78tc6YpJ2oPG8BzBzHaY3CLSSSeo6UCdSQvKraDC2Sj+kB3pfFbGhvICnWAc8lsjBduYvTh7FDgZ6Wwo9jCMTQ8bueKPDOHsVofw4J7fQjwiUuVZKCMWzSPWheZFo9JJjuS2SjKz7rHJ+/VR7ptB5tdN/BbU9JHhJTkpCrQi7jqjHDx3VtZbr9sj7hUZFLnzO9dVBeWTVPS4U3W3fR2/wBt37g2AmUGoTjCNmuaS+3bpPS9RaYOT5wmxzPp1iGfgOL2pFCwgzbTrgA13+P2uYPnSPZQYYqRalhbVvkTfWqfd0efWun4agFK7xInrkXkxFJ6Fwg==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=CMq9MWFBRs4Ffdmpqi68rDUmZiiIE/X8fjd9G2ChIYuwXhh+gDxNBCY1MouhdKUwtnGXeHYM5Jp0PQfAY/vNVtixGG6+AZlzG+RZtmw/CoLoY11S8TXocp9Ubo+kkA1fuJSGGrn2nSRQI/bWnNit0B3ct9ipit268dNIV8h6bZDsISE9ZOPGXNvHA5b4JZoaHeDeQbmi/dwBR4TZlTNc0XFqfHFs9GvOSf4KHMzmWrRCBIhrQWvzKpFvFer5DYWRUB3ZyWpQzcJBZNdmYgleFrStQ0iZSyxmFKur4fRQSsL61hWjEogs1PsVGjtaITVPpojfSvHaDCZrDiWYGa5SUQ==
  • Authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=octoscreen.de;

It helps of course yes. Thank you for the detailed explanation.
Can I although ask about those updates ? How does it get stuck ? What are the symptoms ? What do you do to unstuck ?

With respect,
Arnold Szederjesi

On 18 May 2022, at 09:30, yann Guillerm <> wrote:

hello, 

here is my experience with overpass server in production.
We are using overpass since 5 years. 
we use docker container  with two sort of extract : France and World.
on a Server with AMD Epyc 7351P - 16c/32t - 2.4 GHz/2.9 GHz , 128Go Ram and nvme SSD 512 Go   we launch 16 servers (docker) . load balancing is done with nginx.
SSD is only use for container data --> multiple servers are using the same disk storage.

It works without problems for years.

Why this choice ? 
We first try to work with one overpass server  serving all the request, but it create errors ( 5XX http errors) . 
With multiple docker containers we don't have this problem .... except if we mix request type :  
  we use two types of request : 
     - lot of small requests
     - some very big requests
if we use both request type against the same server, we create 5XX errors . So we have some server for the big request, and most server for the small requests.
 
the only little problem we have with the overpass stuff is the update part which sometimes get stuck (so we write a small script to unstuck it using a cron).

hope this will help you.

Sincerely

Yann Guillerm for coachaac.com

Le mar. 17 mai 2022 à 13:07, Arnold Szederjesi <> a écrit :
Hello all,

We have started to use overpass to query OSM. We have found out early that we will need our own server to be able to cope with the load needed for us.
I have been successful using the docker container described here: https://github.com/wiktorn/Overpass-API.
The next step is to deploy it to production, but I have some questions which are probably the easiest to be answered on this mailing list.
We will probably need only the Europe extract.
The questions are:
1. How much CPU and memory does a normal Overpass server need ?
2. Disk/volume and compute resources will be separated. Therefore, is it okay or does it make sense to have multiple servers using the same volume/mount/disk storage ?
3. Also are there any other performance suggestions ?

Thank you in advance.

With respect,
Arnold Szederjesi




Archive powered by MHonArc 2.6.19+.

Top of Page