Overpass API developpement

[FRANCHOIS Serge <>]

Thanks for the feedback guys.
The context.
The purpose is to host our own overpass server. We intend to use it a lot, 
and we experienced  outages (overload) when using the public servers.
The idea is to have planet, but since my troubles in getting the database up, 
I fell back to Europe, and finally Belgium (to save time obviously).
So you were correct: Just populating an Overpass DB with a Belgium/Planet 
extract provided by Geofabrik, keeping meta data, + area calculation

I tried many times, without cleaning the db dir, admittedly. 
Would that mean a plain (rm *) ? I assumed the init would overwrite the files 
anyway

Some things still blurry to me: 
- How to fetch the correct MIN_DIFF_ID for a particular pbf file.
- How to specify geofabric as the source for the daily diffs, as you suggest. 
Daily or even weekly updates are more than enough for our needs.


For now, I will clean the db dir and restart the init process.
I have defined 3 systemd services: osm_base, areas, and diff. I will start 
only the first two (as long as I don't fully understand the diff update 
process) so not to taint the db.   



Btw, during the latest OSM 3 day get-together in Brussels, my manager 
attended your presentation. You might even have talked to him. His name is 
Catalin.

BR

Serge


-----Original Message-----
From:  
[] On Behalf Of mmd
Sent: Wednesday, November 16, 2016 10:37 PM
To: 
Subject: Re: [overpass] Can't run some queries (they time out)

Am 14.11.2016 um 10:20 schrieb FRANCHOIS Serge:
> 
> The maps were downloaded from download.geofabrik.de Attached is the 
> diff log file The process of defining the MIN_DIFF_ID is not entirely 
> clear to me.
> 
> Here are the vars that I use.
> 
> export FIRST_MINDIFF_ID=36078
> export DB_DIR="/media/datadrive/osm-data-belgium"
> export PLANET_FILE="/media/datadrive/osm/belgium-latest.osm.bz2"
> export REPLICATE_DIR="/media/datadrive/osm-diff-belgium"
> export EXEC_DIR="/srv/osm-3s"
> 

Thanks for the details. I have to say that I found the diff log a bit 
confusing as the numbers in there jump back and forth a few times. Not sure 
if you tried the whole process several times and forgot to clean the DB 
directory in between?

I thought it might be a good idea to go back to the drawing board first:

So, what exactly do you plan to do? Just populating an Overpass DB with a 
Belgium extract provided by Geofabrik, keeping meta data, or maybe something 
else? Did you realize that Geofabrik also provides some _daily_ diff files to 
update your Belgium extract only? That may be a better option than using the 
minutely diffs on planet.openstreetmap.org.

--