Overpass API developpement

Text archives Help


RE: [overpass] Can't run some queries (they time out)


Chronological Thread 
  • From: FRANCHOIS Serge <serge.franchois@altran.com>
  • To: "overpass@listes.openstreetmap.fr" <overpass@listes.openstreetmap.fr>, "overpass@osm101.openstreetmap.fr" <overpass@osm101.openstreetmap.fr>
  • Subject: RE: [overpass] Can't run some queries (they time out)
  • Date: Thu, 17 Nov 2016 09:08:16 +0000
  • Accept-language: en-US, fr-FR


Thanks for the feedback guys.
The context.
The purpose is to host our own overpass server. We intend to use it a lot,
and we experienced outages (overload) when using the public servers.
The idea is to have planet, but since my troubles in getting the database up,
I fell back to Europe, and finally Belgium (to save time obviously).
So you were correct: Just populating an Overpass DB with a Belgium/Planet
extract provided by Geofabrik, keeping meta data, + area calculation

I tried many times, without cleaning the db dir, admittedly.
Would that mean a plain (rm *) ? I assumed the init would overwrite the files
anyway

Some things still blurry to me:
- How to fetch the correct MIN_DIFF_ID for a particular pbf file.
- How to specify geofabric as the source for the daily diffs, as you suggest.
Daily or even weekly updates are more than enough for our needs.


For now, I will clean the db dir and restart the init process.
I have defined 3 systemd services: osm_base, areas, and diff. I will start
only the first two (as long as I don't fully understand the diff update
process) so not to taint the db.



Btw, during the latest OSM 3 day get-together in Brussels, my manager
attended your presentation. You might even have talked to him. His name is
Catalin.

BR

Serge


-----Original Message-----
From: overpass-request@listes.openstreetmap.fr
[mailto:overpass-request@listes.openstreetmap.fr] On Behalf Of mmd
Sent: Wednesday, November 16, 2016 10:37 PM
To: overpass@osm101.openstreetmap.fr
Subject: Re: [overpass] Can't run some queries (they time out)

Am 14.11.2016 um 10:20 schrieb FRANCHOIS Serge:
>
> The maps were downloaded from download.geofabrik.de Attached is the
> diff log file The process of defining the MIN_DIFF_ID is not entirely
> clear to me.
>
> Here are the vars that I use.
>
> export FIRST_MINDIFF_ID=36078
> export DB_DIR="/media/datadrive/osm-data-belgium"
> export PLANET_FILE="/media/datadrive/osm/belgium-latest.osm.bz2"
> export REPLICATE_DIR="/media/datadrive/osm-diff-belgium"
> export EXEC_DIR="/srv/osm-3s"
>

Thanks for the details. I have to say that I found the diff log a bit
confusing as the numbers in there jump back and forth a few times. Not sure
if you tried the whole process several times and forgot to clean the DB
directory in between?

I thought it might be a good idea to go back to the drawing board first:

So, what exactly do you plan to do? Just populating an Overpass DB with a
Belgium extract provided by Geofabrik, keeping meta data, or maybe something
else? Did you realize that Geofabrik also provides some _daily_ diff files to
update your Belgium extract only? That may be a better option than using the
minutely diffs on planet.openstreetmap.org.

--






Archive powered by MHonArc 2.6.18.

Top of page