Overpass API developpement

Text archives Help


Re: [overpass] Setup question


Chronological Thread 
  • From: Roland Olbricht <roland.olbricht@gmx.de>
  • To: overpass@listes.openstreetmap.fr
  • Subject: Re: [overpass] Setup question
  • Date: Sat, 5 Nov 2016 15:33:35 +0100

Hello

in general it would be a courtesy to non-German speakers to use English on this list. The mails from this list are archived and may later readers help to get problems solved.

> Ich bin nach dieser Anleitung vorgegangen:
> http://wiki.openstreetmap.org/wiki/Overpass_API/Installation

thank you for the link. I was not aware that there is a document claiming to be an installation guide. It turns out that it is quite outdated. The official and hopefully up-to-date version is here:

https://overpass-api.de/no_frills.html

> Ich bin dabei, eine Overpass Instanz für lokale Queries hochzuziehen.
> Einen Planet habe ich installiert (Version 27.10.). Das Einspielen hat
> ca. 36h gedauert. Aktuell spiele ich hourly diffs ein, das dauert mir
> irgendwie zu lange. Nach 12h ist er immer noch bei den ersten 22 diffs.

I recommend to set up a database by cloning. If you want to use the planet.osm files then you have to figure out the right diff id from hand. The switch from 0.7.52 to 0.7.53 had affected the cloning process (as in: "wrong filename in crontab"), and I'm now making an up-to-date clone by hand. It should be available tomorrow morning.

The two last planet files are
http://planet.osm.org/planet/2016/planet-161031.osm.bz2
and
http://planet.osm.org/planet/2016/planet-161024.osm.bz2

The planet-latest is a convenience link to that latest version (here from 2016-10-31). You can check that both have the same md5. It is highly unlikely that another planet.osm file from a third party exists, no matter what date the file is. Usually, the planet.osm files are just copied from planet.osm.org to the mirrors. The file date might have been altered during copy to the mirror server.

Usually, the update starts some time after midnight of that date. Hence, the relevant hourly ids from their state files are:

36233 for the 2016-10-31 planet
36065 for the 2016-10-24 planet

I recommend to use minute diffs instead. After parsing in update_from_dir, minute diffs and hourly diffs go through the same process, hence there is not much runtime gain to expect.

- Des weiteren hat er im db-Verzeichnis eine Menge shadow-Dateien, die
alle root gehören. (Das Einspielen läuft als normaler User). Könnte
evtl. vom Dispatcher kommen, der als root läuft?

Yes. No process of Overpass API should be run as root. This is just an unnecessary security risk. Running some as root is likely to produce file permission trouble.

> War es vielleicht ein Fehler die Option "inkl. Metadaten" zu verwenden? Dauert es deshalb so lange?

I won't call it a mistake. But indeed, using meta data makes process times two to three times longer, because much more data has to be processed.

Best regards,
Roland




Archive powered by MHonArc 2.6.18.

Top of page