Overpass API developpement

Text archives Help


Re: [overpass] Overpass API Area Creation in a Custom Server


Chronological Thread 
  • From: yann Guillerm < >
  • To:
  • Subject: Re: [overpass] Overpass API Area Creation in a Custom Server
  • Date: Thu, 25 Jul 2019 09:01:21 +0200

whhooo 24H ! 
i use rules_loop on 2 server where i have priorize the process down and it always make it (for world db) within a few hours.
Actually for France only db, but the server is use for a lot more processes using sometime 100% of the processor, and it take 1h20 to finish the loop. The server specification : intel Xeon E3 1230 v6, 16go Ram.

in the pre-requirement, the documentation said to have at least 4Go ram, a lot of hard disk and that processor is not revelant.

are you sure that processor and ram are free to use ? 

sincerly, 

Yann.




Le jeu. 25 juil. 2019 à 08:12, Sameera Bandara < > a écrit :
Hi Roland,

Thank you very much for the reply. I actually already sorted out the issue after checkin nohup.out. As you have mentioned the issue was something with absolute paths. I specified the relative path to the database_dir and it worked. Below is the error I got initially.

/data/osm/osm-3s_v0.7.55/bin/rules_loop.sh: line 40: /data/osm/osm-3s_v0.7.55/bin//data/osm/osm-3s_v0.7.55/bin/database_dir/rules_loop.log: No such file or directory

/data/osm/osm-3s_v0.7.55/bin/rules_loop.sh: line 41: /data/osm/osm-3s_v0.7.55/bin//data/osm/osm-3s_v0.7.55/bin/database_dir/rules/areas.osm3s: No such file or directory

/data/osm/osm-3s_v0.7.55/bin/rules_loop.sh: line 42: /data/osm/osm-3s_v0.7.55/bin//data/osm/osm-3s_v0.7.55/bin/database_dir/rules_loop.log: No such file or directory


Now the areas are populated and I can issue queries for areas and get results, however the log says the query was timed-out. And it ran exactly 24 hours.


After 23h59m3s: in "make-area", part 0, on line 257. Stack: 0 of 0 8442756 of 0

After 23h59m18s: in "recurse", part 0, on line 255. Stack: 0 of 0 8445531 of 0 0 of 0

After 23h59m33s: in "recurse", part 0, on line 255. Stack: 0 of 0 8447843 of 0 0 of 0

After 23h59m48s: in "make-area", part 0, on line 257. Stack: 0 of 0 8450335 of 0

After 24h0m1s: in "make-area", part 0, on line 257. Stack: 0 of 0 8452832 of 0


</osm>

runtime error: Query timed out in "make-area" at line 257 after 86401 seconds.

<?xml version="1.0" encoding="UTF-8"?>

<osm version="0.6" generator="Overpass API 0.7.55.7 8b86ff77">

<note>The data included in this document is from www.openstreetmap.org. The data is made available under ODbL.</note>

<meta osm_base=""/>


kind regards,
Sameera

On Wed, 24 Jul 2019 at 21:55, Roland Olbricht < > wrote:
Hi Sameera,

could you please check what the file nohup.out contains. There should be error messages there.

As a blind guess, please try the following:

- Stop the rules_loop.sh process, e.g. by "kill 9990".

- Edit the file /data/osm/osm-3s_v0.7.55/bin/rules_loop.sh:
   replace there the line
     DB_DIR="`pwd`/$1"
   with
     DB_DIR="$1"

- Restart the process, i.e. run the command again please.

I coincidentally ran on the Russian instance into the problem that the script fails if its argument is an absolute path because of that line.

Kind regards,
Roland




Archive powered by MHonArc 2.6.19+.

Top of page