Skip to Content.
Sympa Menu

overpass - Re: [overpass] large size of area_blocks.bin

Subject: Overpass API developpement

List archive

Re: [overpass] large size of area_blocks.bin


Chronological Thread 
  • From: Donal Diamond <>
  • To:
  • Subject: Re: [overpass] large size of area_blocks.bin
  • Date: Sun, 4 Sep 2016 21:45:10 +0100


If you want to query the api you can use

http://overpass-turbo.openstreetmap.ie/
http://overpass.openstreetmap.ie/

area[~"."~"."];out count;

<meta osm_base="2016-09-04T20:30:02Z" areas="2016-09-04T20:15:02Z"/>
  <count total="104367" nodes="0" ways="0" relations="0"/>
</osm>

D


On 4 September 2016 at 21:42, Donal Diamond <> wrote:


On 4 September 2016 at 15:29, mmd <> wrote:

I did an initial db load with 49728-ireland-and-northern-ireland.osm.pbf
(including meta, lz4 compression for bin and map), and created areas
(unmodified areas.osm3s script). Total size for areas was 107 MB. Total
size for the db 1.5 GB.

My total size was about 1.5GB when I did initial import.

I started on sequenceNumber=50048 timestamp=2016-09-01T12:30:02Z so using 49728-ireland-and-northern-ireland.osm.pbf from 2016-08-29 should be close.

At some stage after replication is turned on area_blocks.bin increased from ~100MB to ~5GB and later again to 11GB.

It has now increased again to 15GB!



  area[~"."~"."];out count;

produces

  <count total="104219" nodes="0" ways="0" relations="0"/>

Can you please post the exact steps to replicate, including:
* which file to use for an initial load,

Use 49728-ireland-and-northern-ireland.osm.pbf

 
* which replication_id to use for updates

The weekly files are named sequencenumber-ireland-and-northern-ireland.osm.pbf so use 49728

 
* when to run the area creation and how often

I followed the standard install docs so after replication was enabled I just ran

nohup $EXEC_DIR/bin/dispatcher --areas --db-dir=$DB_DIR > dispatcher_areas.out &
nohup $EXEC_DIR/bin/rules_loop.sh $DB_DIR > rules_loop.out &
 
* any other important changes we should be aware of.

Only change I have is to apply_osc_to_db.sh to sleep for 300 instead of 60 as diffs are created every 15 minutes.
 

Thanks







Archive powered by MHonArc 2.6.18.

Top of Page