Overpass API developpement

[mmd <>]

Hi,

Am 02.05.2015 um 11:44 schrieb mmd:
> 
> Right now, I'm running further tests with a full planet file on the dev
> instance. Initial db load was based on a planet-150323.osm.pbf and I'm
> trying to catch up with the latest changes. With the latest fix in place
> the current branch already processed 15 days worth of updates:
> DB size is currently at about 130 GB (attic/meta, LZ4 compression).
> 

over the weekend, all data till May 1st was processed successfully, but
then processing hit another (unrelated) issue:

Reading XML file ... finished reading nodes. Flushing to database ......
done.
Reading XML file ... finished reading ways. Node 3488823404 used in way
4018534 not found.
Node 3488823415 used in way 4018534 not found.
[...]
Node 3476951202 used in way 340464124 not found.
Flushing to database ......terminate called after throwing an instance
of 'std::logic_error'
  what():  Bad geometry for way 4087415
./apply_osc_to_db.sh: line 109: 16700 Aborted                 (core
dumped) ./update_from_dir --osc-dir=$1 --version=$DATA_VERSION $META
--flush-size=0

I'm pretty sure this is related to the diff file issue described in
https://github.com/drolbr/Overpass-API/issues/210

The db is now in some undefined state and I don't really know how to get
things going again.

Best,
mmd



Some stats:

2015-05-01 20:26:57 [16610] start version='2015-03-24T00\:34\:02Z'
2015-05-01 21:07:41 [25443] start version='2015-03-25T00\:34\:02Z'
[..]
2015-05-02 02:15:51 [18569] start version='2015-03-30T05\:53\:02Z'
2015-05-02 03:12:58 [28219] start version='2015-03-31T00\:37\:01Z'
2015-05-02 04:10:53 [6982] start version='2015-03-31T22\:49\:02Z'
[..]
2015-05-02 11:50:16 [18614] start version='2015-04-07T10\:26\:02Z'
2015-05-02 12:58:52 [29069] start version='2015-04-08T08\:12\:03Z'
2015-05-02 14:03:59 [6499] start version='2015-04-09T04\:03\:03Z'
[..]
2015-05-02 18:39:09 [17508] start version='2015-04-12T20\:33\:02Z'
2015-05-02 19:51:58 [28186] start version='2015-04-13T17\:55\:02Z'
[..]
2015-05-03 20:34:03 [16700] start version='2015-05-01T22\:50\:01Z'
2015-05-03 21:27:12 [20483] start version='2015-05-01T22\:50\:01Z'

DB size: 137 GB