Overpass API developpement

[mmd <>]

Am 13.09.2017 um 16:52 schrieb marc marc:
> Hello,
> 
> 1) root cause of the crash
> we didn't find the root cause of the crash
> log extract:
> Sep 12 18:54:00 osm147 dispatcher[27374]: File_Error No such file or 
> directory 2 /ssd/overpass/database//osm3s_v0.7.54_osm_base Unix_Socket::7
> 
> but the file /ssd/overpass/database//osm3s_v0.7.54_osm_base exist
> 


According to the transaction.log file you sent me, something strange
happened at 2017-09-12 18:45:32 - the dispatcher got (re)started,
possibly because the dispatcher process died at that time for some
reason. Do you see anything interesting in dmesg pointing to a crashed
process?

Ansible tries to start it again every 5 seconds afterwards, but this
won't work as long as there are stale lock files around. That's why
there's a large number of "Dispatcher just started" further down in the
log file.

2017-09-12 18:45:25 [28205] request_read_and_idx of process 11597
timeout 180 space 536870912.
2017-09-12 18:45:25 [28205] read_finished of process 11594.
2017-09-12 18:45:25 [11597] request_read_and_idx() end
2017-09-12 18:45:25 [11594] read_finished() end
2017-09-12 18:45:25 [11597] read_idx_finished() start
2017-09-12 18:45:25 [28205] waited idle for 2 cycles.
2017-09-12 18:45:25 [28205] read_idx_finished 11597.
2017-09-12 18:45:25 [11597] read_idx_finished() end
2017-09-12 18:45:25 [11597]
(way["natural"="water"]["tidal"!="yes"](38,-2,39,-1););(._;>>;);out meta;
2017-09-12 18:45:26 [11572] write_commit() start 6546 12873 1823 9642 1379
2017-09-12 18:45:26 [28205] waited idle for 13 cycles.
2017-09-12 18:45:26 [28205] write_commit of process 11572.
2017-09-12 18:45:26 [11572] write_commit() end
2017-09-12 18:45:26 [28205] waited idle for 5 cycles.
2017-09-12 18:45:26 [28205] read_aborted of process 11572.
2017-09-12 18:45:26 [11610] write_start() start version=''
2017-09-12 18:45:26 [28205] waited idle for 5 cycles.
2017-09-12 18:45:26 [28205] write_start of process 11610. Considered as
reading: 11597.
2017-09-12 18:45:26 [11610] write_start() end
2017-09-12 18:45:32 [28205] waited idle for 58 cycles.
2017-09-12 18:45:32 [11667] Dispatcher just started.
2017-09-12 18:45:33 [11597] read_finished() start 394 0 0 0
2017-09-12 18:45:33 [11597] Dispatcher_Client::read_finished::socket
/osm3s_v0.7.54_osm_base 32 Broken pipe
2017-09-12 18:45:37 [12204] Dispatcher just started.
2017-09-12 18:45:42 [12334] Dispatcher just started.
2017-09-12 18:45:47 [12465] Dispatcher just started.
2017-09-12 18:45:53 [12602] Dispatcher just started.
2017-09-12 18:45:58 [12731] Dispatcher just started.
2017-09-12 18:46:03 [12860] Dispatcher just started.
2017-09-12 18:46:08 [12991] Dispatcher just started.
2017-09-12 18:46:14 [13130] Dispatcher just started.
2017-09-12 18:46:19 [13308] Dispatcher just started.
2017-09-12 18:46:24 [13443] Dispatcher just started.
2017-09-12 18:46:29 [13757] Dispatcher just started.
2017-09-12 18:46:35 [14125] Dispatcher just started.
2017-09-12 18:46:40 [14256] Dispatcher just started.
2017-09-12 18:46:45 [14387] Dispatcher just started.
2017-09-12 18:46:50 [14513] Dispatcher just started.
2017-09-12 18:46:56 [14666] Dispatcher just started.
2017-09-12 18:47:01 [14794] Dispatcher just started.
2017-09-12 18:47:06 [14925] Dispatcher just started.
2017-09-12 18:47:11 [15076] Dispatcher just started.
2017-09-12 18:47:17 [15213] Dispatcher just started.
2017-09-12 18:47:22 [15341] Dispatcher just started.
2017-09-12 18:47:27 [15492] Dispatcher just started.
2017-09-12 18:47:29 [11996] waited idle for 361928 cycles.
2017-09-12 18:47:32 [15641] Dispatcher just started.
2017-09-12 18:47:49 [16132] Dispatcher just started.
2017-09-12 18:47:54 [16268] Dispatcher just started.
2017-09-12 18:48:00 [16428] Dispatcher just started.
2017-09-12 18:48:05 [16560] Dispatcher just started.
2017-09-12 18:48:10 [16704] Dispatcher just started.
2017-09-12 18:48:15 [16838] Dispatcher just started.
2017-09-12 18:48:21 [16985] Dispatcher just started.
2017-09-12 18:48:26 [17129] Dispatcher just started.
2017-09-12 18:48:31 [17268] Dispatcher just started.
2017-09-12 18:48:36 [17406] Dispatcher just started.
2017-09-12 18:48:42 [17556] Dispatcher just started.
2017-09-12 18:48:47 [17700] Dispatcher just started.
2017-09-12 18:48:52 [17849] Dispatcher just started.
2017-09-12 18:48:57 [17996] Dispatcher just started.
2017-09-12 18:49:03 [18151] Dispatcher just started.
2017-09-12 18:49:08 [18295] Dispatcher just started.
2017-09-12 18:49:13 [18443] Dispatcher just started.
2017-09-12 18:49:18 [18579] Dispatcher just started.
2017-09-12 18:49:24 [18727] Dispatcher just started.
2017-09-12 18:49:29 [18859] Dispatcher just started.
2017-09-12 18:49:34 [18992] Dispatcher just started.
2017-09-12 18:49:39 [19164] Dispatcher just started.
2017-09-12 18:49:45 [19362] Dispatcher just started.
2017-09-12 18:49:50 [19494] Dispatcher just started.
2017-09-12 18:49:55 [19634] Dispatcher just started.
2017-09-12 18:50:00 [19761] Dispatcher just started.
2017-09-12 18:50:05 [19893] Dispatcher just started.
2017-09-12 18:50:11 [20035] Dispatcher just started.
2017-09-12 18:50:16 [20172] Dispatcher just started.
2017-09-12 18:50:21 [20310] Dispatcher just started.
2017-09-12 18:50:26 [20495] Dispatcher just started.
2017-09-12 18:50:32 [20877] Dispatcher just started.
2017-09-12 18:50:37 [21196] Dispatcher just started.
2017-09-12 18:51:25 [22624] Dispatcher just started.
2017-09-12 18:51:30 [22776] Dispatcher just started.
2017-09-12 18:51:35 [22927] Dispatcher just started.
2017-09-12 18:51:41 [23089] Dispatcher just started.
2017-09-12 18:51:46 [23247] Dispatcher just started.
2017-09-12 18:51:51 [23398] Dispatcher just started.
2017-09-12 18:51:56 [23550] Dispatcher just started.
2017-09-12 18:52:02 [23713] Dispatcher just started.
2017-09-12 18:52:07 [23884] Dispatcher just started.
2017-09-12 18:52:12 [24044] Dispatcher just started.
2017-09-12 18:52:17 [24201] Dispatcher just started.
2017-09-12 18:52:23 [24363] Dispatcher just started.
2017-09-12 18:52:28 [24524] Dispatcher just started.
2017-09-12 18:52:33 [24673] Dispatcher just started.
2017-09-12 18:52:38 [24826] Dispatcher just started.
2017-09-12 18:52:44 [24996] Dispatcher just started.
2017-09-12 18:52:49 [25161] Dispatcher just started.
2017-09-12 18:52:54 [25321] Dispatcher just started.
2017-09-12 18:52:57 [25446] Dispatcher just started.
2017-09-12 18:53:02 [25600] Dispatcher just started.
2017-09-12 18:53:07 [25757] Dispatcher just started.
2017-09-12 18:53:12 [25918] Dispatcher just started.
2017-09-12 18:53:18 [26088] Dispatcher just started.
2017-09-12 18:53:23 [26249] Dispatcher just started.
2017-09-12 18:53:28 [26400] Dispatcher just started.
2017-09-12 18:53:33 [26553] Dispatcher just started.
2017-09-12 18:53:39 [26718] Dispatcher just started.
2017-09-12 18:53:44 [26884] Dispatcher just started.
2017-09-12 18:53:49 [27042] Dispatcher just started.
2017-09-12 18:53:54 [27200] Dispatcher just started.
2017-09-12 18:54:00 [27371] Dispatcher just started.
2017-09-12 18:54:05 [27533] Dispatcher just started.
2017-09-12 18:54:10 [27687] Dispatcher just started.
2017-09-12 18:54:15 [27842] Dispatcher just started.
2017-09-12 18:54:21 [28005] Dispatcher just started.
2017-09-12 18:54:26 [28169] Dispatcher just started.
2017-09-12 18:54:31 [28338] Dispatcher just started.
2017-09-12 18:54:36 [28503] Dispatcher just started.
2017-09-12 18:54:42 [28676] Dispatcher just started.
2017-09-12 18:54:47 [28840] Dispatcher just started.
2017-09-12 18:54:52 [29003] Dispatcher just started.
2017-09-12 18:54:57 [29167] Dispatcher just started.
2017-09-12 18:55:03 [29338] Dispatcher just started.
2017-09-12 18:55:08 [29507] Dispatcher just started.
2017-09-12 18:55:13 [29666] Dispatcher just started.
2017-09-12 18:55:18 [29829] Dispatcher just started.
2017-09-12 18:55:24 [29997] Dispatcher just started.
2017-09-12 18:55:29 [30159] Dispatcher just started.
2017-09-12 18:55:59 [31548] Dispatcher just started.
2017-09-12 18:55:59 [31552] request_read_and_idx() start
2017-09-12 18:55:59 [31548] request_read_and_idx of process 31552
timeout 180 space 536870912.
2017-09-12 18:55:59 [31552] request_read_and_idx() end
2017-09-12 18:55:59 [31552] read_idx_finished() start
2017-09-12 18:55:59 [31548] waited idle for 1 cycles.
2017-09-12 18:55:59 [31548] read_idx_finished 31552.
2017-09-12 18:55:59 [31552] read_idx_finished() end
2017-09-12 18:55:59 [31552]