Overpass API developpement

Text archives Help


Re: [overpass] compressed database info


Chronological Thread 
  • From: mmd <mmd.osm@gmail.com>
  • To: overpass@listes.openstreetmap.fr
  • Subject: Re: [overpass] compressed database info
  • Date: Tue, 21 Apr 2015 19:05:11 +0200

Hi,

Am 11.04.2015 um 15:20 schrieb mmd:
> Hi Roland,
>
> Am 27.02.2015 um 20:38 schrieb Roland Olbricht:
>> After reconsidering the issue, I think it is possible to add code to do
>> the compression on the nodes.map file as well. The two possibilities are
>> that I either do that myself, which may take until at least end of March
>> [..]
>>
>> Or somebody else will adopt the code from the .bin file storage. I'll do
>> my best to help and then merge the result immediately into the
>> backend_compression branch.
>
> Could you describe in a few words some of the high level concepts behind
> those map files and how they fit in the bigger picture (i.e. how they
> are used outside of template_db)?

Roland sent me a couple of helpful hints on how to tackle this issue
(thanks a lot for that, btw). Meanwhile, I've created a new branch [1]
for backend compression including lz4 and map file compression. It
already survived a few (rather basic) tests on the dev instance with a
small country extract.

The coding still has its rough edges and is currently in review process.
It's by no means ready for production yet, but we're hopefully getting
there eventually.

We'll keep you posted on the progress.

fyi...

Best,
mmd

[1] https://github.com/mmd-osm/Overpass-API/tree/backend_compression_lz4_map





Archive powered by MHonArc 2.6.18.

Top of page