gfdrr / geonode-extract

Extract data from a GeoNode (data, styles and metadata)

Extract data from a GeoNode and dump it in a folder

Features

• Downloads data inshapefile format
• Downloads metadata in xml format
• Downloads styles in sld format (not yet implemented)

Installation

Get the latest release using pip or easy_install:

pip install geonode-extract

Usage

geonode-extract http://demo.geonode.org -d <dest_dir>

Known issues

• Does not work with layers with permissions enabled

Thanks

This package exists thanks to GFDRR and the World Bank's OpenDRI initiative.

geonode-extract's Issues

Big rasters fail to be downloaded

[downloaded] Layer geonode:hti_boundary_community_polygon_062006 (46/116)
Could not download layer "geonode:hti_topo_contours20m_line_092008".
Traceback (most recent call last):
File "/usr/local/lib/python2.6/dist-packages/extract/data.py", line 292, in ge
t_data
download_layer(layer, url, dest_dir, username, password)
File "/usr/local/lib/python2.6/dist-packages/extract/data.py", line 120, in do
wnload_layer
content = r.content
File "/usr/local/lib/python2.6/dist-packages/requests/models.py", line 782, in
content
self._content = bytes().join(self.iter_content(CONTENT_CHUNK_SIZE)) or bytes
()
MemoryError

Error raised when the default style has not the same name as the layer

An error is raised when the default style has not the same name as the layer and it stops the export if the ignore-errors flag is not on.

It is an http 404 error because the get_style function https://github.com/GFDRR/geonode-extract/blob/master/extract/data.py#L65 is using the layer name to determine the SLD style name but it can be different.

A fix can be to use gsconfig to get the default style href with something like that

cat = Catalog (url, username, password)
layer = cat.get_layer(layer['name']))
requests.get(layer.default_style.body_href(),auth=(username,password)

An extra feature can be to also to export all alternative styles for the layer. Alternative styles that can be accessed like this:

layer.styles[i].body_href()

metadata export should strip CSW specific tags

The metadata export fetches the ISO XML document via CSW GetRecordById request. The response handler should strip the root element (csw:GetRecordById) and export only the raw metadata.

Consolidate support for version 1.2 and 2.0

The master branch supports the 1.2 version. The dev branch has some modifications to work with the 2.0 version.
Both should be merged and a command line option should be added to choose the version.