dlr-eoc / ukis-h3cellstore

High-level Rust and Python libraries to store H3 cells in ClickHouse databases

ukis_h3cellstore

Python bindings to integrate ClickHouse H3 databases with the Python data science world.

Schematic of the read workflow:

Contents

• ukis_clickhouse_arrow_grpc: GRPC-based interface library for ClickHouse using Arrow IPC as data exchange format
• ukis_h3cellstore: High-level Rust crate to store H3 cells in ClickHouse databases
• ukis_h3cellstorepy: High-level Python library to store H3 cells in ClickHouse databases

See crates subdirectory.

Inner workings

Compacted tables storage schema

Development

Launching a ClickHouse instance for the examples to work

See the clickhouse target in the justfile.

License

This software is licensed under the Apache 2.0 License.

Copyright (c) 2023 German Aerospace Center (DLR) * German Remote Sensing Data Center * Department: Geo-Risks and Civil Security

Changelog

See changelog.

Contributing

The UKIS team welcomes contributions from the community. For more detailed information, see our guide on contributing if you're interested in getting involved.

What is UKIS?

The DLR project Environmental and Crisis Information System (the German abbreviation is UKIS, standing for Umwelt- und Kriseninformationssysteme) aims at harmonizing the development of information systems at the German Remote Sensing Data Center (DFD) and setting up a framework of modularized and generalized software components.

UKIS is intended to ease and standardize the process of setting up specific information systems and thus bridging the gap from EO product generation and information fusion to the delivery of products and information to end users.

Furthermore, the intention is to save and broaden know-how that was and is invested and earned in the development of information systems and components in several ongoing and future DFD projects.

ukis-h3cellstore's Issues

CI: Port argo workflow to github actions

Make max GRPC message size configurable

tonic 0.9 introduces a default max message size of 4MB. This should be higher for this library and also be configurable.

See hyperium/tonic#1274

White background for SVGs

I noticed that it is almost impossible to see the SVGs in the README when you have GitHub's dark mode enabled. Would it be possible to adjust the SVGs so that they always come with a white background?