Coder Social home page Coder Social logo

raw packet storing about ruuvicollector HOT 4 CLOSED

scrin avatar scrin commented on September 28, 2024
raw packet storing

from ruuvicollector.

Comments (4)

ojousima avatar ojousima commented on September 28, 2024

As a quick note, I looked into this a while ago and it seemed that InfluxDB didn't support storing strings as values. I'm not sure if the data payload could be represented as a really big integer, though.

Even if the data can be represented as an integer, InfluxDB probably cannot use the time series compression on data (or even worse, it might do lossy compression, I don't know enough about internals of InfluxDB).

from ruuvicollector.

DG12 avatar DG12 commented on September 28, 2024

Perhaps for influx a series of integer fields
" InfluxDB stores all integers as signed int64 data types. "

Or stored into a SQL (MySQL, SQLlite ) database or
even output to a binary file(s) which could be lifetime managed with logrotate

from ruuvicollector.

Scrin avatar Scrin commented on September 28, 2024

This is actually loosely related to what I've been planning to do with the Ruuvi Gateway; I'm planning on creating a new application (actually.. I started prototyping already) that receives the (raw) data from the gateway (either HTTP POST or MQTT) and process+store it to InfluxDB in the same format as RuuviCollector, making it a convenient drop-in replacement for those who want to switch from a raspberry running RuuviCollector to that.

When that's done I'm planning to add HTTP POST and/or MQTT support to RuuviCollector (or make a separate application) to make it possible to use RuuviCollector (or the separate application) as a replacement for the gateway, which in turn means it'll send any data from RuuviTags, not just the supported formats. Perhaps this is something you could use?

InfluxDB does support strings, but they're not really that well compressed and kind of weird to have in a TSDB in the first place, so some processing should be done before long term storage anyway. This could be done either directly by having an application receive the data with HTTP POST or MQTT. You could even just have a simple bash script subscribe to the MQTT and process your custom data for long-term storage.

from ruuvicollector.

Scrin avatar Scrin commented on September 28, 2024

ruuvi-go-gateway has now reached reasonable stability to recommend using it, currently it supports sending all manufacturer-specific data with company identifier 0x0499 either over HTTP POST or MQTT. If you have a use for a feature not yet supported (such as sending all manufacturer specific data instead of limiting to ruuvi-only), feel free to open an issue there

from ruuvicollector.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.