Coder Social home page Coder Social logo

Comments (12)

steilerDev avatar steilerDev commented on September 25, 2024

Did you specify your data source upon importing the dashboard?

from icloud-photos-sync.

halbtuerke avatar halbtuerke commented on September 25, 2024

Did you specify your data source upon importing the dashboard?

Yes, I have a InfluxDB data source with the Flux query language, which has access to 3 buckets. When importing the JSON, I have chosen this data source to be used.

from icloud-photos-sync.

steilerDev avatar steilerDev commented on September 25, 2024

Are you using an Influx 2 DB? That might be it - I'm still on 1.X (and have created the Dashboard for that) - I'll check this

from icloud-photos-sync.

halbtuerke avatar halbtuerke commented on September 25, 2024

Yes, I have installed InfluxDB in version 2. I might retry with V1 when I have some spare time to set it up.

from icloud-photos-sync.

steilerDev avatar steilerDev commented on September 25, 2024

InfluxDB 2 dropped support for InfluxQL (which has a nice GUI support in Grafana - which is why I stuck with it). So for InfluxDB 2 we'd need to migrate the queries to flux.

If you feel like it you could try doing that and contribute back instead of going back to InfluxDB 1 :)

from icloud-photos-sync.

steilerDev avatar steilerDev commented on September 25, 2024

I have looked into this and started migration, until I saw that Flux has actually reached EoL and will not be present in InfluxDB 3. This means there is no point in migrating to Flux - but there is a way to use InfluxQL against InfluxDB 2 - I will parameterize the metric name, as this will be unique to your DBRP mapping

I will add some notes about this to the docs - feel free to share your experience setting this up (as I will probably skip v2 and go straight to v3 once available.

from icloud-photos-sync.

steilerDev avatar steilerDev commented on September 25, 2024

Updated the dashboard on the dev branch and added to following documentation (I hope it is clear enough):

When importing the JSON model you need to provide an InfluxDB datasource that supports InfluxQL. InfluxDB 1.X supports this out of the box, InfluxDB 2.X needs to be configured to support InfluxQL.

Additionally you need to specify the measurement name, where the sync metrics are stored. For InfluxDB 1.X this should always be icloud_photos_sync (as this is specified in the Influx Line Protocol written by this tool), InfluxDB 2.X however needs to include the database and retention policy mapping in the measurement query. This could be something like example-db.example-rp.icloud_photos_sync, but depends on the DBRP mapping you previously created.

from icloud-photos-sync.

halbtuerke avatar halbtuerke commented on September 25, 2024

Wow, awesome! Thank you for your efforts.

I set up the DBRP mapping for the bucket and when using the influx shell, I am able to query it via SQL.

These are the command that I have used:

influx v1 dbrp create \
  --db example-db \
  --rp example-rp \
  --bucket-id 1933412d2ed108d5 \
  --default
influx v1 shell
select * from "example-db"."example-rp".icloud_photos_sync

Unfortunately I cannot create a InfluxDB data source in Grafana, with the InfluxQL query language.
No matter what I try, I only get the message: InfluxDB returned error: error reading influxDB after clicking on "Save & test". The same credentials work without any issues with the Flux query language. I'm honestly a little bit baffled by this issue.

Do you have an idea what could be wrong here?

from icloud-photos-sync.

halbtuerke avatar halbtuerke commented on September 25, 2024

I found the issue. The Authorization header value requires the Token prefix. This is described at https://community.grafana.com/t/integration-with-influxdb-influxql-error-badrequest/42987/11

Now it seems to work! 🥳

CleanShot 2023-09-22 at 23 11 09@2x

from icloud-photos-sync.

steilerDev avatar steilerDev commented on September 25, 2024

Great news - and phew...100k assets, let me know how the sync goes, i tried really hard to make it stable, but only got 14k in my library to test with

from icloud-photos-sync.

github-actions avatar github-actions commented on September 25, 2024

This issue should be resolved with version v1.2.1-beta.1, please confirm.

from icloud-photos-sync.

github-actions avatar github-actions commented on September 25, 2024

This issue was resolved with version v1.3.0.

from icloud-photos-sync.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.