Coder Social home page Coder Social logo

scambifestival / pinosync Goto Github PK

View Code? Open in Web Editor NEW
3.0 1.0 0.0 59 KB

Script for the synchronization between Pino and GitHub repository scambi.org

Home Page: https://pino.scambi.org

Python 100.00%
11ty baserow csv data eleventy json python baserow-api

pinosync's People

Contributors

2ale2 avatar

Stargazers

 avatar

Watchers

 avatar

pinosync's Issues

Impossible to update files

I thought the followng error occurred because of #3, but once I manually fixed the yml file, the problem does not change. When saving changes in the script, this is the log:

➔ Updating '2021-labs' file using its table...

	ERROR while gathering '2021-labs' table from Pino. The associated file will not be updated.
	{'Allow': 'GET, POST, HEAD, OPTIONS', 'Content-Length': '123', 'Content-Type': 'application/json', 'Date': 'Sat, 06 May 2023 15:05:08 GMT', 'Referrer-Policy': 'same-origin', 'Server': 'Caddy, uvicorn', 'Vary': 'Origin', 'X-Content-Type-Options': 'nosniff', 'X-Frame-Options': 'DENY'}
➔ Updating '2021-pinoli' file using its table...

	ERROR while gathering '2021-pinoli' table from Pino. The associated file will not be updated.
	{'Allow': 'GET, POST, HEAD, OPTIONS', 'Content-Length': '123', 'Content-Type': 'application/json', 'Date': 'Sat, 06 May 2023 15:05:09 GMT', 'Referrer-Policy': 'same-origin', 'Server': 'Caddy, uvicorn', 'Vary': 'Origin', 'X-Content-Type-Options': 'nosniff', 'X-Frame-Options': 'DENY'}
➔ Updating '2022-labs' file using its table...

	ⓘ  New content created.

	➔ Getting old file '2022-labs.csv' content...
	➔ Updating '2022-labs.csv' content...

	ⓘ  '2022-labs.csv' successfully updated.

Jumping to the next one...
➔ Updating '2022-pinoli' file using its table...

	ⓘ  New content created.

	➔ Getting old file '2022-pinoli.csv' content...
	➔ Updating '2022-pinoli.csv' content...

	ⓘ  '2022-pinoli.csv' successfully updated.

Jumping to the next one...
➔ Updating 'people' file using its table...

	ERROR while gathering 'people' table from Pino. The associated file will not be updated.
	{'Allow': 'GET, POST, HEAD, OPTIONS', 'Content-Length': '123', 'Content-Type': 'application/json', 'Date': 'Sat, 06 May 2023 15:05:17 GMT', 'Referrer-Policy': 'same-origin', 'Server': 'Caddy, uvicorn', 'Vary': 'Origin', 'X-Content-Type-Options': 'nosniff', 'X-Frame-Options': 'DENY'}
➔ Updating 'staff' file using its table...

	ERROR while gathering 'staff' table from Pino. The associated file will not be updated.
	{'Allow': 'GET, POST, HEAD, OPTIONS', 'Content-Length': '123', 'Content-Type': 'application/json', 'Date': 'Sat, 06 May 2023 15:05:17 GMT', 'Referrer-Policy': 'same-origin', 'Server': 'Caddy, uvicorn', 'Vary': 'Origin', 'X-Content-Type-Options': 'nosniff', 'X-Frame-Options': 'DENY'}

ⓘ  All files processed

➔ Checking 'toUpdate.yml' configuration file...

ⓘ  'toUpdate.yml' update not needed (file names didn't change!)

Process done. Bye!

Missing data in arrays within CSV files

When there are multiple comma-separated values, only the first one is added to the CSV file. In the bug example below, the fields giorni are incomplete in the parsed csv.

Original table on Pino:
Screenshot from 2023-05-27 17-14-59


2021-labs.csv on scambi.org/data on GitHub:
Screenshot from 2023-05-27 17-15-25

Data files are not correctly updated

By triggering updates, files are not correctly updated. For example, taking as a reference 2021 Program, table 325 view 2549: 2021-labs.

Screenshot from 2023-05-18 12-08-29

2021-labs should not have the props field displayed (maybe there are other incongruities but for the sake of simplicity I am using only this field). The screenshot below shows the original table and its view on Pino.

Screenshot from 2023-05-18 12-07-28

Nevertheless, both locally (when telling pinosync to sync files in ./new) and remotely (on GitHub) the CSV files do not correspond to the Pino table.

Screenshot from 2023-05-18 12-09-28

Screenshot from 2023-05-18 12-12-49

Use `B` also to quit the script

It is confusing to always use B to always get back and then having to use N to exit the script. It would be useful to use B also to quit the script.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.