Sync stopped working about remarkablepocket

[nov1n]

So I finally got upgraded to the new sync protocol and found some time to add support.

I used rmapi to connect to Remarkable Cloud, and their readme states that support for the new protocol is not yet tested through so it is recommended to keep a backup handy. That said I've been running it for about a week without any problems.

The code is currently on a branch, and I will create a release once it keeps working for a few more weeks without problems.

If you want to help me test it the command is:

touch ~/.remarkable-pocket ~/.rmapi && mkdir -p ~/.rmapi-cache && docker run -it --env TZ=Europe/Amsterdam -p 65112:65112 -v ~/.remarkable-pocket:/root/.remarkable-pocket -v ~/.rmapi:/root/.rmapi -v ~/.rmapi-cache:/root/.cache/rmapi ghcr.io/nov1n/remarkable-pocket:0.1.0

Please let me know if you encounter any problems.

[nov1n]

I have not encountered this before. Can you try to remove the ~/.remarkable-pocket config file and perform authorization again?

It may also be related to the new sync protocol that is gradually being rolled out (see juruen/rmapi#187). I am currently still on the old version, so this is difficult for me to test.

[marcusramberg]

Reauth didn't work. It's probably related to new sync as you say.

[jsainzvela]

Same problem here... :(

Tried the reauthentication, but getting the same error

[andypillip]

I got this today, but the message is preceeded by

[2022-04-07 06:26:18] deleted device

[2022-04-07 06:26:18] Serving request failed, Msg: invalid token: token contains an invalid number of segments: invalid token, Origin: invalid token: token contains an invalid number of segments: invalid token, HTTPCode: 401

[andypillip]

I tried starting remarkable-pocket with --reset-credentials. Right after, it’s providing the same error. ):

Also, it seems that --verbose does not activate debugging within rmapi, otherwise it would output get’s result. I do not know how to debug further.

[nov1n]

To enable debug logging for the rmapi client you can add --env LOGGING_LEVEL_ES_JLARRIBA_JRMAPI=DEBUG to the docker run command.

I'm still on the old sync protocol so it's working fine for me.

If you could paste the result of the GET request that would help confirm it is indeed the new sync protocol causing this issue.

[testingtony]

@nov1n I'm getting this on a new build / install. Would debugging output still be useful to you?

[andypillip]

I’m getting a 401 Unauthorized.

…
[2022-07-11 17:54:57] https://document-storage-production-dot-remarkable-production.appspot.com/document-storage/json/2/docs
[2022-07-11 17:54:57] [java.net.http.HttpHeaders@4866f30b { {Authorization=[Bearer eyJhbGciOiJIUzI1NiIsImtpZCI6IjEiLCJ0eXAiOiJKV1QifQ.e…], Content-Type=[application/json]} }]
[2022-07-11 17:54:58] 401
[2022-07-11 17:54:58] 
[2022-07-11 17:54:58] null
[2022-07-11 17:54:58] Exception encountered during context initialization - cancelling refresh
…

Does this help? (:

[nov1n]

I suspect this is indeed the new sync protocol. Adding support is still on my list, but it will be much easier to test once I also get the new version (not sure why that's not happening...).

[jamieadamsuk]

Same issue here. I definitely am on the new sync protocol - so that would explain it. Hope they roll it out to you soon!

[testingtony]

Thanks for getting this working @nov1n . I don't use docker but have compiled it on a raspberry pi and it's worked well so far. I did see one strange occurrance which is an article I'd just read was marked as read, deleted the re-uploaded. The article remains in my lists whereas the other one that was read is moved to the archive

[2022-09-02 20:28:32] Starting sync...
[2022-09-02 20:28:49] Found 2 read article(s) on Remarkable.
[2022-09-02 20:28:49] (1/2) Marking 'Why Sarah Tulip is on a mission to increase diversity in the Leeds tech sector' as read on Pocket...
[2022-09-02 20:28:51] (1/2) Deleting 'Why Sarah Tulip is on a mission to increase diversity in the Leeds tech sector' from Remarkable...
[2022-09-02 20:28:52] (2/2) Marking 'The Neuroscience of Breaking Out of Negative Thinking (and How to Do It in Under 30 Seconds)' as read on Pocket...
[2022-09-02 20:28:52] (2/2) Deleting 'The Neuroscience of Breaking Out of Negative Thinking (and How to Do It in Under 30 Seconds)' from Remarkable...
[2022-09-02 20:28:55] Found 8 unread article(s) on Remarkable. Downloading 2 more from Pocket.
[2022-09-02 20:28:55] (1/2) Downloading: 'A Stranger Looked Like My Twin. That Was Just the Beginning.'.
[2022-09-02 20:29:01] Downloaded article is invalid. See https://github.com/nov1n/RemarkablePocket#limitations for possible causes.
[2022-09-02 20:29:01] (2/2) Downloading: 'The Neuroscience of Breaking Out of Negative Thinking (and How to Do It in Under 30 Seconds)'.
[2022-09-02 20:29:08] (3/2) Downloading: 'Nadiya Hussain Caramel Soda Bread Tear and Share Recipe'.
[2022-09-02 20:29:13] Downloaded article is invalid. See https://github.com/nov1n/RemarkablePocket#limitations for possible causes.
[2022-09-02 20:29:13] (4/2) Downloading: 'Douglas Coupland on Generation X at 30 - 'Generational trashing is eternal''.
[2022-09-02 20:29:19] Uploading 2 article(s) to Remarkable.
[2022-09-02 20:29:19] (1/2) Uploading: 'The Neuroscience of Breaking Out of Negative Thinking (and How to Do It in Under 30 Seconds).epub'.
[2022-09-02 20:29:21] (2/2) Uploading: 'Douglas Coupland on Generation X at 30 - 'Generational trashing is eternal'.epub'.
[2022-09-02 20:29:23] Completed sync in 51s.
[2022-09-02 20:29:23] Next sync in 10m.

[2022-09-02 20:39:23] Starting sync...
[2022-09-02 20:39:40] Found 1 read article(s) on Remarkable.
[2022-09-02 20:39:40] (1/1) Marking 'The Neuroscience of Breaking Out of Negative Thinking (and How to Do It in Under 30 Seconds)' as read on Pocket...
[2022-09-02 20:39:40] (1/1) Deleting 'The Neuroscience of Breaking Out of Negative Thinking (and How to Do It in Under 30 Seconds)' from Remarkable...
[2022-09-02 20:39:43] Found 9 unread article(s) on Remarkable. Downloading 1 more from Pocket.
[2022-09-02 20:39:43] (1/1) Downloading: 'A Stranger Looked Like My Twin. That Was Just the Beginning.'.
[2022-09-02 20:39:43] (2/1) Downloading: 'The Neuroscience of Breaking Out of Negative Thinking (and How to Do It in Under 30 Seconds)'.
[2022-09-02 20:39:49] Uploading 1 article(s) to Remarkable.
[2022-09-02 20:39:49] (1/1) Uploading: 'The Neuroscience of Breaking Out of Negative Thinking (and How to Do It in Under 30 Seconds).epub'.
[2022-09-02 20:39:51] Completed sync in 27s.
[2022-09-02 20:39:51] Next sync in 10m.

[jamieadamsuk]

Confirmed working here also. Much better than the solution that I had cobbled together myself!

[kristiankyvik]

Confirmed it works here as well! Thanks so much for sharing the fix!

[nov1n]

@testingtony can you check whether the article was actually archived on Pocket?

[testingtony]

Hi @nov1n, as far as I can see, the articles that keep getting uploaded to remarkable are never put unto the archive on pocket. Other ones are and they don't get reuploaded to remarkable

…

On 4 Sept 2022, 15:10 +0100, Robert Carosi ***@***.***>, wrote: @testingtony can you check whether the article was actually archived on Pocket? — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: ***@***.***>

[nov1n]

That is very strange indeed. I cannot reproduce this but will add a check that prevents previously read articles from being reuploaded, regardless of their archive status on Pocket.

[testingtony]

Is there any extra logging that I can turn on that might help? Or, if you point me in the right direction I can try running it in a debugger to see if there's any more (I know nothing of the spring boot framework though)

…

On 4 Sept 2022, 15:23 +0100, Robert Carosi ***@***.***>, wrote: That is very strange indeed. I cannot reproduce this but will add a check that prevents previously read articles from being reuploaded, regardless of their archive status on Pocket. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: ***@***.***>

[nov1n]

Can you try touch ~/.remarkable-pocket ~/.rmapi && mkdir -p ~/.rmapi-cache && docker run -it --env TZ=Europe/Amsterdam -p 65112:65112 -v ~/.remarkable-pocket:/root/.remarkable-pocket -v ~/.rmapi:/root/.rmapi -v ~/.rmapi-cache:/root/.cache/rmapi ghcr.io/nov1n/remarkable-pocket:0.2.0 -v ?

[nov1n]

Closed in #7

[testingtony]

Okay. I'll give that a go when I'm next near the computer and let you know the results. It might be a day or two.

…

On 4 Sept 2022, 15:42 +0100, Robert Carosi ***@***.***>, wrote: Can you try touch ~/.remarkable-pocket ~/.rmapi && mkdir -p ~/.rmapi-cache && docker run -it --env TZ=Europe/Amsterdam -p 65112:65112 -v ~/.remarkable-pocket:/root/.remarkable-pocket -v ~/.rmapi:/root/.rmapi -v ~/.rmapi-cache:/root/.cache/rmapi ghcr.io/nov1n/remarkable-pocket:0.2.0 -v ? — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: ***@***.***>

[nov1n]

There are currently a number of problems because Remarkable changed their API again, see #11.