IntelliJ reports exception about aw-watcher-jetbrains

[OlivierMary]

Hi @FlorianKirmaier, Thank's for the report !

You use Community Edition or Ultimate ? I use the 2018.3.4 Ultimate And no problem here... With 2-3 IDEA at same time... I will check this, If you can tell me how to reproduce :)

You have this stack every time you change a file in IDEA ? or some times ?

[FlorianKirmaier]

I'm using the Community Edition.
The exception doesn't happen so often.
I don't know how to reproduce the problem, but I update the ticket when I find out something.

But the slow down of IntelliJ, followed by a crash, happens quite often. It happens more often while selecting files for a commit.

[OlivierMary]

Hum, do you have the same problem without this plugin ? Maybe a too large project kill your IDEA, can you allocation more xmx to your IDEA ?

[FlorianKirmaier]

It started to happen after installing the plugin. It happens quite frequently, and before I didn't really notice it. So it's quite save to assume, that it is related to the plugin.
The JVM already has an unusual big heap of 4gb.

[OlivierMary]

4Gb In "Help" > "Edit Custom VM Options..." ?

[FlorianKirmaier]

Yes, to be more precise: -Xmx3250m

[OlivierMary]

Huge ! XD

I had -Xmx750m and that never failed ... I open huge project...

[FlorianKirmaier]

Now the exception happened aggain.
But this time, I've noticed in a second tab another exception.
IntelliJ claims, it happened in the activity-watcher-plugin:

java.lang.StackOverflowError
	at java.net.SocketInputStream.read(SocketInputStream.java:178)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at okio.Okio$2.read(Okio.java:139)
	at okio.AsyncTimeout$2.read(AsyncTimeout.java:211)
	at okio.RealBufferedSource.indexOf(RealBufferedSource.java:306)
	at okio.RealBufferedSource.indexOf(RealBufferedSource.java:300)
	at okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:196)
	at com.squareup.okhttp.internal.http.Http1xStream.readResponse(Http1xStream.java:186)
	at com.squareup.okhttp.internal.http.Http1xStream.readResponseHeaders(Http1xStream.java:127)
	at com.squareup.okhttp.internal.http.HttpEngine.readNetworkResponse(HttpEngine.java:737)
	at com.squareup.okhttp.internal.http.HttpEngine.access$200(HttpEngine.java:87)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:722)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)

[OlivierMary]

It's a timeout to acces aw-server ... which version of aw-server did you use ? Any application on same port of aw-server ?

[FlorianKirmaier]

I'm using the version v0.8.0b7.
There is no other process, listening to the same port as aw-server.

[OlivierMary]

Hum ! The windows incompatible version.... I can't test it :(

[FlorianKirmaier]

Now, I had the slowdown and the exception at the same time followed with a crash. So it's likely that these two are caused by the same problem. I'm deactivating the plugin for now, because it slows down my productivity.
When there is a new version available, I will test it again.

[OlivierMary]

I will try when with next version of activity watcher, it's will be release soon I think.

[dfbag7]

I have got the same StackOverflowError exception on PHPStorm with ActivityWatch v.0.8.0b6 on Windows 10:

java.lang.StackOverflowError
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
	at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
...etc....

Other exceptions were listed on the "Induced" tab, but those were the same StackOverflow exceptions:

[OlivierMary]

Hi @dfbag7 Any idea to reproduce ?

[dfbag7]

@OlivierMary No exact steps, but I'm suspecting that it can be reproduced when the computer is under heavy load. At that time I had 2 VMs and 2 Idea-based IDEs (GoLand and PHPStorm) running, and also there was a backup application running in background (which produces heavy load to disks causing the whole system to slow down).

[OlivierMary]

So that can be activity watch very slow ?

[OlivierMary]

activity watcher server !

[dfbag7]

yes, that could be

[Daidalos117]

Same here!
java.util.ConcurrentModificationException at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:903) at java.util.ArrayList$Itr.next(ArrayList.java:853) at fr.mary.olivier.aw.watcher.ReportActivity.sendAllEvents(ReportActivity.java:192) at fr.mary.olivier.aw.watcher.ReportActivity.lambda$addAndSendEvent$2(ReportActivity.java:180) at com.intellij.openapi.application.impl.ApplicationImpl$1.run(ApplicationImpl.java:314) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)

MacOS Mojave, PHPstorm 2018.3 and newest version of plugin/activitywatch...

[OlivierMary]

Hi there can you tell me if you have the same issue with the last release ?

https://github.com/ActivityWatch/activitywatch/releases/tag/v0.8.0b8

[Daidalos117]

It's the same for me. Updated Activitywatch, still getting errors sometimes. And I think when error happens it totally slow down PhpStorm.

[luckydonald]

Having exact same exception as OP.
I also seen it going very s... l... o... w...

macos 10.14.2 (18C54)
IntelliJ IDEA pro (trial, lol) as well as PHPStorm
ActivitiyWatcher is v1.0.7.

[OlivierMary]

@luckydonald with witch AW server version ?

[luckydonald]

@OlivierMary Web UI says Version: v0.8.0b7

Btw:

[luckydonald]

Yep, IDE is going slow, and also often shows an out of memory dialog.

[OlivierMary]

@luckydonald When I see your logs, it's AW server which lag, and plugin try to resend all activity in one time... will check that

But why AW server lag ? PC on fire ?

[OlivierMary]

I can reproduce the connexion lost when I stress my HDD. But no failure... Will try stress HDD + CPU + RAM.

[OlivierMary]

Never fail .. with IDEA 2019.1 Ultimate & AW v0.8.0b8 & aw-watcher-jetbrains v1.0.7

Can you tell me when you have failure on intellij if you have the same with Chrome/FF plugin ? To be sure it's when AW can't absorb requests

[luckydonald]

I have running the firefox plugin, PHPStorm, Chrome, and IntelliJ.
Like at the same time as I use them all, and often switch between them.

[luckydonald]

In fact, I also often get connection issues in firefox.

Maybe until the real connection problem is somehow fixed could it - to not crash the IDE - drop events buffering like when it reaches a 1 gigabyte?

[luckydonald]

I believe I have that MacBook (12-inch) from 2017, the one without a cooling fan, so it get's slow sometimes...
So yeah, probably PC on fire.

[OlivierMary]

@luckydonald 1gb of events it's very huge... something like 1 years with 10h usage / hour... without exit IDE.

[luckydonald]

@OlivierMary as it dies with having reached 2GB and getting out of memory, so I'd probably benefit having it stop growing after 1GB.

Maybe it is somehow sending too many events, or too fast?
That would explain the AW server getting unresponsive and also why the Firefox plugin disconnects while PHPStorm is running?
How many event's is it supposed to send in which interval?

[luckydonald]

Were you able to track down the java.util.ConcurrentModificationException? Maybe that one fixed could improve things?

[luckydonald]

But the slow down of IntelliJ, followed by a crash, happens quite often. It happens more often while selecting files for a commit.
~@FlorianKirmaier above

I noticed that too.
Could it be related to not having a normal editor up front and therefore getting some invalid state, or something?

[OlivierMary]

@luckydonald 2GB you talk about IDEA or plugin ?

I tried stress test on my PC to reproduce and nothing on plugin failure.

If I can't reproduce that's hard to fix it...

If plugin detect timeout when sending events that's stopping synchro while it didn't get an '200' answer form aw-server. After that it send all events in pipe.

If aw-server shutdown while using IDEA it's tested. Maybe I have to try to slow significally aw-server response time to reproduce, but I don't know how (stress test didn't slow it)

[luckydonald]

Bummer. I don't really have to do anything other than "just wait" :/

[kw-pr]

I got the same problem. Can't reproduce it but I see it every day.
Increasing memory does not help.

Server Version: v0.8.dev+c6433ea

PHPStorm Logs are full of this:

2019-08-07 14:58:00,725 [21608772]  ERROR - llij.ide.plugins.PluginManager - JDK: 11.0.3; VM: OpenJDK 64-Bit Server VM; Vendor: JetBrains s.r.o
2019-08-07 14:58:00,725 [21608772]  ERROR - llij.ide.plugins.PluginManager - OS: Linux
2019-08-07 14:58:00,725 [21608772]  ERROR - llij.ide.plugins.PluginManager - Plugin to blame: Activity Watcher version: 1.0.7
2019-08-07 14:58:00,725 [21608772]  ERROR - llij.ide.plugins.PluginManager - Last Action: EditorBackSpace
2019-08-07 14:58:00,530 [21608577]  ERROR - llij.ide.plugins.PluginManager - null
java.lang.StackOverflowError
        at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
        at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
        at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
        at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
        at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
        at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
        at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
        at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
        at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)
        at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:695)
        at io.swagger.client.api.DefaultApi$42.intercept(DefaultApi.java:1452)

In the raw data I see the same file is transmitted many times. Is that normal?

I disabled the plugin until it is fixes to solve the problem for now.

[OlivierMary]

I post a new version 1.0.8 tell me if problem is solved. You can DL it from release page on github or wait 2-3d on Jetbrains plugins

[kw-pr]

Thanks a lot for the update!
Looks fine for me. Bucket show only expected events.
I let you know if it comes up again but I think we can close the issue.

[OlivierMary]

Thanks @kw-pr

[OlivierMary]

Hi, there no more errors ? I can close ?

[kw-pr]

Yes, it is working fine now.
Please close.

Thanks a lot!

[OlivierMary]

Great