Coder Social home page Coder Social logo

“This study run is invalid” about jatos HOT 36 OPEN

St-ZFeng avatar St-ZFeng commented on June 11, 2024
“This study run is invalid”

from jatos.

Comments (36)

St-ZFeng avatar St-ZFeng commented on June 11, 2024

image

like this

from jatos.

kristian-lange avatar kristian-lange commented on June 11, 2024

Hi,
This error can happen when the JATOS server side closes the batch session expectantly. This is definitely not a normal thing to happen. Maybe your server runs unstable? Can you monitor the server? Did it crash at one point? How is CPU, memory and disk doing at the server?

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

Hi, This error can happen when the JATOS server side closes the batch session expectantly. This is definitely not a normal thing to happen. Maybe your server runs unstable? Can you monitor the server? Did it crash at one point? How is CPU, memory and disk doing at the server?

When this happens on a participant's page, the experiment administrator interface appears to be all right, and the pages of other participants who are conducting the experiment at the same time also appear to be all right. Therefore, I think this problem may only occur in the page transmission of a single participant.

Thank you for your reply. This server is not owned by me personally, but I will try to inquire about the server's operational status later. By the way, it is indeed a very lightweight server, possibly with only 2 cores and 2G of memory.

from jatos.

kristian-lange avatar kristian-lange commented on June 11, 2024

2GB should be okay for a small JATOS instance with not too many users and participants. Do you have access to JATOS administration page, /jatos/admin? If yes, then check the logs: click Logs and then "application.log". Search for any exceptions and errors.

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

I will try this tomorrow.

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

2GB should be okay for a small JATOS instance with not too many users and participants. Do you have access to JATOS administration page, /jatos/admin? If yes, then check the logs: click Logs and then "application.log". Search for any exceptions and errors.

image

I don't know what happen. There seems to be a lot of warnings. But the time stamp seems to be inconsistent with the time in my area. It is difficult to see which warning is related to the failed participant.

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

After time conversion, I found that the last error should have occurred around 3.20 8:00 on the JATOS server time.

image
image
image

from jatos.

kristian-lange avatar kristian-lange commented on June 11, 2024

There is a lot going on in your log. Can you please copy-paste it here as text (instead of a screenshot). I can comment easier on text.

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

Here.

2023-03-20 07:54:20,376 [WARN] - c.g.a.AuthenticationAction - Authentication failed: remote address 31.56.55.118 tried to access page /
2023-03-20 07:54:41,164 [INFO] - publix_access - GET /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-20 07:54:41,164 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 577, componentId 14
2023-03-20 07:54:41,364 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 07:54:41,365 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577
2023-03-20 07:54:41,456 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 577
2023-03-20 07:56:15,908 [INFO] - publix_access - GET /publix/G6AlWNVoorM
2023-03-20 07:56:15,908 [INFO] - c.p.PublixInterceptor - .run: studyCode G6AlWNVoorM
2023-03-20 07:56:15,909 [INFO] - c.p.w.GeneralMultiplePublix - .startStudy: studyCode G6AlWNVoorM, studyResultId578, studyId 13, batchId 38, workerId 570
2023-03-20 07:56:15,944 [INFO] - publix_access - GET /publix/233317f7-7c6d-444a-83a3-a6a653e67322/719651a6-5300-47c1-8b83-dfdae2c1933d/start
2023-03-20 07:56:15,945 [INFO] - c.p.PublixInterceptor - .startComponent: studyResultId 578, componentId 14
2023-03-20 07:56:18,708 [INFO] - publix_access - GET /publix/233317f7-7c6d-444a-83a3-a6a653e67322/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-20 07:56:18,708 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 578, componentId 14
2023-03-20 07:56:18,750 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 07:56:18,751 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 07:56:18,776 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:56:41,493 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 07:56:41,494 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577
2023-03-20 07:56:56,847 [INFO] - publix_access - GET /publix/G6AlWNVoorM
2023-03-20 07:56:56,847 [INFO] - c.p.PublixInterceptor - .run: studyCode G6AlWNVoorM
2023-03-20 07:56:56,848 [INFO] - c.p.w.GeneralMultiplePublix - .startStudy: studyCode G6AlWNVoorM, studyResultId579, studyId 13, batchId 38, workerId 571
2023-03-20 07:56:56,884 [INFO] - publix_access - GET /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/719651a6-5300-47c1-8b83-dfdae2c1933d/start
2023-03-20 07:56:56,885 [INFO] - c.p.PublixInterceptor - .startComponent: studyResultId 579, componentId 14
2023-03-20 07:56:58,929 [INFO] - publix_access - GET /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-20 07:56:58,930 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 577, componentId 14
2023-03-20 07:57:03,372 [INFO] - publix_access - GET /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-20 07:57:03,374 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 579, componentId 14
2023-03-20 07:57:03,409 [INFO] - publix_access - POST /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/heartbeat
2023-03-20 07:57:03,409 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 579
2023-03-20 07:57:03,443 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 579
2023-03-20 07:57:30,280 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/H.png but it seems you have no access rights.
2023-03-20 07:57:30,451 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/H.png but it seems you have no access rights.
2023-03-20 07:57:30,573 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/H.png but it seems you have no access rights.
2023-03-20 07:57:30,770 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/H.png but it seems you have no access rights.
2023-03-20 07:58:18,806 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 07:58:18,807 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 07:58:29,031 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-20 07:58:29,216 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-20 07:58:29,460 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-20 07:58:29,624 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-20 07:58:33,271 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 07:58:33,633 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 07:58:34,314 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 07:58:34,434 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 07:58:41,694 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 07:58:41,695 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577
2023-03-20 07:59:03,486 [INFO] - publix_access - POST /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/heartbeat
2023-03-20 07:59:03,487 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 579
2023-03-20 07:59:09,729 [INFO] - publix_access - GET /publix/233317f7-7c6d-444a-83a3-a6a653e67322/719651a6-5300-47c1-8b83-dfdae2c1933d/start
2023-03-20 07:59:09,730 [INFO] - c.p.PublixInterceptor - .startComponent: studyResultId 578, componentId 14
2023-03-20 07:59:09,901 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/jspsych.js but it seems you have no access rights.
2023-03-20 07:59:09,938 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-html-button-response.js but it seems you have no access rights.
2023-03-20 07:59:09,974 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-preload.js but it seems you have no access rights.
2023-03-20 07:59:10,011 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-html-keyboard-response.js but it seems you have no access rights.
2023-03-20 07:59:10,048 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-cloze.js but it seems you have no access rights.
2023-03-20 07:59:10,085 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-survey.js but it seems you have no access rights.
2023-03-20 07:59:10,122 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-html-slider-response.js but it seems you have no access rights.
2023-03-20 07:59:10,406 [INFO] - publix_access - GET /publix/233317f7-7c6d-444a-83a3-a6a653e67322/719651a6-5300-47c1-8b83-dfdae2c1933d/start
2023-03-20 07:59:10,407 [INFO] - c.p.PublixInterceptor - .startComponent: studyResultId 578, componentId 14
2023-03-20 07:59:13,273 [INFO] - publix_access - GET /publix/233317f7-7c6d-444a-83a3-a6a653e67322/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-20 07:59:13,273 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 578, componentId 14
2023-03-20 07:59:13,409 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 07:59:13,409 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 07:59:13,507 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:13,780 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,032 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,294 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,563 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,941 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:15,219 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:15,474 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:15,726 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 08:00:08,980 [INFO] - g.ErrorHandler - not found: Requested page /jatos/import/studyConfirmed couldn't be found.
2023-03-20 08:00:18,844 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 08:00:18,844 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 08:00:38,574 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-20 08:00:38,773 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-20 08:00:38,889 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-20 08:00:39,025 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-20 08:00:41,824 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 08:00:41,825 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577
2023-03-20 08:00:42,602 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 08:00:42,932 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 08:00:43,125 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 08:00:43,245 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 08:01:03,568 [INFO] - publix_access - POST /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/heartbeat
2023-03-20 08:01:03,568 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 579
2023-03-20 08:01:11,723 [WARN] - c.g.a.AuthenticationAction - Authentication failed: remote address 193.32.162.159 tried to access page /
2023-03-20 08:02:18,894 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 08:02:18,894 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 08:02:41,935 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 08:02:41,936 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577
2023-03-20 08:03:03,651 [INFO] - publix_access - POST /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/heartbeat
2023-03-20 08:03:03,652 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 579
2023-03-20 08:04:18,940 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 08:04:18,941 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 08:04:42,048 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 08:04:42,049 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577
2023-03-20 08:05:03,739 [INFO] - publix_access - POST /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/heartbeat
2023-03-20 08:05:03,740 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 579
2023-03-20 08:05:24,065 [INFO] - publix_access - POST /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/719651a6-5300-47c1-8b83-dfdae2c1933d/resultData
2023-03-20 08:05:24,066 [INFO] - c.p.PublixInterceptor - .submitOrAppendResultData: studyResultId 579, componentId 14
2023-03-20 08:05:24,101 [INFO] - publix_access - GET /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/end?successful=true&message=con-mqb-725
2023-03-20 08:05:24,101 [INFO] - c.p.PublixInterceptor - .finishStudy: studyResultId 579, successful true
2023-03-20 08:05:49,878 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/News2.png but it seems you have no access rights.
2023-03-20 08:05:50,303 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/News2.png but it seems you have no access rights.
2023-03-20 08:05:50,463 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/News2.png but it seems you have no access rights.
2023-03-20 08:05:50,598 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/News2.png but it seems you have no access rights.
2023-03-20 08:06:10,294 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/1441607667576727.gif but it seems you have no access rights.
2023-03-20 08:06:10,464 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/1441607667576727.gif but it seems you have no access rights.
2023-03-20 08:06:10,595 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/1441607667576727.gif but it seems you have no access rights.
2023-03-20 08:06:10,716 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/1441607667576727.gif but it seems you have no access rights.
2023-03-20 08:06:18,997 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 08:06:18,997 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 08:06:42,248 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 08:06:42,248 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577
2023-03-20 08:08:19,037 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 08:08:19,038 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 08:08:42,386 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 08:08:42,387 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577

from jatos.

kristian-lange avatar kristian-lange commented on June 11, 2024

I cannot find anything in the log that explains the error “This study run is invalid”.

There are no hints for a lack of memory or disk space (CPU is usually not a problem with JATOS). But this doesn't mean that memory or disk is not a problem.

But there are a couple of strange log messages:

2023-03-20 07:57:30,280 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/H.png but it seems you have no access rights.

Your study run cannot access an image with the path Study2-empathy/H.png. Maybe the path is wrong? Check the component with the UUID 719651a6-5300-47c1-8b83-dfdae2c1933d.

2023-03-20 07:58:29,031 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
...
2023-03-20 07:58:33,271 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
...
2023-03-20 07:59:09,938 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-html-button-response.js but it seems you have no access rights.
2023-03-20 07:59:09,974 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-preload.js but it seems you have no access rights.
2023-03-20 07:59:10,011 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-html-keyboard-response.js but it seems you have no access rights.
2023-03-20 07:59:10,048 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-cloze.js but it seems you have no access rights.
2023-03-20 07:59:10,085 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-survey.js but it seems you have no access rights.
2023-03-20 07:59:10,122 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-html-slider-response.js but it seems you have no access rights.

Same with these paths.

2023-03-20 07:59:13,507 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:13,780 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,032 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,294 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,563 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,941 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:15,219 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:15,474 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:15,726 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578

The batch channel for one study run got opened 10 times in short succession. Usually only once. Strange! Maybe reloads?

2023-03-20 08:00:08,980 [INFO] - g.ErrorHandler - not found: Requested page /jatos/import/studyConfirmed couldn't be found.

That is a strange error. The endpoint exists for a HTTP POST. Do you call this endpoint somehow manually with a different HTTP method? Why? Better use the JATOS API.

That's all I can say about the log. Have you got any monitoring of your server? And which version of JATOS do you run?

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024
2023-03-21 10:12:35,818 [INFO] - gui_access - GET /jatos/logs/application.log?reverse=true (admin)
2023-03-21 10:12:19,490 [INFO] - c.p.PublixInterceptor - .finishStudy: studyResultId 587, successful true
2023-03-21 10:12:19,490 [INFO] - publix_access - GET /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/end?successful=true&message=con-507-523
2023-03-21 10:12:18,444 [INFO] - c.p.PublixInterceptor - .submitOrAppendResultData: studyResultId 587, componentId 14
2023-03-21 10:12:18,443 [INFO] - publix_access - POST /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/719651a6-5300-47c1-8b83-dfdae2c1933d/resultData
2023-03-21 10:12:09,883 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 587
2023-03-21 10:12:09,883 [INFO] - publix_access - POST /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/heartbeat
2023-03-21 10:11:58,192 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:11:35,235 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:11:11,230 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:10:54,419 [INFO] - gui_access - GET /jatos/login (null)
2023-03-21 10:10:54,321 [WARN] - c.g.a.AuthenticationAction - Authentication failed: remote address 220.196.160.61 tried to access page /jatos/13/14/run
2023-03-21 10:10:48,277 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:10:25,314 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:10:22,823 [INFO] - gui_access - GET /jatos/login (null)
2023-03-21 10:10:22,701 [WARN] - c.g.a.AuthenticationAction - Authentication failed: remote address 220.196.160.151 tried to access page /jatos/13/studyLinks
2023-03-21 10:10:15,080 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:14,833 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:14,581 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:14,326 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:13,944 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:13,702 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:13,450 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:13,185 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:12,920 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:12,833 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 589
2023-03-21 10:10:12,832 [INFO] - publix_access - POST /publix/c683f26f-938f-466a-a0c3-46f7e3896c94/heartbeat
2023-03-21 10:10:12,693 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 589, componentId 14
2023-03-21 10:10:12,693 [INFO] - publix_access - GET /publix/c683f26f-938f-466a-a0c3-46f7e3896c94/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-21 10:10:09,616 [INFO] - c.p.PublixInterceptor - .startComponent: studyResultId 589, componentId 14
2023-03-21 10:10:09,615 [INFO] - publix_access - GET /publix/c683f26f-938f-466a-a0c3-46f7e3896c94/719651a6-5300-47c1-8b83-dfdae2c1933d/start
2023-03-21 10:10:09,486 [INFO] - c.p.w.GeneralMultiplePublix - .startStudy: studyCode G6AlWNVoorM, studyResultId589, studyId 13, batchId 38, workerId 579
2023-03-21 10:10:09,485 [INFO] - c.p.PublixInterceptor - .run: studyCode G6AlWNVoorM
2023-03-21 10:10:09,485 [INFO] - publix_access - GET /publix/G6AlWNVoorM
2023-03-21 10:10:09,195 [INFO] - g.ErrorHandler - not found: Requested page  /publix/jspsych/plugin-html-slider-response.js couldn't be found.
2023-03-21 10:10:09,161 [INFO] - g.ErrorHandler - not found: Requested page  /publix/jspsych/plugin-survey.js couldn't be found.
2023-03-21 10:10:09,126 [INFO] - g.ErrorHandler - not found: Requested page  /publix/jspsych/plugin-cloze.js couldn't be found.
2023-03-21 10:10:09,092 [INFO] - g.ErrorHandler - not found: Requested page  /publix/jspsych/plugin-html-keyboard-response.js couldn't be found.
2023-03-21 10:10:09,058 [INFO] - g.ErrorHandler - not found: Requested page  /publix/jspsych/plugin-preload.js couldn't be found.
2023-03-21 10:10:09,023 [INFO] - g.ErrorHandler - not found: Requested page  /publix/jspsych/plugin-html-button-response.js couldn't be found.
2023-03-21 10:10:08,989 [INFO] - g.ErrorHandler - not found: Requested page  /publix/jspsych/jspsych.js couldn't be found.
2023-03-21 10:10:08,921 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 587
2023-03-21 10:10:08,920 [INFO] - publix_access - POST /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/heartbeat
2023-03-21 10:10:08,871 [INFO] - c.p.PublixInterceptor - .startComponent: studyResultId 588, componentId 14
2023-03-21 10:10:08,870 [INFO] - publix_access - GET /publix/5d4ab8c2-4a1c-4994-bcbc-c474a79241a3/719651a6-5300-47c1-8b83-dfdae2c1933d/start
2023-03-21 10:10:08,747 [INFO] - c.p.w.GeneralMultiplePublix - .startStudy: studyCode G6AlWNVoorM, studyResultId588, studyId 13, batchId 38, workerId 578
2023-03-21 10:10:08,746 [INFO] - c.p.PublixInterceptor - .run: studyCode G6AlWNVoorM
2023-03-21 10:10:08,746 [INFO] - publix_access - GET /publix/G6AlWNVoorM
2023-03-21 10:10:01,331 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:09:37,320 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:09:20,871 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 587, componentId 14
2023-03-21 10:09:20,869 [INFO] - publix_access - GET /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-21 10:09:19,942 [INFO] - gui_access - GET /jatos/login (null)
2023-03-21 10:09:19,813 [WARN] - c.g.a.AuthenticationAction - Authentication failed: remote address 220.196.160.101 tried to access page /jatos/13/14/tableData
2023-03-21 10:09:14,343 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:09:10,662 [INFO] - gui_access - GET /jatos/logs/application.log?reverse=true (admin)
2023-03-21 10:08:55,601 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/external_page.html but it seems you have no access rights.
2023-03-21 10:08:52,414 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:08:51,091 [INFO] - g.ErrorHandler - PublixException during call /publix/646d97c7-e6be-4468-90d8-3204f1213f91/719651a6-5300-47c1-8b83-dfdae2c1933d/initData: Worker 1 is not allowed to do study 13.
2023-03-21 10:08:51,091 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 586, componentId 14
2023-03-21 10:08:51,090 [INFO] - publix_access - GET /publix/646d97c7-e6be-4468-90d8-3204f1213f91/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-21 10:08:29,353 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:08:16,364 [INFO] - gui_access - GET /jatos/logs/application.log?reverse=true (admin)
2023-03-21 10:08:08,565 [INFO] - gui_access - GET /jatos/sidebarStudyList (admin)
2023-03-21 10:08:07,954 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:08:07,950 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 587
2023-03-21 10:08:07,949 [INFO] - publix_access - POST /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/heartbeat
2023-03-21 10:08:07,922 [INFO] - gui_access - GET /jatos/releaseInfo? (admin)
2023-03-21 10:08:07,910 [INFO] - gui_access - GET /jatos/status (admin)
2023-03-21 10:08:06,972 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 587, componentId 14
2023-03-21 10:08:06,972 [INFO] - publix_access - GET /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-21 10:08:06,326 [INFO] - gui_access - GET /jatos/admin (admin)
2023-03-21 10:07:52,271 [INFO] - c.p.PublixInterceptor - .startComponent: studyResultId 587, componentId 14
2023-03-21 10:07:52,270 [INFO] - publix_access - GET /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/719651a6-5300-47c1-8b83-dfdae2c1933d/start
2023-03-21 10:07:51,272 [INFO] - c.p.w.GeneralMultiplePublix - .startStudy: studyCode G6AlWNVoorM, studyResultId587, studyId 13, batchId 38, workerId 577
2023-03-21 10:07:51,270 [INFO] - c.p.PublixInterceptor - .run: studyCode G6AlWNVoorM
2023-03-21 10:07:51,270 [INFO] - publix_access - GET /publix/G6AlWNVoorM
2023-03-21 10:07:38,435 [INFO] - gui_access - GET /jatos/13/batch/38/generalMultipleRun (admin)
2023-03-21 10:07:34,968 [INFO] - gui_access - GET /jatos/13/batch/38/studyLinksSetupData (admin)
2023-03-21 10:07:32,436 [INFO] - gui_access - GET /jatos/sidebarStudyList (admin)
2023-03-21 10:07:32,435 [INFO] - gui_access - GET /jatos/13/batch/38/studyLinksSetupData (admin)
2023-03-21 10:07:31,472 [INFO] - gui_access - GET /jatos/13/batches?_=1679393248964 (admin)
2023-03-21 10:07:28,664 [INFO] - gui_access - GET /jatos/13/studyLinks (admin)
2023-03-21 10:07:26,515 [INFO] - gui_access - GET /jatos/13/componentsTableData?_=1679393245122 (admin)
2023-03-21 10:07:22,960 [INFO] - gui_access - GET /jatos/13/14/tableData?_=1679393241184 (admin)
2023-03-21 10:07:22,887 [INFO] - gui_access - GET /jatos/sidebarStudyList (admin)
2023-03-21 10:07:20,824 [INFO] - gui_access - GET /jatos/13/14/results (admin)
2023-03-21 10:07:10,308 [INFO] - gui_access - GET /jatos/13/componentsTableData?_=1679393229199 (admin)

I just ran a complete study during this time and some of the problems disappeared and some remained. The problem of opening the batch channel multiple times in a short period of time should always be present. It is not clear what is causing these problems. However, there is nothing unusual about the experimental run page or the administrator interface, except for two extra data records (albeit records without data files).

I built this JATOS server four months ago following a tutorial I found on the web, and have not opened the server backend since then. Everything is done on the web page. I don't know if these problems stem from the server side build process. Maybe I should take the time to rebuild the server? I don't know much about this aspect of server building.

Thanks for going out of your way to answer this. The exceptions are indeed not related to the "invalid" exception. My JATOS version is 3.7.4. system information is attached below.

This is probably a very tricky problem. If you find any solution to this problem, thank you for suggesting it. I will check the log file in time the next time the "invalid" is displayed.

JATOS configuration
Version: 3.7.4
URL host: http://soc......
URL basepath: /
URL host + basepath: http://soc......
Local basepath: /opt/docker
Study assets root path: /opt/docker/study_assets_root
Result data max size: 5.0 MB
Result uploads allowed: true
Result uploads path: /opt/docker/result_uploads
Result uploads max file size: 30.0 MB
Result uploads limit per study run: 50.0 MB
Study logs allowed: true
Study logs path: /opt/docker/study_logs
Uses in-memory DB: false
User session validation: false
User session timeout: 1440
User session inactivity: 60
DB URL: jdbc:h2:./database/jatos;MODE=MYSQL;DATABASE_TO_UPPER=FALSE;IGNORECASE=TRUE;DEFAULT_LOCK_TIMEOUT=10000;SELECT_FOR_UPDATE_MVCC=FALSE
DB driver: org.h2.Driver
JPA unit: mysqlPersistenceUnit
Google OAuth allowed: false
LDAP URL: 
LDAP base DN: []
LDAP admin DN: 
LDAP timeout: 5000
Max results DB query size: 10

OS info
OS name: Linux
OS version: 5.4.0-77-generic
System load average: 0.01
Available processors: 2

JVM info
Uptime: 2570h 49m 24.53s
Name: 14@cf5fac895732
PID: 14
Java name: OpenJDK 64-Bit Server VM
Java version: 11.0.15
Thread count: 33
Peak thread count: 55
Total memory: 230.7 MB
Free memory: 71.9 MB
Used memory: 158.8 MB
Max memory: 1.0 GB
Heap memory used: 150 MB
Non-heap memory used: 197 MB

from jatos.

kristian-lange avatar kristian-lange commented on June 11, 2024

Good to know, your server did not crash recently (Uptime: 2570h 49m 24.53s) :)

Max memory: 1.0 GB - 1 GB just for JATOS should be enough for running just one experiment

You could consider updating your JATOS to 3.8.1. I don't think this will fix your issue but there are some performance improvements in the recent releases that might help especially since you have only 1GB memory on your server.

And what's about those file access issues? Did you check the paths in your study? E.g.

2023-03-20 07:57:30,280 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/H.png but it seems you have no access rights.

But my main concern are these multiple c.p.GeneralMultipleBatchChannel - .open. There should only be one. And I do not really have an idea what's going on here.

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

Fortunately, these issues will not affect my experimental operation.

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024
2023-03-22 08:08:49,387 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 623
2023-03-22 08:08:49,387 [INFO] - publix_access - POST /publix/d9fdcfb9-a3e1-4cb1-acb9-2a38c51eccfe/heartbeat
2023-03-22 08:08:03,267 [INFO] - c.p.PublixInterceptor - .finishStudy: studyResultId 616, successful true
2023-03-22 08:08:03,267 [INFO] - publix_access - GET /publix/044c9a87-0c86-44b2-bd2c-8250aeabf38a/end?successful=true&message=con-89p-266
2023-03-22 08:08:03,165 [INFO] - c.p.PublixInterceptor - .submitOrAppendResultData: studyResultId 616, componentId 14
2023-03-22 08:08:03,164 [INFO] - publix_access - POST /publix/044c9a87-0c86-44b2-bd2c-8250aeabf38a/719651a6-5300-47c1-8b83-dfdae2c1933d/resultData
2023-03-22 08:07:39,161 [INFO] - c.p.PublixInterceptor - .finishStudy: studyResultId 619, successful true
2023-03-22 08:07:39,160 [INFO] - publix_access - GET /publix/046bc236-262d-4e20-9e91-c9fc364d8238/end?successful=true&message=con-0vy-911
2023-03-22 08:07:39,073 [INFO] - c.p.PublixInterceptor - .submitOrAppendResultData: studyResultId 619, componentId 14
2023-03-22 08:07:39,072 [INFO] - publix_access - POST /publix/046bc236-262d-4e20-9e91-c9fc364d8238/719651a6-5300-47c1-8b83-dfdae2c1933d/resultData
2023-03-22 08:07:28,082 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 619
2023-03-22 08:07:28,082 [INFO] - publix_access - POST /publix/046bc236-262d-4e20-9e91-c9fc364d8238/heartbeat
2023-03-22 08:07:02,343 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/N.png but it seems you have no access rights.
2023-03-22 08:07:02,180 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/N.png but it seems you have no access rights.
2023-03-22 08:07:02,004 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/N.png but it seems you have no access rights.
2023-03-22 08:07:01,744 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/N.png but it seems you have no access rights.
2023-03-22 08:06:56,593 [INFO] - gui_access - GET /jatos/13/batch/38/tableData?workerType=GeneralMultiple&_=1679472415325 (admin)
2023-03-22 08:06:56,546 [INFO] - gui_access - GET /jatos/sidebarStudyList (admin)
2023-03-22 08:06:54,921 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 618
2023-03-22 08:06:54,920 [INFO] - publix_access - POST /publix/e39039d6-3bc6-43a3-82ed-3ee54f3e5277/heartbeat
2023-03-22 08:06:54,417 [INFO] - gui_access - GET /jatos/13/batch/38/results?workerType=GeneralMultiple (admin)
2023-03-22 08:06:51,090 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 617
2023-03-22 08:06:51,090 [INFO] - publix_access - POST /publix/01f92197-6eaa-4e42-b19a-9bf25a5a29b1/heartbeat
2023-03-22 08:06:49,337 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 623
2023-03-22 08:06:49,337 [INFO] - publix_access - POST /publix/d9fdcfb9-a3e1-4cb1-acb9-2a38c51eccfe/heartbeat
2023-03-22 08:06:28,550 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-22 08:06:28,436 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-22 08:06:28,313 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-22 08:06:28,132 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-22 08:06:10,174 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 616
2023-03-22 08:06:10,174 [INFO] - publix_access - POST /publix/044c9a87-0c86-44b2-bd2c-8250aeabf38a/heartbeat
2023-03-22 08:06:05,868 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-22 08:06:05,267 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-22 08:06:04,519 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-22 08:06:04,344 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-22 08:05:27,930 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 619

Just now this issue happened again——a participant's screen displayed "invalid". I checked the logs during this period and didn't see any strange exceptions. I have already checked the path issue, it doesn't occur in my local running, but it happens after importing the experimental file to the server. Tonight I will try to update the JATOS server to the latest version. Ideally, it would be best to rebuild the server directly.

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

My god! When I updated to the latest version, the structure of the data I collected changed dramatically, which meant that I had to refactor my data analysis code. Is this a normal change after the update? Or did I make a mistake somewhere.

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

The line break seems to have disappeared.

from jatos.

kristian-lange avatar kristian-lange commented on June 11, 2024

Sorry for the late reply. Can you please elaborate on how the structure of your data changed? What was it before and how does it look now. You say the line breaks disappeared?

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

Never mind, I have already solved this problem.

Yes, the line breaks did disappear. I wrote a program using JSPsych, and after updating JATOS to the latest version, the line breaks in the data were removed, resulting in all the CSV data being in a single row (there should have been multiple rows, with one row of data for each component). The same thing did not happen in version 3.7.4, so I have now reverted back to that version.

I wrote a Python program to deal with the line break issue, but the process was a bit convoluted, especially since my HTML page contained a lot of nested quotes.

I didn't do any further testing, so I don't know if this problem is caused by issues with the latest version or compatibility issues between two versions. Perhaps it only occurs in my study.

from jatos.

kristian-lange avatar kristian-lange commented on June 11, 2024

Never mind, I have already solved this problem.

Would you care to share how you solve it? Maybe someone else has the same problem and can use your expertise.

Yes, the line breaks did disappear. I wrote a program using JSPsych, and after updating JATOS to the latest version, the line breaks in the data were removed, resulting in all the CSV data being in a single row (there should have been multiple rows, with one row of data for each component).

I see. I just tried and can confirm. This should not happen. Result data should be allowed to have line-breaks. I created a new bug issue (#285) for this.

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

I was sick the other day, so a lot of work has been put on hold, and I apologize for not responding to your message until now.

If there were no nested quotes in the html, then this problem would be easily solved by simply inserting line breaks after a specific number of quotes (usually two times the maximum number of columns). However, in Jspsych's data the entire content of the html is usually recorded, for example <p style="....."> this type of tag information, which creates nested quotes.

The pairing status of each quotation mark is first checked one by one. If a character is a paired quotation mark and its next character is not a comma but an unpaired quotation mark, a line-break is inserted between the two. This usually results in broken data. Thanks to Jspsych's data format, which starts with multiple consecutive nulls from the third line, the second step is to merge all lines that do not start with consecutive nulls with the previous line. But I'm not sure that this method works in all cases. Please be sure to perform a data backup before this operation.

import os

folder_path = './'  
#Step one
for filename in os.listdir(folder_path):
    if filename.endswith('.txt'):
        file_path = os.path.join(folder_path, filename)
        with open(file_path, 'r', encoding='utf-8') as f:
            content = f.read()
        modified_content = ''
        open_quote = True  
        for i, c in enumerate(content):
            modified_content += c
            if c == '"':
                open_quote = not open_quote 
                if i < len(content) - 1 and content[i+1] != ','and open_quote:

                    modified_content += '\n'

        with open(file_path, 'w', encoding='utf-8-sig') as f:
            f.write(modified_content)
            


#Step two
for filename in os.listdir(folder_path):
    if filename.endswith(".txt"):  
        file_path = os.path.join(folder_path, filename)
        with open(file_path, "r", encoding="utf-8") as f:
            lines = f.readlines()

        merged_lines = [lines[0].rstrip()]  
        for i in range(1, len(lines)):
            line = lines[i].rstrip()
            if i > 2 and not line.startswith('"","",""'):
                merged_lines[-1] += line
            else:
                merged_lines.append(line)

        with open(os.path.splitext(file_path)[0] + ".txt", "w", encoding="utf-8-sig", newline='') as f:
            for line in merged_lines:
                f.write(line + "\n")

from jatos.

kristian-lange avatar kristian-lange commented on June 11, 2024

Thank you for sharing! Maybe it can help others :)
And the next release v3.8.2 with the bug fix will come out soon.

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

I am glad to hear this. Is there an expected release time for the new version?

from jatos.

kristian-lange avatar kristian-lange commented on June 11, 2024

There is no release date, but I guess within the next 2 weeks.

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

The line break seems to have disappeared.

This issue seems to be happening with 3.7.6 as well. The data view of the JATOS page seems to be fine, but once exported, the line breaks still disappear.

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

Hope the new version will be released soon.

from jatos.

kristian-lange avatar kristian-lange commented on June 11, 2024

I'm sorry for the delay. There are some issues related to running JATOS in a cluster with multiple nodes that have to solved before we can release the new version. But hopefully, fingers crossed, next weekend it's going to happen.

from jatos.

kirstenstark avatar kirstenstark commented on June 11, 2024

Hi Kristian,
thank you so much for sharing JATOS with us. We are having a similar problem. Our institute's server was updated about six weeks ago, and since then about 25 % of our participants have been receiving the message "The experiment failed to load." at a seemingly random moment during the experiment. Curisously, we have been collecting data for this experiment since January (about 65-70 datasets collected) and have not changed anything about this experiment since then. So far, we have never had this problem.
Unfortunately, I can't reproduce the problem myself, but a student sent me a screenshot their console output. Unfortunately I can't make sense of it and don't really know where in my could I should try to fix it. All images are available and are loaded properly for other participants. The problem occurred on different OS and in different browsers (including Chrome and Firefox).

Regarding the issue "Internal JATOS error during /publix/[jatos study code]. Check logs to get more information." others have reported in the cogsci forum: We had a similar problem about two weeks ago (a month after the update), when we out of a sudden got the same error message every time any Jatos link was opened in a browser where a Jatos link had been opened at some point before. This problem can be fixed by clearing the browser cache (even though this means all participants need to be instructed to empty their browser cache first).

IMG_6379
IMG_6378

from jatos.

kristian-lange avatar kristian-lange commented on June 11, 2024

Hi!

It would have been better to post this kind of question in the CogSci forum since it's more a support kind of question. And secondly it would have been better to post the question in a new thread or issue; just to keep things separated and clean. Sorry for nagging so much ;). But, now, since we are already here ... you have two issues as far as I can see: 1) the connection problems, and 2) the Internal JATOS error due malformed cookies.

About 1) The two screenshots show that your participant was not able to reach the JATOS server (lots of connection timeouts, batch channel heartbeat fail, websocket connection fail). So something was broken, either the JATOS server or something between the server and your participant (router, network etc.). Here I can't help much since I do not operate this particular JATOS server nor the other parts of this infrastructure. I'd recommend to contact your admin.

About 2) JATOS has a problem dealing with old cookies from older JATOS versions after an update with certain browsers. This is a one-time thing and after one deletes those cookies JATOS works normally. But it is a bug and the next version (v3.8.2) will have a fix for it.

Best,
Kristian

from jatos.

kirstenstark avatar kirstenstark commented on June 11, 2024

Hi!
Thank you for your reply! And sorry for posting in the wrong place, I wasn't sure which forum to use. I'll switch to the CogSci forum :)
Should I just delete my post here?

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

I'm sorry for the delay. There are some issues related to running JATOS in a cluster with multiple nodes that have to solved before we can release the new version. But hopefully, fingers crossed, next weekend it's going to happen.

It doesn't seem to be possible to update directly in the existing server yet, do I need to reinstall the server or will this feature take a few days to implement? My current version is 3.7.6.

from jatos.

kristian-lange avatar kristian-lange commented on June 11, 2024

It should be possible to update from 3.7.6 to 3.8.2. Why do you think it is not?

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

image
Still showing as a 3.8.1 update.

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

QQ图片20230508152001
Oh, no more questions. Probably an internet connection issue, even the 3.8.1 update doesn't work. I will take some time to rebuild the server. After all, this is the only viable way to get the newest version for me.

Thank you again.

from jatos.

kristian-lange avatar kristian-lange commented on June 11, 2024

Yes, looks like some connection issue.

And a hint: you can force an update to a certain version by using the 'version' query parameter. Sometimes JATOS doesn't acknowledge the newest version. E.g. for cortex.jatos.org it would be:

https://cortex.jatos.org/jatos/admin?version=v3.8.2

from jatos.

St-ZFeng avatar St-ZFeng commented on June 11, 2024

OK, I'll try it if the internet connection improves.

from jatos.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.