URI is malformed cannot open the document about build_tools

[ShockwaveNN]

I have a working version of own compiled OnlyOffice/DocumentServer

Which version (branch) did you use for this compilation.

Could you try to run release docker version of DocumentServer on same setup, so we can be sure those problems not in integration with Nextcloud, but with compiled DocumentServer?

[warnerbryce]

The docker onlyoffice/documentserver works

The version i used has been made with build tools 🛠 on the 21th of January (i don’t know how to verify the version after compiling)

I just built, with the docker tool, OnlyOffice DocumentServer v5.5.2 r2 without modifying sources files and i will test it today.

[ShockwaveNN]

@warnerbryce I advice you to build from master using build_tools (and got v5.5.1 is result), since v5.5.2 could be not production ready, it's not tested yet

on the 21th of January (i don’t know how to verify the version after compiling)

Yea, seems this is some kind middle of development build, on january we were not ready to make stable release

[warnerbryce]

I advice you to build from master using build_tools

Nice, but how can i make it ? When i modify configure.py with update set on 0, i still get the last update everytime i run ./automate.py
Do i have to put argument on ./automate.py like this :
python3 automate.py server --update 0 --branch v.5.5.1 ?

Thank you

[ShockwaveNN]

Do i have to put argument on ./automate.py like this :
python3 automate.py server --update 0 --branch v.5.5.1 ?

Currently this is not working. See #78 (comment)

When i modify configure.py with update set on 0, i still get the last update everytime i run ./automate.py

Yeah, you got latest master version, which should be correct. I'm not sure that I understand your question, but I think best way is to do - checkout master branch of build_tools, clean working dir of leftovers and run cd tools/linux && python3 ./automate.py

If you got any troubles with build from master - I think it's better to create issue at build_tools

[warnerbryce]

Currently this is not working. See ONLYOFFICE/build_tools#78 (comment)

Alright, that why i've made, i downloaded Build Tools with this command :
git clone https://github.com/ONLYOFFICE/build_tools.git

Normally it downloads the master build ? but then the --tag when creating the docker build isn't necessary ?
How do i build the v.5.5.1.76 ?

mkdir out/
docker build --branch v.5.5.1.76 . 
docker run -v etc.....           ?

Thank you

[ShockwaveNN]

Currently building from tag is not working, but master=5.5.1.76 so you should build from master

[warnerbryce]

So for a good start,
I did this :
a clean directory, empty,
git clone -b v5.5.1.76 https://github.com/ONLYOFFICE/build_tools
cd build_tools
mkdir out

What's next ?
docker build .
then docker run ?
How do i mod the compilation process to tell you take the 5.5.1 version of OnlyOffice ?

EDIT : @ShockwaveNN i found that : #74 (comment)
I am building again, i will update this issue after that

[ShockwaveNN]

git clone -b v5.5.1.76 https://github.com/ONLYOFFICE/build_tools

No, from master, do not change branch

[ShockwaveNN]

I've moved this issue to build_tools repo

[warnerbryce]

Update :
I've compiled again a working 5.5.1 OnlyOffice document server but :
I canot get http://IPv4ofServer:8000/welcome working ... i get CANNOT GET /welcome
Only healthcheck return true and index.html return : Server is functioning normally. Version: 5.5.1. Build: 0
I have no error nor debug logs on docservice while doing this manipulation...
I put redis on port mode with port 6379 and localhost
When i try to connect via Nextcloud admin OnlyOffice panel from a server outside of the OnlyOffice server i get this :

2020/04/22 11:50:04 [notice] 8712#8712: *499 "^\/OfficeWeb(\/apps\/.*)$" does not match "/healthcheck", client: EXTERNAL_IP, server: office.domain.fr, request: "GET /healthcheck HTTP/1.1", host: "office.domain.fr"
2020/04/22 11:50:04 [info] 8712#8712: *499 client EXTERNAL_IP closed keepalive connection
2020/04/22 11:50:04 [notice] 8712#8712: *501 "^\/OfficeWeb(\/apps\/.*)$" does not match "/coauthoring/CommandService.ashx", client: EXTERNAL_IP, server: office.domain.fr, request: "POST /coauthoring/CommandService.ashx HTTP/1.1", host: "office.domain.fr"
2020/04/22 11:50:04 [info] 8712#8712: *501 client EXTERNAL_IP closed keepalive connection
2020/04/22 11:50:04 [notice] 8712#8712: *503 "^\/OfficeWeb(\/apps\/.*)$" does not match "/ConvertService.ashx", client: EXTERNAL_IP, server: office.domain.fr, request: "POST /ConvertService.ashx HTTP/1.1", host: "office.domain.fr"
2020/04/22 11:50:05 [info] 8712#8712: *503 client EXTERNAL_IP closed keepalive connection

Does the Nginx conf file isn't faulty or need a tweaking ?

---

When i set only this parameter in Nextcloud Admin Panel : Address of OnlyOffice server : https://office.domain.fr/
i get this log from DocService :

2020-04-22T12:04:33.252] [DEBUG] nodeJS - healthCheck end
[2020-04-22T12:04:33.269] [DEBUG] nodeJS - Start commandFromServer: docId = undefined c = version
[2020-04-22T12:04:33.269] [DEBUG] nodeJS - End commandFromServer: docId = undefined {"error":0,"version":"5.5.1.0"}
[2020-04-22T12:04:33.292] [DEBUG] nodeJS - Start convert request docId = conv_check_1085272186_docx
[2020-04-22T12:04:33.305] [DEBUG] nodeJS - Start Task(id=conv_check_1085272186_docx)
[2020-04-22T12:04:33.359] [DEBUG] nodeJS - downloadFile complete filesize=6994 (id=conv_check_1085272186_docx)
[2020-04-22T12:04:33.392] [DEBUG] nodeJS - stdout (id=conv_check_1085272186_docx):
[2020-04-22T12:04:33.392] [DEBUG] nodeJS - stderr (id=conv_check_1085272186_docx):
[2020-04-22T12:04:33.392] [DEBUG] nodeJS - ExitCode (code=0;signal=null;error:0;id=conv_check_1085272186_docx)
[2020-04-22T12:04:33.398] [DEBUG] nodeJS - Start receiveTask: docId = conv_check_1085272186_docx {"cmd":{"withAuthorization":true,"c":"conv","id":"conv_check_1085272186_docx","format":"docx","url":"https://cloud.domain.fr/apps/onlyoffice/empty?doc=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJhY3Rpb24iOiJlbXB0eSJ9.mWcMqi9XkjAlLE79IFDkkEduE8S8gaJ6wgLaeafZxOM","title":"check_1085272186.docx","outputformat":65,"outputpath":"output.docx","codepage":46,"delimiter":4,"embeddedfonts":false,"status_info":0,"nobase64":true}}
[2020-04-22T12:04:33.394] [DEBUG] nodeJS - processUploadToStorage complete(id=conv_check_1085272186_docx)
[2020-04-22T12:04:33.394] [DEBUG] nodeJS - output (data={"cmd":{"withAuthorization":true,"c":"conv","id":"conv_check_1085272186_docx","format":"docx","url":"https://cloud.domain.fr/apps/onlyoffice/empty?doc=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJhY3Rpb24iOiJlbXB0eSJ9.mWcMqi9XkjAlLE79IFDkkEduE8S8gaJ6wgLaeafZxOM","title":"check_1085272186.docx","outputformat":65,"outputpath":"output.docx","codepage":46,"delimiter":4,"embeddedfonts":false,"status_info":0,"nobase64":true}};id=conv_check_1085272186_docx)
[2020-04-22T12:04:33.394] [DEBUG] nodeJS - postProcess (id=conv_check_1085272186_docx)
[2020-04-22T12:04:33.395] [DEBUG] nodeJS - deleteFolderRecursive (id=conv_check_1085272186_docx)
[2020-04-22T12:04:33.413] [DEBUG] nodeJS - End receiveTask: docId = conv_check_1085272186_docx
[2020-04-22T12:04:34.309] [DEBUG] nodeJS - End convert request end true url https://office.domain.fr, office.domain.fr/cache/files/conv_check_1085272186_docx/output.docx/check_1085272186.docx?md5=08EmZL_vq7Tb8HUybjJnZQ&expires=1587550775&disposition=attachment&filename=check_1085272186.docx status 0 docId = conv_check_1085272186_docx

The URL is wrong, "https://office.domain.fr, office.domain.fr/" it's crazy, when i took the last line and remove the wrong ", office.domain.fr" in the url, i get the document.

[ShockwaveNN]

I canot get http://IPv4ofServer:8000/welcome working ... i get CANNOT GET /welcome
Only healthcheck return true and index.html return : Server is functioning normally

Yes, this is correct behavior, since welcome page is not included in this build

Other issues I need to check, I never tryed to connect compiled version to nextcloud, only to our own nodejs integration example

[warnerbryce]

@ShockwaveNN this problem is present in my old version from 21th of January.
I don't know if it is related with the Nginx reverse proxy file or another file that breaks the return URL.
I can't see where this bad URL is formatted so i can't diagnose more.
I cross finger that will be an easy fix because i put so much hope on it.

[ShockwaveNN]

If this error not new and you have pretty complicated setup - I think you should try same config with deb version of DocumentServer (or Docker) and see if this problem actual for all version of DocumentServer or just compiled from source

[warnerbryce]

@ShockwaveNN this isn’t new but only for the DocumentServer Compiled version.
The Docker version always work, the old as the newer one. But the docker version don’t have the same nginx proxy file.
I tried this file on the DS compiled but same error.

[ShockwaveNN]

But the docker version don’t have the same nginx proxy file.

To be clear - you mean config file from https://github.com/ONLYOFFICE/build_tools#installing-and-configuring-nginx this step?

[warnerbryce]

@ShockwaveNN yes it’s the file i use with the compiled version. I just add the « server_name office.domain.fr; » line and then lunch certbot for ssl connection

[ShockwaveNN]

@warnerbryce could you try to temporary disable ssl and check that error is same?

[warnerbryce]

@ShockwaveNN I can't
mixed content is forbidden.
Nextcloud don't want to connect to http OnlyOffice server nor ownsigned SSL certs.

The SSL works fine because i can access to the same pages with https://office.domain.fr/ and http://192.168.XXX.XXX//. And if i attack from outside my LAN https://office.domain.fr/ behaves the same.

[ShockwaveNN]

mixed content is forbidden.

yeah, I hope you temproarly disable ssl on nextcloud side also

But ok

We'll try to connect with our instance of nextcloud as soon as compilation is finished, but without SSL and see if got any errors

[warnerbryce]

@ShockwaveNN It behaves the same with FULL HTTP.
The URL is wrongly created with a duplicate http://office.domain.fr, office.domain.fr/......

[ShockwaveNN]

@warnerbryce Same error if use ip address instead of domain with Full HTTP?

[warnerbryce]

@warnerbryce Same error if use ip address instead of domain with Full HTTP?

Yeah it gave http://XXX.XXX.XXX.XXX, XXX.XXX.XXX.XXX/.....

[ShockwaveNN]

So, I just connected my compiled instance to nextcloud without ssl on both parts and my similar logs seems like this:

[2020-04-22T14:13:52.140] [DEBUG] nodeJS - Start commandFromServer: docId = undefined c = version
[2020-04-22T14:13:52.140] [DEBUG] nodeJS - End commandFromServer: docId = undefined {"error":0,"version":"5.5.1.0"}
[2020-04-22T14:13:52.171] [DEBUG] nodeJS - Start convert request docId = conv_check_1132276900_docx
[2020-04-22T14:13:52.179] [DEBUG] nodeJS - Start Task(id=conv_check_1132276900_docx)
[2020-04-22T14:13:52.426] [DEBUG] nodeJS - downloadFile complete filesize=6994 (id=conv_check_1132276900_docx)
[2020-04-22T14:13:52.471] [DEBUG] nodeJS - stdout (id=conv_check_1132276900_docx):
[2020-04-22T14:13:52.471] [DEBUG] nodeJS - stderr (id=conv_check_1132276900_docx):
[2020-04-22T14:13:52.471] [DEBUG] nodeJS - ExitCode (code=0;signal=null;error:0;id=conv_check_1132276900_docx)
[2020-04-22T14:13:52.475] [DEBUG] nodeJS - processUploadToStorage complete(id=conv_check_1132276900_docx)
[2020-04-22T14:13:52.475] [DEBUG] nodeJS - output (data={"cmd":{"withAuthorization":true,"c":"conv","id":"conv_check_1132276900_docx","format":"docx","url":"http://nct-enterprise.tk/cloud/apps/onlyoffice/empty?doc=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJhY3Rpb24iOiJlbXB0eSJ9.yOmL859Xo-1kC7rK-So2dS94B4dtF_eWslsbUlQhFuA","title":"check_1132276900.docx","outputformat":65,"outputpath":"output.docx","codepage":46,"delimiter":4,"embeddedfonts":false,"status_info":0,"nobase64":true}};id=conv_check_1132276900_docx)
[2020-04-22T14:13:52.476] [DEBUG] nodeJS - postProcess (id=conv_check_1132276900_docx)
[2020-04-22T14:13:52.477] [DEBUG] nodeJS - deleteFolderRecursive (id=conv_check_1132276900_docx)
[2020-04-22T14:13:52.481] [DEBUG] nodeJS - Start receiveTask: docId = conv_check_1132276900_docx {"cmd":{"withAuthorization":true,"c":"conv","id":"conv_check_1132276900_docx","format":"docx","url":"http://nct-enterprise.tk/cloud/apps/onlyoffice/empty?doc=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJhY3Rpb24iOiJlbXB0eSJ9.yOmL859Xo-1kC7rK-So2dS94B4dtF_eWslsbUlQhFuA","title":"check_1132276900.docx","outputformat":65,"outputpath":"output.docx","codepage":46,"delimiter":4,"embeddedfonts":false,"status_info":0,"nobase64":true}}
[2020-04-22T14:13:52.484] [DEBUG] nodeJS - End receiveTask: docId = conv_check_1132276900_docx
[2020-04-22T14:13:53.185] [DEBUG] nodeJS - End convert request end true url http://ip.ip.ip.ip/cache/files/conv_check_1132276900_docx/output.docx/check_1132276900.docx?md5=04kJ1YaR_ILVXOWEq_reyQ&expires=1587565734&disposition=attachment&filename=check_1132276900.docx status 0 docId = conv_check_1132276900_docx

Last line looks correct

So, can you show your nginx current config file?

[warnerbryce]

Here is my onlyoffice.conf file :

map $http_host $this_host {
  "" $host;
  default $http_host;
}
map $http_x_forwarded_proto $the_scheme {
  default $http_x_forwarded_proto;
  "" $scheme;
}
map $http_x_forwarded_host $the_host {
  default $http_x_forwarded_host;
  "" $this_host;
}
map $http_upgrade $proxy_connection {
  default upgrade;
  "" close;
}
proxy_set_header Host $http_host;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection $proxy_connection;
proxy_set_header X-Forwarded-Host $the_host;
proxy_set_header X-Forwarded-Proto $the_scheme;
server {
  error_log /var/log/nginx/only.error.log debug;
  server_tokens off;
  server_name office.domain.fr;
  rewrite ^\/OfficeWeb(\/apps\/.*)$ /web-apps$1 redirect;
  location / {
    proxy_pass http://localhost:8000;
    proxy_http_version 1.1;
  }
  location /spellchecker/ {
    proxy_pass http://localhost:8080/;
    proxy_http_version 1.1;
  }

    listen [::]:443 ssl; # managed by Certbot
    listen 443 ssl; # managed by Certbot
    ssl_certificate /etc/letsencrypt/live/office.domain.fr/fullchain.pem; # managed by Certbot
    ssl_certificate_key /etc/letsencrypt/live/office.domain.fr/privkey.pem; # managed by Certbot
    include /etc/letsencrypt/options-ssl-nginx.conf; # managed by Certbot
    ssl_dhparam /etc/letsencrypt/ssl-dhparams.pem; # managed by Certbot

}

server {
    if ($host = office.domain.fr) {
        return 301 https://$host$request_uri;
    } # managed by Certbot


}

I am using Nextcloud 18.0.3 and i tested on a 17.0.5 too

[ShockwaveNN]

I see there is only difference with ssl settings

Could you try to use exact same as I use from https://github.com/ONLYOFFICE/build_tools#installing-and-configuring-nginx?

In meantime we've update our nextcloud instance to v18 (currently we test in with 17) and see if got any similar errors

[warnerbryce]

Could you try to use exact same as I use from https://github.com/ONLYOFFICE/build_tools#installing-and-configuring-nginx?

That what i use when i test in full HTTP mode, this is exactly the same, just with one line for server_name

[ShockwaveNN]

@warnerbryce Ok, while we are in process of upgrade of our nextcloud instance - could you contact me via [email protected]

We'll try to connect you nextcloud with mine compiled DocumentServer

[ShockwaveNN]

Ok, seems this resolved problem (in email), runining compiled version in container
https://github.com/onlyoffice-testing-robot/documentserver-from-source-build/tree/feature/use-build-tools

But I still don't understand what is the problem.

Last question - that host system did you use to run not-containered DocumentServer?

[warnerbryce]

This host never fully had a working compiled version of OnlyOffice.
I always used the docker pull command with onlyoffice/DocumentServer
I started to compile the code just some days ago.

I think there is :
A- something to do with the nginx template that didn’t match
B- something when loading the commands that is lacking, and that the docked script solved.

[ShockwaveNN]

This host never fully had a working compiled version of OnlyOffice.

Yeah, but which host? maybe I will be able to repdocue, my hosts was Ubuntu 14.04 for compilation (Since it's only compile on 14.04) and Ubuntu 18.04 for running comiple version.

[warnerbryce]

I had a ubuntu 14.04.6 that never finished the process but it was the automate.py server bug.

I use the docker 14.04.4 for compiling and it works.
For fire up processes it is a ubuntu 18.04

[ShockwaveNN]

@warnerbryce Ok, in such case I'm out of ideas. But glad to hear that it's working for you now