Cannot download dataset about ubuntu-ranking-dataset-creator

[prasanna-bigreco]

facing same issue. is it again related to mcgill servers?

[raopku]

@jasonleeinf have you solved the problem? i come across the same error

[danimateos]

Same here: the dataset has the wrong permissions:

./generate.sh
Downloading http://cs.mcgill.ca/~jpineau/datasets/ubuntu-corpus-1.0/ubuntu_dialogs.tgz to ./ubuntu_dialogs.tgz
Successfully downloaded ./ubuntu_dialogs.tgz
Unpacking dialogs ...
Traceback (most recent call last):
  File "create_ubuntu_dataset.py", line 404, in <module>
    prepare_data_maybe_download(args.data_root)
  File "create_ubuntu_dataset.py", line 266, in prepare_data_maybe_download
    with tarfile.open(archive_path) as tar:
  File "/home/dani/anaconda3/envs/ubuntudialogue/lib/python2.7/tarfile.py", line 1680, in open
    raise ReadError("file could not be opened successfully")
tarfile.ReadError: file could not be opened successfully
Unpacking dialogs ...
Traceback (most recent call last):
  File "create_ubuntu_dataset.py", line 404, in <module>
    prepare_data_maybe_download(args.data_root)
  File "create_ubuntu_dataset.py", line 266, in prepare_data_maybe_download
    with tarfile.open(archive_path) as tar:
  File "/home/dani/anaconda3/envs/ubuntudialogue/lib/python2.7/tarfile.py", line 1680, in open
    raise ReadError("file could not be opened successfully")
tarfile.ReadError: file could not be opened successfully
Unpacking dialogs ...
Traceback (most recent call last):
  File "create_ubuntu_dataset.py", line 404, in <module>
    prepare_data_maybe_download(args.data_root)
  File "create_ubuntu_dataset.py", line 266, in prepare_data_maybe_download
    with tarfile.open(archive_path) as tar:
  File "/home/dani/anaconda3/envs/ubuntudialogue/lib/python2.7/tarfile.py", line 1680, in open
    raise ReadError("file could not be opened successfully")
tarfile.ReadError: file could not be opened successfully

The problem is with permissions, as shown by:

wget http://cs.mcgill.ca/~jpineau/datasets/ubuntu-corpus-1.0/ubuntu_dialogs.tgz
--2017-01-11 11:18:17--  http://cs.mcgill.ca/~jpineau/datasets/ubuntu-corpus-1.0/ubuntu_dialogs.tgz
Resolving cs.mcgill.ca (cs.mcgill.ca)... 132.206.51.10
Connecting to cs.mcgill.ca (cs.mcgill.ca)|132.206.51.10|:80... connected.
HTTP request sent, awaiting response... 403 Forbidden
2017-01-11 11:18:17 ERROR 403: Forbidden.

If I browse in chrome to http://cs.mcgill.ca/~jpineau/datasets/ubuntu-corpus-1.0/ubuntu_dialogs.tgz I get

Forbidden

You don't have permission to access /~jpineau/datasets/ubuntu-corpus-1.0/ubuntu_dialogs.tgz on this server.
Server unable to read htaccess file, denying access to be safe

Apache/2.4.18 (Ubuntu) Server at cs.mcgill.ca Port 80

The directory itself is probably not readable by "others"; if I browse to http://cs.mcgill.ca/~jpineau/datasets/ I get:

See http://stackoverflow.com/questions/27890751/magento-new-host-403-forbidden-server-unable-to-read-htaccess-file or http://stackoverflow.com/questions/31365981/server-unable-to-read-htaccess-file-denying-access-to-be-safe on how to fix; basically, chmod -R o+r * on the datasets/ubuntu-corpus-1.0 directory.

[matteosal]

One more adding to the choir: is there any chance this will be available again?

[rkadlec]

@ryan-lowe Do you have access to the servers? There is apparently something wrong with permissions.

[ryan-lowe]

Sorry for the delayed reply. I do not have permissions, but I just sent an e-mail to Joelle Pineau and to the CS technical people at McGill who will be able to sort it out. I think it will take a most a few days

Again, apologies for the inconvenience. I think that if there is a chance that this keeps happening (it's the 2nd time at least), we will try to move it to a more permanent location. @rkadlec, would IBM be amenable to this?

[ryan-lowe]

Okay, so it turns out the tech admins have just fixed the issue -- apparently it was a permissions problem. If any problems persist, please let me know!

[danimateos]

Great, thanks! I'm running generate.sh right now and it seems ok.

[rkadlec]

Closing this issue since the hosting works fine over the last month.

[thepsyntist]

Getting empty response on the request 8 out of 10 times and even if the download starts, it just stops around 900KB.

[tomyoung96]

Facing the issue ERR_EMPTY_RESPONSE as @thepsyntist reported. Is there something wrong with the server? @ryan-lowe Thanks a lot!

[ryan-lowe]

Thanks for the heads up, I'll ask the McGill tech support people to look into it.

[ryan-lowe]

Okay, it should be fixed now! @tomyoung96 @thepsyntist

[thepsyntist]

Yep, it has been fixed. Thank you!

…

On Mon, Apr 3, 2017 at 11:34 PM, Ryan Lowe ***@***.***> wrote: Okay, it should be fixed now! — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#13 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AJ5C4ueA802884PNKAwMv-6Ye-ybpPqgks5rsTS6gaJpZM4LMrek> .

-- http://thepsycraft.com (Providing web solutions at affordable rates)