Coder Social home page Coder Social logo

senisioi / neuraltextsimplification Goto Github PK

View Code? Open in Web Editor NEW
71.0 7.0 23.0 27.66 MB

Exploring Neural Text Simplification

Shell 6.01% Lua 56.06% Python 37.94%
simplification neural-network seq2seq neural-text-simplification deep-learning opennmt

neuraltextsimplification's Issues

License?

Hi Sergiu, would you mind indicating what license this code is under? E.g. is it open source (like MIT, Apache...)

Predictions on Validation Set

Hi,
I was able to find the predictions of the models in the test set, but I was wondering if you could make available the predictions of the models (or even just the best one) on the validation set.

Thanks!

Error: Inconsistent tensor size

image

While running translate.sh, I am getting the following error:
/home/ubuntu/torch/install/bin/luajit: /home/ubuntu/torch/install/share/lua/5.1/nn/JoinTable.lua:39: inconsistent tensor size at /home/ubuntu/torch/pkg/torch/lib/TH/generic/THTensorCopy.c:17

Attached is a screenshot for your reference. Any idea why this is happening?

Translator.lua

user@zhomart:~/torch/src/scripts$ ./translate.sh
/home/user/torch/install/bin/luajit: ./onmt/translate/Translator.lua:94: attempt to index field 'opt' (a nil value)
stack traceback:
./onmt/translate/Translator.lua:94: in function '__init'
/home/user/torch/install/share/lua/5.1/torch/init.lua:91: in function 'new'
translate.lua:53: in function 'main'
translate.lua:206: in main chunk
[C]: in function 'dofile'
...user/torch/install/lib/luarocks/rocks/trepl/scm-1/bin/th:150: in main chunk
[C]: at 0x00405d50
Check results in /home/user/torch/results_NTS/result_NTS_epoch11_10.19.t7_5

Unable to get the output

I followed the exact instructions given in the Readme section but I do not get the correct output. The output generated is the same as the input. Can you please help me out? @senisioi

I am using Lua 5.3.4 and torch 7.
The model I am testing is NTS_epoch11_10.19_release.t7.

Running Problem for the third command

Can anyone tell me why the process of the third command stopped at this stage?
(py3) Apples-iMac:NeuralTextSimplification apple$ python src/download_models.py ./models [LINE:53]# INFO [2019-01-22 15:06:32,095] Saving files to: ./models [LINE:10]# INFO [2019-01-22 15:06:32,096] Downloading 0B_pjS_ZjPfT9dEtrbV85UXhSelU to ./models/NTS_epoch11_10.19.t7 [LINE:11]# INFO [2019-01-22 15:06:32,096] Please be patient, it may take a while... [LINE:824]# DEBUG [2019-01-22 15:06:32,222] Starting new HTTPS connection (1): docs.google.com [LINE:396]# DEBUG [2019-01-22 15:06:32,599] https://docs.google.com:443 "GET /uc?export=download&id=0B_pjS_ZjPfT9dEtrbV85UXhSelU HTTP/1.1" 200 None [LINE:16]# INFO [2019-01-22 15:06:32,600] ... [LINE:824]# DEBUG [2019-01-22 15:06:32,602] Starting new HTTPS connection (2): docs.google.com [LINE:396]# DEBUG [2019-01-22 15:06:32,891] https://docs.google.com:443 "GET /uc?export=download&confirm=5MMl&id=0B_pjS_ZjPfT9dEtrbV85UXhSelU HTTP/1.1" 302 None [LINE:824]# DEBUG [2019-01-22 15:06:32,894] Starting new HTTPS connection (1): doc-0o-1g-docs.googleusercontent.com [LINE:396]# DEBUG [2019-01-22 15:06:35,749] https://doc-0o-1g-docs.googleusercontent.com:443 "GET /docs/securesc/ha0ro937gcuc7l7deffksulhg5h7mbp1/q8872a9n7poj4sqt0mouh1jdqbo4ou8h/1548136800000/06297222380386734599/*/0B_pjS_ZjPfT9dEtrbV85UXhSelU?e=download HTTP/1.1" 200 None

What is considered the best simplification result?

Which of these is the best general purpose model to use for text simplification?
Is there any way to improve the result grammatical quality?
Thank you!

Inputs:

A jet aircraft is an aircraft propelled by jet engines.
A jet engine is a reaction engine discharging a fast-moving jet that generates thrust by jet propulsion.
An engine or motor is a machine designed to convert one form of energy into mechanical energy.
An aircraft is a machine that is able to fly by gaining support from the air.

Outputs:

/root/NeuralTextSimplification/results_NTS/result_NTS_epoch11_10.19.t7_5
A jet aircraft is an aircraft propelled by jet engines. .
A jet engine is a reaction engine .
An engine or motor is a machine designed to convert one form of energy into mechanical energy. .
An aircraft is a machine that is able to fly by gaining support from the air. .

/root/NeuralTextSimplification/results_NTS/result_NTS_epoch11_10.19.t7_5_h1
A jet aircraft is an aircraft propelled by jet engines. .
A jet engine is a reaction engine .
An engine or motor is a machine designed to convert one form of energy into mechanical energy. .
An aircraft is a machine that is able to fly by gaining support from the air. .

/root/NeuralTextSimplification/results_NTS/result_NTS_epoch11_10.19.t7_5_h2
A jet aircraft is an aircraft by jet aircraft .
A jet engine is a reaction engine that generates thrust by jet engines .
An engine or motor is a machine designed to convert one form of energy into mechanical energy. into mechanical energy. .
An aircraft is a machine that is able to get support from the air. .

/root/NeuralTextSimplification/results_NTS/result_NTS_epoch11_10.19.t7_5_h3
A jet aircraft is an aircraft propelled by jet engines. by jet engines. .
A jet engine is a jet engine that generates thrust by jet engines .
An engine or motor is a machine designed to convert one form of energy into mechanical energy. ( mechanical energy. ) into mechanical energy. .
An aircraft is a machine that is able to fly by gaining support from the air. air. .

/root/NeuralTextSimplification/results_NTS/result_NTS_epoch11_10.19.t7_5_h4
A jet aircraft is an aircraft that is propelled by jet engines. .
A jet engine is a small reaction engine that generates thrust by jet engines .
An engine or motor is a machine designed to convert one form of energy into mechanical energy. ( mechanical energy. ) .
An aircraft is a machine that is able to run by gaining support from the air. .

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.