Comments (6)
Hi Alexander,
Thank you very much for your interest!
Each module has a different behavior in terms of RAM requirements and speed.
We didn't make specific tests but we used Linguakit for analysing large text corpora, for instance, several Wikipedias.
For instance, the 'dep' analysis of a text document takes over 2,5% of 8G RAM and analyzes 1,4k words per second (using the processor of my laptop: Intel(R) Core(TM) i7-7500U CPU @ 2.70GHz). So, it takes two weeks in syntactically analyzing the entire English Wikipedia (2 billion words) in my laptop.
from linguakit.
wow @gamallo. it's pretty impressive the performance. As I understand due the operations behind the analysis CPU is the most important instead of I/O operations.
About the other modules do exists some place to find the metrics e.g for (rel
)
Nice, thank you very much for answered my question.
I think, it would be worth to have this comparatives in the documentation. I'll be glad to contribute at least with it.
from linguakit.
Sorry to ask multiple things. But I'm really love this project and I want to use this to help people learn a Mayan language from Spanish (and better from Mayan to Spanish). 😄
What is the best way to use Linguakit
for example from an HTTP API? I imagine that maybe executing the binary from the other language.
e.g
In Golang
cmd := exec.Command("linguakit", "rel", "es", "hola amigo", "-s")
log.Printf("Running command and waiting for it to finish...")
err := cmd.Run()
log.Printf("Command finished with error: %v", err)
I'll appreciate your comments.
from linguakit.
Hi @gamallo, sorry to bother you. I know you probably has more important things to do.
But i'll try, I will really appreciate your comments or observations on my last comment.
Sorry and thank you.
from linguakit.
Sorry for the delay. I'm not sure if I understood your last question, but I'll try to answer. The most efficient way to use Linguakit is to run an API. As it is written in Perl, the most natural way to build an API for all or some of the Linguakit modules is to use Dancer: http://perldancer.org/
On the other hand, as you said, you can also run the 'linguakit' command from any other language that allows access to the command line. This is the easiest way to use Linguakit from another application even if it is not so efficient as having access via API.
Hope it helps.
Best
from linguakit.
Hi @gamallo, yes it is.
Thanks a lot for your time. Makes sense. I was asking about how to run linguakit
from other programming language because I want to make an API using Golang (I don't know too much Perl).
Thanks
from linguakit.
Related Issues (13)
- Co-Reference HOT 8
- Sentiment analysis HOT 4
- Modularize? HOT 3
- Linking not working HOT 4
- String MalFormed HOT 1
- perl: symbol lookup error HOT 3
- portability HOT 1
- Issue in sentiment score calculation HOT 3
- Sentiment analysis is not working. HOT 1
- Run on Windows HOT 1
- Issue with Summarizer HOT 23
- Triples HOT 55
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from linguakit.