Comments (5)
Have you tried running this code in a 64 bit process?
On Thu, 6 Oct 2016, 08:06 RalfSmith, [email protected] wrote:
I am trying this simple piece of code, for benchmarking purposes, but I
get an OutOfMemoryException when reaching around 350K elements inserted.DawgBuilder dawgBuilder = new DawgBuilder();
for (int i = 0; i < 10000000; i++)
{
dawgBuilder.Insert(Guid.NewGuid().ToString(), true);
}—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
#9, or mute the thread
https://github.com/notifications/unsubscribe-auth/AD15-oFs97mcCjCDrufkVn9mydTHutVXks5qxJ3agaJpZM4KPnbY
.
from dawgsharp.
Also, this class is built to store natural language strings efficiently.
Using it with Guids will not give you the benefits this class was designed
to provide.
On Thu, 6 Oct 2016, 09:53 Sergey Slepov, [email protected] wrote:
Have you tried running this code in a 64 bit process?
On Thu, 6 Oct 2016, 08:06 RalfSmith, [email protected] wrote:
I am trying this simple piece of code, for benchmarking purposes, but I
get an OutOfMemoryException when reaching around 350K elements inserted.DawgBuilder dawgBuilder = new DawgBuilder();
for (int i = 0; i < 10000000; i++)
{
dawgBuilder.Insert(Guid.NewGuid().ToString(), true);
}—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
#9, or mute the thread
https://github.com/notifications/unsubscribe-auth/AD15-oFs97mcCjCDrufkVn9mydTHutVXks5qxJ3agaJpZM4KPnbY
.
from dawgsharp.
I will compile it as x64, and let you know. I read in the documentation the remark about the benefits of storing words, but I wanted (needed) to create a testing environment for different data structures as neutral as possible.
Thank you very much for your extremely fast response!
from dawgsharp.
You're welcome. But keep in mind that whatever benchmarks you do on Guids
may not reflect the timings on natural language words. I would highly
recommend testing on data that you want to use in production.
Also, can you post your benchmark results here?
On Thu, 6 Oct 2016, 10:23 RalfSmith, [email protected] wrote:
I will compile it as x64, and let you know. I read in the documentation
the remark about the benefits of storing words, but I wanted (needed) to
create a testing environment for different data structures as neutral as
possible.Thank you very much for your extremely fast response!
—
You are receiving this because you commented.Reply to this email directly, view it on GitHub
#9 (comment), or mute
the thread
https://github.com/notifications/unsubscribe-auth/AD15-vNfEKs8pFN4dfCodZeVfpJ_FiIFks5qxL4ZgaJpZM4KPnbY
.
from dawgsharp.
Hi @RalfSmith,
How did the testing go? Did it work in x64?
from dawgsharp.
Related Issues (20)
- Improve lookup speed
- Support .NET Standard HOT 1
- Possible error with your sample code HOT 3
- Make file even smaller by deduplicating payloads
- Поддерживается ли поиск с возможными заменами е<>ё? HOT 2
- Unexpected behaviour of DawgBuilder.TryGetValue() HOT 1
- How do i use it or anagram solving HOT 4
- Error when loading bin file HOT 8
- How can i get a random word ? HOT 4
- Dawg.MatchSuffix feature? HOT 5
- Dawg.MatchSuffix with max Count HOT 4
- EndOfStreamException: Unable to read beyond the end of the stream. HOT 4
- Dawg could use less memory HOT 2
- Optimise FuseEnds()
- Optimize the compaction algorithm for speed HOT 1
- Implement IDictionary <string, TValue> on Dawg and DawgBuilder HOT 1
- Add an XML comments file to the package HOT 1
- Consider MIT or LGPL please? HOT 2
- Use shorts instead of ints if the number of nodes is < 32K
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dawgsharp.