Partial Search not working about tntsearch

[mandys]

Okay -

The following works.

2 entries -

mandymoore
mandynomore

search for mandy

both come up.

but [email protected] and [email protected]

search for mandy, mandy2 wont come up.

problem seems to be whenever there is a digit in the string.
partial match fails then.

[nticaric]

Let me try to explain how it works and why the word mandy2 won't come up.
Before saving each word to the index, we do a process called stemming, which basically takes the
common root of a word. Since documents are going to use different forms of a word, such as organize, organizes, and organizing the stemming process is needed to be able to give you meaningful results and not to give you an empty result set if you don't know the right word form.

The default stemmer that we use for TNTSearch is the PorterStemmer and if you feed it with the
word mandy the stem becomes mandi, and if you feed it with mandy2 it becomes mandy2.

So to sum it up, it treats mandy and mandy2 as two different words

[mandys]

Thanks for the explanation.

But, that means if someone signs up on the site as [email protected], then if i try to search for jennifer i won't get back any results.

[nticaric]

That's correct because the text isn't broken down by numbers. However, you can change this by
implementing your own Tokenizer. Here's the current implementation

https://github.com/teamtnt/tntsearch/blob/master/src/Support/Tokenizer.php

[tpodg]

I've got the similar problem, but I am not entirely sure that it has something to do with the current explanation... Taking into account that fuzziness is enabled.
I've debugged the execution and it seems that some words are simply ignored.
The problem is in the method 'getAllDocumentsForKeyword' (TNTSearch.php:219). In my example 'getWordlistByKeyword' returns 2 words with obviously different ids, but when binding the value, $word[0]['id'] is used, meaning that only one word is used. In my opinion the select statement should search for all of the found words / ids. I didn't look when the tokenizer is applied but at that point, this probably isn't the expected behaviour.

[nticaric]

Can you provide a concrete example and I'll try to explain

[tpodg]

Sure, I have some screenshots, it should be easier. The search phrase is 521 and the keywords saved in TNT db are 521c and 521m. I'm using default fuzzy search config - distance = 2, prefix = 2.
In my case the second keyword is ignored, because the select statement always returns only the first id.

[nticaric]

@Sciyguy ok, I understand. We should probably add this only when fuzziness is enabled

[nticaric]

Closing this one, since the issue should be solved if fuzziness is enabled.

[Tofandel]

There seems to be a bug here, asYouType enabled should find both mandy and mandy2 which it does

Until you enable fuzziness, and then it doesn't find any partial word