Very slow requests

[chokosabe]

Just installed the plugin (thanks for all the great work).

Just using it with the instructions and each query is taking ~ 2 secs (100,000 records, 8 gb ram) using the fuzzy suggester.

[spinscale]

I'll try to reproduce this with some data... not sure where this might come from.

How big is your FST according to the suggest stats API? How big is your ES_HEAP_SIZE?

[spinscale]

Also, can you add your mapping and a sample query which is being slow?

[chokosabe]

suggestStats: http://pastebin.com/NRtggyfq
ES_HEAP_SIZE is 3gb

query: 'http://localhost:9200/product_en/product-type/__suggest' -d '{"field":"name", "type":"fuzzy", "term":"car"}'

[spinscale]

Just to make sure: Every query you fire is slow, right? The first query you are sending initializes the in-memory data structure. This query is supposed to be slow. When you are sending another query for the same field it should be really fast.

If you are sending any query for a field two times, it remains slow, right?

Another question: Is the name field very long or quite short? Do you have a rough average? I want to reproduce your problem as close as possible, so I need as good information as possible.

[chokosabe]

Hi there. Yes, every request is slow and they take the same time.

The field names can be very long. Up to 150 chars in some cases...

[spinscale]

I have an idea what the problem is (thanks to posting the statistics). Need to investigate though.

[spinscale]

Hey,

I fixed the issue. Can you test it before I release a new version to the maven repo?

git clone https://github.com/spinscale/elasticsearch-suggest-plugin
cd elasticsearch-suggest-plugin
mvn -DskipTests=true package
cd path/to/your/elasticsearch/inst
bin/plugin -install suggest -url file:///path/to/github/directory/elasticsearch-suggest/target/releases/elasticsearch-plugin-suggest-0.90.0-0.6.2-SNAPSHOT.zip

That would be awesome! Many thanks for your help!

[chokosabe]

Having trouble compiling/building with Maven.

[spinscale]

I just released a new version, can you test that one? Version is 0.6.2

[spinscale]

Please test with 0.90.0-0.6.3 - which is a bugfix version

[spinscale]

any feedback here? Can I close this one?

[chokosabe]

Hi Alex,

the issue is still there. I guess most people will move onto the suggest api thats part of the package now (once someone puts in some documentation). Thanks for all the help.