I moved to ES 0.90.9 and JDK1.7. Still slower than tar.
curl -X POST "http://localhost:9200/documents/_search?pretty=true" -d '
{
"query": {
"query_string": {
"query": "(text:"understanding" ) "
}
},
"fields": [
"id",
"ratings"
]
} '
Here's a result. See how long it takes? That's obscene for 50 documents.
{
"took" : 4294,
"timed_out" : false,
"_shards" : {
"total" : 5,
"successful" : 5,
"failed" : 0
},
"hits" : {
"total" : 11,
"max_score" : 0.048666354,
"hits" : [ {
"_index" : "documents",
"_type" : "doc",
"_id" : "eb7b1c4a-b8c9-4bdc-8baf-aa16002831f3",
"_score" : 0.048666354,
"fields" : {
"id" : "eb7b1c4a-b8c9-4bdc-8baf-aa16002831f3",
"ratings" :
}
}, {
"_index" : "documents",
"_type" : "doc",
"_id" : "c5ce2faf-db3d-4623-9ecc-398f4a78f123",
"_score" : 0.030950457,
"fields" : {
"id" : "c5ce2faf-db3d-4623-9ecc-398f4a78f123",
"ratings" :
}
}, {
"_index" : "documents",
"_type" : "doc",
"_id" : "87666287-6b01-4c99-8c8e-430f3417014b",
"_score" : 0.030665938,
"fields" : {
"id" : "87666287-6b01-4c99-8c8e-430f3417014b",
"ratings" :
}
}, {
"_index" : "documents",
"_type" : "doc",
"_id" : "f10c9a47-7efa-424d-bf65-7072bbbf64be",
"_score" : 0.028295785,
"fields" : {
"id" : "f10c9a47-7efa-424d-bf65-7072bbbf64be",
"ratings" :
}
}, {
"_index" : "documents",
"_type" : "doc",
"_id" : "b1d2f103-d2c6-4b4e-8fd2-8615b9ed6bb0",
"_score" : 0.02708165,
"fields" : {
"id" : "b1d2f103-d2c6-4b4e-8fd2-8615b9ed6bb0",
"ratings" :
}
}, {
"_index" : "documents",
"_type" : "doc",
"_id" : "6aa4b05b-ee38-49b4-a3e2-1f2a01e62f40",
"_score" : 0.025010176,
"fields" : {
"id" : "6aa4b05b-ee38-49b4-a3e2-1f2a01e62f40",
"ratings" :
}
}, {
"_index" : "documents",
"_type" : "doc",
"_id" : "78d5a3d7-4c45-4f1b-a596-993916aed2de",
"_score" : 0.02360665,
"fields" : {
"id" : "78d5a3d7-4c45-4f1b-a596-993916aed2de",
"ratings" :
}
}, {
"_index" : "documents",
"_type" : "doc",
"_id" : "21be8c9e-3e73-44e8-9b31-db44fa0a4faa",
"_score" : 0.020865528,
"fields" : {
"id" : "21be8c9e-3e73-44e8-9b31-db44fa0a4faa",
"ratings" :
}
}, {
"_index" : "documents",
"_type" : "doc",
"_id" : "1be7eb7e-dd8b-4582-aa0d-2edb20fa4339",
"_score" : 0.020655818,
"fields" : {
"id" : "1be7eb7e-dd8b-4582-aa0d-2edb20fa4339",
"ratings" :
}
}, {
"_index" : "documents",
"_type" : "doc",
"_id" : "a695fdd5-d025-4f77-8b25-c7fdea8bbbe3",
"_score" : 0.017684866,
"fields" : {
"id" : "a695fdd5-d025-4f77-8b25-c7fdea8bbbe3",
"ratings" :
}
} ]
}
}
On Wednesday, January 1, 2014 12:44:46 PM UTC-5, project2501 wrote:
Hi,
Thanks for the response.
The box has 15GB RAM. 4GB allocated to ES.
The mapping is simple and has only about 6 not_analyzed fields, 1 date
field and 1 text field.
The documents are large however, 10MB each with 100's of fields. Only a
couple are being returned and the response documents are less than 10k
each (only two two small fields returned).
Sun JDK 1.6
I will try Oracle JDK 1.7 and latest ES.
I was trying different things with node/replica to see if there is a
change in performance.
Cluster health is green.
On Wednesday, January 1, 2014 12:30:49 PM UTC-5, Jörg Prante wrote:
There can be lots of reasons - EC2-related, OS related, Java related,
cluster setup related, index related, query related...
Can you give an example of your mapping and a document you have indexed?
How much RAM is your EC2 instance? Do you use hardware virtualization?
Did you disable swap and enable mlock?
What is the cluster health, is it green? If you have just one node, why
is there 1 replica? It makes not much sense.
Side notes: Please use ES version 0.90.9 as it is the latest of the 0.90
branch with bugs fixed. And what vendor is jdk1.6.0_45? Please use Java
7, especially if you use OpenJDK 6.
Jörg
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/201a4ca6-bc05-48f4-85ff-d3d2e8b152cc%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.