Size limitations?

Elastic Stack Elasticsearch
1

All,

I can't seem to find this in the docs, so if it exists, I apologize, but is
there a default size limit for a text field? Also, is there a size limit for
an HTTP request body in the REST API? I seem to be having some issues with
sending requests that some part of it is too large, and I'm not sure if it's
a single large field (16MB works, 50MB doesn't) or the entire bulk insert
request (again, 50MB works, 100MB doesn't)

Thanks,

Matt

2

There is a built in limit in the HTTP (chunk handling) layer that limits requests to 100mb. You can set it using http.max_content_length (for example, set it to a bigger value).
On Wednesday, March 9, 2011 at 4:47 PM, Matt Paul wrote:

All,

I can't seem to find this in the docs, so if it exists, I apologize, but is there a default size limit for a text field? Also, is there a size limit for an HTTP request body in the REST API? I seem to be having some issues with sending requests that some part of it is too large, and I'm not sure if it's a single large field (16MB works, 50MB doesn't) or the entire bulk insert request (again, 50MB works, 100MB doesn't)

Thanks,

Matt

3

Thanks Shay! Is there any limit on the length of a field (text or
otherwise)?

On Mar 9, 12:30 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

There is a built in limit in the HTTP (chunk handling) layer that limits requests to 100mb. You can set it using http.max_content_length (for example, set it to a bigger value).

On Wednesday, March 9, 2011 at 4:47 PM, Matt Paul wrote:

All,

I can't seem to find this in the docs, so if it exists, I apologize, but is there a default size limit for a text field? Also, is there a size limit for an HTTP request body in the REST API? I seem to be having some issues with sending requests that some part of it is too large, and I'm not sure if it's a single large field (16MB works, 50MB doesn't) or the entire bulk insert request (again, 50MB works, 100MB doesn't)

Thanks,

Matt

4

There isn't. But note, with this large fields / documents, they have to be represented in memory on elasticsearch server. Make sure you have plenty of it.
On Wednesday, March 9, 2011 at 11:39 PM, Matt Paul wrote:

Thanks Shay! Is there any limit on the length of a field (text or
otherwise)?

On Mar 9, 12:30 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

There is a built in limit in the HTTP (chunk handling) layer that limits requests to 100mb. You can set it using http.max_content_length (for example, set it to a bigger value).

On Wednesday, March 9, 2011 at 4:47 PM, Matt Paul wrote:

All,

I can't seem to find this in the docs, so if it exists, I apologize, but is there a default size limit for a text field? Also, is there a size limit for an HTTP request body in the REST API? I seem to be having some issues with sending requests that some part of it is too large, and I'm not sure if it's a single large field (16MB works, 50MB doesn't) or the entire bulk insert request (again, 50MB works, 100MB doesn't)

Thanks,

Matt

5

Shay,

OK, thanks. Although we do have the multi-MB fields, they are few and
far between and we're planning on at least 16 of not 32GB of memory
per server (x64) and greatly enlarging the java memory limit, so
hopefully memory won't be an issue.

Matt

On Mar 10, 12:07 am, Shay Banon shay.ba...@elasticsearch.com wrote:

There isn't. But note, with this large fields / documents, they have to be represented in memory on elasticsearch server. Make sure you have plenty of it.

On Wednesday, March 9, 2011 at 11:39 PM, Matt Paul wrote:

Thanks Shay! Is there any limit on the length of a field (text or
otherwise)?

On Mar 9, 12:30 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

There is a built in limit in the HTTP (chunk handling) layer that limits requests to 100mb. You can set it using http.max_content_length (for example, set it to a bigger value).

On Wednesday, March 9, 2011 at 4:47 PM, Matt Paul wrote:

All,

I can't seem to find this in the docs, so if it exists, I apologize, but is there a default size limit for a text field? Also, is there a size limit for an HTTP request body in the REST API? I seem to be having some issues with sending requests that some part of it is too large, and I'm not sure if it's a single large field (16MB works, 50MB doesn't) or the entire bulk insert request (again, 50MB works, 100MB doesn't)

Thanks,

Matt

6

I thought this is a right place to put my question.
In my application I have a field which sometimes get about 50KB and somethimes 1KB
I had marked this field has not analized and performed some queries over him.
In result when this field is shorter I get the right results without any problem but when this field is bigger I can't get results.
There is some way to get right results allways?
Some maxfield attribute or something I can setup or there are some limitations with not analyzed fields?

Thank you in advance.