Disable output from bulk inserts

Elastic Stack Elasticsearch
1

I just loaded a hundred thousand records using the bulk API. A the very
end I receive the OK messages for each and every one of my inserts.
Scrolls for about 2 minutes. Is there a way to disable this?

Second question. Is it possible when using the bulk API that you just
reference the Index in the CURL statement and then in the actual file just
have the actual data records.
Currently I have to basically repeat the Index every other line such as
{ "index" : {_index" : .........
{"col1": val, "col2": val ......
{ "index" : {_index" : .........
{"col1": val, "col2": val ......

It would be nice if it was just like the following in the file
{"col1": val, "col2": val ......
{"col1": val, "col2": val ......
{"col1": val, "col2": val ......
{"col1": val, "col2": val ......
{"col1": val, "col2": val ......

Thank you

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

2

So I modified my input file (input.json) to look like
{ "index" : {"_index" : "names", "_type" : "ind1", "_id" : "3038814",
"field1": "T", "field2": "00"...}}
{ "index" : {"_index" : "names", "_type" : "ind1", "_id" : "3038815",
"field1": "T", "field2": "00"...}}
/n (new line at end)

and it appears to work, however it only loads the FIRST record and then
returns??

curl -s XPOST localhost:9200/_bulk --data-binary @input.json; echo

Any thoughts on why it's only loading first record. Thanks

On Sunday, February 24, 2013 1:02:42 AM UTC-5, Mike Oakes wrote:

I just loaded a hundred thousand records using the bulk API. A the very
end I receive the OK messages for each and every one of my inserts.
Scrolls for about 2 minutes. Is there a way to disable this?

Second question. Is it possible when using the bulk API that you just
reference the Index in the CURL statement and then in the actual file just
have the actual data records.
Currently I have to basically repeat the Index every other line such as
{ "index" : {_index" : .........
{"col1": val, "col2": val ......
{ "index" : {_index" : .........
{"col1": val, "col2": val ......

It would be nice if it was just like the following in the file
{"col1": val, "col2": val ......
{"col1": val, "col2": val ......
{"col1": val, "col2": val ......
{"col1": val, "col2": val ......
{"col1": val, "col2": val ......

Thank you

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

3

The second format you use is incorrect. Essentially you are just specifying
a meta-data line, and not the document properties itself.

Your first format is correct. If you pass the index and type in the URL,
then you can reduce your metadata line to the minimum, eg:

{ index: { id: 3038814}}\n
{ field1: "T", etc }\n

clint

On Sun, Feb 24, 2013 at 5:03 PM, Mike Oakes mdoakes42@gmail.com wrote:

So I modified my input file (input.json) to look like
{ "index" : {"_index" : "names", "_type" : "ind1", "_id" : "3038814",
"field1": "T", "field2": "00"...}}
{ "index" : {"_index" : "names", "_type" : "ind1", "_id" : "3038815",
"field1": "T", "field2": "00"...}}
/n (new line at end)

and it appears to work, however it only loads the FIRST record and then
returns??

curl -s XPOST localhost:9200/_bulk --data-binary @input.json; echo

Any thoughts on why it's only loading first record. Thanks

On Sunday, February 24, 2013 1:02:42 AM UTC-5, Mike Oakes wrote:

I just loaded a hundred thousand records using the bulk API. A the very
end I receive the OK messages for each and every one of my inserts.
Scrolls for about 2 minutes. Is there a way to disable this?

Second question. Is it possible when using the bulk API that you just
reference the Index in the CURL statement and then in the actual file just
have the actual data records.
Currently I have to basically repeat the Index every other line such as
{ "index" : {_index" : .........
{"col1": val, "col2": val ......
{ "index" : {_index" : .........
{"col1": val, "col2": val ......

It would be nice if it was just like the following in the file
{"col1": val, "col2": val ......
{"col1": val, "col2": val ......
{"col1": val, "col2": val ......
{"col1": val, "col2": val ......
{"col1": val, "col2": val ......

Thank you

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.