Logstash Additional fields added by ES output

Elastic Stack Elasticsearch
1

I am using logstash. input is jdbc and output is es.

Just wanted to know the fields which I see when using just stout in output are the same fields which will be index to es or es output plug in might add some other extra fields? I have to debug some issue .

2

20181117_213856
20181117_213856.jpg2941×2206 2.89 MB

When input =jdbc hive, output =csv. Code works.

When input =jdbc hive, output =es. Code fails.

When input =jdbc oracle, output =es. Code works.

When input =csv , output =es. Code works.

So it's crazy. Not able to fix this for two days now.

3

20181117_212516
20181117_212516.jpg2079×1559 1.43 MB
20181117_212132
20181117_212132.jpg2941×2206 2.8 MB

Error

4

Please use text wrapped under </> than images from next time.

I suppose you are trying to connect Apache Hive to Elasticsearch.

If so, kindly use ES-Hadoop. Here is the link

5

Why not improve jdbc plug in? I can bring data from Hive to file. Just that es output is not able create some autogenerated fields I guess.