Pipeline in Elastic cloud

Elastic Stack Elasticsearch
1

Hi everyone, I am a new to the Elasticsearch stack. We are using the Elasticsearch cloud (7.5.2).
Because logstash isn't part of the cloud solution I am trying out the ingest node using the pipeline.
We want to be able to manipulate the incomming data.

I found the discription for the ingest node on this URL: https://www.elastic.co/guide/en/elasticsearch/reference/6.2/ingest.html

Within the Management section I have created a Hello_world pipeline

image
image1680×1010 127 KB

(I have editted the screenshot: the host, user and password)

To check if this pipeline works, I used the Dev Tools. But I get an error saying it is an illegal_argument_exception. status = 400

image
image1300×398 24 KB

What am I doing wrong?
Is there other information, I have not found yet?

2

You are confusing centrally managed Logstash pipelines with ingest processors that run in Elasticsearch itself.

With Elastic Cloud you can still use Logstash if you want to; it needs to run on an additional server that you provide and control.

However, if you prefer to do any data transformation in Elasticsearch itself and just send the data in packaged up in JSON format, use an ingest processor.

3

Thank you. That is very clear. I will get further in my configuration process.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.