Maven Packages

nmalocic · March 30, 2021, 8:28am

Hi everyone,
Is it possible to load maven package to use Json Processor from code?
I am writing plugin, and I need to use Json Processor to parse data.

Thanks,
Nemanja

dadoonet · March 30, 2021, 8:53am

What kind of plugin is that? Is it a processor for ingest pipeline?

No. This code is not published on Maven.
But you can copy/paste the existing code (if compatible with the Elastic License 2.0 or SSPL V1) from:

github.com

elastic/elasticsearch/blob/main/modules/ingest-common/src/main/java/org/elasticsearch/ingest/common/JsonProcessor.java

/*
 * Copyright Elasticsearch B.V. and/or licensed to Elasticsearch B.V. under one
 * or more contributor license agreements. Licensed under the Elastic License
 * 2.0 and the Server Side Public License, v 1; you may not use this file except
 * in compliance with, at your election, the Elastic License 2.0 or the Server
 * Side Public License, v 1.
 */

package org.elasticsearch.ingest.common;

import org.elasticsearch.common.bytes.BytesArray;
import org.elasticsearch.common.bytes.BytesReference;
import org.elasticsearch.core.Strings;
import org.elasticsearch.ingest.AbstractProcessor;
import org.elasticsearch.ingest.ConfigurationUtils;
import org.elasticsearch.ingest.IngestDocument;
import org.elasticsearch.ingest.Processor;
import org.elasticsearch.xcontent.XContentParser;
import org.elasticsearch.xcontent.XContentParserConfiguration;
import org.elasticsearch.xcontent.json.JsonXContent;

This file has been truncated. show original

nmalocic · March 30, 2021, 9:08am

Hi @dadoonet, thanks for the answer.
I am writing Ingest Plugin to create ingest pipeline.
Inside of the plugin I call 3rd party API (I know this is not optimal but didn't found better solutions), then I want to parse that JSON and save it as nested fields and not just strings.
I'll try the copy paste method, and see if it works thanks.
My current workaround is to document that custom pipeline has to have my processor and than json processor after that in order to work.

Thanks,
Nemanja

dadoonet · March 30, 2021, 3:36pm

I think that's what I'd do as well.

nmalocic · March 31, 2021, 7:34am

Thanks a lot for the comments!
Nemanja

nmalocic · April 5, 2021, 11:50am

Hi @dadoonet I didn't want to start new tread for this.
Is there any examples on how to parse optional configuration?
I need to have option to add config file for my plugin, that configure additional logic.
I need proper way to check if config.yml is there, and also if settings are not present to use default value.

I was looking at elasticsearch/ExampleCustomSettingsConfig.java at master · elastic/elasticsearch · GitHub but this wont work if any setting is missing.

Thanks

system · May 3, 2021, 11:51am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.