# How to use logstash to upload data in elasticsearch in specific format

**URL:** <https://discuss.elastic.co/t/how-to-use-logstash-to-upload-data-in-elasticsearch-in-specific-format/135642>\
**Category:** Logstash\
**Created:** [June 13, 2018, 6:59am UTC](https://discuss.elastic.co/t/how-to-use-logstash-to-upload-data-in-elasticsearch-in-specific-format/135642 "2018-06-13T06:59:44Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![rs123](https://avatars.discourse-cdn.com/v4/letter/r/73ab20/32.png) [@rs123](https://discuss.elastic.co/u/rs123)\
**Post date:** [June 13, 2018, 6:59am UTC](https://discuss.elastic.co/t/how-to-use-logstash-to-upload-data-in-elasticsearch-in-specific-format/135642/1 "2018-06-13T06:59:44Z")

</div>

Both mapping and index are as below:

> ```
> PUT somki
> {
> "mappings": {
> "_doc" : {
> "properties" : {
> "suggest" : {
> "type" : "completion",
> "contexts": [
> { 
> "name": "userid",
> "type": "category"
> }
> ]
> }
> }
> }
> }
> }
> 
> POST somki/_doc/
> {
> "suggest": {
> "input": ["123","asb"],
> "contexts": {
> "userid": ["99568656541578","abhi"] 
> }
> }
> }
> 
> ```

And I have a csv file which contains four columns and value of first two columns I want to put in input and value of remaining two column's value I want to put in userid as shown in above indexing. How can I do this?

---

<div class="post-metadata">

**Author:** ![rs123](https://avatars.discourse-cdn.com/v4/letter/r/73ab20/32.png) [@rs123](https://discuss.elastic.co/u/rs123)\
**Post date:** [June 13, 2018, 9:47am UTC](https://discuss.elastic.co/t/how-to-use-logstash-to-upload-data-in-elasticsearch-in-specific-format/135642/2 "2018-06-13T09:47:52Z")

</div>

Anyone?

---

<div class="post-metadata">

**Author:** ![rs123](https://avatars.discourse-cdn.com/v4/letter/r/73ab20/32.png) [@rs123](https://discuss.elastic.co/u/rs123)\
**Post date:** [June 15, 2018, 5:41am UTC](https://discuss.elastic.co/t/how-to-use-logstash-to-upload-data-in-elasticsearch-in-specific-format/135642/3 "2018-06-15T05:41:33Z")

</div>

Someone?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [June 15, 2018, 8:05am UTC](https://discuss.elastic.co/t/how-to-use-logstash-to-upload-data-in-elasticsearch-in-specific-format/135642/4 "2018-06-15T08:05:25Z")

</div>

Try something like this:

```auto
input {
  generator {
    lines => ['123,asb,99568656541578,abhi']
    count => 1
  } 
} 

filter {
  grok {
    match => { "message" => "%{NOTSPACE:[suggest][input]},%{NOTSPACE:[suggest][input]},%{NOTSPACE:[suggest][contexts][userid]},%{NOTSPACE:[suggest][contexts][userid]}" }
  }
}

output {
  stdout { codec => rubydebug }
}

```

---

<div class="post-metadata">

**Author:** ![rs123](https://avatars.discourse-cdn.com/v4/letter/r/73ab20/32.png) [@rs123](https://discuss.elastic.co/u/rs123)\
**Post date:** [June 15, 2018, 10:46am UTC](https://discuss.elastic.co/t/how-to-use-logstash-to-upload-data-in-elasticsearch-in-specific-format/135642/5 "2018-06-15T10:46:08Z")

</div>

Thanks for reply.  
I tried this and it worked but when I look for suggestion I don't get any. Here is my suggester format.

```
GET somki/_search
{
    "suggest": {
        "suggestion" : {
            "prefix" : "asb",
            "completion" : {
                "field" : "suggest",
                "contexts": {
                    "userid": ["99568656541578"]
                },
                "fuzzy" : {
                  "fuzziness" : 2
                }
            }
        }
    }
}

```

When I upload each document individually following the format shown above in the question it works.  
And my .conf file.

```
input {

file {
path => "C:\Users\ramesh\Downloads\elasticsearch\Data\Book1.csv"
start_position => "beginning"
 sincedb_path => "/dev/null"
}

  generator {
    lines => ['oNumber,oName,userids,userID']
    count => 1
  } 
} 

filter {
  grok {
    match => { "message" => "%{NOTSPACE:[suggest][input]},%{NOTSPACE:[suggest][input]},%{NOTSPACE:[suggest][contexts][userid]},%{NOTSPACE:[suggest][contexts][userid]}" }
  }
}

output {
elasticsearch {
     hosts => "http://localhost:9200"
     index => "somki"
	 user => elastic
     password => "elastic"
  }
  stdout { codec => rubydebug }
}

```

Here oNumber, oName, userids, userID are csv file column names and each row contains values like 123, asb, 99568656541578, abhi.  
Please provide appropriate changes. Thank You!

---

<div class="post-metadata">

**Author:** ![rs123](https://avatars.discourse-cdn.com/v4/letter/r/73ab20/32.png) [@rs123](https://discuss.elastic.co/u/rs123)\
**Post date:** [June 18, 2018, 7:22am UTC](https://discuss.elastic.co/t/how-to-use-logstash-to-upload-data-in-elasticsearch-in-specific-format/135642/6 "2018-06-18T07:22:25Z")

</div>

Anyone?

---

<div class="post-metadata">

**Author:** ![rs123](https://avatars.discourse-cdn.com/v4/letter/r/73ab20/32.png) [@rs123](https://discuss.elastic.co/u/rs123)\
**Post date:** [June 19, 2018, 7:09am UTC](https://discuss.elastic.co/t/how-to-use-logstash-to-upload-data-in-elasticsearch-in-specific-format/135642/7 "2018-06-19T07:09:45Z")

</div>

Someone, anything?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [June 19, 2018, 7:26am UTC](https://discuss.elastic.co/t/how-to-use-logstash-to-upload-data-in-elasticsearch-in-specific-format/135642/8 "2018-06-19T07:26:41Z")

</div>

I would recommend posting the question related to search and suggestions under the Elasticsearch category as you are more likely to get a response there.

---

<div class="post-metadata">

**Author:** ![rs123](https://avatars.discourse-cdn.com/v4/letter/r/73ab20/32.png) [@rs123](https://discuss.elastic.co/u/rs123)\
**Post date:** [June 19, 2018, 8:12am UTC](https://discuss.elastic.co/t/how-to-use-logstash-to-upload-data-in-elasticsearch-in-specific-format/135642/9 "2018-06-19T08:12:52Z")

</div>

Thanks!

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 17, 2018, 8:12am UTC](https://discuss.elastic.co/t/how-to-use-logstash-to-upload-data-in-elasticsearch-in-specific-format/135642/10 "2018-07-17T08:12:55Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.