# Error while using amazon\_es **URL:** \ **Category:** Logstash\ **Created:** [May 2, 2019, 7:29am UTC](https://discuss.elastic.co/t/error-while-using-amazon-es/179294 "2019-05-02T07:29:00Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![Shubham\_Yadav1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shubham_yadav1/32/41659_2.png) [@Shubham\_Yadav1](https://discuss.elastic.co/u/Shubham_Yadav1)\ **Post date:** [May 2, 2019, 7:29am UTC](https://discuss.elastic.co/t/error-while-using-amazon-es/179294/1 "2019-05-02T07:29:00Z")
I am running logstash on RHEL with amazon\_es output plugin to send data to aws elastic search but getting this output and i don't see index in kibana. how do i make sure everything is working fine? WARNING: Could not find logstash.yml which is typically located in $LS\_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console [WARN] 2019-05-02 05:51:34.547 [LogStash::Runner] multilocal - Ignoring the 'pipelines.yml' file because modules or command line options are specified [INFO] 2019-05-02 05:51:34.561 [LogStash::Runner] runner - Starting Logstash {"logstash.version"=\>"6.7.1"} /usr/share/logstash/logstash-output-amazon\_es/lib/logstash/outputs/amazon\_es/http\_client/pool.rb:33: warning: already initialized constant ROOT\_URI\_PATH /usr/share/logstash/logstash-output-amazon\_es/lib/logstash/outputs/amazon\_es/http\_client/pool.rb:36: warning: already initialized constant DEFAULT\_OPTIONS /usr/share/logstash/logstash-output-amazon\_es/lib/logstash/outputs/amazon\_es/http\_client/pool.rb:160: warning: already initialized constant ES1\_SNIFF\_RE\_URL /usr/share/logstash/logstash-output-amazon\_es/lib/logstash/outputs/amazon\_es/http\_client/manticore\_adapter.rb:7: warning: already initialized constant DEFAULT\_HEADERS /usr/share/logstash/logstash-output-amazon\_es/lib/logstash/outputs/amazon\_es/http\_client.rb:24: warning: already initialized constant TARGET\_BULK\_BYTES /usr/share/logstash/logstash-output-amazon\_es/lib/logstash/outputs/amazon\_es/common.rb:8: warning: already initialized constant DOC\_DLQ\_CODES /usr/share/logstash/logstash-output-amazon\_es/lib/logstash/outputs/amazon\_es/common.rb:9: warning: already initialized constant DOC\_SUCCESS\_CODES /usr/share/logstash/logstash-output-amazon\_es/lib/logstash/outputs/amazon\_es/common.rb:10: warning: already initialized constant DOC\_CONFLICT\_CODE /usr/share/logstash/logstash-output-amazon\_es/lib/logstash/outputs/amazon\_es/common.rb:16: warning: already initialized constant VERSION\_TYPES\_PERMITTING\_CONFLICT /usr/share/logstash/logstash-output-amazon\_es/lib/logstash/outputs/amazon\_es/common.rb:133: warning: already initialized constant VALID\_HTTP\_ACTIONS /usr/share/logstash/logstash-output-amazon\_es/lib/logstash/outputs/amazon\_es/common.rb:247: warning: already initialized constant DEFAULT\_EVENT\_TYPE\_ES6 /usr/share/logstash/logstash-output-amazon\_es/lib/logstash/outputs/amazon\_es/common.rb:248: warning: already initialized constant DEFAULT\_EVENT\_TYPE\_ES7 [INFO] 2019-05-02 05:51:41.492 [Converge PipelineAction::Create] pipeline - Starting pipeline {:pipeline\_id=\>"main", "pipeline.workers"=\>8, "pipeline.batch.size"=\>125, "pipeline.batch.delay"=\>50} url template {:scheme=\>nil, :user=\>nil, :password=\>nil, :host=\>"URLTEMPLATE", :port=\>443, :path=\>nil} [INFO] 2019-05-02 05:51:41.971 [[main]-pipeline-manager] elasticsearch - Elasticsearch pool URLs updated {:changes=\>{:removed=\>, :added=\>[[https://search-yhsb-test-pwnkrhvj5ct4ikyldwungz5u6a.eu-west-1.es.amazonaws.com:443/](https://search-yhsb-test-pwnkrhvj5ct4ikyldwungz5u6a.eu-west-1.es.amazonaws.com:443/)]}} [INFO] 2019-05-02 05:51:41.979 [[main]-pipeline-manager] elasticsearch - Running health check to see if an Elasticsearch connection is working {:healthcheck\_url=\>[https://search-yhsb-test-pwnkrhvj5ct4ikyldwungz5u6a.eu-west-1.es.amazonaws.com:443/](https://search-yhsb-test-pwnkrhvj5ct4ikyldwungz5u6a.eu-west-1.es.amazonaws.com:443/), :path=\>"/"} [WARN] 2019-05-02 05:51:42.524 [[main]-pipeline-manager] elasticsearch - Restored connection to ES instance {:url=\>"[https://search-yhsb-test-pwnkrhvj5ct4ikyldwungz5u6a.eu-west-1.es.amazonaws.com:443/](https://search-yhsb-test-pwnkrhvj5ct4ikyldwungz5u6a.eu-west-1.es.amazonaws.com:443/)"} [INFO] 2019-05-02 05:51:42.708 [[main]-pipeline-manager] elasticsearch - ES Output version determined {:es\_version=\>6} [WARN] 2019-05-02 05:51:42.712 [[main]-pipeline-manager] elasticsearch - Detected a 6.x and above cluster: the `type` event field won't be used to determine the document \_type {:es\_version=\>6} [INFO] 2019-05-02 05:51:42.740 [[main]-pipeline-manager] elasticsearch - New Elasticsearch output {:class=\>"LogStash::Outputs::ElasticSearch", :hosts=\>["[//search-yhsb-test-pwnkrhvj5ct4ikyldwungz5u6a.eu-west-1.es.amazonaws.com](https://search-yhsb-test-pwnkrhvj5ct4ikyldwungz5u6a.eu-west-1.es.amazonaws.com)"]} [INFO] 2019-05-02 05:51:42.758 [Ruby-0-Thread-5: :1] elasticsearch - Using mapping template from {:path=\>nil} [INFO] 2019-05-02 05:51:42.777 [Ruby-0-Thread-5: :1] elasticsearch - Attempting to install template {:manage\_template=\>{"template"=\>"logstash-_", "version"=\>60001, "settings"=\>{"index.refresh\_interval"=\>"5s"}, "mappings"=\>{"default"=\>{"dynamic\_templates"=\>[{"message\_field"=\>{"path\_match"=\>"message", "match\_mapping\_type"=\>"string", "mapping"=\>{"type"=\>"text", "norms"=\>false}}}, {"string\_fields"=\>{"match"=\>"_", "match\_mapping\_type"=\>"string", "mapping"=\>{"type"=\>"text", "norms"=\>false, "fields"=\>{"keyword"=\>{"type"=\>"keyword", "ignore\_above"=\>256}}}}}], "properties"=\>{"@timestamp"=\>{"type"=\>"date"}, "@version"=\>{"type"=\>"keyword"}, "geoip"=\>{"dynamic"=\>true, "properties"=\>{"ip"=\>{"type"=\>"ip"}, "location"=\>{"type"=\>"geo\_point"}, "latitude"=\>{"type"=\>"half\_float"}, "longitude"=\>{"type"=\>"half\_float"}}}}}}}} [INFO] 2019-05-02 05:51:43.127 [Converge PipelineAction::Create] pipeline - Pipeline started successfully {:pipeline\_id=\>"main", :thread=\>"#\"} [INFO] 2019-05-02 05:51:43.193 [Ruby-0-Thread-1: /usr/share/logstash/lib/bootstrap/environment.rb:6] agent - Pipelines running {:count=\>1, :running\_pipelines=\>[:main], :non\_running\_pipelines=\>} [INFO] 2019-05-02 05:51:43.202 [[main]\9601} My output file content is. output { amazon\_es { hosts =\> ["[search-yhsb-test-pwnkrhvj5ct4ikyldwungz5u6a.eu-west-1.es.amazonaws.com](http://search-yhsb-test-pwnkrhvj5ct4ikyldwungz5u6a.eu-west-1.es.amazonaws.com)" ] region =\> "eu-west-1" index =\> "logstash-aperture-iPPW2-devo-na-eu-service" aws\_access\_key\_id =\> 'DLURO3TJNQCD4B' aws\_secret\_access\_key =\> '0wenj+O+4JAArlMJMKwz9H1' ``` } } ``` ---
**Author:** ![Shubham\_Yadav1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shubham_yadav1/32/41659_2.png) [@Shubham\_Yadav1](https://discuss.elastic.co/u/Shubham_Yadav1)\ **Post date:** [May 5, 2019, 4:20pm UTC](https://discuss.elastic.co/t/error-while-using-amazon-es/179294/2 "2019-05-05T16:20:05Z")
@bennyinc @ep4sh guys please can you help? ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [May 5, 2019, 4:47pm UTC](https://discuss.elastic.co/t/error-while-using-amazon-es/179294/3 "2019-05-05T16:47:52Z")
Could you try and make your index name all lowercase? If this is the issue you should be able to see it in the Elasticsearch logs, assuming you have access to them on AWS ES. Also do not ping people not already involved in the thread. This forum is manned by volunteers. ---
**Author:** ![Shubham\_Yadav1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shubham_yadav1/32/41659_2.png) [@Shubham\_Yadav1](https://discuss.elastic.co/u/Shubham_Yadav1)\ **Post date:** [May 7, 2019, 11:45am UTC](https://discuss.elastic.co/t/error-while-using-amazon-es/179294/4 "2019-05-07T11:45:15Z")
thanks for the reply! changed the index name to ppw2-devo-na-eu-service-%{+YYYY.MM.dd} but the error now is " Failed to install template: name or service now known" ---
**Author:** ![ep4sh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ep4sh/32/40099_2.png) [@ep4sh](https://discuss.elastic.co/u/ep4sh)\ **Post date:** [May 7, 2019, 6:16pm UTC](https://discuss.elastic.co/t/error-while-using-amazon-es/179294/5 "2019-05-07T18:16:15Z")
You can create the output to file / stdout =\> it helps you to understand which stage has an error. please dont share you credentials, it is not secure =) ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [June 4, 2019, 6:16pm UTC](https://discuss.elastic.co/t/error-while-using-amazon-es/179294/6 "2019-06-04T18:16:19Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.