# Upload Logstash and Elastic Cloud data

**URL:** <https://discuss.elastic.co/t/upload-logstash-and-elastic-cloud-data/228448>\
**Category:** Logstash\
**Created:** [April 17, 2020, 4:57am UTC](https://discuss.elastic.co/t/upload-logstash-and-elastic-cloud-data/228448 "2020-04-17T04:57:22Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![111317](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/111317/32/66249_2.png) [@111317](https://discuss.elastic.co/u/111317)\
**Post date:** [April 17, 2020, 4:57am UTC](https://discuss.elastic.co/t/upload-logstash-and-elastic-cloud-data/228448/1 "2020-04-17T04:57:22Z")

</div>

Logstash has been successful.

```auto
Java HotSpot(TM) 64-Bit Server VM warning: Ignoring option UseConcMarkSweepGC; support was removed in 14.0
Java HotSpot(TM) 64-Bit Server VM warning: Ignoring option CMSInitiatingOccupancyFraction; support was removed in 14.0
Java HotSpot(TM) 64-Bit Server VM warning: Ignoring option UseCMSInitiatingOccupancyOnly; support was removed in 14.0
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by com.headius.backport9.modules.Modules (file:/root/logstash-7.6.2/logstash-core/lib/jars/jruby-complete-9.2.9.0.jar) to method sun.nio.ch.NativeThread.signal(long)
WARNING: Please consider reporting this to the maintainers of com.headius.backport9.modules.Modules
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Sending Logstash logs to /root/logstash-7.6.2/logs which is now configured via log4j2.properties
[2020-04-17T09:42:16,278][WARN][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2020-04-17T09:42:16,412][INFO][logstash.runner] Starting Logstash {"logstash.version"=>"7.6.2"}
[2020-04-17T09:42:18,559][INFO][org.reflections.Reflections] Reflections took 78 ms to scan 1 urls, producing 20 keys and 40 values
[2020-04-17T09:42:19,712][INFO][logstash.outputs.elasticsearch][main] Elasticsearch pool URLs updated {:changes=>{:removed=>[], :added=>[https://elastic:xxxxxx@a77aaf4882664376b700d79c0fa670c6.ap-southeast-1.aws.found.io:9243/]}}
[2020-04-17T09:42:20,553][WARN][logstash.outputs.elasticsearch][main] Restored connection to ES instance {:url=>"https://elastic:xxxxxx@a77aaf4882664376b700d79c0fa670c6.ap-southeast-1.aws.found.io:9243/"}
[2020-04-17T09:42:21,008][INFO][logstash.outputs.elasticsearch][main] ES Output version determined {:es_version=>7}
[2020-04-17T09:42:21,020][WARN][logstash.outputs.elasticsearch][main] Detected a 6.x and above cluster: the `type` event field won't be used to determine the document _type {:es_version=>7}
[2020-04-17T09:42:21,200][INFO][logstash.outputs.elasticsearch][main] New Elasticsearch output {:class=>"LogStash::Outputs::ElasticSearch", :hosts=>["https://a77aaf4882664376b700d79c0fa670c6.ap-southeast-1.aws.found.io:9243/"]}
[2020-04-17T09:42:21,315][WARN][org.logstash.instrument.metrics.gauge.LazyDelegatingGauge][main] A gauge metric of an unknown type (org.jruby.RubyArray) has been created for key: cluster_uuids. This may result in invalid serialization. It is recommended to log an issue to the responsible developer/development team.
[2020-04-17T09:42:21,324][INFO][logstash.javapipeline][main] Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>2, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>50, "pipeline.max_inflight"=>250, "pipeline.sources"=>["/root/logstash-7.6.2/config/test.conf"], :thread=>"#<Thread:0x515c422e run>"}
[2020-04-17T09:42:21,454][INFO][logstash.outputs.elasticsearch][main] Using default mapping template
[2020-04-17T09:42:21,666][INFO][logstash.outputs.elasticsearch][main] Attempting to install template {:manage_template=>{"index_patterns"=>"logstash-*", "version"=>60001, "settings"=>{"index.refresh_interval"=>"5s", "number_of_shards"=>1}, "mappings"=>{"dynamic_templates"=>[{"message_field"=>{"path_match"=>"message", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false}}}, {"string_fields"=>{"match"=>"*", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}}}], "properties"=>{"@timestamp"=>{"type"=>"date"}, "@version"=>{"type"=>"keyword"}, "geoip"=>{"dynamic"=>true, "properties"=>{"ip"=>{"type"=>"ip"}, "location"=>{"type"=>"geo_point"}, "latitude"=>{"type"=>"half_float"}, "longitude"=>{"type"=>"half_float"}}}}}}}
[2020-04-17T09:42:22,921][INFO][logstash.javapipeline][main] Pipeline started {"pipeline.id"=>"main"}
[2020-04-17T09:42:23,014][INFO][logstash.agent] Pipelines running {:count=>1, :running_pipelines=>[:main], :non_running_pipelines=>[]}
[2020-04-17T09:42:23,042][INFO][filewatch.observingtail][main] START, creating Discoverer, Watch with file and sincedb collections
[2020-04-17T09:42:23,431][INFO][logstash.agent] Successfully started Logstash API endpoint {:port=>9600}

```

However, when I check in Kibana, the index has not arrived.

Logstash settings are:

```auto
 1 # Sample Logstash configuration for creating a simple
  2 # Beats -> Logstash -> Elasticsearch pipeline.
  3
  4 input {
  5 file{
  6 path => "/root/testlog/*"
  7 start_position => "beginning"
  8 sincedb_path => "/dev/null"
  9 }
 10 }
 11 filter {
 12 json {
 13 source => "message"
 14 }
 15 }
 16 output {
 17 elasticsearch {
 18 action => "index"
 19 index => "logtest"
 20 hosts => ["https:// ******************.ap-********.aws .found.io:9243/"]
 21 #stdout{
 22 # codec => "rubydebug"
 23 user => " ******"
 24 password => " ************"
 25 #user => "elastic"
 26 }
 27 }

```

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [April 17, 2020, 4:59am UTC](https://discuss.elastic.co/t/upload-logstash-and-elastic-cloud-data/228448/2 "2020-04-17T04:59:41Z")

</div>

Please don't start multiple threads on the same question, let's continue the discussion here - [How to send data to Elastic Cloud with On-Premise Logstash](https://discuss.elastic.co/t/how-to-send-data-to-elastic-cloud-with-on-premise-logstash/228423/15)

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [April 17, 2020, 4:59am UTC](https://discuss.elastic.co/t/upload-logstash-and-elastic-cloud-data/228448/3 "2020-04-17T04:59:44Z")

</div>


