# Ingest data from salesforce to elasticsearch using Logstash **URL:** \ **Category:** Logstash\ **Created:** [October 22, 2020, 3:15am UTC](https://discuss.elastic.co/t/ingest-data-from-salesforce-to-elasticsearch-using-logstash/252921 "2020-10-22T03:15:29Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![SUMANT\_MISHRA](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sumant_mishra/32/77606_2.png) [@SUMANT\_MISHRA](https://discuss.elastic.co/u/SUMANT_MISHRA)\ **Post date:** [October 22, 2020, 3:15am UTC](https://discuss.elastic.co/t/ingest-data-from-salesforce-to-elasticsearch-using-logstash/252921/1 "2020-10-22T03:15:29Z")
Hi, I am trying to ingest data from salesforce to elasticsearch using logstash in Macbook Pro (macOS Mojave Version 10.14.2). But it's not working and gives the below error in my terminal: ```auto *[2020-10-22T08:37:06,130][INFO][logstash.runner] Starting Logstash {"logstash.version"=>"7.9.2", "jruby.version"=>"jruby 9.2.13.0 (2.5.7) 2020-08-03 9a89c94bcc OpenJDK 64-Bit Server VM 25.212-b03 on 1.8.0_212-b03 +indy +jit [darwin-x86_64]"}* *[2020-10-22T08:37:06,348][WARN][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified* *[2020-10-22T08:37:07,967][INFO][org.reflections.Reflections] Reflections took 32 ms to scan 1 urls, producing 22 keys and 45 values * *[2020-10-22T08:37:09,408][INFO][logstash.outputs.elasticsearch][main] Elasticsearch pool URLs updated {:changes=>{:removed=>[], :added=>[http://127.0.0.1:9200/]}}* *[2020-10-22T08:37:09,570][WARN][logstash.outputs.elasticsearch][main] Restored connection to ES instance {:url=>"http://127.0.0.1:9200/"}* *[2020-10-22T08:37:09,612][INFO][logstash.outputs.elasticsearch][main] ES Output version determined {:es_version=>7}* *[2020-10-22T08:37:09,616][WARN][logstash.outputs.elasticsearch][main] Detected a 6.x and above cluster: the `type` event field won't be used to determine the document _type {:es_version=>7}* *[2020-10-22T08:37:09,659][INFO][logstash.outputs.elasticsearch][main] New Elasticsearch output {:class=>"LogStash::Outputs::ElasticSearch", :hosts=>["//127.0.0.1:9200"]}* *[2020-10-22T08:37:09,714][INFO][logstash.outputs.elasticsearch][main] Using a default mapping template {:es_version=>7, :ecs_compatibility=>:disabled}* *[2020-10-22T08:37:09,756][INFO][logstash.javapipeline][main] Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>12, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>50, "pipeline.max_inflight"=>1500, "pipeline.sources"=>["/Volumes/Macintosh HD2/RnDAndLearning/ElasticStack/logstash/salesforce/logstash.config"], :thread=>"#"}* *[2020-10-22T08:37:09,781][INFO][logstash.outputs.elasticsearch][main] Attempting to install template {:manage_template=>{"index_patterns"=>"logstash-*", "version"=>60001, "settings"=>{"index.refresh_interval"=>"5s", "number_of_shards"=>1}, "mappings"=>{"dynamic_templates"=>[{"message_field"=>{"path_match"=>"message", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false}}}, {"string_fields"=>{"match"=>"*", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}}}], "properties"=>{"@timestamp"=>{"type"=>"date"}, "@version"=>{"type"=>"keyword"}, "geoip"=>{"dynamic"=>true, "properties"=>{"ip"=>{"type"=>"ip"}, "location"=>{"type"=>"geo_point"}, "latitude"=>{"type"=>"half_float"}, "longitude"=>{"type"=>"half_float"}}}}}}}* *[2020-10-22T08:37:10,511][INFO][logstash.javapipeline][main] Pipeline Java execution initialization time {"seconds"=>0.75}* *[2020-10-22T08:37:15,714][ERROR][logstash.agent] Failed to execute action {:id=>:main, :action_type=>LogStash::ConvergeResult::FailedAction, :message=>"Could not execute action: PipelineAction::Create
, action_result: false", :backtrace=>nil}* *[2020-10-22T08:37:15,912][INFO][logstash.agent] Successfully started Logstash API endpoint {:port=>9600}* *[2020-10-22T08:37:21,012][INFO][logstash.runner] Logstash shut down.* *[2020-10-22T08:37:21,024][ERROR][org.logstash.Logstash] java.lang.IllegalStateException: Logstash stopped processing because of an error: (SystemExit) exit* ``` Below is my configuration in config file (filename is logstash.config) ```auto input { salesforce { client_id => "Consumer Key" client_secret => "Consumer Secret" username => "xxxxxxxxxxx@force.com" password => "xxxxxxxxxxx" security_token => "Security token" sfdc_object_name => "Account" } } filter {} output { elasticsearch { hosts => ["127.0.0.1:9200"] index => "sforce" } stdout {} } ``` **Credentials are correct** because I am able to login successfully using postman. And I am able to set source and export as CSV using Jitterbit. **Logstash works fine** because I am able to ingest data from CSV and JSON to elasticsearch. Please help me resolving this. Logstash version is logstash-7.9.2 ---
**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\ **Post date:** [October 22, 2020, 2:32pm UTC](https://discuss.elastic.co/t/ingest-data-from-salesforce-to-elasticsearch-using-logstash/252921/2 "2020-10-22T14:32:20Z")
You may get a more informative message if you enable log.level debug. ---
**Author:** ![SUMANT\_MISHRA](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sumant_mishra/32/77606_2.png) [@SUMANT\_MISHRA](https://discuss.elastic.co/u/SUMANT_MISHRA)\ **Post date:** [October 22, 2020, 6:07pm UTC](https://discuss.elastic.co/t/ingest-data-from-salesforce-to-elasticsearch-using-logstash/252921/3 "2020-10-22T18:07:05Z")
Hi @Badger, I am really sorry to say, I am not that much expert who can understand this one line short solution. I am really struggling in integrating salesforce with elasticsearch using logstash version 7.9.2. I am using "logstash-input-salesforce" plugin in logstash. Please suggest if I am missing anything. Reiterating, I am able to access "Account" object using jitterbit and same credentials. Am I missing anything or "logstash-input-salesforce" is a valid plugin? Please guide. ---
**Author:** ![xeraa](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/xeraa/32/48181_2.png) [@xeraa](https://discuss.elastic.co/u/xeraa)\ **Post date:** [October 23, 2020, 1:44pm UTC](https://discuss.elastic.co/t/ingest-data-from-salesforce-to-elasticsearch-using-logstash/252921/4 "2020-10-23T13:44:12Z")
See [https://www.elastic.co/guide/en/logstash/current/running-logstash-command-line.html](https://www.elastic.co/guide/en/logstash/current/running-logstash-command-line.html) for how to enable the log.level debug (as Badger suggested) and please post that output. ---
**Author:** ![SUMANT\_MISHRA](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sumant_mishra/32/77606_2.png) [@SUMANT\_MISHRA](https://discuss.elastic.co/u/SUMANT_MISHRA)\ **Post date:** [October 23, 2020, 6:00pm UTC](https://discuss.elastic.co/t/ingest-data-from-salesforce-to-elasticsearch-using-logstash/252921/5 "2020-10-23T18:00:07Z")
Hi @xeraa, Thanks for sharing the link. That really helped in setting log.level. @Badger, @xeraa, Please find below the command I ran and the log output in my terminal. I have replaced security details with xxxx. Hope that works. **Terminal Command:** bin/logstash -f /Volumes/Macintosh\ HD2/RnDAndLearning/ElasticStack/logstash/salesforce/logst.conf --log.level debug **Output:** [https://bxblobstoragedev.blob.core.windows.net/log/debug.txt](https://bxblobstoragedev.blob.core.windows.net/log/debug.txt) There is a character limit here. So, uploaded to a public folder. Thanks ---
**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\ **Post date:** [October 23, 2020, 6:56pm UTC](https://discuss.elastic.co/t/ingest-data-from-salesforce-to-elasticsearch-using-logstash/252921/6 "2020-10-23T18:56:57Z")
[2020-10-23T23:16:43,881][ERROR][logstash.javapipeline][main] Pipeline error {:pipeline\_id=\>"main", :exception=\>#\403, :headers=\>{...}, :body=\>[{"message"=\>"The REST API is not enabled for this Organization.", "errorCode"=\>"API\_DISABLED\_FOR\_ORG"}] That is the error you are getting. ---
**Author:** ![SUMANT\_MISHRA](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sumant_mishra/32/77606_2.png) [@SUMANT\_MISHRA](https://discuss.elastic.co/u/SUMANT_MISHRA)\ **Post date:** [October 23, 2020, 7:45pm UTC](https://discuss.elastic.co/t/ingest-data-from-salesforce-to-elasticsearch-using-logstash/252921/7 "2020-10-23T19:45:12Z")
@Badger, Thank you very much! This is really a valuable input. With developer account, now it works fine. API is disabled with free account. For testing purposes, need to create a developer account. API is an 'add on' feature for Professional Edition. You will not be able to enable that during your trial. If you want to experiment with Connected Apps, you can sign up for a free Developer Edition at [developerforce.com](http://developerforce.com) ([https://developer.salesforce.com](https://developer.salesforce.com/)). This will be an Enterprise Edition org (with small data allowance). > **[Help | Training | Salesforce](https://help.salesforce.com/articleView?id=000327326&type=1&mode=1)** > **[API is not enabled for this Organization or Partner - Answers - Salesforce...](https://trailblazers.salesforce.com/answers?id=90630000000hxbhAAA)** Thanks @xeraa for helping in setting debug which eventually solved the problem 🙂 ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [November 20, 2020, 7:45pm UTC](https://discuss.elastic.co/t/ingest-data-from-salesforce-to-elasticsearch-using-logstash/252921/8 "2020-11-20T19:45:14Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.