# Oracle Data to ES using Logstash

**URL:** <https://discuss.elastic.co/t/oracle-data-to-es-using-logstash/352900>\
**Category:** Logstash\
**Tags:** painless\
**Created:** [February 9, 2024, 12:30am UTC](https://discuss.elastic.co/t/oracle-data-to-es-using-logstash/352900 "2024-02-09T00:30:54Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![elkeng](https://avatars.discourse-cdn.com/v4/letter/e/58f4c7/32.png) [@elkeng](https://discuss.elastic.co/u/elkeng)\
**Post date:** [February 9, 2024, 12:30am UTC](https://discuss.elastic.co/t/oracle-data-to-es-using-logstash/352900/1 "2024-02-09T00:30:54Z")

</div>

Hello everyone,

I am trying to ingest Oracle data to ES using Logstash. But I got some errors in different conditions.  
Is there a procedure or best practice to do this?

Thanks

---

<div class="post-metadata">

**Author:** ![Rios](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rios/32/95745_2.png) [@Rios](https://discuss.elastic.co/u/Rios)\
**Post date:** [February 9, 2024, 12:39am UTC](https://discuss.elastic.co/t/oracle-data-to-es-using-logstash/352900/2 "2024-02-09T00:39:57Z")

</div>

Welcome to the community!

Can you explain what kind of errors do you have?  
Please copy:

- error
- .conf
- event data, at least a sample

---

<div class="post-metadata">

**Author:** ![elkeng](https://avatars.discourse-cdn.com/v4/letter/e/58f4c7/32.png) [@elkeng](https://discuss.elastic.co/u/elkeng)\
**Post date:** [February 9, 2024, 12:52am UTC](https://discuss.elastic.co/t/oracle-data-to-es-using-logstash/352900/3 "2024-02-09T00:52:55Z")

</div>

Conf File  
...  
input {  
jdbc {  
jdbc\_driver\_library =\> "/usr/share/java/ojdbc8.jar"  
jdbc\_driver\_class =\> "Java::oracle.jdbc.driver.OracleDriver"  
jdbc\_connection\_string =\> "jdbc:oracle:thin:@xx.xx.xx.xx:1521/db"  
jdbc\_user =\> "user"  
jdbc\_password =\> "password"  
jdbc\_paging\_enabled =\> true  
tracking\_column =\> "timestamp"  
use\_column\_value =\> true  
tracking\_column\_type =\> "numeric"  
schedule =\> "\*/5 \* \* \* \* \*"  
statement =\> "SELECT \* from table"  
}  
}  
output {  
Elasticsearch {  
hosts =\> ["[https://yy.yy.yy.yy:9200](https://yy.yy.yy.yy:9200)"]  
index =\> "test01"  
user =\> "elastic"  
password =\> "qwerty"  
document\_id =\> "%{id}"  
SSL =\> true  
cacert =\> "/etc/elasticsearch/certs/http\_ca.crt"  
}  
stdout { codec =\> "rubydebug"}  
}

...

Error  
...  
[ERROR][logstash.outputs.elasticsearch][main][3c86d10b3884197b72b9f1d472ddb8113c95053bce9c42dec049000aa78c151a] An unknown error occurred sending a bulk request to Elasticsearch (will retry indefinitely) {:message=\>""\xE8" from ASCII-8BIT to UTF-8", :exception=\>LogStash::Json::GeneratorError, :backtrace=\>["/usr/share/logstash/logstash-core/lib/logstash/json.rb:41:in `jruby_dump'", "/usr/share/logstash/vendor/bundle/jruby/3.1.0/gems/logstash-output-elasticsearch-11.22.2-java/lib/logstash/outputs/elasticsearch/http_client.rb:132:in `block in bulk'", "org/jruby/RubyArray.java:2813:in `map'", "/usr/share/logstash/vendor/bundle/jruby/3.1.0/gems/logstash-output-elasticsearch-11.22.2-java/lib/logstash/outputs/elasticsearch/http_client.rb:132:in `block in bulk'", "org/jruby/RubyArray.java:1989:in `each'", "org/jruby/RubyEnumerable.java:1229:in `each\_with\_index'", "/usr/share/logstash/vendor/bundle/jruby/3.1.0/gems/logstash-output-elasticsearch-11.22.2-java/lib/logstash/outputs/elasticsearch/http\_client.rb:130:in `bulk'", "/usr/share/logstash/vendor/bundle/jruby/3.1.0/gems/logstash-output-elasticsearch-11.22.2-java/lib/logstash/plugin_mixins/elasticsearch/common.rb:380:in `safe\_bulk'", "/usr/share/logstash/vendor/bundle/jruby/3.1.0/gems/logstash-output-elasticsearch-11.22.2-java/lib/logstash/plugin\_mixins/elasticsearch/common.rb:252:in `submit'", "/usr/share/logstash/vendor/bundle/jruby/3.1.0/gems/logstash-output-elasticsearch-11.22.2-java/lib/logstash/plugin_mixins/elasticsearch/common.rb:197:in `retrying\_submit'", "/usr/share/logstash/vendor/bundle/jruby/3.1.0/gems/logstash-output-elasticsearch-11.22.2-java/lib/logstash/outputs/elasticsearch.rb:397:in `multi_receive'", "org/logstash/config/ir/compiler/AbstractOutputDelegatorExt.java:121:in `multi\_receive'", "/usr/share/logstash/logstash-core/lib/logstash/java\_pipeline.rb:304:in `block in start\_workers'"]}

...

It is just a data table containing personal info.

---

<div class="post-metadata">

**Author:** ![Rios](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rios/32/95745_2.png) [@Rios](https://discuss.elastic.co/u/Rios)\
**Post date:** [February 9, 2024, 7:38am UTC](https://discuss.elastic.co/t/oracle-data-to-es-using-logstash/352900/4 "2024-02-09T07:38:16Z")

</div>

> [@elkeng](#):
>
> An unknown error occurred sending a bulk request to Elasticsearch (will retry indefinitely) {:message=\>""\xE8" from ASCII-8BIT to UTF-8",

Yes it's simple, however you have different encoding.

Check [this](https://stackoverflow.com/questions/59314971/logstash-input-jdbc-how-to-use-utf-8-chars-in-statement). Also just try will work without setting `document_id => "%{id}"`

---

<div class="post-metadata">

**Author:** ![elkeng](https://avatars.discourse-cdn.com/v4/letter/e/58f4c7/32.png) [@elkeng](https://discuss.elastic.co/u/elkeng)\
**Post date:** [February 12, 2024, 2:19pm UTC](https://discuss.elastic.co/t/oracle-data-to-es-using-logstash/352900/5 "2024-02-12T14:19:25Z")

</div>

Unfortunately, it doesn't work.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 11, 2024, 2:19pm UTC](https://discuss.elastic.co/t/oracle-data-to-es-using-logstash/352900/6 "2024-03-11T14:19:29Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
