# Oracle to Elasticsearch **URL:** \ **Category:** Elasticsearch\ **Created:** [December 18, 2014, 6:07pm UTC](https://discuss.elastic.co/t/oracle-to-elasticsearch/21319 "2014-12-18T18:07:16Z")\ **Posts on this page:** 11\ **Page:** 1
**Author:** ![Marian\_Valero](https://avatars.discourse-cdn.com/v4/letter/m/b9e5f3/32.png) [@Marian\_Valero](https://discuss.elastic.co/u/Marian_Valero)\ **Post date:** [December 18, 2014, 6:07pm UTC](https://discuss.elastic.co/t/oracle-to-elasticsearch/21319/1 "2014-12-18T18:07:16Z")
I want to migrate from oracle to elasticsearch data for analize that. I have using logstash to read a csv file but when input this data I have much logs that I have inserting, for example I have 100000 lines and this has inserting 150000 lines of logs. How can I fix that? This is my logstash.conf: input { file { path =\> "/home/mogangi/logstash-1.4.2/bin/eso.csv" type =\> "responselog" start\_position =\> "beginning" } } filter { csv { columns =\> ["ID", "DELIVERYID", "MSGID", "RSPDATE", "RAWRESPONSE", "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER", "CLEANTEXT"] separator =\> "," } } output { elasticsearch { action =\> "index" host =\> "localhost" index =\> "logstash-%{+YYYY.MM.dd}" workers =\> 1 } # stdout { # codec =\> rubydebug # } } Other questions is, how can I connect logstash to oracle in real time, no local? without to use JDBC river. Thanks -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [December 19, 2014, 7:52am UTC](https://discuss.elastic.co/t/oracle-to-elasticsearch/21319/2 "2014-12-19T07:52:08Z")
Can you elaborate on where you are seeing the extra 50k of entries? ie how did you get this count. There is currently no O/JDBC connector plugins for logstash so you need to use a river. You may also want to ask further Logstash questions at [https://groups.google.com/forum/?hl=en-GB#!forum/logstash-users](https://groups.google.com/forum/?hl=en-GB#!forum/logstash-users) On 18 December 2014 at 19:07, Marian Valero [marianv0992@gmail.com](mailto:marianv0992@gmail.com) wrote: > I want to migrate from oracle to elasticsearch data for analize that. I > have using logstash to read a csv file but when input this data I have much > logs that I have inserting, for example I have 100000 lines and this has > inserting 150000 lines of logs. How can I fix that? This is my > logstash.conf: > > input { > file { > path =\> "/home/mogangi/logstash-1.4.2/bin/eso.csv" > type =\> "responselog" > start\_position =\> "beginning" > } > } > filter { > csv { > columns =\> ["ID", "DELIVERYID", "MSGID", "RSPDATE", "RAWRESPONSE", > "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER", "CLEANTEXT"] > separator =\> "," > } > } > output { > elasticsearch { > action =\> "index" > host =\> "localhost" > index =\> "logstash-%{+YYYY.MM.dd}" > workers =\> 1 > } > # stdout { > # codec =\> rubydebug > # } > } > > Other questions is, how can I connect logstash to oracle in real time, no > local? without to use JDBC river. > > Thanks > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_sTFYd8xJFQjkyAom1moP4Vaa3%2BnZxX%3DO-aducH2mRcw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_sTFYd8xJFQjkyAom1moP4Vaa3%2BnZxX%3DO-aducH2mRcw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\ **Post date:** [December 19, 2014, 9:38am UTC](https://discuss.elastic.co/t/oracle-to-elasticsearch/21319/3 "2014-12-19T09:38:19Z")
With JDBC plugin, you can realize scenarios comparable to this one [http://tebros.com/2011/09/keep-mongodb-and-oracle-in-sync-using-streams-advanced-queuing/](http://tebros.com/2011/09/keep-mongodb-and-oracle-in-sync-using-streams-advanced-queuing/) so I am not sure why do do not want JDBC plugin? Do you need a documentation? Jörg On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero [marianv0992@gmail.com](mailto:marianv0992@gmail.com) wrote: > I want to migrate from oracle to elasticsearch data for analize that. I > have using logstash to read a csv file but when input this data I have much > logs that I have inserting, for example I have 100000 lines and this has > inserting 150000 lines of logs. How can I fix that? This is my > logstash.conf: > > input { > file { > path =\> "/home/mogangi/logstash-1.4.2/bin/eso.csv" > type =\> "responselog" > start\_position =\> "beginning" > } > } > filter { > csv { > columns =\> ["ID", "DELIVERYID", "MSGID", "RSPDATE", "RAWRESPONSE", > "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER", "CLEANTEXT"] > separator =\> "," > } > } > output { > elasticsearch { > action =\> "index" > host =\> "localhost" > index =\> "logstash-%{+YYYY.MM.dd}" > workers =\> 1 > } > # stdout { > # codec =\> rubydebug > # } > } > > Other questions is, how can I connect logstash to oracle in real time, no > local? without to use JDBC river. > > Thanks > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHY6CMuqWEwCg705koK-JgX1x-i2VK%2Byzs7SQTJYDBZKw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHY6CMuqWEwCg705koK-JgX1x-i2VK%2Byzs7SQTJYDBZKw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Marian\_Valero](https://avatars.discourse-cdn.com/v4/letter/m/b9e5f3/32.png) [@Marian\_Valero](https://discuss.elastic.co/u/Marian_Valero)\ **Post date:** [December 19, 2014, 1:28pm UTC](https://discuss.elastic.co/t/oracle-to-elasticsearch/21319/4 "2014-12-19T13:28:12Z")
They tell me that JDBC don't support El viernes, 19 de diciembre de 2014 05:08:27 UTC-4:30, Jörg Prante escribió: > With JDBC plugin, you can realize scenarios comparable to this one > > [Keep MongoDB and Oracle in sync using Streams Advanced Queuing](http://tebros.com/2011/09/keep-mongodb-and-oracle-in-sync-using-streams-advanced-queuing/) > > so I am not sure why do do not want JDBC plugin? > > Do you need a documentation? > > Jörg > > On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero \<[maria...@gmail.com](mailto:maria...@gmail.com) > \\> wrote: > > > I want to migrate from oracle to elasticsearch data for analize that. I > > have using logstash to read a csv file but when input this data I have much > > logs that I have inserting, for example I have 100000 lines and this has > > inserting 150000 lines of logs. How can I fix that? This is my > > logstash.conf: > > > > input { > > file { > > path =\> "/home/mogangi/logstash-1.4.2/bin/eso.csv" > > type =\> "responselog" > > start\_position =\> "beginning" > > } > > } > > filter { > > csv { > > columns =\> ["ID", "DELIVERYID", "MSGID", "RSPDATE", > > "RAWRESPONSE", "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER", > > "CLEANTEXT"] > > separator =\> "," > > } > > } > > output { > > elasticsearch { > > action =\> "index" > > host =\> "localhost" > > index =\> "logstash-%{+YYYY.MM.dd}" > > workers =\> 1 > > } > > # stdout { > > # codec =\> rubydebug > > # } > > } > > > > Other questions is, how can I connect logstash to oracle in real time, no > > local? without to use JDBC river. > > > > Thanks > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\ **Post date:** [December 19, 2014, 1:51pm UTC](https://discuss.elastic.co/t/oracle-to-elasticsearch/21319/5 "2014-12-19T13:51:17Z")
If you can be more specific, I might try to help as best as I can. Oracle offers Oracle RDBMS and Oracle also offers JDBC so all Oracle RDBMS provide JDBC support. Jörg On Fri, Dec 19, 2014 at 2:28 PM, Marian Valero [marianv0992@gmail.com](mailto:marianv0992@gmail.com) wrote: > They tell me that JDBC don't support > > El viernes, 19 de diciembre de 2014 05:08:27 UTC-4:30, Jörg Prante > escribió: > > > With JDBC plugin, you can realize scenarios comparable to this one > > > > [http://tebros.com/2011/09/keep-mongodb-and-oracle-in-](http://tebros.com/2011/09/keep-mongodb-and-oracle-in-) > > sync-using-streams-advanced-queuing/ > > > > so I am not sure why do do not want JDBC plugin? > > > > Do you need a documentation? > > > > Jörg > > > > On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero [maria...@gmail.com](mailto:maria...@gmail.com) > > wrote: > > > > > I want to migrate from oracle to elasticsearch data for analize that. I > > > have using logstash to read a csv file but when input this data I have much > > > logs that I have inserting, for example I have 100000 lines and this has > > > inserting 150000 lines of logs. How can I fix that? This is my > > > logstash.conf: > > > > > > input { > > > file { > > > path =\> "/home/mogangi/logstash-1.4.2/bin/eso.csv" > > > type =\> "responselog" > > > start\_position =\> "beginning" > > > } > > > } > > > filter { > > > csv { > > > columns =\> ["ID", "DELIVERYID", "MSGID", "RSPDATE", > > > "RAWRESPONSE", "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER", > > > "CLEANTEXT"] > > > separator =\> "," > > > } > > > } > > > output { > > > elasticsearch { > > > action =\> "index" > > > host =\> "localhost" > > > index =\> "logstash-%{+YYYY.MM.dd}" > > > workers =\> 1 > > > } > > > # stdout { > > > # codec =\> rubydebug > > > # } > > > } > > > > > > Other questions is, how can I connect logstash to oracle in real time, > > > no local? without to use JDBC river. > > > > > > Thanks > > > > > > -- > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b% > > > [40googlegroups.com](http://40googlegroups.com) > > > [https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Marian\_Valero](https://avatars.discourse-cdn.com/v4/letter/m/b9e5f3/32.png) [@Marian\_Valero](https://discuss.elastic.co/u/Marian_Valero)\ **Post date:** [December 19, 2014, 1:54pm UTC](https://discuss.elastic.co/t/oracle-to-elasticsearch/21319/6 "2014-12-19T13:54:36Z")
ES and Logstash support tell me that at this time, they do not have an input for Logstash that accepts SQL from Oracle. they also do not recommend use of the existing JDBC river as we don't support it. 2014-12-19 9:21 GMT-04:30 [joergprante@gmail.com](mailto:joergprante@gmail.com) [joergprante@gmail.com](mailto:joergprante@gmail.com): > If you can be more specific, I might try to help as best as I can. > > Oracle offers Oracle RDBMS and Oracle also offers JDBC so all Oracle RDBMS > provide JDBC support. > > Jörg > > On Fri, Dec 19, 2014 at 2:28 PM, Marian Valero [marianv0992@gmail.com](mailto:marianv0992@gmail.com) > wrote: > > > They tell me that JDBC don't support > > > > El viernes, 19 de diciembre de 2014 05:08:27 UTC-4:30, Jörg Prante > > escribió: > > > > > With JDBC plugin, you can realize scenarios comparable to this one > > > > > > [http://tebros.com/2011/09/keep-mongodb-and-oracle-in-](http://tebros.com/2011/09/keep-mongodb-and-oracle-in-) > > > sync-using-streams-advanced-queuing/ > > > > > > so I am not sure why do do not want JDBC plugin? > > > > > > Do you need a documentation? > > > > > > Jörg > > > > > > On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero [maria...@gmail.com](mailto:maria...@gmail.com) > > > wrote: > > > > > > > I want to migrate from oracle to elasticsearch data for analize that. I > > > > have using logstash to read a csv file but when input this data I have much > > > > logs that I have inserting, for example I have 100000 lines and this has > > > > inserting 150000 lines of logs. How can I fix that? This is my > > > > logstash.conf: > > > > > > > > input { > > > > file { > > > > path =\> "/home/mogangi/logstash-1.4.2/bin/eso.csv" > > > > type =\> "responselog" > > > > start\_position =\> "beginning" > > > > } > > > > } > > > > filter { > > > > csv { > > > > columns =\> ["ID", "DELIVERYID", "MSGID", "RSPDATE", > > > > "RAWRESPONSE", "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER", > > > > "CLEANTEXT"] > > > > separator =\> "," > > > > } > > > > } > > > > output { > > > > elasticsearch { > > > > action =\> "index" > > > > host =\> "localhost" > > > > index =\> "logstash-%{+YYYY.MM.dd}" > > > > workers =\> 1 > > > > } > > > > # stdout { > > > > # codec =\> rubydebug > > > > # } > > > > } > > > > > > > > Other questions is, how can I connect logstash to oracle in real time, > > > > no local? without to use JDBC river. > > > > > > > > Thanks > > > > > > > > -- > > > > You received this message because you are subscribed to the Google > > > > Groups "elasticsearch" group. > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b% > > > > [40googlegroups.com](http://40googlegroups.com) > > > > [https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > . > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > -- > > > You received this message because you are subscribed to the Google Groups > > > "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send an > > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com) > > > [https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > [https://groups.google.com/d/topic/elasticsearch/14C3mxsYQtA/unsubscribe](https://groups.google.com/d/topic/elasticsearch/14C3mxsYQtA/unsubscribe). > To unsubscribe from this group and all its topics, send an email to > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com) > [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com?utm_medium=email&utm_source=footer) > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\ **Post date:** [December 19, 2014, 1:58pm UTC](https://discuss.elastic.co/t/oracle-to-elasticsearch/21319/7 "2014-12-19T13:58:34Z")
So you avoid all community supported plugins? As a side note, I wrote JDBC plugin for ES a few years ago so I can load my Oracle production data to ES. Jörg On Fri, Dec 19, 2014 at 2:54 PM, Marian Valero [marianv0992@gmail.com](mailto:marianv0992@gmail.com) wrote: > ES and Logstash support tell me that at this time, they do not have an > input for Logstash that accepts SQL from Oracle. they also do not recommend > use of the existing JDBC river as we don't support it. > > 2014-12-19 9:21 GMT-04:30 [joergprante@gmail.com](mailto:joergprante@gmail.com) [joergprante@gmail.com](mailto:joergprante@gmail.com): > > > If you can be more specific, I might try to help as best as I can. > > > > Oracle offers Oracle RDBMS and Oracle also offers JDBC so all Oracle > > RDBMS provide JDBC support. > > > > Jörg > > > > On Fri, Dec 19, 2014 at 2:28 PM, Marian Valero [marianv0992@gmail.com](mailto:marianv0992@gmail.com) > > wrote: > > > > > They tell me that JDBC don't support > > > > > > El viernes, 19 de diciembre de 2014 05:08:27 UTC-4:30, Jörg Prante > > > escribió: > > > > > > > With JDBC plugin, you can realize scenarios comparable to this one > > > > > > > > [http://tebros.com/2011/09/keep-mongodb-and-oracle-in-](http://tebros.com/2011/09/keep-mongodb-and-oracle-in-) > > > > sync-using-streams-advanced-queuing/ > > > > > > > > so I am not sure why do do not want JDBC plugin? > > > > > > > > Do you need a documentation? > > > > > > > > Jörg > > > > > > > > On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero [maria...@gmail.com](mailto:maria...@gmail.com) > > > > wrote: > > > > > > > > > I want to migrate from oracle to elasticsearch data for analize that. > > > > > I have using logstash to read a csv file but when input this data I have > > > > > much logs that I have inserting, for example I have 100000 lines and this > > > > > has inserting 150000 lines of logs. How can I fix that? This is my > > > > > logstash.conf: > > > > > > > > > > input { > > > > > file { > > > > > path =\> "/home/mogangi/logstash-1.4.2/bin/eso.csv" > > > > > type =\> "responselog" > > > > > start\_position =\> "beginning" > > > > > } > > > > > } > > > > > filter { > > > > > csv { > > > > > columns =\> ["ID", "DELIVERYID", "MSGID", "RSPDATE", > > > > > "RAWRESPONSE", "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER", > > > > > "CLEANTEXT"] > > > > > separator =\> "," > > > > > } > > > > > } > > > > > output { > > > > > elasticsearch { > > > > > action =\> "index" > > > > > host =\> "localhost" > > > > > index =\> "logstash-%{+YYYY.MM.dd}" > > > > > workers =\> 1 > > > > > } > > > > > # stdout { > > > > > # codec =\> rubydebug > > > > > # } > > > > > } > > > > > > > > > > Other questions is, how can I connect logstash to oracle in real time, > > > > > no local? without to use JDBC river. > > > > > > > > > > Thanks > > > > > > > > > > -- > > > > > You received this message because you are subscribed to the Google > > > > > Groups "elasticsearch" group. > > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > > msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b% > > > > > [40googlegroups.com](http://40googlegroups.com) > > > > > [https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > . > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > -- > > > > You received this message because you are subscribed to the Google > > > > Groups "elasticsearch" group. > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > > > To view this discussion on the web visit > > > > [https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com) > > > > [https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > . > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > -- > > You received this message because you are subscribed to a topic in the > > Google Groups "elasticsearch" group. > > To unsubscribe from this topic, visit > > [https://groups.google.com/d/topic/elasticsearch/14C3mxsYQtA/unsubscribe](https://groups.google.com/d/topic/elasticsearch/14C3mxsYQtA/unsubscribe). > > To unsubscribe from this group and all its topics, send an email to > > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com) > > [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com?utm_medium=email&utm_source=footer) > > . > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com) > [https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com?utm_medium=email&utm_source=footer) > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoG7G4uJy1EyftRFNigKUfSLi2jNvgarpnAkxzvTKOgZNw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoG7G4uJy1EyftRFNigKUfSLi2jNvgarpnAkxzvTKOgZNw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Marian\_Valero](https://avatars.discourse-cdn.com/v4/letter/m/b9e5f3/32.png) [@Marian\_Valero](https://discuss.elastic.co/u/Marian_Valero)\ **Post date:** [December 19, 2014, 2:08pm UTC](https://discuss.elastic.co/t/oracle-to-elasticsearch/21319/8 "2014-12-19T14:08:46Z")
Yes I know, only that they tell me and my questions was for know what recomended us to me, but this is not reason for I don't use JDBC, also I want to know how can I do that. I have been an example of this like explain here: [GitHub - jprante/elasticsearch-jdbc: JDBC importer for Elasticsearch](https://github.com/jprante/elasticsearch-river-jdbc) but I don't know how to use that very well. So if you can help me I appreciate this. Thanks. El viernes, 19 de diciembre de 2014 09:28:41 UTC-4:30, Jörg Prante escribió: > So you avoid all community supported plugins? > > As a side note, I wrote JDBC plugin for ES a few years ago so I can load > my Oracle production data to ES. > > Jörg > > On Fri, Dec 19, 2014 at 2:54 PM, Marian Valero \<[maria...@gmail.com](mailto:maria...@gmail.com) > \\> wrote: > > > ES and Logstash support tell me that at this time, they do not have an > > input for Logstash that accepts SQL from Oracle. they also do not recommend > > use of the existing JDBC river as we don't support it. > > > > 2014-12-19 9:21 GMT-04:30 [joerg...@gmail.com](mailto:joerg...@gmail.com) \ \< > > [joerg...@gmail.com](mailto:joerg...@gmail.com) \\>: > > > > > If you can be more specific, I might try to help as best as I can. > > > > > > Oracle offers Oracle RDBMS and Oracle also offers JDBC so all Oracle > > > RDBMS provide JDBC support. > > > > > > Jörg > > > > > > On Fri, Dec 19, 2014 at 2:28 PM, Marian Valero \<[maria...@gmail.com](mailto:maria...@gmail.com) > > > \\> wrote: > > > > > > > They tell me that JDBC don't support > > > > > > > > El viernes, 19 de diciembre de 2014 05:08:27 UTC-4:30, Jörg Prante > > > > escribió: > > > > > > > > > With JDBC plugin, you can realize scenarios comparable to this one > > > > > > > > > > [http://tebros.com/2011/09/keep-mongodb-and-oracle-in-](http://tebros.com/2011/09/keep-mongodb-and-oracle-in-) > > > > > sync-using-streams-advanced-queuing/ > > > > > > > > > > so I am not sure why do do not want JDBC plugin? > > > > > > > > > > Do you need a documentation? > > > > > > > > > > Jörg > > > > > > > > > > On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero [maria...@gmail.com](mailto:maria...@gmail.com) > > > > > wrote: > > > > > > > > > > > I want to migrate from oracle to elasticsearch data for analize that. > > > > > > I have using logstash to read a csv file but when input this data I have > > > > > > much logs that I have inserting, for example I have 100000 lines and this > > > > > > has inserting 150000 lines of logs. How can I fix that? This is my > > > > > > logstash.conf: > > > > > > > > > > > > input { > > > > > > file { > > > > > > path =\> "/home/mogangi/logstash-1.4.2/bin/eso.csv" > > > > > > type =\> "responselog" > > > > > > start\_position =\> "beginning" > > > > > > } > > > > > > } > > > > > > filter { > > > > > > csv { > > > > > > columns =\> ["ID", "DELIVERYID", "MSGID", "RSPDATE", > > > > > > "RAWRESPONSE", "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER", > > > > > > "CLEANTEXT"] > > > > > > separator =\> "," > > > > > > } > > > > > > } > > > > > > output { > > > > > > elasticsearch { > > > > > > action =\> "index" > > > > > > host =\> "localhost" > > > > > > index =\> "logstash-%{+YYYY.MM.dd}" > > > > > > workers =\> 1 > > > > > > } > > > > > > # stdout { > > > > > > # codec =\> rubydebug > > > > > > # } > > > > > > } > > > > > > > > > > > > Other questions is, how can I connect logstash to oracle in real > > > > > > time, no local? without to use JDBC river. > > > > > > > > > > > > Thanks > > > > > > > > > > > > -- > > > > > > You received this message because you are subscribed to the Google > > > > > > Groups "elasticsearch" group. > > > > > > To unsubscribe from this group and stop receiving emails from it, > > > > > > send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > > > msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b% > > > > > > [40googlegroups.com](http://40googlegroups.com) > > > > > > [https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > > . > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > > > -- > > > > > You received this message because you are subscribed to the Google > > > > > Groups "elasticsearch" group. > > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > > > > To view this discussion on the web visit > > > > > [https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com) > > > > > [https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > . > > > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > -- > > > You received this message because you are subscribed to a topic in the > > > Google Groups "elasticsearch" group. > > > To unsubscribe from this topic, visit > > > [https://groups.google.com/d/topic/elasticsearch/14C3mxsYQtA/unsubscribe](https://groups.google.com/d/topic/elasticsearch/14C3mxsYQtA/unsubscribe). > > > To unsubscribe from this group and all its topics, send an email to > > > [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com) > > > [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com?utm_medium=email&utm_source=footer) > > > . > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com) > > [https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com?utm_medium=email&utm_source=footer) > > . > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/15080092-e9c8-4cdb-9732-84c3954fc3cf%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/15080092-e9c8-4cdb-9732-84c3954fc3cf%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\ **Post date:** [December 19, 2014, 2:24pm UTC](https://discuss.elastic.co/t/oracle-to-elasticsearch/21319/9 "2014-12-19T14:24:44Z")
If you can give me a few calm days over the holidays, I will try to rewrite the Mongo DB example recipe with Oracle triggers to Elasticsearch with JDBC plugin. Jörg On Fri, Dec 19, 2014 at 3:08 PM, Marian Valero [marianv0992@gmail.com](mailto:marianv0992@gmail.com) wrote: > Yes I know, only that they tell me and my questions was for know what > recomended us to me, but this is not reason for I don't use JDBC, also I > want to know how can I do that. I have been an example of this like explain > here: [GitHub - jprante/elasticsearch-jdbc: JDBC importer for Elasticsearch](https://github.com/jprante/elasticsearch-river-jdbc) but I don't > know how to use that very well. So if you can help me I appreciate this. > Thanks. > > El viernes, 19 de diciembre de 2014 09:28:41 UTC-4:30, Jörg Prante > escribió: > > > So you avoid all community supported plugins? > > > > As a side note, I wrote JDBC plugin for ES a few years ago so I can load > > my Oracle production data to ES. > > > > Jörg > > > > On Fri, Dec 19, 2014 at 2:54 PM, Marian Valero [maria...@gmail.com](mailto:maria...@gmail.com) > > wrote: > > > > > ES and Logstash support tell me that at this time, they do not have an > > > input for Logstash that accepts SQL from Oracle. they also do not recommend > > > use of the existing JDBC river as we don't support it. > > > > > > 2014-12-19 9:21 GMT-04:30 [joerg...@gmail.com](mailto:joerg...@gmail.com) [joerg...@gmail.com](mailto:joerg...@gmail.com): > > > > > > > If you can be more specific, I might try to help as best as I can. > > > > > > > > Oracle offers Oracle RDBMS and Oracle also offers JDBC so all Oracle > > > > RDBMS provide JDBC support. > > > > > > > > Jörg > > > > > > > > On Fri, Dec 19, 2014 at 2:28 PM, Marian Valero [maria...@gmail.com](mailto:maria...@gmail.com) > > > > wrote: > > > > > > > > > They tell me that JDBC don't support > > > > > > > > > > El viernes, 19 de diciembre de 2014 05:08:27 UTC-4:30, Jörg Prante > > > > > escribió: > > > > > > > > > > > With JDBC plugin, you can realize scenarios comparable to this one > > > > > > > > > > > > [http://tebros.com/2011/09/keep-mongodb-and-oracle-in-sync-](http://tebros.com/2011/09/keep-mongodb-and-oracle-in-sync-) > > > > > > using-streams-advanced-queuing/ > > > > > > > > > > > > so I am not sure why do do not want JDBC plugin? > > > > > > > > > > > > Do you need a documentation? > > > > > > > > > > > > Jörg > > > > > > > > > > > > On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero [maria...@gmail.com](mailto:maria...@gmail.com) > > > > > > wrote: > > > > > > > > > > > > > I want to migrate from oracle to elasticsearch data for analize > > > > > > > that. I have using logstash to read a csv file but when input this data I > > > > > > > have much logs that I have inserting, for example I have 100000 lines and > > > > > > > this has inserting 150000 lines of logs. How can I fix that? This is my > > > > > > > logstash.conf: > > > > > > > > > > > > > > input { > > > > > > > file { > > > > > > > path =\> "/home/mogangi/logstash-1.4.2/bin/eso.csv" > > > > > > > type =\> "responselog" > > > > > > > start\_position =\> "beginning" > > > > > > > } > > > > > > > } > > > > > > > filter { > > > > > > > csv { > > > > > > > columns =\> ["ID", "DELIVERYID", "MSGID", "RSPDATE", > > > > > > > "RAWRESPONSE", "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER", > > > > > > > "CLEANTEXT"] > > > > > > > separator =\> "," > > > > > > > } > > > > > > > } > > > > > > > output { > > > > > > > elasticsearch { > > > > > > > action =\> "index" > > > > > > > host =\> "localhost" > > > > > > > index =\> "logstash-%{+YYYY.MM.dd}" > > > > > > > workers =\> 1 > > > > > > > } > > > > > > > # stdout { > > > > > > > # codec =\> rubydebug > > > > > > > # } > > > > > > > } > > > > > > > > > > > > > > Other questions is, how can I connect logstash to oracle in real > > > > > > > time, no local? without to use JDBC river. > > > > > > > > > > > > > > Thanks > > > > > > > > > > > > > > -- > > > > > > > You received this message because you are subscribed to the Google > > > > > > > Groups "elasticsearch" group. > > > > > > > To unsubscribe from this group and stop receiving emails from it, > > > > > > > send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > > To view this discussion on the web visit > > > > > > > [https://groups.google.com/d/msgid/elasticsearch/0963bc61-83f](https://groups.google.com/d/msgid/elasticsearch/0963bc61-83f) > > > > > > > e-4ae7-8dec-adfc3430c16b%[40googlegroups.com](http://40googlegroups.com) > > > > > > > [https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > > > . > > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > > > > > -- > > > > > > You received this message because you are subscribed to the Google > > > > > > Groups "elasticsearch" group. > > > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > > > msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc% > > > > > > [40googlegroups.com](http://40googlegroups.com) > > > > > > [https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > > . > > > > > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > -- > > > > You received this message because you are subscribed to a topic in the > > > > Google Groups "elasticsearch" group. > > > > To unsubscribe from this topic, visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > topic/elasticsearch/14C3mxsYQtA/unsubscribe. > > > > To unsubscribe from this group and all its topics, send an email to > > > > [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray- > > > > RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%[40mail.gmail.com](http://40mail.gmail.com) > > > > [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com?utm_medium=email&utm_source=footer) > > > > . > > > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > -- > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6Rr > > > uTLaazYHV2WrOa%2Bg%[40mail.gmail.com](http://40mail.gmail.com) > > > [https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com?utm_medium=email&utm_source=footer) > > > . > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/15080092-e9c8-4cdb-9732-84c3954fc3cf%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/15080092-e9c8-4cdb-9732-84c3954fc3cf%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/15080092-e9c8-4cdb-9732-84c3954fc3cf%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/15080092-e9c8-4cdb-9732-84c3954fc3cf%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGEQ2jDZvq\_6kELxEjFy9v%3DABQPXD6iMU-5F5o6cJFHAQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGEQ2jDZvq_6kELxEjFy9v%3DABQPXD6iMU-5F5o6cJFHAQ%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Marian\_Valero](https://avatars.discourse-cdn.com/v4/letter/m/b9e5f3/32.png) [@Marian\_Valero](https://discuss.elastic.co/u/Marian_Valero)\ **Post date:** [December 19, 2014, 2:30pm UTC](https://discuss.elastic.co/t/oracle-to-elasticsearch/21319/10 "2014-12-19T14:30:06Z")
Yesss sure, thank you so much and merry christmas 2014-12-19 9:54 GMT-04:30 [joergprante@gmail.com](mailto:joergprante@gmail.com) [joergprante@gmail.com](mailto:joergprante@gmail.com): > If you can give me a few calm days over the holidays, I will try to > rewrite the Mongo DB example recipe with Oracle triggers to Elasticsearch > with JDBC plugin. > > Jörg > > On Fri, Dec 19, 2014 at 3:08 PM, Marian Valero [marianv0992@gmail.com](mailto:marianv0992@gmail.com) > wrote: > > > Yes I know, only that they tell me and my questions was for know what > > recomended us to me, but this is not reason for I don't use JDBC, also I > > want to know how can I do that. I have been an example of this like explain > > here: [GitHub - jprante/elasticsearch-jdbc: JDBC importer for Elasticsearch](https://github.com/jprante/elasticsearch-river-jdbc) but I don't > > know how to use that very well. So if you can help me I appreciate this. > > Thanks. > > > > El viernes, 19 de diciembre de 2014 09:28:41 UTC-4:30, Jörg Prante > > escribió: > > > > > So you avoid all community supported plugins? > > > > > > As a side note, I wrote JDBC plugin for ES a few years ago so I can load > > > my Oracle production data to ES. > > > > > > Jörg > > > > > > On Fri, Dec 19, 2014 at 2:54 PM, Marian Valero [maria...@gmail.com](mailto:maria...@gmail.com) > > > wrote: > > > > > > > ES and Logstash support tell me that at this time, they do not have an > > > > input for Logstash that accepts SQL from Oracle. they also do not recommend > > > > use of the existing JDBC river as we don't support it. > > > > > > > > 2014-12-19 9:21 GMT-04:30 [joerg...@gmail.com](mailto:joerg...@gmail.com) [joerg...@gmail.com](mailto:joerg...@gmail.com): > > > > > > > > > If you can be more specific, I might try to help as best as I can. > > > > > > > > > > Oracle offers Oracle RDBMS and Oracle also offers JDBC so all Oracle > > > > > RDBMS provide JDBC support. > > > > > > > > > > Jörg > > > > > > > > > > On Fri, Dec 19, 2014 at 2:28 PM, Marian Valero [maria...@gmail.com](mailto:maria...@gmail.com) > > > > > wrote: > > > > > > > > > > > They tell me that JDBC don't support > > > > > > > > > > > > El viernes, 19 de diciembre de 2014 05:08:27 UTC-4:30, Jörg Prante > > > > > > escribió: > > > > > > > > > > > > > With JDBC plugin, you can realize scenarios comparable to this one > > > > > > > > > > > > > > [http://tebros.com/2011/09/keep-mongodb-and-oracle-in-sync-](http://tebros.com/2011/09/keep-mongodb-and-oracle-in-sync-) > > > > > > > using-streams-advanced-queuing/ > > > > > > > > > > > > > > so I am not sure why do do not want JDBC plugin? > > > > > > > > > > > > > > Do you need a documentation? > > > > > > > > > > > > > > Jörg > > > > > > > > > > > > > > On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero [maria...@gmail.com](mailto:maria...@gmail.com) > > > > > > > wrote: > > > > > > > > > > > > > > > I want to migrate from oracle to elasticsearch data for analize > > > > > > > > that. I have using logstash to read a csv file but when input this data I > > > > > > > > have much logs that I have inserting, for example I have 100000 lines and > > > > > > > > this has inserting 150000 lines of logs. How can I fix that? This is my > > > > > > > > logstash.conf: > > > > > > > > > > > > > > > > input { > > > > > > > > file { > > > > > > > > path =\> "/home/mogangi/logstash-1.4.2/bin/eso.csv" > > > > > > > > type =\> "responselog" > > > > > > > > start\_position =\> "beginning" > > > > > > > > } > > > > > > > > } > > > > > > > > filter { > > > > > > > > csv { > > > > > > > > columns =\> ["ID", "DELIVERYID", "MSGID", "RSPDATE", > > > > > > > > "RAWRESPONSE", "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER", > > > > > > > > "CLEANTEXT"] > > > > > > > > separator =\> "," > > > > > > > > } > > > > > > > > } > > > > > > > > output { > > > > > > > > elasticsearch { > > > > > > > > action =\> "index" > > > > > > > > host =\> "localhost" > > > > > > > > index =\> "logstash-%{+YYYY.MM.dd}" > > > > > > > > workers =\> 1 > > > > > > > > } > > > > > > > > # stdout { > > > > > > > > # codec =\> rubydebug > > > > > > > > # } > > > > > > > > } > > > > > > > > > > > > > > > > Other questions is, how can I connect logstash to oracle in real > > > > > > > > time, no local? without to use JDBC river. > > > > > > > > > > > > > > > > Thanks > > > > > > > > > > > > > > > > -- > > > > > > > > You received this message because you are subscribed to the Google > > > > > > > > Groups "elasticsearch" group. > > > > > > > > To unsubscribe from this group and stop receiving emails from it, > > > > > > > > send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > > > To view this discussion on the web visit > > > > > > > > [https://groups.google.com/d/msgid/elasticsearch/0963bc61-83f](https://groups.google.com/d/msgid/elasticsearch/0963bc61-83f) > > > > > > > > e-4ae7-8dec-adfc3430c16b%[40googlegroups.com](http://40googlegroups.com) > > > > > > > > [https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > > > > . > > > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > > > > > > > -- > > > > > > > You received this message because you are subscribed to the Google > > > > > > > Groups "elasticsearch" group. > > > > > > > To unsubscribe from this group and stop receiving emails from it, > > > > > > > send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > > > > msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc% > > > > > > > [40googlegroups.com](http://40googlegroups.com) > > > > > > > [https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > > > . > > > > > > > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > > > -- > > > > > You received this message because you are subscribed to a topic in the > > > > > Google Groups "elasticsearch" group. > > > > > To unsubscribe from this topic, visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > > topic/elasticsearch/14C3mxsYQtA/unsubscribe. > > > > > To unsubscribe from this group and all its topics, send an email to > > > > > [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > > msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray- > > > > > RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%[40mail.gmail.com](http://40mail.gmail.com) > > > > > [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com?utm_medium=email&utm_source=footer) > > > > > . > > > > > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > -- > > > > You received this message because you are subscribed to the Google > > > > Groups "elasticsearch" group. > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6Rr > > > > uTLaazYHV2WrOa%2Bg%[40mail.gmail.com](http://40mail.gmail.com) > > > > [https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com?utm_medium=email&utm_source=footer) > > > > . > > > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > -- > > > You received this message because you are subscribed to the Google Groups > > > "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send an > > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/15080092-e9c8-4cdb-9732-84c3954fc3cf%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/15080092-e9c8-4cdb-9732-84c3954fc3cf%40googlegroups.com) > > > [https://groups.google.com/d/msgid/elasticsearch/15080092-e9c8-4cdb-9732-84c3954fc3cf%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/15080092-e9c8-4cdb-9732-84c3954fc3cf%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > [https://groups.google.com/d/topic/elasticsearch/14C3mxsYQtA/unsubscribe](https://groups.google.com/d/topic/elasticsearch/14C3mxsYQtA/unsubscribe). > To unsubscribe from this group and all its topics, send an email to > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGEQ2jDZvq\_6kELxEjFy9v%3DABQPXD6iMU-5F5o6cJFHAQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGEQ2jDZvq_6kELxEjFy9v%3DABQPXD6iMU-5F5o6cJFHAQ%40mail.gmail.com) > [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGEQ2jDZvq\_6kELxEjFy9v%3DABQPXD6iMU-5F5o6cJFHAQ%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGEQ2jDZvq_6kELxEjFy9v%3DABQPXD6iMU-5F5o6cJFHAQ%40mail.gmail.com?utm_medium=email&utm_source=footer) > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DYD-UVRuec959T2dzzV-Ns1uH1x3r9aEe0ZRH8akKVR7Q%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DYD-UVRuec959T2dzzV-Ns1uH1x3r9aEe0ZRH8akKVR7Q%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:42am UTC](https://discuss.elastic.co/t/oracle-to-elasticsearch/21319/11 "2017-07-06T00:42:40Z")