Oracle to Elasticsearch

Marian_Valero · December 18, 2014, 6:07pm

I want to migrate from oracle to elasticsearch data for analize that. I
have using logstash to read a csv file but when input this data I have much
logs that I have inserting, for example I have 100000 lines and this has
inserting 150000 lines of logs. How can I fix that? This is my
logstash.conf:

input {
file {
path => "/home/mogangi/logstash-1.4.2/bin/eso.csv"
type => "responselog"
start_position => "beginning"
}
}
filter {
csv {
columns => ["ID", "DELIVERYID", "MSGID", "RSPDATE", "RAWRESPONSE",
"PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER", "CLEANTEXT"]
separator => ","
}
}
output {
elasticsearch {
action => "index"
host => "localhost"
index => "logstash-%{+YYYY.MM.dd}"
workers => 1
}
# stdout {
# codec => rubydebug
# }
}

Other questions is, how can I connect logstash to oracle in real time, no
local? without to use JDBC river.

Thanks

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

warkolm · December 19, 2014, 7:52am

Can you elaborate on where you are seeing the extra 50k of entries? ie how
did you get this count.

There is currently no O/JDBC connector plugins for logstash so you need to
use a river.
You may also want to ask further Logstash questions at
https://groups.google.com/forum/?hl=en-GB#!forum/logstash-users

On 18 December 2014 at 19:07, Marian Valero marianv0992@gmail.com wrote:

I want to migrate from oracle to elasticsearch data for analize that. I
have using logstash to read a csv file but when input this data I have much
logs that I have inserting, for example I have 100000 lines and this has
inserting 150000 lines of logs. How can I fix that? This is my
logstash.conf:

input {
file {
path => "/home/mogangi/logstash-1.4.2/bin/eso.csv"
type => "responselog"
start_position => "beginning"
}
}
filter {
csv {
columns => ["ID", "DELIVERYID", "MSGID", "RSPDATE", "RAWRESPONSE",
"PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER", "CLEANTEXT"]
separator => ","
}
}
output {
elasticsearch {
action => "index"
host => "localhost"
index => "logstash-%{+YYYY.MM.dd}"
workers => 1
}
# stdout {
# codec => rubydebug
# }
}

Other questions is, how can I connect logstash to oracle in real time, no
local? without to use JDBC river.

Thanks

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_sTFYd8xJFQjkyAom1moP4Vaa3%2BnZxX%3DO-aducH2mRcw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

jprante · December 19, 2014, 9:38am

With JDBC plugin, you can realize scenarios comparable to this one

http://tebros.com/2011/09/keep-mongodb-and-oracle-in-sync-using-streams-advanced-queuing/

so I am not sure why do do not want JDBC plugin?

Do you need a documentation?

Jörg

On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero marianv0992@gmail.com
wrote:

I want to migrate from oracle to elasticsearch data for analize that. I
have using logstash to read a csv file but when input this data I have much
logs that I have inserting, for example I have 100000 lines and this has
inserting 150000 lines of logs. How can I fix that? This is my
logstash.conf:

input {
file {
path => "/home/mogangi/logstash-1.4.2/bin/eso.csv"
type => "responselog"
start_position => "beginning"
}
}
filter {
csv {
columns => ["ID", "DELIVERYID", "MSGID", "RSPDATE", "RAWRESPONSE",
"PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER", "CLEANTEXT"]
separator => ","
}
}
output {
elasticsearch {
action => "index"
host => "localhost"
index => "logstash-%{+YYYY.MM.dd}"
workers => 1
}
# stdout {
# codec => rubydebug
# }
}

Other questions is, how can I connect logstash to oracle in real time, no
local? without to use JDBC river.

Thanks

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHY6CMuqWEwCg705koK-JgX1x-i2VK%2Byzs7SQTJYDBZKw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Marian_Valero · December 19, 2014, 1:28pm

They tell me that JDBC don't support

El viernes, 19 de diciembre de 2014 05:08:27 UTC-4:30, Jörg Prante escribió:

With JDBC plugin, you can realize scenarios comparable to this one

Keep MongoDB and Oracle in sync using Streams Advanced Queuing

so I am not sure why do do not want JDBC plugin?

Do you need a documentation?

Jörg

On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero <maria...@gmail.com
<javascript:>> wrote:

I want to migrate from oracle to elasticsearch data for analize that. I
have using logstash to read a csv file but when input this data I have much
logs that I have inserting, for example I have 100000 lines and this has
inserting 150000 lines of logs. How can I fix that? This is my
logstash.conf:

input {
file {
path => "/home/mogangi/logstash-1.4.2/bin/eso.csv"
type => "responselog"
start_position => "beginning"
}
}
filter {
csv {
columns => ["ID", "DELIVERYID", "MSGID", "RSPDATE",
"RAWRESPONSE", "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER",
"CLEANTEXT"]
separator => ","
}
}
output {
elasticsearch {
action => "index"
host => "localhost"
index => "logstash-%{+YYYY.MM.dd}"
workers => 1
}
# stdout {
# codec => rubydebug
# }
}

Other questions is, how can I connect logstash to oracle in real time, no
local? without to use JDBC river.

Thanks

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

jprante · December 19, 2014, 1:51pm

If you can be more specific, I might try to help as best as I can.

Oracle offers Oracle RDBMS and Oracle also offers JDBC so all Oracle RDBMS
provide JDBC support.

Jörg

On Fri, Dec 19, 2014 at 2:28 PM, Marian Valero marianv0992@gmail.com
wrote:

They tell me that JDBC don't support

El viernes, 19 de diciembre de 2014 05:08:27 UTC-4:30, Jörg Prante
escribió:

With JDBC plugin, you can realize scenarios comparable to this one

http://tebros.com/2011/09/keep-mongodb-and-oracle-in-
sync-using-streams-advanced-queuing/

so I am not sure why do do not want JDBC plugin?

Do you need a documentation?

Jörg

On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero maria...@gmail.com
wrote:

I want to migrate from oracle to elasticsearch data for analize that. I
have using logstash to read a csv file but when input this data I have much
logs that I have inserting, for example I have 100000 lines and this has
inserting 150000 lines of logs. How can I fix that? This is my
logstash.conf:

input {
file {
path => "/home/mogangi/logstash-1.4.2/bin/eso.csv"
type => "responselog"
start_position => "beginning"
}
}
filter {
csv {
columns => ["ID", "DELIVERYID", "MSGID", "RSPDATE",
"RAWRESPONSE", "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER",
"CLEANTEXT"]
separator => ","
}
}
output {
elasticsearch {
action => "index"
host => "localhost"
index => "logstash-%{+YYYY.MM.dd}"
workers => 1
}
# stdout {
# codec => rubydebug
# }
}

Other questions is, how can I connect logstash to oracle in real time,
no local? without to use JDBC river.

Thanks

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Marian_Valero · December 19, 2014, 1:54pm

ES and Logstash support tell me that at this time, they do not have an
input for Logstash that accepts SQL from Oracle. they also do not recommend
use of the existing JDBC river as we don't support it.

2014-12-19 9:21 GMT-04:30 joergprante@gmail.com joergprante@gmail.com:

If you can be more specific, I might try to help as best as I can.

Oracle offers Oracle RDBMS and Oracle also offers JDBC so all Oracle RDBMS
provide JDBC support.

Jörg

On Fri, Dec 19, 2014 at 2:28 PM, Marian Valero marianv0992@gmail.com
wrote:

They tell me that JDBC don't support

El viernes, 19 de diciembre de 2014 05:08:27 UTC-4:30, Jörg Prante
escribió:

With JDBC plugin, you can realize scenarios comparable to this one

http://tebros.com/2011/09/keep-mongodb-and-oracle-in-
sync-using-streams-advanced-queuing/

so I am not sure why do do not want JDBC plugin?

Do you need a documentation?

Jörg

On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero maria...@gmail.com
wrote:

I want to migrate from oracle to elasticsearch data for analize that. I
have using logstash to read a csv file but when input this data I have much
logs that I have inserting, for example I have 100000 lines and this has
inserting 150000 lines of logs. How can I fix that? This is my
logstash.conf:

input {
file {
path => "/home/mogangi/logstash-1.4.2/bin/eso.csv"
type => "responselog"
start_position => "beginning"
}
}
filter {
csv {
columns => ["ID", "DELIVERYID", "MSGID", "RSPDATE",
"RAWRESPONSE", "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER",
"CLEANTEXT"]
separator => ","
}
}
output {
elasticsearch {
action => "index"
host => "localhost"
index => "logstash-%{+YYYY.MM.dd}"
workers => 1
}
# stdout {
# codec => rubydebug
# }
}

Other questions is, how can I connect logstash to oracle in real time,
no local? without to use JDBC river.

Thanks

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/14C3mxsYQtA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

jprante · December 19, 2014, 1:58pm

So you avoid all community supported plugins?

As a side note, I wrote JDBC plugin for ES a few years ago so I can load my
Oracle production data to ES.

Jörg

On Fri, Dec 19, 2014 at 2:54 PM, Marian Valero marianv0992@gmail.com
wrote:

ES and Logstash support tell me that at this time, they do not have an
input for Logstash that accepts SQL from Oracle. they also do not recommend
use of the existing JDBC river as we don't support it.

2014-12-19 9:21 GMT-04:30 joergprante@gmail.com joergprante@gmail.com:

If you can be more specific, I might try to help as best as I can.

Oracle offers Oracle RDBMS and Oracle also offers JDBC so all Oracle
RDBMS provide JDBC support.

Jörg

On Fri, Dec 19, 2014 at 2:28 PM, Marian Valero marianv0992@gmail.com
wrote:

They tell me that JDBC don't support

El viernes, 19 de diciembre de 2014 05:08:27 UTC-4:30, Jörg Prante
escribió:

With JDBC plugin, you can realize scenarios comparable to this one

http://tebros.com/2011/09/keep-mongodb-and-oracle-in-
sync-using-streams-advanced-queuing/

so I am not sure why do do not want JDBC plugin?

Do you need a documentation?

Jörg

On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero maria...@gmail.com
wrote:

I want to migrate from oracle to elasticsearch data for analize that.
I have using logstash to read a csv file but when input this data I have
much logs that I have inserting, for example I have 100000 lines and this
has inserting 150000 lines of logs. How can I fix that? This is my
logstash.conf:

input {
file {
path => "/home/mogangi/logstash-1.4.2/bin/eso.csv"
type => "responselog"
start_position => "beginning"
}
}
filter {
csv {
columns => ["ID", "DELIVERYID", "MSGID", "RSPDATE",
"RAWRESPONSE", "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER",
"CLEANTEXT"]
separator => ","
}
}
output {
elasticsearch {
action => "index"
host => "localhost"
index => "logstash-%{+YYYY.MM.dd}"
workers => 1
}
# stdout {
# codec => rubydebug
# }
}

Other questions is, how can I connect logstash to oracle in real time,
no local? without to use JDBC river.

Thanks

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/14C3mxsYQtA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoG7G4uJy1EyftRFNigKUfSLi2jNvgarpnAkxzvTKOgZNw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Marian_Valero · December 19, 2014, 2:08pm

Yes I know, only that they tell me and my questions was for know what
recomended us to me, but this is not reason for I don't use JDBC, also I
want to know how can I do that. I have been an example of this like explain
here: GitHub - jprante/elasticsearch-jdbc: JDBC importer for Elasticsearch but I don't know
how to use that very well. So if you can help me I appreciate this. Thanks.

El viernes, 19 de diciembre de 2014 09:28:41 UTC-4:30, Jörg Prante escribió:

So you avoid all community supported plugins?

As a side note, I wrote JDBC plugin for ES a few years ago so I can load
my Oracle production data to ES.

Jörg

On Fri, Dec 19, 2014 at 2:54 PM, Marian Valero <maria...@gmail.com
<javascript:>> wrote:

ES and Logstash support tell me that at this time, they do not have an
input for Logstash that accepts SQL from Oracle. they also do not recommend
use of the existing JDBC river as we don't support it.

2014-12-19 9:21 GMT-04:30 joerg...@gmail.com <javascript:> <
joerg...@gmail.com <javascript:>>:

If you can be more specific, I might try to help as best as I can.

Oracle offers Oracle RDBMS and Oracle also offers JDBC so all Oracle
RDBMS provide JDBC support.

Jörg

On Fri, Dec 19, 2014 at 2:28 PM, Marian Valero <maria...@gmail.com
<javascript:>> wrote:

They tell me that JDBC don't support

El viernes, 19 de diciembre de 2014 05:08:27 UTC-4:30, Jörg Prante
escribió:

With JDBC plugin, you can realize scenarios comparable to this one

http://tebros.com/2011/09/keep-mongodb-and-oracle-in-
sync-using-streams-advanced-queuing/

so I am not sure why do do not want JDBC plugin?

Do you need a documentation?

Jörg

On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero maria...@gmail.com
wrote:

I want to migrate from oracle to elasticsearch data for analize that.
I have using logstash to read a csv file but when input this data I have
much logs that I have inserting, for example I have 100000 lines and this
has inserting 150000 lines of logs. How can I fix that? This is my
logstash.conf:

input {
file {
path => "/home/mogangi/logstash-1.4.2/bin/eso.csv"
type => "responselog"
start_position => "beginning"
}
}
filter {
csv {
columns => ["ID", "DELIVERYID", "MSGID", "RSPDATE",
"RAWRESPONSE", "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER",
"CLEANTEXT"]
separator => ","
}
}
output {
elasticsearch {
action => "index"
host => "localhost"
index => "logstash-%{+YYYY.MM.dd}"
workers => 1
}
# stdout {
# codec => rubydebug
# }
}

Other questions is, how can I connect logstash to oracle in real
time, no local? without to use JDBC river.

Thanks

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/14C3mxsYQtA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/15080092-e9c8-4cdb-9732-84c3954fc3cf%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

jprante · December 19, 2014, 2:24pm

If you can give me a few calm days over the holidays, I will try to rewrite
the Mongo DB example recipe with Oracle triggers to Elasticsearch with JDBC
plugin.

Jörg

On Fri, Dec 19, 2014 at 3:08 PM, Marian Valero marianv0992@gmail.com
wrote:

Yes I know, only that they tell me and my questions was for know what
recomended us to me, but this is not reason for I don't use JDBC, also I
want to know how can I do that. I have been an example of this like explain
here: GitHub - jprante/elasticsearch-jdbc: JDBC importer for Elasticsearch but I don't
know how to use that very well. So if you can help me I appreciate this.
Thanks.

El viernes, 19 de diciembre de 2014 09:28:41 UTC-4:30, Jörg Prante
escribió:

So you avoid all community supported plugins?

As a side note, I wrote JDBC plugin for ES a few years ago so I can load
my Oracle production data to ES.

Jörg

On Fri, Dec 19, 2014 at 2:54 PM, Marian Valero maria...@gmail.com
wrote:

ES and Logstash support tell me that at this time, they do not have an
input for Logstash that accepts SQL from Oracle. they also do not recommend
use of the existing JDBC river as we don't support it.

2014-12-19 9:21 GMT-04:30 joerg...@gmail.com joerg...@gmail.com:

If you can be more specific, I might try to help as best as I can.

Oracle offers Oracle RDBMS and Oracle also offers JDBC so all Oracle
RDBMS provide JDBC support.

Jörg

On Fri, Dec 19, 2014 at 2:28 PM, Marian Valero maria...@gmail.com
wrote:

They tell me that JDBC don't support

El viernes, 19 de diciembre de 2014 05:08:27 UTC-4:30, Jörg Prante
escribió:

With JDBC plugin, you can realize scenarios comparable to this one

http://tebros.com/2011/09/keep-mongodb-and-oracle-in-sync-
using-streams-advanced-queuing/

so I am not sure why do do not want JDBC plugin?

Do you need a documentation?

Jörg

On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero maria...@gmail.com
wrote:

I want to migrate from oracle to elasticsearch data for analize
that. I have using logstash to read a csv file but when input this data I
have much logs that I have inserting, for example I have 100000 lines and
this has inserting 150000 lines of logs. How can I fix that? This is my
logstash.conf:

input {
file {
path => "/home/mogangi/logstash-1.4.2/bin/eso.csv"
type => "responselog"
start_position => "beginning"
}
}
filter {
csv {
columns => ["ID", "DELIVERYID", "MSGID", "RSPDATE",
"RAWRESPONSE", "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER",
"CLEANTEXT"]
separator => ","
}
}
output {
elasticsearch {
action => "index"
host => "localhost"
index => "logstash-%{+YYYY.MM.dd}"
workers => 1
}
# stdout {
# codec => rubydebug
# }
}

Other questions is, how can I connect logstash to oracle in real
time, no local? without to use JDBC river.

Thanks

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/0963bc61-83f
e-4ae7-8dec-adfc3430c16b%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/elasticsearch/14C3mxsYQtA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-
RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6Rr
uTLaazYHV2WrOa%2Bg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/15080092-e9c8-4cdb-9732-84c3954fc3cf%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/15080092-e9c8-4cdb-9732-84c3954fc3cf%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGEQ2jDZvq_6kELxEjFy9v%3DABQPXD6iMU-5F5o6cJFHAQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Marian_Valero · December 19, 2014, 2:30pm

Yesss sure, thank you so much and merry christmas

2014-12-19 9:54 GMT-04:30 joergprante@gmail.com joergprante@gmail.com:

If you can give me a few calm days over the holidays, I will try to
rewrite the Mongo DB example recipe with Oracle triggers to Elasticsearch
with JDBC plugin.

Jörg

On Fri, Dec 19, 2014 at 3:08 PM, Marian Valero marianv0992@gmail.com
wrote:

Yes I know, only that they tell me and my questions was for know what
recomended us to me, but this is not reason for I don't use JDBC, also I
want to know how can I do that. I have been an example of this like explain
here: GitHub - jprante/elasticsearch-jdbc: JDBC importer for Elasticsearch but I don't
know how to use that very well. So if you can help me I appreciate this.
Thanks.

El viernes, 19 de diciembre de 2014 09:28:41 UTC-4:30, Jörg Prante
escribió:

So you avoid all community supported plugins?

As a side note, I wrote JDBC plugin for ES a few years ago so I can load
my Oracle production data to ES.

Jörg

On Fri, Dec 19, 2014 at 2:54 PM, Marian Valero maria...@gmail.com
wrote:

ES and Logstash support tell me that at this time, they do not have an
input for Logstash that accepts SQL from Oracle. they also do not recommend
use of the existing JDBC river as we don't support it.

2014-12-19 9:21 GMT-04:30 joerg...@gmail.com joerg...@gmail.com:

If you can be more specific, I might try to help as best as I can.

Oracle offers Oracle RDBMS and Oracle also offers JDBC so all Oracle
RDBMS provide JDBC support.

Jörg

On Fri, Dec 19, 2014 at 2:28 PM, Marian Valero maria...@gmail.com
wrote:

They tell me that JDBC don't support

El viernes, 19 de diciembre de 2014 05:08:27 UTC-4:30, Jörg Prante
escribió:

With JDBC plugin, you can realize scenarios comparable to this one

http://tebros.com/2011/09/keep-mongodb-and-oracle-in-sync-
using-streams-advanced-queuing/

so I am not sure why do do not want JDBC plugin?

Do you need a documentation?

Jörg

On Thu, Dec 18, 2014 at 7:07 PM, Marian Valero maria...@gmail.com
wrote:

I want to migrate from oracle to elasticsearch data for analize
that. I have using logstash to read a csv file but when input this data I
have much logs that I have inserting, for example I have 100000 lines and
this has inserting 150000 lines of logs. How can I fix that? This is my
logstash.conf:

input {
file {
path => "/home/mogangi/logstash-1.4.2/bin/eso.csv"
type => "responselog"
start_position => "beginning"
}
}
filter {
csv {
columns => ["ID", "DELIVERYID", "MSGID", "RSPDATE",
"RAWRESPONSE", "PARSEDRESPONSE", "SHORTCODE", "INSID", "MOBILENUMBER",
"CLEANTEXT"]
separator => ","
}
}
output {
elasticsearch {
action => "index"
host => "localhost"
index => "logstash-%{+YYYY.MM.dd}"
workers => 1
}
# stdout {
# codec => rubydebug
# }
}

Other questions is, how can I connect logstash to oracle in real
time, no local? without to use JDBC river.

Thanks

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/0963bc61-83f
e-4ae7-8dec-adfc3430c16b%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/0963bc61-83fe-4ae7-8dec-adfc3430c16b%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/e9d5bd5f-b922-4a3d-a63b-7519e6aa8fbc%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/elasticsearch/14C3mxsYQtA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-
RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEnCx27Gq%3Dray-RzTb8J2O2mXsEX9gnze4zsjM1jbnbwA%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6Rr
uTLaazYHV2WrOa%2Bg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DY3au76pkDxtdvi81Uax88PNUu6RruTLaazYHV2WrOa%2Bg%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/15080092-e9c8-4cdb-9732-84c3954fc3cf%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/15080092-e9c8-4cdb-9732-84c3954fc3cf%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/14C3mxsYQtA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGEQ2jDZvq_6kELxEjFy9v%3DABQPXD6iMU-5F5o6cJFHAQ%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGEQ2jDZvq_6kELxEjFy9v%3DABQPXD6iMU-5F5o6cJFHAQ%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CADT%2BR%3DYD-UVRuec959T2dzzV-Ns1uH1x3r9aEe0ZRH8akKVR7Q%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Topic		Replies	Views
How to migrate data from db oracle to ES use Logstash? Elasticsearch	2	424	October 25, 2021
Oracle Data to ES using Logstash Logstash painless	5	250	March 11, 2024
Tune logstash JDBC input for huge datasets Logstash	5	946	May 16, 2023
How to Put Elasticsearch data to Oracle Table Logstash	8	992	October 29, 2020
Trying to get the data from oracle database through logstash but data is not coming to elasticsearch Logstash	10	2197	February 25, 2020

Oracle to Elasticsearch

Related topics