# Logstash sqlite plugin can't output in elasticsearch

**URL:** <https://discuss.elastic.co/t/logstash-sqlite-plugin-cant-output-in-elasticsearch/63701>\
**Category:** Logstash\
**Created:** [October 24, 2016, 3:16am UTC](https://discuss.elastic.co/t/logstash-sqlite-plugin-cant-output-in-elasticsearch/63701 "2016-10-24T03:16:28Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![Rem](https://avatars.discourse-cdn.com/v4/letter/r/5fc32e/32.png) [@Rem](https://discuss.elastic.co/u/Rem)\
**Post date:** [October 24, 2016, 3:16am UTC](https://discuss.elastic.co/t/logstash-sqlite-plugin-cant-output-in-elasticsearch/63701/1 "2016-10-24T03:16:28Z")

</div>

Hello,  
I really need to store my logs in a database because I will modify the data so I tried using the sqlite pluging of logstash.

Here's my config file :  
input {  
sqlite {  
path =\> "C:/Users/Library/Documents/logstash-2.4.0/tmp/DB\_withweblogs.db"  
type =\> weblogs  
}  
}

output {  
elasticsearch {  
hosts =\> ["localhost:9200"]  
index =\> "test-{+YYYY.MM.dd}"  
}  
stdout {}  
}

Here's the error who is cause by the output to elasticsearch :

e[33mCannot serialize instance of: Sequel::JDBC::Database {:class=\>"JrJackson::ParseError", :backtrace=\>["com/jrjackson/JrJacksonBase.java:76:in `generate'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/jrjackson-0.3.9-java/lib/jrjackson/jrjackson.rb:60:in`dump'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/multi\_json-1.12.1/lib/multi\_json/adapters/jr\_jackson.rb:20:in `dump'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/multi_json-1.12.1/lib/multi_json/adapter.rb:25:in`dump'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/multi\_json-1.12.1/lib/multi\_json.rb:139:in `dump'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/elasticsearch-api-1.1.0/lib/elasticsearch/api/utils.rb:99:in`\_\_bulkify'", "org/jruby/RubyArray.java:2414:in `map'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/elasticsearch-api-1.1.0/lib/elasticsearch/api/utils.rb:89:in`\_\_bulkify'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/elasticsearch-api-1.1.0/lib/elasticsearch/api/actions/bulk.rb:88:in `bulk'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.7.1-java/lib/logstash/outputs/elasticsearch/http_client.rb:53:in`non\_threadsafe\_bulk'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.7.1-java/lib/logstash/outputs/elasticsearch/http\_client.rb:38:in `bulk'", "org/jruby/ext/thread/Mutex.java:149:in`synchronize'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.7.1-java/lib/logstash/outputs/elasticsearch/http\_client.rb:38:in `bulk'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.7.1-java/lib/logstash/outputs/elasticsearch/common.rb:172:in`safe\_bulk'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.7.1-java/lib/logstash/outputs/elasticsearch/common.rb:101:in `submit'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.7.1-java/lib/logstash/outputs/elasticsearch/common.rb:86:in`retrying\_submit'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.7.1-java/lib/logstash/outputs/elasticsearch/common.rb:29:in `multi_receive'", "org/jruby/RubyArray.java:1653:in`each\_slice'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.7.1-java/lib/logstash/outputs/elasticsearch/common.rb:28:in `multi_receive'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-2.4.0-java/lib/logstash/output_delegator.rb:130:in`worker\_multi\_receive'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-2.4.0-java/lib/logstash/output\_delegator.rb:114:in `multi_receive'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-2.4.0-java/lib/logstash/pipeline.rb:301:in`output\_batch'", "org/jruby/RubyHash.java:1342:in `each'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-2.4.0-java/lib/logstash/pipeline.rb:301:in`output\_batch'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-2.4.0-java/lib/logstash/pipeline.rb:232:in `worker_loop'", "C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-2.4.0-java/lib/logstash/pipeline.rb:201:in`start\_workers'"], :level=\>:warn}e[0m  
e[33mSIGINT received. Shutting down the agent. {:level=\>:warn}e[0m  
stopping pipeline {:id=\>"main"}

how can I take my data in my sqlite database (done) but exporting it in elasticsearch?

Thank you

---

<div class="post-metadata">

**Author:** ![Rem](https://avatars.discourse-cdn.com/v4/letter/r/5fc32e/32.png) [@Rem](https://discuss.elastic.co/u/Rem)\
**Post date:** [October 24, 2016, 4:47am UTC](https://discuss.elastic.co/t/logstash-sqlite-plugin-cant-output-in-elasticsearch/63701/2 "2016-10-24T04:47:31Z")

</div>

I tried to export in a file and then import it in ES after. But I get the same error.

different .conf file :  
input {  
sqlite {  
path =\> "C:/Users/Library/Documents/logstash-2.4.0/tmp/DB\_withweblogs.db"  
type =\> weblogs  
}  
}

output {  
file {  
path =\> "C:/Users/Library/Documents/logstash-2.4.0/test.txt"  
}  
stdout {}  
}

Error :

C:\Users\Library\Documents\logstash-2.4.0\>bin\logstash -f test.conf  
Settings: Default pipeline workers: 1  
Pipeline main started  
LogStash::Json::GeneratorError: Cannot serialize instance of: Sequel::JDBC::Database  
jruby\_dump at C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-2.4.0-java/lib/logstash/json.rb:53  
to\_json at C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-event-2.4.0-java/lib/logstash/event.rb:145  
encode at C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-codec-json\_lines-2.1.3/lib/logstash/codecs/json\_lines.rb:48  
receive at C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-output-file-2.2.5/lib/logstash/outputs/file.rb:129  
multi\_receive at C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-2.4.0-java/lib/logstash/outputs/base.rb:109  
each at org/jruby/RubyArray.java:1613  
multi\_receive at C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-2.4.0-java/lib/logstash/outputs/base.rb:109  
worker\_multi\_receive at C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-2.4.0-java/lib/logstash/output\_delegator.rb:130  
multi\_receive at C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-2.4.0-java/lib/logstash/output\_delegator.rb:114  
output\_batch at C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-2.4.0-java/lib/logstash/pipeline.rb:301  
each at org/jruby/RubyHash.java:1342  
output\_batch at C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-2.4.0-java/lib/logstash/pipeline.rb:301  
worker\_loop at C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-2.4.0-java/lib/logstash/pipeline.rb:232  
start\_workers at C:/Users/Library/Documents/logstash-2.4.0/vendor/bundle/jruby/1.9/gems/logstash-core-2.4.0-java/lib/logstash/pipeline.rb:201

Does anyone know why it does not work in the output?

---

<div class="post-metadata">

**Author:** ![Rem](https://avatars.discourse-cdn.com/v4/letter/r/5fc32e/32.png) [@Rem](https://discuss.elastic.co/u/Rem)\
**Post date:** [October 25, 2016, 1:11am UTC](https://discuss.elastic.co/t/logstash-sqlite-plugin-cant-output-in-elasticsearch/63701/3 "2016-10-25T01:11:55Z")

</div>

Can anyone tell me if they have already used that plugin before and made it work?

---

<div class="post-metadata">

**Author:** ![Rem](https://avatars.discourse-cdn.com/v4/letter/r/5fc32e/32.png) [@Rem](https://discuss.elastic.co/u/Rem)\
**Post date:** [October 25, 2016, 3:43am UTC](https://discuss.elastic.co/t/logstash-sqlite-plugin-cant-output-in-elasticsearch/63701/4 "2016-10-25T03:43:28Z")

</div>

Thanks to this guy :

> <https://github.com/logstash-plugins/logstash-input-sqlite/commit/98498dadf0ef8dd192dc790f80e4911b7dc39048>

(I got the link from this website : [https://github.com/logstash-plugins/logstash-input-sqlite/issues/5](https://github.com/logstash-plugins/logstash-input-sqlite/issues/5))

I found the file in this path :  
C:\Users\Library\Documents\logstash-2.4.0\vendor\bundle\jruby\1.9\gems\logstash-input-sqlite-2.0.4\lib\logstash\inputs

and changed as he said the @db variable for @path on line 160.

Now it works

Here's my .conf file :

input {  
sqlite {  
path =\> "C:/Users/Library/Documents/logstash-2.4.0/tmp/DROIT\_BIBLIO\_withweblogs.db"  
type =\> weblogs  
}  
}

output {  
elasticsearch {  
hosts =\> ["localhost:9200"]  
index =\> "test"  
}  
stdout {}  
}

I have verify with :  
curl -XGET 'localhost:9200/test/\_search?pretty&q=response=200'

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:32am UTC](https://discuss.elastic.co/t/logstash-sqlite-plugin-cant-output-in-elasticsearch/63701/5 "2017-07-06T04:32:58Z")

</div>


