Is there a way to bulk upload without logstash - tried elasticsearch-py and stuck


Is there a way to bulk upload without logstash e.g. lets say it would be impossible for me to setup a logstash server but had ability to run a AWS Lambda to push to ES Hosted Elasticsearch?

I am trying following but completely stuck:

from elasticsearch import Elasticsearch
from elasticsearch import helpers
import json
from datetime import datetime
import cx_Oracle

con = cx_Oracle.connect('user/password@host/service')
print con.version

sql = "select field1, field2 from table_a where  os.datetimestamp_created >= sysdate - interval '10' minute"

cur = con.cursor()
columns = [column[0] for column in cur.description]

print columns
results = []

for row in cur.fetchall():

print results

es = Elasticsearch(


Appreciate help, i'm stuck. Can Lambda be used? If not why not? What alternatives do i have?


yes it is possible. You might want to take a look at this blog post and the tools used in there


This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.