I am trying to push data from a database to ElasticSearch. The records is in Json format and each records is of about 300 lines. I am trying to push about 1000 records. The ElasticSearch shows only 9-10 records. Is there a Threshold limit to the no of records in ElasticSearch?
Hi @Aditya2,
there are limits, but not in that range. An index is divided into shards and each shard can maximum hold around 2 billion docs (2^31-1).
Elasticsearch will report back errors if there are issues with any of the docs. Are you using the _bulk API or the index API? If using the _bulk API, notice that it will return an outer level 200 OK even if there are errors. It then returns a separate status code per doc in the response, see Bulk API.
Also notice that the _bulk API has special requirements around line breaks.
Can you elaborate a bit on how data are pushed from the database to Elasticsearch?
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.