We are trying to upload packet captures files (tshark -r capture.pcap -T ek > packets.json) , randomly data are getting missed to upload while using BULK upload to elastic
curl -s -H "Content-Type: application/x-ndjson" -XPOST "localhost:9200/_bulk" --data-binary "@packets.json”
There are 25,000 data entries totaly in that JSON, on upload we see only around 24445 data
No errors are displayed while uploading to elastic, Request for help, on how we can resolve this issue?
How are you processing this packets.json into the supported BULK format? Are you manually generating an ID for each document? If so, maybe there are repeated IDs?
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
© 2020. All Rights Reserved - Elasticsearch
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.