My cluster is 1 shard / 1 replica and the size is about 600Mo/1gb when I index 20 files
I tried to upgrade the number of shards and replicas to 4/4 and the time for indexing 20 json files with bulk insert .NET is reduce to the half.
I advanced in my test :
I used json decode in filebeat and it works. Now, I can see my data (Name,Unit,Value,geo and Time) but I also see all another logs fields that I don't want in my mapping.
Also, The geo data is not recognize as geo point type. Is there something to add in config ?
I tried to do my own template but it seems that filebeat don't take it. btw: the bulk with filebeat :
20 json files with total lines around 5 millions takes 19 minutes !! IS it normal ? for me, it seems very very slow..
Same files with bulk insert in c# is about 3/4 minutes.
