As the docs mention, index.mapping.ignore_malformed is an index setting, so if the type of the incoming event doesn't match then it'll ignore it.
Now, to figure out what is happening you may want to drop that from the mapping, process a few docs, then check them out.
If this is log data, ie time based, you should use time based indices ![]()
It's a good idea to put that in a different directory.