I read the following from the manual. However, i could not seem to find this requirement from apache kafka documentation? We would like to use hostname + source filename to be kafka event key, which is definitely not unique. something like the following:
key: ['beat.hostname', 'source']
Thanks for pointing this out! I think you're right; here is a stackoverflow post with a useful discussion about key uniqueness. If strict ordering of the events is needed, a fixed key may be desirable, but it shouldn't be necessary in general.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.