Python -> ElasticSearch Data Stream.. i'm doing something wrong.. suggestions

i'm trying to write a pretty basic python script to bulk insert some ip blacklists into an elasticsearch data stream.

this is my code, its basic for now:

    def bulkESSubmit(self):
            es = Elasticsearch(['http://<HOST>:9200'], http_auth=('<user>', '<password>'), timeout=100, max_retries=2, retry_on_timeout=True)
            actions = []

            for item in tqdm(self.BadIP_Dict):
                tempDict = {
                    '_index': indexName,
                    '_op_type': "create",
                    '_source': {
                        'ipaddress': item,
                        'sources': list(set(self.BadIP_Dict[item])),
                        'tags' : list(set(commonTags)),
                count += 1
            helpers.bulk(es, actions)

i've got the ILM set up, i've got the index template set up.. when i try to insert i get this error:
"'reason': 'only write ops with an op_type of create are allowed in data streams'"

i've looked for examples online.. i've found a few:

but nothing seems to work.. what am i missing?
any suggestions would be greatly appreciated

Do you get an error if you don't declare the _op_type (and let it default to index)?

that doesnt work either.. I tried that too.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.