Importing data to Machine Learning

Elastic Stack Kibana
1

Hi,
I'm studying Machine Learning and trying to import sample data to the Elasticsearch witch can be found here Machine-Learning-with-Elastic-Stack-Second-Edition/Chapter12 at main · PacktPublishing/Machine-Learning-with-Elastic-Stack-Second-Edition · GitHub

I can import exactly 8132 rows, but if I add one more row I get an error "File structure cannot be determined". Just above 8000 lines doesn't sound that big. I have checked that data format is ok.

2

Hello @tapiojaa ,

Can you please tell us which Elasticsearch version you are using so we can recreate the issue? 8000 rows is definitely not the limit, so the problem should be elsewhere.

3

We have the latest version 8.15. We are running Elasticsearch on AKS. I wonder if memory configuration could be the reason? We have following memory configuration on each node pools. I don't know which node pool takes care of importing data

          - name: elasticsearch
            env:
              - name: ES_JAVA_OPTS
                value: "-Xms4g -Xmx4g"
            resources:
              limits:
                # cpu: 1
                memory: 6Gi
              requests:
                # cpu: 1
                memory: 2Gi