I am trying to implement a vector index using ELSER2. The data source is SharePoint Online and I have used the Elasticsearch SharePoint Online connector to ingest data into the index with DLS enabled.
I followed this blog from Elastic => Federated SharePoint searches with Azure OpenAI Service On your data - Elasticsearch Labs to create the vector index.
Now, how can I add token size based chunking using the Elastic pipelines? I want to chunk the incoming SharePoint document body with token size of 512.