I connected elastic ai assistant to my local llm. when I active streaming control in ai assistant settings, this error is shown: Error: Response from LLM API is empty or undefined.
I check the request which is sent to llm, it does not contain "stream" field.
the kibana version is: 8.14.3
Could you try with 8.16.0? I think there's now a OpenAI compatible service which might the one to use.
I have not permit to install any other versions of kibana. I should use 8.14.3. do you think this is a bug in this version?
I don't know. I'd always try the latest version to check if the problem can be reproduced in a more recent version.
Specifically on the AI domain. Things are moving super fast in this area.
Could you share how you created the connection? Which license level do you have?
Also check this in case it helps: AI Assistant | Elastic Security Solution [8.16] | Elastic