# Response truncated in GenAI playground

**URL:** <https://discuss.elastic.co/t/response-truncated-in-genai-playground/373914>\
**Category:** Elastic Search\
**Created:** [January 30, 2025, 9:57pm UTC](https://discuss.elastic.co/t/response-truncated-in-genai-playground/373914 "2025-01-30T21:57:45Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![loren](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/loren/32/44942_2.png) [@loren](https://discuss.elastic.co/u/loren)\
**Post date:** [January 30, 2025, 9:57pm UTC](https://discuss.elastic.co/t/response-truncated-in-genai-playground/373914/1 "2025-01-30T21:57:45Z")

</div>

I'm trying out the Playground tech preview with ELSER and Gemini 1.5 Pro on my GCP-based Elastic Cloud cluster. This is so powerful and _almost_ idiot proof to set up. I understand it's not officially supported, but I'm close to getting a decent demo and wonder if I could get some pointers getting it across the line.

1. The generated response is often truncated midway through the Summary and without any Citations. I'm only getting about 800-1000 characters. What governs this and how can I increase it?
2. I often get "Unterminated string in JSON at position 1175" as the response. Any idea what causes this or how to work around it?

---

<div class="post-metadata">

**Author:** ![joemcelroy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/joemcelroy/32/103757_2.png) [@joemcelroy](https://discuss.elastic.co/u/joemcelroy)\
**Post date:** [January 31, 2025, 9:16am UTC](https://discuss.elastic.co/t/response-truncated-in-genai-playground/373914/2 "2025-01-31T09:16:36Z")

</div>

Hi there, glad you're getting good results with it.

1. Would it be possible to try out a different model (for example OpenAi's) just to double check that the issues are with the model vs playground itself. We will also check our side on Gemini.
2. We re-write the question based on the conversation for better RAG retrieval and gemini may struggle with this task. Claude and Openai likely give better results here

---

<div class="post-metadata">

**Author:** ![loren](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/loren/32/44942_2.png) [@loren](https://discuss.elastic.co/u/loren)\
**Post date:** [January 31, 2025, 3:59pm UTC](https://discuss.elastic.co/t/response-truncated-in-genai-playground/373914/3 "2025-01-31T15:59:03Z")

</div>

Hmmm, I'm not sure I can try a different model. I'm restricted to using GCP-based Elastic Cloud deployments, and inside of that I only appear to have Gemini 1.5 Pro or Flash as options.  
My hunch is that the issue isn't with Playground, as sometimes (1 in 10) I will get an un-truncated response with both a Summary and Citations section.

Perhaps Gemini 2.0 will help here, if that's in the offing for Playground. If you'd like someone to alpha test it with real-world data, I would be thrilled to help. 😉

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 28, 2025, 3:59pm UTC](https://discuss.elastic.co/t/response-truncated-in-genai-playground/373914/4 "2025-02-28T15:59:57Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
