# Generative AI asstiant

**URL:** <https://discuss.elastic.co/t/generative-ai-asstiant/368507>\
**Category:** Elastic Security\
**Created:** [October 9, 2024, 9:09am UTC](https://discuss.elastic.co/t/generative-ai-asstiant/368507 "2024-10-09T09:09:36Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![arcsons](https://avatars.discourse-cdn.com/v4/letter/a/5fc32e/32.png) [@arcsons](https://discuss.elastic.co/u/arcsons)\
**Post date:** [October 9, 2024, 9:09am UTC](https://discuss.elastic.co/t/generative-ai-asstiant/368507/1 "2024-10-09T09:09:36Z")

</div>

Hi,

I'm planning to test the AI Assistant in my lab, where I'm running Elastic Security with a trial license. I have two basic questions about it:

1. The documentation states: "You need an account with a third-party generative AI provider, which AI Assistant uses to generate responses. Supported providers are OpenAI, Azure OpenAI Service, and Amazon Bedrock." Do I need a paid subscription like ChatGPT-4, or is a free account sufficient? If a free account is enough, which provider is most popular among Elastic users?

2. I see there's mention of a local LLM. Does this mean you download it from Hugging Face? If so, which model is recommended?

Thank for your support.

---

<div class="post-metadata">

**Author:** ![remich](https://avatars.discourse-cdn.com/v4/letter/r/c89c15/32.png) [@remich](https://discuss.elastic.co/u/remich)\
**Post date:** [October 9, 2024, 9:25am UTC](https://discuss.elastic.co/t/generative-ai-asstiant/368507/2 "2024-10-09T09:25:35Z")

</div>

Hi,

Looks like you can [Connect to your own local LLM | Elastic Security Solution [8.15] | Elastic](https://www.elastic.co/guide/en/security/current/connect-to-byo-llm.html)

However if you choose chatGPT I dont think there is a free plan for api, but I might be wrong

---

<div class="post-metadata">

**Author:** ![Andrew\_G](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrew_g/32/49178_2.png) [@Andrew\_G](https://discuss.elastic.co/u/Andrew_G)\
**Post date:** [October 9, 2024, 1:40pm UTC](https://discuss.elastic.co/t/generative-ai-asstiant/368507/3 "2024-10-09T13:40:07Z")

</div>

Hi @arcsons!

> [@arcsons](#):
>
> The documentation states: "You need an account with a third-party generative AI provider, which AI Assistant uses to generate responses. Supported providers are OpenAI, Azure OpenAI Service, and Amazon Bedrock." Do I need a paid subscription like ChatGPT-4, or is a free account sufficient? If a free account is enough, which provider is most popular among Elastic users?

The supported (hosted) providers require payment for API access. OpenAI offers a "[Pay as you go](https://platform.openai.com/settings/organization/billing/overview)" option as an alternative to a subscription. At the time of this writing, it's possible to make a one time payment, with a minimum of $5.

Note: It may take a few minutes for pay as you go credits to apply to your account, which means your API key might fail until they are applied.

> [@arcsons](#):
>
> I see there's mention of a local LLM. Does this mean you download it from Hugging Face? If so, which model is recommended?

We have more documentation on connecting to a locall LLM [here](https://www.elastic.co/guide/en/security/current/connect-to-byo-llm.html).

At this time we don't recommend a particular model, but we do provide guidance in the [Large language model performance matrix](https://www.elastic.co/guide/en/security/current/llm-performance-matrix.html). That said, since you're just getting started, consider trying the assistant with one of the hosted models first if that's an option for you.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 6, 2024, 1:40pm UTC](https://discuss.elastic.co/t/generative-ai-asstiant/368507/4 "2024-11-06T13:40:20Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
