# Index filter doesn't work on Data Frame Analytics

**URL:** <https://discuss.elastic.co/t/index-filter-doesnt-work-on-data-frame-analytics/301841>\
**Category:** Elasticsearch\
**Tags:** elastic-stack-machine-learning\
**Created:** [April 7, 2022, 8:04am UTC](https://discuss.elastic.co/t/index-filter-doesnt-work-on-data-frame-analytics/301841 "2022-04-07T08:04:19Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![shuiqu](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shuiqu/32/104082_2.png) [@shuiqu](https://discuss.elastic.co/u/shuiqu)\
**Post date:** [April 7, 2022, 8:04am UTC](https://discuss.elastic.co/t/index-filter-doesnt-work-on-data-frame-analytics/301841/1 "2022-04-07T08:04:19Z")

</div>

I am new to elastic.

When I use the machine learning feature I find that Index filter does not seem to work on Data Frame Analytics.

I set the filter AveTicketPrice:500 to 600 on kibana\_sample\_data\_flights and saved this search  
 ![image](https://us1.discourse-cdn.com/elastic/original/3X/0/8/08e8fa9ff7dbf26f7fe2defcbfe5217628eda104.png)

When I try to use this search in Anomaly Detection, the filter works fine.

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/3/c/3cc66e17b05bab9fe2b805dcbf66e2b69fa3597f.png)

But I noticed that when this search was selected in Data Frame Analytics, the filter didn't take effect and the data outside the price range still appeared in the data display.  
 ![image](https://us1.discourse-cdn.com/elastic/original/3X/2/9/290fd5fde6b449b876a5239768c714de4726427f.png)

Is my way of using the filter wrong?

What should I do if I need to use data that meets certain criteria in Data Frame Analytics.

Thanks in advance.

shuiqu

---

<div class="post-metadata">

**Author:** ![richcollier](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/richcollier/32/115035_2.png) [@richcollier](https://discuss.elastic.co/u/richcollier)\
**Post date:** [April 11, 2022, 11:18am UTC](https://discuss.elastic.co/t/index-filter-doesnt-work-on-data-frame-analytics/301841/2 "2022-04-11T11:18:16Z")

</div>

Use the following KQL as your search filter in Kibana Discover:

`AvgTicketPrice >= 500 and AvgTicketPrice <= 600`

Save the search and use that as your basis for your Data Frame Analytics job

---

<div class="post-metadata">

**Author:** ![shuiqu](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shuiqu/32/104082_2.png) [@shuiqu](https://discuss.elastic.co/u/shuiqu)\
**Post date:** [April 12, 2022, 1:54am UTC](https://discuss.elastic.co/t/index-filter-doesnt-work-on-data-frame-analytics/301841/3 "2022-04-12T01:54:08Z")

</div>

Thank you very much for your help.

It's working.

I would like to know: In Data Frame Analytics, is it only possible to use filters by KQL?

---

<div class="post-metadata">

**Author:** ![richcollier](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/richcollier/32/115035_2.png) [@richcollier](https://discuss.elastic.co/u/richcollier)\
**Post date:** [April 12, 2022, 11:23am UTC](https://discuss.elastic.co/t/index-filter-doesnt-work-on-data-frame-analytics/301841/4 "2022-04-12T11:23:02Z")

</div>

You can also use the standard Elasticsearch DSL (if you configure it via the API). Using the UI, however, limits you to using KQL.

---

<div class="post-metadata">

**Author:** ![Melissa\_Alvarez](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/melissa_alvarez/32/48327_2.png) [@Melissa\_Alvarez](https://discuss.elastic.co/u/Melissa_Alvarez)\
**Post date:** [April 12, 2022, 6:42pm UTC](https://discuss.elastic.co/t/index-filter-doesnt-work-on-data-frame-analytics/301841/5 "2022-04-12T18:42:57Z")

</div>

I've created an issue to add support for this in Data Frame Analytics. Thanks!

---

<div class="post-metadata">

**Author:** ![shuiqu](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shuiqu/32/104082_2.png) [@shuiqu](https://discuss.elastic.co/u/shuiqu)\
**Post date:** [April 13, 2022, 2:19am UTC](https://discuss.elastic.co/t/index-filter-doesnt-work-on-data-frame-analytics/301841/6 "2022-04-13T02:19:20Z")

</div>

Thank you very much for helping me.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 11, 2022, 2:19am UTC](https://discuss.elastic.co/t/index-filter-doesnt-work-on-data-frame-analytics/301841/7 "2022-05-11T02:19:36Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
