# Transforms weird situation

**URL:** <https://discuss.elastic.co/t/transforms-weird-situation/237224>\
**Category:** Elasticsearch\
**Created:** [June 16, 2020, 6:12am UTC](https://discuss.elastic.co/t/transforms-weird-situation/237224 "2020-06-16T06:12:20Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![fadjar340](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/fadjar340/32/43610_2.png) [@fadjar340](https://discuss.elastic.co/u/fadjar340)\
**Post date:** [June 16, 2020, 6:12am UTC](https://discuss.elastic.co/t/transforms-weird-situation/237224/1 "2020-06-16T06:12:20Z")

</div>

Hi experts,

I have several transforms for pivot, this is the situation that make me confused:

1. The transform works as expected
2. The Documents Processes and documents indexed increased as expected with around 500 documents per sec
3. the weird thing is when I checked in discovery of the target index, the count didn't increased as the rate of the documents indexed.

Any information about this situation?  
Please brief me what happened in the transforms feature...

ELK stack 7.6.2, BTW

Regards,  
Fadjar Tandabawana

---

<div class="post-metadata">

**Author:** ![Hendrik\_Muhs](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/hendrik_muhs/32/25802_2.png) [@Hendrik\_Muhs](https://discuss.elastic.co/u/Hendrik_Muhs)\
**Post date:** [June 16, 2020, 6:42am UTC](https://discuss.elastic.co/t/transforms-weird-situation/237224/2 "2020-06-16T06:42:56Z")

</div>

Hi,

without further, more detailed information this is hard to answer. Can you post your transform configuration and some example data. Are you using a continuous transform or batch?

In case of a continuous transform, transform updates(overwrites) existing documents. This might explain that transform stats reports increasing documents indexed, while at the same time the document count is not increasing.

I can give a better answer once I have more details.

---

<div class="post-metadata">

**Author:** ![fadjar340](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/fadjar340/32/43610_2.png) [@fadjar340](https://discuss.elastic.co/u/fadjar340)\
**Post date:** [June 16, 2020, 7:28am UTC](https://discuss.elastic.co/t/transforms-weird-situation/237224/3 "2020-06-16T07:28:07Z")

</div>

I got the situation, I use continues transform, so, its expected behavior since the transforms overwrites the existing document.

Thank you for the explanation...

---

<div class="post-metadata">

**Author:** ![Hendrik\_Muhs](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/hendrik_muhs/32/25802_2.png) [@Hendrik\_Muhs](https://discuss.elastic.co/u/Hendrik_Muhs)\
**Post date:** [June 16, 2020, 7:40am UTC](https://discuss.elastic.co/t/transforms-weird-situation/237224/4 "2020-06-16T07:40:42Z")

</div>

Thanks for the feedback.

Note that in case you use `date_histogram` as `group_by` in your transform, its advised to upgrade to 7.7, it reduces the load significantly.

---

<div class="post-metadata">

**Author:** ![fadjar340](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/fadjar340/32/43610_2.png) [@fadjar340](https://discuss.elastic.co/u/fadjar340)\
**Post date:** [June 16, 2020, 7:43am UTC](https://discuss.elastic.co/t/transforms-weird-situation/237224/5 "2020-06-16T07:43:43Z")

</div>

I know, in other cluster I use 7.7.x and it's significant result, but I have little bit issue using 7.7, because in heartbeat index, the 7.6 use [rtt.us](http://rtt.us) as result of ICMP rtt, but in 7.7, it use [icmp.rtt.us](http://icmp.rtt.us) for the same function. It will break the dashboard, BTW...  
And also break the SLA that already settled, if you have any solution for this, I'm happy to know.

Regards,  
Fadjar Tandabawana

---

<div class="post-metadata">

**Author:** ![Hendrik\_Muhs](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/hendrik_muhs/32/25802_2.png) [@Hendrik\_Muhs](https://discuss.elastic.co/u/Hendrik_Muhs)\
**Post date:** [June 16, 2020, 8:03am UTC](https://discuss.elastic.co/t/transforms-weird-situation/237224/6 "2020-06-16T08:03:20Z")

</div>

Sorry I can't answer that question, I recommend to open a new topic under beats, if you haven't already.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 14, 2020, 8:08am UTC](https://discuss.elastic.co/t/transforms-weird-situation/237224/7 "2020-07-14T08:08:23Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
