# Grouping/extracting results uploaded to Elasticsearch **URL:** \ **Category:** Elasticsearch\ **Created:** [April 22, 2015, 1:05pm UTC](https://discuss.elastic.co/t/grouping-extracting-results-uploaded-to-elasticsearch/23361 "2015-04-22T13:05:04Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![KT\_SSP](https://avatars.discourse-cdn.com/v4/letter/k/dfb087/32.png) [@KT\_SSP](https://discuss.elastic.co/u/KT_SSP)\ **Post date:** [April 22, 2015, 1:05pm UTC](https://discuss.elastic.co/t/grouping-extracting-results-uploaded-to-elasticsearch/23361/1 "2015-04-22T13:05:04Z")
Hello We have a build process using ant that is externally monitored (web page) and shows the current goal in a group of goals. The active goal is being uploaded to elasticsearch every 60 seconds and is allowing us to monitor a builds progress. So for three goals (A,B & C) we would see something like " **AAABBBBCCCCCC**" with A taking 3 minutes, B taking 4 and C taking 6. Using this, we are able to manually/visually determine how long each goal is taking. What we would like to be able to do is query and ascertain trends/expected times from this data to, for example, allow us to flag when builds/goals take 20% longer than the average. Is this possible with the current data set or do we need to change what we upload? Appreciate any/all help. _(Note: currently using elasticsearch 1.1.2-1 on CentOS 6)_ -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/6fb77ef6-7a86-4bba-af9b-0c3cadb9ef4a%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/6fb77ef6-7a86-4bba-af9b-0c3cadb9ef4a%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [April 23, 2015, 1:22am UTC](https://discuss.elastic.co/t/grouping-extracting-results-uploaded-to-elasticsearch/23361/2 "2015-04-23T01:22:44Z")
You ideally want to restructure your data and split the fields out. If you can't do it in your code then Logstash would be able to do something. On 22 April 2015 at 23:05, KT SSP [kevin.toyne@ssp-uk.com](mailto:kevin.toyne@ssp-uk.com) wrote: > Hello > > We have a build process using ant that is externally monitored (web page) > and shows the current goal in a group of goals. The active goal is being > uploaded to elasticsearch every 60 seconds and is allowing us to monitor a > builds progress. So for three goals (A,B & C) we would see something like > " **AAABBBBCCCCCC**" with A taking 3 minutes, B taking 4 and C > taking 6. > > Using this, we are able to manually/visually determine how long each goal > is taking. What we would like to be able to do is query and ascertain > trends/expected times from this data to, for example, allow us to flag when > builds/goals take 20% longer than the average. Is this possible with the > current data set or do we need to change what we upload? > > Appreciate any/all help. > > _(Note: currently using elasticsearch 1.1.2-1 on CentOS 6)_ > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/6fb77ef6-7a86-4bba-af9b-0c3cadb9ef4a%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/6fb77ef6-7a86-4bba-af9b-0c3cadb9ef4a%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/6fb77ef6-7a86-4bba-af9b-0c3cadb9ef4a%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/6fb77ef6-7a86-4bba-af9b-0c3cadb9ef4a%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_tSg\_U7RktPWz-AdZaQW19BDEb6LvtiGQhebERfzM87w%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_tSg_U7RktPWz-AdZaQW19BDEb6LvtiGQhebERfzM87w%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![KT\_SSP](https://avatars.discourse-cdn.com/v4/letter/k/dfb087/32.png) [@KT\_SSP](https://discuss.elastic.co/u/KT_SSP)\ **Post date:** [April 23, 2015, 7:53am UTC](https://discuss.elastic.co/t/grouping-extracting-results-uploaded-to-elasticsearch/23361/3 "2015-04-23T07:53:27Z")
When you say "split the fields out", do you mean take " **AAABBBBCCCCCC**" and have it post multiple entries, one for each 60 second snapshot. If so, then that is what is already being done, perhaps I should have explained that better. Each character was meant to represent a single entry posted to elasticsearch once every 60 seconds, with "\_" representing not in a build and "A", "B" and "C" for the build steps themselves. What we would like to achieve is for timings between not only the first and last entry for a goal, so 3 for "A", 4 for "B" and 6 for "C", but potentially the first and last entry for a build, start of "A" to end of "C", so 13 in this example. The other complication is around having multiple builds and separating them. Using the collective example, two builds might appear as " **AAABBBBCCCCCC\_\_\_\_\_\_AAABBBBCCCCCC**" (each character being a single snapshot every 60 seconds), so being able to split the first build from the second and so on. Regards On Thursday, 23 April 2015 02:23:13 UTC+1, Mark Walkom wrote: > You ideally want to restructure your data and split the fields out. > > If you can't do it in your code then Logstash would be able to do > something. > > On 22 April 2015 at 23:05, KT SSP \<[kevin...@ssp-uk.com](mailto:kevin...@ssp-uk.com) \\> > wrote: > > > Hello > > > > We have a build process using ant that is externally monitored (web page) > > and shows the current goal in a group of goals. The active goal is being > > uploaded to elasticsearch every 60 seconds and is allowing us to monitor a > > builds progress. So for three goals (A,B & C) we would see something like > > " **AAABBBBCCCCCC**" with A taking 3 minutes, B taking 4 and C > > taking 6. > > > > Using this, we are able to manually/visually determine how long each goal > > is taking. What we would like to be able to do is query and ascertain > > trends/expected times from this data to, for example, allow us to flag when > > builds/goals take 20% longer than the average. Is this possible with the > > current data set or do we need to change what we upload? > > > > Appreciate any/all help. > > > > _(Note: currently using elasticsearch 1.1.2-1 on CentOS 6)_ > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/6fb77ef6-7a86-4bba-af9b-0c3cadb9ef4a%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/6fb77ef6-7a86-4bba-af9b-0c3cadb9ef4a%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/6fb77ef6-7a86-4bba-af9b-0c3cadb9ef4a%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/6fb77ef6-7a86-4bba-af9b-0c3cadb9ef4a%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/76d93e91-9623-4e9a-92de-352b0356e90a%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/76d93e91-9623-4e9a-92de-352b0356e90a%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:18am UTC](https://discuss.elastic.co/t/grouping-extracting-results-uploaded-to-elasticsearch/23361/4 "2017-07-06T00:18:07Z")
Closed on July 6, 2017, 12:18am UTC