Number Of Occurrences Of A Particular Word in a field

Elastic Stack Kibana
1

I index my emails in Kibana. And I would like to know the number of times that the word "timeout" appears in "Emailbody" field.
{
"From":"string",
"To" : "string",
"Date" "date"
"Emailbody": "string"
}

Thank you in advance for your help.

Michael B.

2

This is more an Elasticsearch question. Assuming that the field is named emailbody, is the field configured to be analyzed in ES? If so, you can use the Lucene Query Syntax to find all documents that have that work in the field, which would be emailbody:timeout. Putting that in the Kibana query bar will filter the documents returned, and then you could get the count of the documents.

1 Like
3

Thank you very much for your proposal.
I try it right away and I inform you of the result.

Best regards
Michael B.

4

Hello Joe,
it works perfectly I get the count of the documents
but I would like to know: The number of times that the word "timeout" is repeated
on the emailbody field for each document?
Thank you in advance for your help :slight_smile:

5

Oh, I misunderstood what you were trying to see, sorry about that.

As you can see, Elasticsearch will give you the documents that contain the term pretty easily, but I don't know if there's a way to get the count of times a word was used in a field. Looking at the API, I don't see anything that looks like it'll do that, at least not directly.

I think you can do this with a scripted field though. I haven't tried it, but the idea would be to just use a term filter like you are now, and have a script field that would split that value by spaces, and then someone filter by the word you want and then count the remaining items. It would probably be crazy slow, but it would work.

The better way to do this would be to enrich the data when you index it, effectively doing the term count just the one time, and indexing the result along with everything else. This only works if you know ahead of time what term or terms you care about, but it sounds like maybe you do in this case. For existing documents, you can pretty easily reindex them.

1 Like
6

Thank you i will try it :slight_smile:

7

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.