Update: I'm being careless, I had the field listed in a mutate>lowercase function later on in the pipe
Ingesting Twitter data with the twitter input and then running ruby inline code to put links in a separate field. Unfortunately, twitter links appears to be case sensitive and my ruby code isn't preserving case. Any ideas?
if [extended_tweet][full_text] {
ruby {
code => "event.set('links', event.get('[extended_tweet][full_text]').scan(/https?:\/\/\S*/i))"
}
} else {
ruby {
code => "event.set('links', event.get('text').scan(/https?:\/\/\S*/i))"
}
}
Output in Kibana: