Elasticsearch twitter river filtered stream question


(Josh Harrison) #1

Quick question about the ES twitter river at


The twitter streaming API allows you to filter, and you apparently get up
to 1% of the stream total, with our search queries. So, if I were filtering
for "coffee", I'd get "coffee" tweets that I wouldn't get if I was just
capturing the 1% stream passively.
Does the Twitter river use this filter functionality, or does it do its
filtering on the ingestion side, ingesting the normal 1% stream and
discarding anything that doesn't match

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/b7adb5f1-49a1-4424-8f4e-1c75e15c4cb0%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(David Pilato) #2

It uses the filter functionality provided by Twitter API.

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr

Le 7 juillet 2014 à 21:54:02, Josh Harrison (hijakk@gmail.com) a écrit:

Quick question about the ES twitter river at https://github.com/elasticsearch/elasticsearch-river-twitter
The twitter streaming API allows you to filter, and you apparently get up to 1% of the stream total, with our search queries. So, if I were filtering for "coffee", I'd get "coffee" tweets that I wouldn't get if I was just capturing the 1% stream passively.
Does the Twitter river use this filter functionality, or does it do its filtering on the ingestion side, ingesting the normal 1% stream and discarding anything that doesn't match

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/b7adb5f1-49a1-4424-8f4e-1c75e15c4cb0%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/etPan.53bb1e60.625558ec.5cf2%40MacBook-Air-de-David.local.
For more options, visit https://groups.google.com/d/optout.


(system) #3