Hello, I've got some success working with Spark SQL CLI to access our ES data. Environment: ES: 1.3.2 es-hadoop: elasticsearch-hadoop-2.2.0 Spark: spark-1.4.1-bin-hadoop2.6 The pushdown feature is working great! However, I noticed that for queries like: SELECT count(member_id),member_id FRO…

Spark SQL: count(*) fetches all data

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Spark SQL: count(*) fetches all data