ES using DocValues internally yet?

[otisg (Otis Gospodnetić)]

Hi,

I thought ES was using Lucene's DocValues internally, but it looks like it
does not. Am I missing something? Looking at the wrong place? Here's
what I see in master:

$ ffjg -i DocVal | grep -v ScriptDocVal
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
BytesRef docValue = termsIndex.getValue(doc);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
if (docValue == null) {
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
return docValue.compareTo(value);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
BytesRef docValue = getRelevantValue(termsIndex, doc, sortMode);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
if (docValue == null) {
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
return docValue.compareTo(value);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/DoubleValuesComparatorBase.java:
final double docValue = readerValues.getValueMissing(doc,
missingValue);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/DoubleValuesComparatorBase.java:
return compare(docValue, value);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/LongValuesComparatorBase.java:
long docValue = readerValues.getValueMissing(doc, missingValue);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/LongValuesComparatorBase.java:
return compare(docValue, value);

Qs:

• When will ES start using DocValues internally, roughly? By 1.0 or after?
• Is any info available on what sort of DocValue support will be exposed by
  ES?

Thanks,
Otis

ELASTICSERCH Performance Monitoring - http://sematext.com/spm/index.html

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

[mattweber]

Simon has a docvalues branch but it is not in master yet and probably won't
make .90 according to him.

On Thursday, April 4, 2013, Otis Gospodnetic wrote:

Hi,

I thought ES was using Lucene's DocValues internally, but it looks like it
does not. Am I missing something? Looking at the wrong place? Here's
what I see in master:

$ ffjg -i DocVal | grep -v ScriptDocVal
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
BytesRef docValue = termsIndex.getValue(doc);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
if (docValue == null) {
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
return docValue.compareTo(value);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
BytesRef docValue = getRelevantValue(termsIndex, doc, sortMode);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
if (docValue == null) {
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
return docValue.compareTo(value);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/DoubleValuesComparatorBase.java:
final double docValue = readerValues.getValueMissing(doc,
missingValue);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/DoubleValuesComparatorBase.java:
return compare(docValue, value);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/LongValuesComparatorBase.java:
long docValue = readerValues.getValueMissing(doc, missingValue);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/LongValuesComparatorBase.java:
return compare(docValue, value);

Qs:

• When will ES start using DocValues internally, roughly? By 1.0 or after?
• Is any info available on what sort of DocValue support will be exposed
  by ES?

Thanks,
Otis

ELASTICSERCH Performance Monitoring - Sematext Monitoring | Infrastructure Monitoring Service

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Thanks,
Matt Weber

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

[simonw_2]

hey otis,

DocValues are not exposed yet. We decided to move the exposure to post 0.90
to reduce the # of new features on the one hand and to get 0.90 out on the
other.
Regarding which features, it will be similar to what you can do with plain
lucene while we might need to go for SortedBytes even on numeric fields
since numerics are not multivalued.

simon

On Thursday, April 4, 2013 8:31:56 PM UTC+2, Otis Gospodnetic wrote:

Hi,

I thought ES was using Lucene's DocValues internally, but it looks like it
does not. Am I missing something? Looking at the wrong place? Here's
what I see in master:

$ ffjg -i DocVal | grep -v ScriptDocVal
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
BytesRef docValue = termsIndex.getValue(doc);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
if (docValue == null) {
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
return docValue.compareTo(value);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
BytesRef docValue = getRelevantValue(termsIndex, doc, sortMode);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
if (docValue == null) {
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/BytesRefOrdValComparator.java:
return docValue.compareTo(value);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/DoubleValuesComparatorBase.java:
final double docValue = readerValues.getValueMissing(doc,
missingValue);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/DoubleValuesComparatorBase.java:
return compare(docValue, value);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/LongValuesComparatorBase.java:
long docValue = readerValues.getValueMissing(doc, missingValue);
./src/main/java/org/elasticsearch/index/fielddata/fieldcomparator/LongValuesComparatorBase.java:
return compare(docValue, value);

Qs:

• When will ES start using DocValues internally, roughly? By 1.0 or after?
• Is any info available on what sort of DocValue support will be exposed
  by ES?

Thanks,
Otis

ELASTICSERCH Performance Monitoring - Sematext Monitoring | Infrastructure Monitoring Service

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.