Discuss the Elastic Stack

Which class file trigger writing of segments.gen / segments_1

Elastic Stack Elasticsearch

Jason_Wee (Jason Wee) August 29, 2014, 12:38pm 1

Hello people,

Anybody know which class/component in elastic search trigger writing
of segments.gen and segments_1? I'm currently using elastic search version
1.2.1. It would be great if you can provide link pin point which line in
the class does that.

Thank you.

/Jason

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/bdfc3860-cb26-4f21-9597-4f500eb950e2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

jprante (Jörg Prante) August 29, 2014, 12:49pm 2

This is Lucene, when indexing starts. Look at the SegmentsInfo class
https://lucene.apache.org/core/4_9_0/core/org/apache/lucene/index/SegmentInfos.html

Jörg

On Fri, Aug 29, 2014 at 2:38 PM, Jason Wee peichieh@gmail.com wrote:

Hello people,

Anybody know which class/component in Elasticsearch trigger writing
of segments.gen and segments_1? I'm currently using Elasticsearch version
1.2.1. It would be great if you can provide link pin point which line in
the class does that.

Thank you.

/Jason

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/bdfc3860-cb26-4f21-9597-4f500eb950e2%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/bdfc3860-cb26-4f21-9597-4f500eb950e2%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoG%3Ddauci86-7Y-RaN%2BJW94kqXU%3DwTA3kgxLO5Mj%3DLL0aQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Jason_Wee (Jason Wee) August 29, 2014, 3:30pm 3

Thanks Jörg,

read this link
https://lucene.apache.org/core/4_8_1/core/org/apache/lucene/index/SegmentInfos.html
, very informative.

Found a few spots that call the class SegmentInfos, below are them.

github.com

elastic/elasticsearch/blob/v1.2.1/src/main/java/org/elasticsearch/index/gateway/local/LocalIndexShardGateway.java

/*
 * Licensed to Elasticsearch under one or more contributor
 * license agreements. See the NOTICE file distributed with
 * this work for additional information regarding copyright
 * ownership. Elasticsearch licenses this file to you under
 * the Apache License, Version 2.0 (the "License"); you may
 * not use this file except in compliance with the License.
 * You may obtain a copy of the License at
 *
 *    http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing,
 * software distributed under the License is distributed on an
 * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
 * KIND, either express or implied.  See the License for the
 * specific language governing permissions and limitations
 * under the License.
 */

package org.elasticsearch.index.gateway.local;

This file has been truncated. show original

github.com

elastic/elasticsearch/blob/v1.2.1/src/main/java/org/elasticsearch/common/lucene/Lucene.java

/*
 * Licensed to Elasticsearch under one or more contributor
 * license agreements. See the NOTICE file distributed with
 * this work for additional information regarding copyright
 * ownership. Elasticsearch licenses this file to you under
 * the Apache License, Version 2.0 (the "License"); you may
 * not use this file except in compliance with the License.
 * You may obtain a copy of the License at
 *
 *    http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing,
 * software distributed under the License is distributed on an
 * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
 * KIND, either express or implied.  See the License for the
 * specific language governing permissions and limitations
 * under the License.
 */

package org.elasticsearch.common.lucene;

This file has been truncated. show original

github.com

elastic/elasticsearch/blob/v1.2.1/src/main/java/org/elasticsearch/index/engine/internal/InternalEngine.java

/*
 * Licensed to Elasticsearch under one or more contributor
 * license agreements. See the NOTICE file distributed with
 * this work for additional information regarding copyright
 * ownership. Elasticsearch licenses this file to you under
 * the Apache License, Version 2.0 (the "License"); you may
 * not use this file except in compliance with the License.
 * You may obtain a copy of the License at
 *
 *    http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing,
 * software distributed under the License is distributed on an
 * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
 * KIND, either express or implied.  See the License for the
 * specific language governing permissions and limitations
 * under the License.
 */

package org.elasticsearch.index.engine.internal;

This file has been truncated. show original

github.com

elastic/elasticsearch/blob/v1.2.1/src/main/java/org/elasticsearch/index/merge/policy/ElasticsearchMergePolicy.java

/*
 * Licensed to Elasticsearch under one or more contributor
 * license agreements. See the NOTICE file distributed with
 * this work for additional information regarding copyright
 * ownership. Elasticsearch licenses this file to you under
 * the Apache License, Version 2.0 (the "License"); you may
 * not use this file except in compliance with the License.
 * You may obtain a copy of the License at
 *
 *    http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing,
 * software distributed under the License is distributed on an
 * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
 * KIND, either express or implied.  See the License for the
 * specific language governing permissions and limitations
 * under the License.
 */

package org.elasticsearch.index.merge.policy;

This file has been truncated. show original

github.com

elastic/elasticsearch/blob/v1.2.1/src/main/java/org/elasticsearch/index/snapshots/blobstore/BlobStoreIndexShardRepository.java

/*
 * Licensed to Elasticsearch under one or more contributor
 * license agreements. See the NOTICE file distributed with
 * this work for additional information regarding copyright
 * ownership. Elasticsearch licenses this file to you under
 * the Apache License, Version 2.0 (the "License"); you may
 * not use this file except in compliance with the License.
 * You may obtain a copy of the License at
 *
 *    http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing,
 * software distributed under the License is distributed on an
 * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
 * KIND, either express or implied.  See the License for the
 * specific language governing permissions and limitations
 * under the License.
 */

package org.elasticsearch.index.snapshots.blobstore;

This file has been truncated. show original

I understand that both segments file are written by Lucene but during
index, do you know which class in elasticsearch that eventually lead to
trigger the underlying writing of segments file?

/Jason

On Fri, Aug 29, 2014 at 8:49 PM, joergprante@gmail.com <
joergprante@gmail.com> wrote:

This is Lucene, when indexing starts. Look at the SegmentsInfo class
SegmentInfos (Lucene 4.9.0 API)

Jörg

On Fri, Aug 29, 2014 at 2:38 PM, Jason Wee peichieh@gmail.com wrote:

Hello people,

Anybody know which class/component in Elasticsearch trigger writing
of segments.gen and segments_1? I'm currently using Elasticsearch version
1.2.1. It would be great if you can provide link pin point which line in
the class does that.

Thank you.

/Jason

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/bdfc3860-cb26-4f21-9597-4f500eb950e2%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/bdfc3860-cb26-4f21-9597-4f500eb950e2%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoG%3Ddauci86-7Y-RaN%2BJW94kqXU%3DwTA3kgxLO5Mj%3DLL0aQ%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoG%3Ddauci86-7Y-RaN%2BJW94kqXU%3DwTA3kgxLO5Mj%3DLL0aQ%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAHO4itx9BQfQN2f0JLwwUi4kKupohF1Otxh1_s31t40QeZbcPg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

jprante (Jörg Prante) August 29, 2014, 4:07pm 4

All the classes in ES that create documents and indices are able to be
involved into calling SegmentInfos.

Jörg

On Fri, Aug 29, 2014 at 5:30 PM, Jason Wee peichieh@gmail.com wrote:

Thanks Jörg,

read this link
SegmentInfos (Lucene 4.8.1 API)
, very informative.

Found a few spots that call the class SegmentInfos, below are them.

https://github.com/elasticsearch/elasticsearch/blob/v1.2.1/src/main/java/org/elasticsearch/index/gateway/local/LocalIndexShardGateway.java

https://github.com/elasticsearch/elasticsearch/blob/v1.2.1/src/main/java/org/elasticsearch/common/lucene/Lucene.java

https://github.com/elasticsearch/elasticsearch/blob/v1.2.1/src/main/java/org/elasticsearch/index/engine/internal/InternalEngine.java

https://github.com/elasticsearch/elasticsearch/blob/v1.2.1/src/main/java/org/elasticsearch/index/merge/policy/ElasticsearchMergePolicy.java

https://github.com/elasticsearch/elasticsearch/blob/v1.2.1/src/main/java/org/elasticsearch/index/snapshots/blobstore/BlobStoreIndexShardRepository.java

I understand that both segments file are written by Lucene but during
index, do you know which class in elasticsearch that eventually lead to
trigger the underlying writing of segments file?

/Jason

On Fri, Aug 29, 2014 at 8:49 PM, joergprante@gmail.com <
joergprante@gmail.com> wrote:

This is Lucene, when indexing starts. Look at the SegmentsInfo class
SegmentInfos (Lucene 4.9.0 API)

Jörg

On Fri, Aug 29, 2014 at 2:38 PM, Jason Wee peichieh@gmail.com wrote:

Hello people,

Anybody know which class/component in Elasticsearch trigger writing
of segments.gen and segments_1? I'm currently using Elasticsearch version
1.2.1. It would be great if you can provide link pin point which line in
the class does that.

Thank you.

/Jason

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/bdfc3860-cb26-4f21-9597-4f500eb950e2%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/bdfc3860-cb26-4f21-9597-4f500eb950e2%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoG%3Ddauci86-7Y-RaN%2BJW94kqXU%3DwTA3kgxLO5Mj%3DLL0aQ%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoG%3Ddauci86-7Y-RaN%2BJW94kqXU%3DwTA3kgxLO5Mj%3DLL0aQ%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAHO4itx9BQfQN2f0JLwwUi4kKupohF1Otxh1_s31t40QeZbcPg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAHO4itx9BQfQN2f0JLwwUi4kKupohF1Otxh1_s31t40QeZbcPg%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEeVZS76RDc-goD6C1L04csNc-LiaxfbQsJ5PQvAkUz%2Bg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

© 2020. All Rights Reserved - Elasticsearch

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.