# Are there any comprehensive documents which describe the detailed process of document indexing and searching? **URL:** \ **Category:** Elasticsearch\ **Created:** [May 22, 2015, 2:47pm UTC](https://discuss.elastic.co/t/are-there-any-comprehensive-documents-which-describe-the-detailed-process-of-document-indexing-and-searching/23672 "2015-05-22T14:47:51Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![shihpeng](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shihpeng/32/40318_2.png) [@shihpeng](https://discuss.elastic.co/u/shihpeng)\ **Post date:** [May 22, 2015, 2:47pm UTC](https://discuss.elastic.co/t/are-there-any-comprehensive-documents-which-describe-the-detailed-process-of-document-indexing-and-searching/23672/1 "2015-05-22T14:47:51Z")
Although I have read a lot of guides and articles, there seems still something I missed in understanding the process of document indexing and searching. I would like to know if there are any comprehensive documents which describe the process very detailly? For example, the document indexing process involves document preprocessing, text analyzing, load into memory buffer (in the mean time also write this operation into translog), write out as segment files, ..., etc. The document indexing operation in Elasticsearch is actually quite complicated, but the articles I can found on the Internet always only cover some of these steps. Are there any such detailed documents available? Thanks in advance. ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/4cf44fe9-e14b-4957-954e-8782c5b3c2cc%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/4cf44fe9-e14b-4957-954e-8782c5b3c2cc%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Jason\_Wee](https://avatars.discourse-cdn.com/v4/letter/j/7ea924/32.png) [@Jason\_Wee](https://discuss.elastic.co/u/Jason_Wee)\ **Post date:** [May 25, 2015, 9:45am UTC](https://discuss.elastic.co/t/are-there-any-comprehensive-documents-which-describe-the-detailed-process-of-document-indexing-and-searching/23672/2 "2015-05-25T09:45:29Z")
If you have that basic knowledge, perhaps the next steps would be read into the code, for instance, you mentioned about translog, so find for the translog class file and start from there? jason On Fri, May 22, 2015 at 10:47 PM, Shih-Peng Lin [shihpeng.lin@gmail.com](mailto:shihpeng.lin@gmail.com) wrote: > Although I have read a lot of guides and articles, there seems still > something I missed in understanding the process of document indexing and > searching. I would like to know if there are any comprehensive documents > which describe the process very detailly? > > For example, the document indexing process involves document > preprocessing, text analyzing, load into memory buffer (in the mean time > also write this operation into translog), write out as segment files, ..., > etc. The document indexing operation in Elasticsearch is actually quite > complicated, but the articles I can found on the Internet always only cover > some of these steps. > > Are there any such detailed documents available? > > Thanks in advance. > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/4cf44fe9-e14b-4957-954e-8782c5b3c2cc%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/4cf44fe9-e14b-4957-954e-8782c5b3c2cc%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/4cf44fe9-e14b-4957-954e-8782c5b3c2cc%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/4cf44fe9-e14b-4957-954e-8782c5b3c2cc%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAHO4itx7q%2BiKojEAasxZDwGDBR6o7WKJKCw29TmcZCqU36RKkA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAHO4itx7q%2BiKojEAasxZDwGDBR6o7WKJKCw29TmcZCqU36RKkA%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![nik9000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nik9000/32/44947_2.png) [@nik9000](https://discuss.elastic.co/u/nik9000)\ **Post date:** [May 25, 2015, 12:11pm UTC](https://discuss.elastic.co/t/are-there-any-comprehensive-documents-which-describe-the-detailed-process-of-document-indexing-and-searching/23672/3 "2015-05-25T12:11:16Z")
I get the sense that this is a good start though I haven't watched it myself: [https://www.elastic.co/elasticon/2015/sf/elasticsearch-data-journey-life-of-a-document-in-elasticsearch](https://www.elastic.co/elasticon/2015/sf/elasticsearch-data-journey-life-of-a-document-in-elasticsearch) On May 25, 2015 5:45 AM, "Jason Wee" [peichieh@gmail.com](mailto:peichieh@gmail.com) wrote: > If you have that basic knowledge, perhaps the next steps would be read > into the code, for instance, you mentioned about translog, so find for the > translog class file and start from there? > > jason > > On Fri, May 22, 2015 at 10:47 PM, Shih-Peng Lin [shihpeng.lin@gmail.com](mailto:shihpeng.lin@gmail.com) > wrote: > > > Although I have read a lot of guides and articles, there seems still > > something I missed in understanding the process of document indexing and > > searching. I would like to know if there are any comprehensive documents > > which describe the process very detailly? > > > > For example, the document indexing process involves document > > preprocessing, text analyzing, load into memory buffer (in the mean time > > also write this operation into translog), write out as segment files, ..., > > etc. The document indexing operation in Elasticsearch is actually quite > > complicated, but the articles I can found on the Internet always only cover > > some of these steps. > > > > Are there any such detailed documents available? > > > > Thanks in advance. > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/4cf44fe9-e14b-4957-954e-8782c5b3c2cc%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/4cf44fe9-e14b-4957-954e-8782c5b3c2cc%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/4cf44fe9-e14b-4957-954e-8782c5b3c2cc%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/4cf44fe9-e14b-4957-954e-8782c5b3c2cc%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CAHO4itx7q%2BiKojEAasxZDwGDBR6o7WKJKCw29TmcZCqU36RKkA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAHO4itx7q%2BiKojEAasxZDwGDBR6o7WKJKCw29TmcZCqU36RKkA%40mail.gmail.com) > [https://groups.google.com/d/msgid/elasticsearch/CAHO4itx7q%2BiKojEAasxZDwGDBR6o7WKJKCw29TmcZCqU36RKkA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAHO4itx7q%2BiKojEAasxZDwGDBR6o7WKJKCw29TmcZCqU36RKkA%40mail.gmail.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3t0AzG6wzS\_wJsRxRjG\_D8TdhrRmUz7AApGPD\_YAcAPQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3t0AzG6wzS_wJsRxRjG_D8TdhrRmUz7AApGPD_YAcAPQ%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Jason\_Wee](https://avatars.discourse-cdn.com/v4/letter/j/7ea924/32.png) [@Jason\_Wee](https://discuss.elastic.co/u/Jason_Wee)\ **Post date:** [May 25, 2015, 1:59pm UTC](https://discuss.elastic.co/t/are-there-any-comprehensive-documents-which-describe-the-detailed-process-of-document-indexing-and-searching/23672/4 "2015-05-25T13:59:10Z")
that's good to know, will read the link 🙂 On Mon, May 25, 2015 at 8:11 PM, Nikolas Everett [nik9000@gmail.com](mailto:nik9000@gmail.com) wrote: > I get the sense that this is a good start though I haven't watched it > myself: > > [https://www.elastic.co/elasticon/2015/sf/elasticsearch-data-journey-life-of-a-document-in-elasticsearch](https://www.elastic.co/elasticon/2015/sf/elasticsearch-data-journey-life-of-a-document-in-elasticsearch) > On May 25, 2015 5:45 AM, "Jason Wee" [peichieh@gmail.com](mailto:peichieh@gmail.com) wrote: > > > If you have that basic knowledge, perhaps the next steps would be read > > into the code, for instance, you mentioned about translog, so find for the > > translog class file and start from there? > > > > jason > > > > On Fri, May 22, 2015 at 10:47 PM, Shih-Peng Lin [shihpeng.lin@gmail.com](mailto:shihpeng.lin@gmail.com) > > wrote: > > > > > Although I have read a lot of guides and articles, there seems still > > > something I missed in understanding the process of document indexing and > > > searching. I would like to know if there are any comprehensive documents > > > which describe the process very detailly? > > > > > > For example, the document indexing process involves document > > > preprocessing, text analyzing, load into memory buffer (in the mean time > > > also write this operation into translog), write out as segment files, ..., > > > etc. The document indexing operation in Elasticsearch is actually quite > > > complicated, but the articles I can found on the Internet always only cover > > > some of these steps. > > > > > > Are there any such detailed documents available? > > > > > > Thanks in advance. > > > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/4cf44fe9-e14b-4957-954e-8782c5b3c2cc%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/4cf44fe9-e14b-4957-954e-8782c5b3c2cc%40googlegroups.com) > > > [https://groups.google.com/d/msgid/elasticsearch/4cf44fe9-e14b-4957-954e-8782c5b3c2cc%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/4cf44fe9-e14b-4957-954e-8782c5b3c2cc%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/CAHO4itx7q%2BiKojEAasxZDwGDBR6o7WKJKCw29TmcZCqU36RKkA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAHO4itx7q%2BiKojEAasxZDwGDBR6o7WKJKCw29TmcZCqU36RKkA%40mail.gmail.com) > > [https://groups.google.com/d/msgid/elasticsearch/CAHO4itx7q%2BiKojEAasxZDwGDBR6o7WKJKCw29TmcZCqU36RKkA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAHO4itx7q%2BiKojEAasxZDwGDBR6o7WKJKCw29TmcZCqU36RKkA%40mail.gmail.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3t0AzG6wzS\_wJsRxRjG\_D8TdhrRmUz7AApGPD\_YAcAPQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3t0AzG6wzS_wJsRxRjG_D8TdhrRmUz7AApGPD_YAcAPQ%40mail.gmail.com) > [https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3t0AzG6wzS\_wJsRxRjG\_D8TdhrRmUz7AApGPD\_YAcAPQ%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3t0AzG6wzS_wJsRxRjG_D8TdhrRmUz7AApGPD_YAcAPQ%40mail.gmail.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAHO4itxwb7oHsBR8s0bLVJJ1dXvCzUaLfvG815M9aomjAA%2BcvA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAHO4itxwb7oHsBR8s0bLVJJ1dXvCzUaLfvG815M9aomjAA%2BcvA%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:12am UTC](https://discuss.elastic.co/t/are-there-any-comprehensive-documents-which-describe-the-detailed-process-of-document-indexing-and-searching/23672/5 "2017-07-06T00:12:05Z")