# How to index my website

**URL:** <https://discuss.elastic.co/t/how-to-index-my-website/4560>\
**Category:** Elasticsearch\
**Created:** [June 6, 2011, 6:15pm UTC](https://discuss.elastic.co/t/how-to-index-my-website/4560 "2011-06-06T18:15:51Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![venkatnehatha](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/venkatnehatha/32/3205_2.png) [@venkatnehatha](https://discuss.elastic.co/u/venkatnehatha)\
**Post date:** [June 6, 2011, 6:15pm UTC](https://discuss.elastic.co/t/how-to-index-my-website/4560/1 "2011-06-06T18:15:51Z")

</div>

Hi All,

I am a newbie to (Elastic)Search engines. I want to use ElasticSearch for my website. I am done with the installation and done given twitter example indexing, it's working fine.  
Now to integrate with my website, what is the best way to store indexes. I mean, what is the best JSON format to use? And do I need to maintain entire my web page content as a JSON doc for indexing??

Thanks in advance.

-Nehatha

---

<div class="post-metadata">

**Author:** ![venkatnehatha](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/venkatnehatha/32/3205_2.png) [@venkatnehatha](https://discuss.elastic.co/u/venkatnehatha)\
**Post date:** [June 7, 2011, 4:25pm UTC](https://discuss.elastic.co/t/how-to-index-my-website/4560/2 "2011-06-07T16:25:32Z")

</div>

Can anybody plz reply.

---

<div class="post-metadata">

**Author:** ![Karussell1](https://avatars.discourse-cdn.com/v4/letter/k/50afbb/32.png) [@Karussell1](https://discuss.elastic.co/u/Karussell1)\
**Post date:** [June 8, 2011, 11:38am UTC](https://discuss.elastic.co/t/how-to-index-my-website/4560/3 "2011-06-08T11:38:12Z")

</div>

either use the underlying database of your website to feed ES

or if you don't have access to this DB use a crawler (like nutch) or  
write your own simple parser ...

> what is the best JSON format to use

What do you mean here? The mapping? url+title+text should be the  
minimum I guess 🙂

Regards,  
Peter.

On Jun 6, 8:15 pm, venkatnehatha [venkatneha...@gmail.com](mailto:venkatneha...@gmail.com) wrote:

> Hi All,
> 
> I am a newbie to (Elastic)Search engines. I want to use Elasticsearch for my  
> website. I am done with the installation and done given twitter example  
> indexing, it's working fine.  
> Now to integrate with my website, what is the best way to store indexes. I  
> mean, what is the best JSON format to use? And do I need to maintain entire  
> my web page content as a JSON doc for indexing??
> 
> Thanks in advance.
> 
> -Nehatha
> 
> --  
> View this message in context:[http://elasticsearch-users.115913.n3.nabble.com/How-to-index-my-websi](http://elasticsearch-users.115913.n3.nabble.com/How-to-index-my-websi)...  
> Sent from the Elasticsearch Users mailing list archive at [Nabble.com](http://Nabble.com).

---

<div class="post-metadata">

**Author:** ![fashionalwallet](https://avatars.discourse-cdn.com/v4/letter/f/839c29/32.png) [@fashionalwallet](https://discuss.elastic.co/u/fashionalwallet)\
**Post date:** [June 9, 2011, 9:08am UTC](https://discuss.elastic.co/t/how-to-index-my-website/4560/4 "2011-06-09T09:08:22Z")

</div>

- deleted -

---

<div class="post-metadata">

**Author:** ![venkatnehatha](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/venkatnehatha/32/3205_2.png) [@venkatnehatha](https://discuss.elastic.co/u/venkatnehatha)\
**Post date:** [June 9, 2011, 5:49pm UTC](https://discuss.elastic.co/t/how-to-index-my-website/4560/5 "2011-06-09T17:49:45Z")

</div>

Thank you for the reply Karussel.

can you suggest best php/java api to feed ES that cares about index names and all.

Thanks,  
Nehatha

---

<div class="post-metadata">

**Author:** ![Karussell1](https://avatars.discourse-cdn.com/v4/letter/k/50afbb/32.png) [@Karussell1](https://discuss.elastic.co/u/Karussell1)\
**Post date:** [June 13, 2011, 7:49am UTC](https://discuss.elastic.co/t/how-to-index-my-website/4560/6 "2011-06-13T07:49:04Z")

</div>

Java API is already included in ES. For other clients:

[http://www.elasticsearch.org/guide/appendix/clients.html](http://www.elasticsearch.org/guide/appendix/clients.html)

---

<div class="post-metadata">

**Author:** ![venkatnehatha](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/venkatnehatha/32/3205_2.png) [@venkatnehatha](https://discuss.elastic.co/u/venkatnehatha)\
**Post date:** [June 13, 2011, 6:09pm UTC](https://discuss.elastic.co/t/how-to-index-my-website/4560/7 "2011-06-13T18:09:55Z")

</div>

Thank you Karussell. I need the generic php/java scripts to crawl websites and FEED ES.

can you plz suggest one.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:03am UTC](https://discuss.elastic.co/t/how-to-index-my-website/4560/8 "2017-07-06T04:03:42Z")

</div>


