# Google crawling elasticsearch.org?

**URL:** <https://discuss.elastic.co/t/google-crawling-elasticsearch-org/4366>\
**Category:** Elasticsearch\
**Created:** [May 8, 2011, 9:10pm UTC](https://discuss.elastic.co/t/google-crawling-elasticsearch-org/4366 "2011-05-08T21:10:19Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![searchersteve](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/searchersteve/32/3008_2.png) [@searchersteve](https://discuss.elastic.co/u/searchersteve)\
**Post date:** [May 8, 2011, 9:10pm UTC](https://discuss.elastic.co/t/google-crawling-elasticsearch-org/4366/1 "2011-05-08T21:10:19Z")

</div>

This is maybe a question to Kimchy, but I'll share with the community:

Since your site redesign, I've noticed that every time I do a simple Google search for your documentation, I end up with a link that is no longer working. Google doesn't appear to have a current sitemap or something. I assume you have a decent amount of traffic. I wonder why won't Google update the information?

I've finally accustomed myself to going to the site and then searching, which is of course what I should be doing anyway. I'm just lazy and addicted to my Google browser plugin.

-- Steve

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [May 8, 2011, 9:43pm UTC](https://discuss.elastic.co/t/google-crawling-elasticsearch-org/4366/2 "2011-05-08T21:43:56Z")

</div>

To be honest, I am at a loss here. I have done everything I can to "tell" google to stop/remove [elasticsearch.com](http://elasticsearch.com). It redirects using 301, bad links return 404, web master tools has been update to reflect that, and it shows it does index [elasticsearch.org](http://elasticsearch.org).

My current plan is to buy a shotgun, get to their data centers, and shoot all the replicas holding the [elasticsearch.com](http://elasticsearch.com) indices ("bullet time" style of course, to reduce chances of recoverability).

-shay.banon

p.s. Note to google version of Echelon, the previous paragraph is a joke.  
On Monday, May 9, 2011 at 12:10 AM, searchersteve wrote:

> This is maybe a question to Kimchy, but I'll share with the community:
> 
> Since your site redesign, I've noticed that every time I do a simple Google  
> search for your documentation, I end up with a link that is no longer  
> working. Google doesn't appear to have a current sitemap or something. I  
> assume you have a decent amount of traffic. I wonder why won't Google update  
> the information?
> 
> I've finally accustomed myself to going to the site and then searching,  
> which is of course what I should be doing anyway. I'm just lazy and addicted  
> to my Google browser plugin.
> 
> -- Steve
> 
> --  
> View this message in context: [http://elasticsearch-users.115913.n3.nabble.com/Google-crawling-elasticsearch-org-tp2916515p2916515.html](http://elasticsearch-users.115913.n3.nabble.com/Google-crawling-elasticsearch-org-tp2916515p2916515.html)  
> Sent from the Elasticsearch Users mailing list archive at [Nabble.com](http://Nabble.com).

---

<div class="post-metadata">

**Author:** ![Lukas\_Vlcek1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/lukas_vlcek1/32/819_2.png) [@Lukas\_Vlcek1](https://discuss.elastic.co/u/Lukas_Vlcek1)\
**Post date:** [May 8, 2011, 10:57pm UTC](https://discuss.elastic.co/t/google-crawling-elasticsearch-org/4366/3 "2011-05-08T22:57:54Z")

</div>

Just found this video talk about this subject:

> **[Google Search Central](https://www.youtube.com/googlewebmasterhelp#p/u/16/QyQs3tz7ZKo)**
>
> Welcome to the official Google Search Central YouTube channel (formerly Google Webmasters) where you can find information and tools to help you understand and improve your site in Google Search. Find content on SEO best practices, tutorials on Google...

[http://www.youtube.com/googlewebmasterhelp#p/u/16/QyQs3tz7ZKo](http://www.youtube.com/googlewebmasterhelp#p/u/16/QyQs3tz7ZKo)HTH  
Lukas

On Sun, May 8, 2011 at 11:43 PM, Shay Banon [shay.banon@elasticsearch.com](mailto:shay.banon@elasticsearch.com)wrote:

> To be honest, I am at a loss here. I have done everything I can to "tell"  
> google to stop/remove [elasticsearch.com](http://elasticsearch.com). It redirects using 301, bad links  
> return 404, web master tools has been update to reflect that, and it shows  
> it does index [elasticsearch.org](http://elasticsearch.org).
> 
> My current plan is to buy a shotgun, get to their data centers, and shoot  
> all the replicas holding the [elasticsearch.com](http://elasticsearch.com) indices ("bullet time"  
> style of course, to reduce chances of recoverability).
> 
> -shay.banon
> 
> p.s. Note to google version of Echelon, the previous paragraph is a joke.
> 
> On Monday, May 9, 2011 at 12:10 AM, searchersteve wrote:
> 
> This is maybe a question to Kimchy, but I'll share with the community:
> 
> Since your site redesign, I've noticed that every time I do a simple Google  
> search for your documentation, I end up with a link that is no longer  
> working. Google doesn't appear to have a current sitemap or something. I  
> assume you have a decent amount of traffic. I wonder why won't Google  
> update  
> the information?
> 
> I've finally accustomed myself to going to the site and then searching,  
> which is of course what I should be doing anyway. I'm just lazy and  
> addicted  
> to my Google browser plugin.
> 
> -- Steve
> 
> --  
> View this message in context:  
> [http://elasticsearch-users.115913.n3.nabble.com/Google-crawling-elasticsearch-org-tp2916515p2916515.html](http://elasticsearch-users.115913.n3.nabble.com/Google-crawling-elasticsearch-org-tp2916515p2916515.html)  
> Sent from the Elasticsearch Users mailing list archive at [Nabble.com](http://Nabble.com).

---

<div class="post-metadata">

**Author:** ![medcl\_net](https://avatars.discourse-cdn.com/v4/letter/m/90ced4/32.png) [@medcl\_net](https://discuss.elastic.co/u/medcl_net)\
**Post date:** [May 9, 2011, 3:59pm UTC](https://discuss.elastic.co/t/google-crawling-elasticsearch-org/4366/4 "2011-05-09T15:59:01Z")

</div>

crazy plan~

From: Shay Banon  
Sent: Monday, May 09, 2011 5:43 AM  
To: [users@elasticsearch.com](mailto:users@elasticsearch.com)  
Subject: Re: Google crawling elasticsearch.org?

To be honest, I am at a loss here. I have done everything I can to "tell" google to stop/remove [elasticsearch.com](http://elasticsearch.com). It redirects using 301, bad links return 404, web master tools has been update to reflect that, and it shows it does index elasticsearch.org.

My current plan is to buy a shotgun, get to their data centers, and shoot all the replicas holding the [elasticsearch.com](http://elasticsearch.com) indices ("bullet time" style of course, to reduce chances of recoverability).

-shay.banon

p.s. Note to google version of Echelon, the previous paragraph is a joke.

On Monday, May 9, 2011 at 12:10 AM, searchersteve wrote:

This is maybe a question to Kimchy, but I'll share with the community:

Since your site redesign, I've noticed that every time I do a simple Google  
search for your documentation, I end up with a link that is no longer  
working. Google doesn't appear to have a current sitemap or something. I  
assume you have a decent amount of traffic. I wonder why won't Google update  
the information?

I've finally accustomed myself to going to the site and then searching,  
which is of course what I should be doing anyway. I'm just lazy and addicted  
to my Google browser plugin.

-- Steve

--  
View this message in context: [http://elasticsearch-users.115913.n3.nabble.com/Google-crawling-elasticsearch-org-tp2916515p2916515.html](http://elasticsearch-users.115913.n3.nabble.com/Google-crawling-elasticsearch-org-tp2916515p2916515.html)  
Sent from the ElasticSearch Users mailing list archive at [Nabble.com](http://Nabble.com).

---

<div class="post-metadata">

**Author:** ![searchersteve](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/searchersteve/32/3008_2.png) [@searchersteve](https://discuss.elastic.co/u/searchersteve)\
**Post date:** [May 9, 2011, 6:18pm UTC](https://discuss.elastic.co/t/google-crawling-elasticsearch-org/4366/5 "2011-05-09T18:18:20Z")

</div>

Ahhh. My sympathies. I hope it won't come to that. :]

---

<div class="post-metadata">

**Author:** ![karmi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/karmi/32/44951_2.png) [@karmi](https://discuss.elastic.co/u/karmi)\
**Post date:** [May 11, 2011, 2:34pm UTC](https://discuss.elastic.co/t/google-crawling-elasticsearch-org/4366/6 "2011-05-11T14:34:56Z")

</div>

Maybe there's some mismatch with .org/.com domains:

host [elasticsearch.org](http://elasticsearch.org)  
[elasticsearch.org](http://elasticsearch.org) has address 207.97.227.245  
host 207.97.227.245  
245.227.97.207.in-addr.arpa domain name pointer [pages.github.com](http://pages.github.com)

but:

host [elasticsearch.com](http://elasticsearch.com)  
[elasticsearch.com](http://elasticsearch.com) has address 64.202.189.170  
host 64.202.189.170  
170.189.202.64.in-addr.arpa domain name pointer pwfwd-  
[v01.prod.mesa1.secureserver.net](http://v01.prod.mesa1.secureserver.net).

Maybe google fails on those redirects from .com =\> .org? I think both  
should point to GH pages.

Karel

On May 8, 11:43 pm, Shay Banon [shay.ba...@elasticsearch.com](mailto:shay.ba...@elasticsearch.com) wrote:

> To be honest, I am at a loss here. I have done everything I can to "tell" google to stop/remove [elasticsearch.com](http://elasticsearch.com). It redirects using 301, bad links return 404, web master tools has been update to reflect that, and it shows it does index [elasticsearch.org](http://elasticsearch.org).
> 
> My current plan is to buy a shotgun, get to their data centers, and shoot all the replicas holding the [elasticsearch.com](http://elasticsearch.com) indices ("bullet time" style of course, to reduce chances of recoverability).
> 
> -shay.banon
> 
> p.s. Note to google version of Echelon, the previous paragraph is a joke.
> 
> On Monday, May 9, 2011 at 12:10 AM, searchersteve wrote:
> 
> > This is maybe a question to Kimchy, but I'll share with the community:
> 
> > Since your site redesign, I've noticed that every time I do a simple Google  
> > search for your documentation, I end up with a link that is no longer  
> > working. Google doesn't appear to have a current sitemap or something. I  
> > assume you have a decent amount of traffic. I wonder why won't Google update  
> > the information?
> 
> > I've finally accustomed myself to going to the site and then searching,  
> > which is of course what I should be doing anyway. I'm just lazy and addicted  
> > to my Google browser plugin.
> 
> > -- Steve
> 
> > --  
> > View this message in context:[http://elasticsearch-users.115913.n3.nabble.com/Google-crawling-elast](http://elasticsearch-users.115913.n3.nabble.com/Google-crawling-elast)...  
> > Sent from the Elasticsearch Users mailing list archive at [Nabble.com](http://Nabble.com).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:06am UTC](https://discuss.elastic.co/t/google-crawling-elasticsearch-org/4366/7 "2017-07-06T04:06:28Z")

</div>


