# App Search not chasing HTTP 302s when validating URLs?

**URL:** <https://discuss.elastic.co/t/app-search-not-chasing-http-302s-when-validating-urls/284213>\
**Category:** Elastic Search\
**Created:** [September 14, 2021, 5:52pm UTC](https://discuss.elastic.co/t/app-search-not-chasing-http-302s-when-validating-urls/284213 "2021-09-14T17:52:15Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![lgoolsby](https://avatars.discourse-cdn.com/v4/letter/l/90db22/32.png) [@lgoolsby](https://discuss.elastic.co/u/lgoolsby)\
**Post date:** [September 14, 2021, 5:52pm UTC](https://discuss.elastic.co/t/app-search-not-chasing-http-302s-when-validating-urls/284213/1 "2021-09-14T17:52:15Z")

</div>

When adding a new URL to the web crawler the validation fails with this error:

`When we fetched the web page at [my domain], it returned data that was not HTML.`

If I `curl -I [my domain]` from the pod's shell I see that the response is an HTTP 302 with a Location header.

If I `curl [my domain]` I get the following text:

`<html><body>You are being <a href="[my domain]/[path]">redirected</a>.</body></html>`

And if I `curl [my domain]/[path]` I get valid HTML.

I'm going to specify the entry point for this domain once its added but I can't get that far in the wizard.

How can I add this site to the crawler?

---

<div class="post-metadata">

**Author:** ![Carlos\_D](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carlos_d/32/126245_2.png) [@Carlos\_D](https://discuss.elastic.co/u/Carlos_D)\
**Post date:** [September 29, 2021, 10:11am UTC](https://discuss.elastic.co/t/app-search-not-chasing-http-302s-when-validating-urls/284213/2 "2021-09-29T10:11:09Z")

</div>

Hi @lgoolsby !

I would recommend using the [new Enterprise Search 7.15 version](https://www.elastic.co/downloads/enterprise-search). This version adds some enhancements to the way the Web Crawler handles redirections for the domain pages.

Could you please give it a go and share what your experience is?

In case this is not possible, it would be great to have more details:

- Your domain, in case it can be shared with us
- The full cURL requests - responses for your domain

Thanks!

---

<div class="post-metadata">

**Author:** ![lgoolsby](https://avatars.discourse-cdn.com/v4/letter/l/90db22/32.png) [@lgoolsby](https://discuss.elastic.co/u/lgoolsby)\
**Post date:** [October 12, 2021, 5:46pm UTC](https://discuss.elastic.co/t/app-search-not-chasing-http-302s-when-validating-urls/284213/3 "2021-10-12T17:46:29Z")

</div>

Yep, that fixed the problem. Thanks!

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 4, 2022, 8:32am UTC](https://discuss.elastic.co/t/app-search-not-chasing-http-302s-when-validating-urls/284213/4 "2022-11-04T08:32:19Z")

</div>


