# Crawling Microsoft Stream Videos Site Issue **URL:** \ **Category:** Elastic Search\ **Created:** [July 17, 2022, 3:56pm UTC](https://discuss.elastic.co/t/crawling-microsoft-stream-videos-site-issue/309823 "2022-07-17T15:56:53Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![itsraj](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/itsraj/32/106993_2.png) [@itsraj](https://discuss.elastic.co/u/itsraj)\ **Post date:** [July 17, 2022, 3:56pm UTC](https://discuss.elastic.co/t/crawling-microsoft-stream-videos-site-issue/309823/1 "2022-07-17T15:56:53Z")
Hello Team, I am trying to crawl the Microsoft Streams site in Enterprise Search. But getting below error. ![image](https://us1.discourse-cdn.com/elastic/original/3X/1/0/105ec7d3dd8fde8f40ac58e147c2f1a4cd6e30e6.png) Please help me to crawl the password-protected URL below to crawl videos. [Microsoft Stream](https://web.microsoftstream.com/studio/videos) ---
**Author:** ![Carlos\_D](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carlos_d/32/126245_2.png) [@Carlos\_D](https://discuss.elastic.co/u/Carlos_D)\ **Post date:** [July 18, 2022, 8:24am UTC](https://discuss.elastic.co/t/crawling-microsoft-stream-videos-site-issue/309823/2 "2022-07-18T08:24:44Z")
hi @itsraj : App Search Crawler cannot be used to crawl OAuth2 authenticated sites like the one you're describing. Crawler supports [HTTP Authentication](https://www.elastic.co/guide/en/app-search/current/web-crawler-reference.html#web-crawler-reference-http-authentication) and using a [HTTP proxy](https://www.elastic.co/guide/en/app-search/current/web-crawler-reference.html#web-crawler-reference-http-proxy). If you can setup the Microsoft Streams site to use HTTP authentication or it can be accessed via a proxy, you might use these Crawler features to retrieve content from it. Hope that helps! ---
**Author:** ![itsraj](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/itsraj/32/106993_2.png) [@itsraj](https://discuss.elastic.co/u/itsraj)\ **Post date:** [July 18, 2022, 12:12pm UTC](https://discuss.elastic.co/t/crawling-microsoft-stream-videos-site-issue/309823/3 "2022-07-18T12:12:45Z")
Hey @Carlos_D, is it possible to use it as a Custom API Content source in Workplace Search? It is one of the requirements we got from one of the clients. Please let me know the possible options for it. ---
**Author:** ![Carlos\_D](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carlos_d/32/126245_2.png) [@Carlos\_D](https://discuss.elastic.co/u/Carlos_D)\ **Post date:** [July 18, 2022, 12:42pm UTC](https://discuss.elastic.co/t/crawling-microsoft-stream-videos-site-issue/309823/4 "2022-07-18T12:42:04Z")
> is it possible to use it as a Custom API Content source in Workplace Search? Yes, you could build a [Custom API Content source](https://www.elastic.co/guide/en/workplace-search/master/workplace-search-custom-api-sources.html) or use a [custom connector package](https://www.elastic.co/guide/en/workplace-search/master/custom-connector-package.html). Keep in mind that: - You will need to develop authentication and retrieval of documents from the Microsoft Stream Videos - You need to ingest those documents into Workplace Search via the [Custom Sources Indexing API](https://www.elastic.co/guide/en/workplace-search/master/workplace-search-custom-sources-api.html) or using the custom connectors package. - Data will be available in Workplace Search, not App Search. If that meets your requirements, then you can try that route. Please review the [known limitations](https://www.elastic.co/guide/en/workplace-search/master/custom-connector-package.html#custom-connector-package-issues) before going the custom connectors route. ---
**Author:** ![itsraj](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/itsraj/32/106993_2.png) [@itsraj](https://discuss.elastic.co/u/itsraj)\ **Post date:** [July 18, 2022, 2:49pm UTC](https://discuss.elastic.co/t/crawling-microsoft-stream-videos-site-issue/309823/5 "2022-07-18T14:49:09Z")
is there any documentation for it? can you please help with it? ---
**Author:** ![Carlos\_D](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carlos_d/32/126245_2.png) [@Carlos\_D](https://discuss.elastic.co/u/Carlos_D)\ **Post date:** [July 18, 2022, 5:00pm UTC](https://discuss.elastic.co/t/crawling-microsoft-stream-videos-site-issue/309823/6 "2022-07-18T17:00:22Z")
Sure! I have shared the docs links in the previous post. I can help with specific issues you might have, but can't engage on a full solution discovery. I recommend going through the documentation, check what option works best for your use case, and try to build a proof of concept using that. Keep in mind that you will need programmatic access to Microsoft Stream Videos site in order to automatically ingest content from it; that should be your first step in order to check the viability of the approach. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [August 15, 2022, 5:00pm UTC](https://discuss.elastic.co/t/crawling-microsoft-stream-videos-site-issue/309823/7 "2022-08-15T17:00:32Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.