# Elasticsearch crawler - Usage of "lastmod" properties in sitempas

**URL:** <https://discuss.elastic.co/t/elasticsearch-crawler-usage-of-lastmod-properties-in-sitempas/379138>\
**Category:** Elastic Search\
**Created:** [June 12, 2025, 1:03pm UTC](https://discuss.elastic.co/t/elasticsearch-crawler-usage-of-lastmod-properties-in-sitempas/379138 "2025-06-12T13:03:48Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![madsurfer](https://avatars.discourse-cdn.com/v4/letter/m/ce7236/32.png) [@madsurfer](https://discuss.elastic.co/u/madsurfer)\
**Post date:** [June 12, 2025, 1:03pm UTC](https://discuss.elastic.co/t/elasticsearch-crawler-usage-of-lastmod-properties-in-sitempas/379138/1 "2025-06-12T13:03:48Z")

</div>

Hi,

I am looking for documentation about how the Elasticsearch Crawler is handling the "lastmod" properties in website sitemaps. But so far, I am not able to find IF ES is actually taking the lastmod in consideration and actually crawl/update only the page is a lastmod newer than the previous crawl.

Thanks,

David

---

<div class="post-metadata">

**Author:** ![piotrprz](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/piotrprz/32/128141_2.png) [@piotrprz](https://discuss.elastic.co/u/piotrprz)\
**Post date:** [August 18, 2025, 2:42pm UTC](https://discuss.elastic.co/t/elasticsearch-crawler-usage-of-lastmod-properties-in-sitempas/379138/2 "2025-08-18T14:42:28Z")

</div>

Hi!  
I don’t think the Crawler is taking the `lastmod` parameter into account. Also:  
[crawler/docs/features/CRAWLER\_DIRECTIVES.md at d6c749b5888f6e3f53b3a798ee655cea341f447d · elastic/crawler · GitHub](https://github.com/elastic/crawler/blob/d6c749b5888f6e3f53b3a798ee655cea341f447d/docs/features/CRAWLER_DIRECTIVES.md?plain=1#L245) states:

> The web crawler does not process optional metadata defined by the standard.  
> The web crawler extracts a list of URLs from each sitemap and ignores all other information.