# Logging indices for separate websites

**URL:** https://discuss.elastic.co/t/logging-indices-for-separate-websites/250361
**Category:** Elasticsearch
**Created:** [September 29, 2020, 1:10pm UTC](https://discuss.elastic.co/t/logging-indices-for-separate-websites/250361 "2020-09-29T13:10:01Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![bram](https://avatars.discourse-cdn.com/v4/letter/b/9d8465/32.png) [@bram](https://discuss.elastic.co/u/bram)
#### Post date: [September 29, 2020, 1:10pm UTC](https://discuss.elastic.co/t/logging-indices-for-separate-websites/250361/1 "2020-09-29T13:10:01Z")

</div>

Hey,

We're running multiple webshops on the same application. And we're logging some API calls we're making (with separate index for each logging use-case). We have one shared logging elasticsearch cluster.  
But for the cluster, is it better to have one index with documents from all the webshops, or to split them up with one index each (still separating the separate logging use-cases)?

At the moment we have them split up:  
shopA-apiX-logging-2020.08  
shopB-apiX-logging-2020.08  
shopA-apiX-logging-2020.09  
shopB-apiX-logging-2020.09

But with ~10 different webshops, the amount of indices on our cluster keeps growing. While the indices are not that big.  
Biggest index is 2.1gb, but the median is at 98mb.

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [September 30, 2020, 6:49am UTC](https://discuss.elastic.co/t/logging-indices-for-separate-websites/250361/2 "2020-09-30T06:49:29Z")

</div>

Having lots of small indices and shards is inefficient and can cause problems, so I would probably recommend consolidating indices. Another way might be to have a monthly index per user rather than per application.

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [September 30, 2020, 10:10pm UTC](https://discuss.elastic.co/t/logging-indices-for-separate-websites/250361/3 "2020-09-30T22:10:14Z")

</div>

Look at using [ILM](https://www.elastic.co/guide/en/elasticsearch/reference/current/ilm-start.html) to manage the rollover process.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [October 28, 2020, 10:10pm UTC](https://discuss.elastic.co/t/logging-indices-for-separate-websites/250361/4 "2020-10-28T22:10:18Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
