# Facing issue when there is non uniform data

**URL:** <https://discuss.elastic.co/t/facing-issue-when-there-is-non-uniform-data/34126>\
**Category:** Elasticsearch\
**Created:** [November 9, 2015, 6:29am UTC](https://discuss.elastic.co/t/facing-issue-when-there-is-non-uniform-data/34126 "2015-11-09T06:29:45Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![Amit2015](https://avatars.discourse-cdn.com/v4/letter/a/258eb7/32.png) [@Amit2015](https://discuss.elastic.co/u/Amit2015)\
**Post date:** [November 9, 2015, 6:29am UTC](https://discuss.elastic.co/t/facing-issue-when-there-is-non-uniform-data/34126/1 "2015-11-09T06:29:46Z")

</div>

Hi Guys,

I am using ElasticSearch with Python. In my txt file DOB is non uniform like 1991-12-12 , 1991/12/12, 1991-Dec-12 something like that.Using same formate date like YYYY-MM-DD, I can import txt file but not able to import file due to that non uniform data. Manually it't time consuming and can't edit data which is in GB. Kindly suggest me solution...

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [November 9, 2015, 6:43am UTC](https://discuss.elastic.co/t/facing-issue-when-there-is-non-uniform-data/34126/2 "2015-11-09T06:43:27Z")

</div>

If you know all date formats in advance you can define them in the mapping.

---

<div class="post-metadata">

**Author:** ![Amit2015](https://avatars.discourse-cdn.com/v4/letter/a/258eb7/32.png) [@Amit2015](https://discuss.elastic.co/u/Amit2015)\
**Post date:** [November 9, 2015, 6:45am UTC](https://discuss.elastic.co/t/facing-issue-when-there-is-non-uniform-data/34126/3 "2015-11-09T06:45:56Z")

</div>

Hi,

You mean in python script?

If you have any sample or example please share it.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [November 9, 2015, 7:08am UTC](https://discuss.elastic.co/t/facing-issue-when-there-is-non-uniform-data/34126/4 "2015-11-09T07:08:25Z")

</div>

No I meant "elasticsearch mapping".

[https://www.elastic.co/guide/en/elasticsearch/reference/2.0/date.html](https://www.elastic.co/guide/en/elasticsearch/reference/2.0/date.html)

---

<div class="post-metadata">

**Author:** ![Amit2015](https://avatars.discourse-cdn.com/v4/letter/a/258eb7/32.png) [@Amit2015](https://discuss.elastic.co/u/Amit2015)\
**Post date:** [November 9, 2015, 9:46am UTC](https://discuss.elastic.co/t/facing-issue-when-there-is-non-uniform-data/34126/5 "2015-11-09T09:46:56Z")

</div>

Hi David,

Thanks for solution. Still I am facing when date is like 1987/09/09.

One more concern I have, I want to generate auto unique id for each row. How can I do that?

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [November 9, 2015, 10:14am UTC](https://discuss.elastic.co/t/facing-issue-when-there-is-non-uniform-data/34126/6 "2015-11-09T10:14:08Z")

</div>

Don't provide any id and it will be automatically generated.

---

<div class="post-metadata">

**Author:** ![Amit2015](https://avatars.discourse-cdn.com/v4/letter/a/258eb7/32.png) [@Amit2015](https://discuss.elastic.co/u/Amit2015)\
**Post date:** [November 10, 2015, 5:30am UTC](https://discuss.elastic.co/t/facing-issue-when-there-is-non-uniform-data/34126/7 "2015-11-10T05:30:23Z")

</div>

It would auto gerenate id which would be random but if I want to ID in uniform like 1,2 3...

CSV file is big so cant manually enter ID.

Still facing problem with date data type. I have to manually edit date in YYYY-MM-DD form.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [November 10, 2015, 6:47am UTC](https://discuss.elastic.co/t/facing-issue-when-there-is-non-uniform-data/34126/8 "2015-11-10T06:47:34Z")

</div>

If you are injecting with Python you could probably add a counter in your script.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 11:39pm UTC](https://discuss.elastic.co/t/facing-issue-when-there-is-non-uniform-data/34126/9 "2017-07-05T23:39:33Z")

</div>


