# Data management

**URL:** <https://discuss.elastic.co/t/data-management/315371>\
**Category:** Elasticsearch\
**Created:** [September 28, 2022, 11:51am UTC](https://discuss.elastic.co/t/data-management/315371 "2022-09-28T11:51:07Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Juanfer](https://avatars.discourse-cdn.com/v4/letter/j/c67d28/32.png) [@Juanfer](https://discuss.elastic.co/u/Juanfer)\
**Post date:** [September 28, 2022, 11:51am UTC](https://discuss.elastic.co/t/data-management/315371/1 "2022-09-28T11:51:07Z")

</div>

Hi there, I have a question regarding the organization in Kibana. Since I am a beginner I want to understand the scope and best practices for my data storage in there. I will have 3 datasets which at some point I will like to merge/nest together 2 of them based on a column. For instance:

index1.id == index2.campaign\_id

I am aware of the limitations of performing SQL so my questions are the following:

1. Is it feasible to perform that connection within Elastic or should be better before uploading to elastic.
2. Is it possible to execute through the Python API, perform similar SQL actions and bulk-import them back to elastic (This ignores the original benefits of elastic)
3. In case performing the acton inside elastic is best, what would be a good start for me to learn about it? I have read the docs and still I have a lot of gaps in how to perform such a query.

I thank you in advance for the help.

Best,  
Juan

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [October 4, 2022, 5:14am UTC](https://discuss.elastic.co/t/data-management/315371/2 "2022-10-04T05:14:41Z")

</div>

1. Elasticsearch cannot do this, you will need to do it externally
2. Yes
3. N/A

---

<div class="post-metadata">

**Author:** ![Juanfer](https://avatars.discourse-cdn.com/v4/letter/j/c67d28/32.png) [@Juanfer](https://discuss.elastic.co/u/Juanfer)\
**Post date:** [October 4, 2022, 8:27am UTC](https://discuss.elastic.co/t/data-management/315371/3 "2022-10-04T08:27:12Z")

</div>

Thanks Mark for your answer. Then I think I will in the meantime to data transformations outside Elastic and then allocate there.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 1, 2022, 8:28am UTC](https://discuss.elastic.co/t/data-management/315371/4 "2022-11-01T08:28:07Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.