# Few questions as I take over from an external Dev **URL:** \ **Category:** Elasticsearch\ **Created:** [November 9, 2020, 5:38am UTC](https://discuss.elastic.co/t/few-questions-as-i-take-over-from-an-external-dev/254705 "2020-11-09T05:38:33Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![M\_Gibbs](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/m_gibbs/32/45665_2.png) [@M\_Gibbs](https://discuss.elastic.co/u/M_Gibbs)\ **Post date:** [November 9, 2020, 5:38am UTC](https://discuss.elastic.co/t/few-questions-as-i-take-over-from-an-external-dev/254705/1 "2020-11-09T05:38:33Z")
Hey all, I'm starting to transition our ES from our external dev to myself. I'm no developer, but can generally learn most things. I have a few questions just to stat getting my head around things. 1. Our current mapping does not include a geo\_point field, but we do have the coordinates. It was just mapped as text. Can I update this field type without needing to create an entirely new indice/index? 2. Is it possible to create a new field, and programmatically update this field with new data, for the index to then be able to return that result in near, but not quite real time? E.g. we have some data that is not mapped with avatars. We'd like to get these avatars (company logos) and update on the fly. Is this possible? 3. We have 300+ million records. Each does have a persistent id. Can we simply update the indice with a new dataset (from S3) or do we need to create an entirely new index each time with the S3 data? 4. Is logstash considered the best resource for indexing data from S3? Thank you! ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [November 9, 2020, 5:48am UTC](https://discuss.elastic.co/t/few-questions-as-i-take-over-from-an-external-dev/254705/2 "2020-11-09T05:48:49Z")
1. You will need to reindex to cast the current text into the new format 2. You can create the field, then update it later, yes. Elasticsearch is near-realtime though, so not sure what that has to do with returning the field in this use 3. Depends what you want to achieve. If the actual number of updates is low, then consider just updating records as needed. If there is a lot of updates, then it'd be more efficient to create a new index 4. Depends what you need to do with the data, if it's just pulling it in then take a look at [https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-input-s3.html](https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-input-s3.html) It sounds like this is user profile-like information, is that right? ---
**Author:** ![M\_Gibbs](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/m_gibbs/32/45665_2.png) [@M\_Gibbs](https://discuss.elastic.co/u/M_Gibbs)\ **Post date:** [November 10, 2020, 9:46pm UTC](https://discuss.elastic.co/t/few-questions-as-i-take-over-from-an-external-dev/254705/3 "2020-11-10T21:46:16Z")
Thank you @warkolm for your answers. Yes, it's a combo of company/profile data. I'm going to look at filebeat now. Quick question before I go down that rabbit hole - do I need to first 'map' the fields before it's indexed, or as part of the indexing process I am able to do this within filebeat? ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [November 10, 2020, 10:46pm UTC](https://discuss.elastic.co/t/few-questions-as-i-take-over-from-an-external-dev/254705/4 "2020-11-10T22:46:00Z")
Elasticsearch will figure it out as best it can - dynamic mapping. When you are starting it's usually a good idea to test a bit of data, then grab the mappings, tweak as you need, then setup a template. ---
**Author:** ![M\_Gibbs](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/m_gibbs/32/45665_2.png) [@M\_Gibbs](https://discuss.elastic.co/u/M_Gibbs)\ **Post date:** [November 10, 2020, 10:47pm UTC](https://discuss.elastic.co/t/few-questions-as-i-take-over-from-an-external-dev/254705/5 "2020-11-10T22:47:43Z")
Got it. Unfortunately the dynamic mapping we used previously, didn't pick up coordinates as a geo\_point so we can't use the radius/bounding box - which is one of the reasons we need to remap and reindex. Is setting up a template available in filebeat? ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [November 10, 2020, 10:49pm UTC](https://discuss.elastic.co/t/few-questions-as-i-take-over-from-an-external-dev/254705/6 "2020-11-10T22:49:13Z")
Filebeat has built in templates. But you can also define your own. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [December 8, 2020, 10:49pm UTC](https://discuss.elastic.co/t/few-questions-as-i-take-over-from-an-external-dev/254705/7 "2020-12-08T22:49:14Z")
Closed on December 8, 2020, 10:49pm UTC This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.