# Using Elastic stack

**URL:** <https://discuss.elastic.co/t/using-elastic-stack/73171>\
**Category:** Logstash\
**Created:** [January 30, 2017, 9:16am UTC](https://discuss.elastic.co/t/using-elastic-stack/73171 "2017-01-30T09:16:12Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![avivc](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/avivc/32/16501_2.png) [@avivc](https://discuss.elastic.co/u/avivc)\
**Post date:** [January 30, 2017, 9:16am UTC](https://discuss.elastic.co/t/using-elastic-stack/73171/1 "2017-01-30T09:16:12Z")

</div>

Hi,  
As a new user of Elastic, I'm trying to to establish an architecture for my needs. I'll describe my Dilemmas:  
I'm using a service API(CA agile control) that holds thousands data records. In this API, it is possible to get maximum 2000 records at a time.  
Due to Logstash limitation, it cannot indexing my records (e.g., read 1st 2000 records and than starts from record index 2001 for the next 2000 records and so on..). There is no straight forward iteration solution based on Logstash configuration file

I can create an intermediate toolkit that iterate over my service API, for each 2000 record by index, and send it to Logstash - and from there to Elasticsearch and Kibana.

My questions are(For the long term):

- What are the benefits of using Elastic stack in this case?
- according to above, is it necessary to use Logstash? is it better to set my toolkit straight forward to Elasticsearch?
- I'll need to use **Beats** component to ship data from more than 1 data source. Can beats talk directly with Elasticsearch and skip Logstash? If not, what are the advantages?

I hope I made myself clear. Sorry for the length. I'm trying to set up my needs as clear as possible  
Thanks

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [January 30, 2017, 9:21am UTC](https://discuss.elastic.co/t/using-elastic-stack/73171/2 "2017-01-30T09:21:19Z")

</div>

> What are the benefits of using Elastic stack in this case?  
> according to above, is it necessary to use Logstash? is it better to set my toolkit straight forward to Elasticsearch?

It's never _necessary_ to use Logstash but it's often convenient, but for some more specialized use cases it's inadequate.

> I'll need to use Beats component to ship data from more than 1 data source. Can beats talk directly with Elasticsearch and skip Logstash? If not, what are the advantages?

Yes, it can.

---

<div class="post-metadata">

**Author:** ![avivc](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/avivc/32/16501_2.png) [@avivc](https://discuss.elastic.co/u/avivc)\
**Post date:** [January 30, 2017, 9:26am UTC](https://discuss.elastic.co/t/using-elastic-stack/73171/3 "2017-01-30T09:26:58Z")

</div>

Tnx @magnusbaeck  
By saying Logstash it's often convenient, what do you mean? in which cases?

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [January 30, 2017, 9:31am UTC](https://discuss.elastic.co/t/using-elastic-stack/73171/4 "2017-01-30T09:31:35Z")

</div>

Do you want me enumerate all the cases where using Logstash is easier than writing a custom script?

---

<div class="post-metadata">

**Author:** ![avivc](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/avivc/32/16501_2.png) [@avivc](https://discuss.elastic.co/u/avivc)\
**Post date:** [January 30, 2017, 9:36am UTC](https://discuss.elastic.co/t/using-elastic-stack/73171/5 "2017-01-30T09:36:51Z")

</div>

No. off course not 🙂  
Any relevant links/tutorial that you can recommend? for this case

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 27, 2017, 9:37am UTC](https://discuss.elastic.co/t/using-elastic-stack/73171/6 "2017-02-27T09:37:03Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
