# Index not being created in Elastic search - S3 as input -
**URL:** https://discuss.elastic.co/t/index-not-being-created-in-elastic-search-s3-as-input/113661
**Category:** Logstash
**Created:** [December 31, 2017, 2:55pm UTC](https://discuss.elastic.co/t/index-not-being-created-in-elastic-search-s3-as-input/113661 "2017-12-31T14:55:03Z")
**Posts on this page:** 6
**Page:** 1
### Author:  [@elastico\_imp](https://discuss.elastic.co/u/elastico_imp)
#### Post date: [December 31, 2017, 2:55pm UTC](https://discuss.elastic.co/t/index-not-being-created-in-elastic-search-s3-as-input/113661/1 "2017-12-31T14:55:03Z")
please find the trace .. iam testing out S3 as input have Cloudtrail events in S3 buckets from all accounts. trying to ingest to ES. LS doesnt create index.
---
### Author:  [@elastico\_imp](https://discuss.elastic.co/u/elastico_imp)
#### Post date: [December 31, 2017, 2:56pm UTC](https://discuss.elastic.co/t/index-not-being-created-in-elastic-search-s3-as-input/113661/2 "2017-12-31T14:56:42Z")
My conf file
input {
s3 {
bucket =\> "xyzzz-cloudtrail-logs"
aws\_credentials\_file =\> "/root/logstash-5.3.0/config/aws\_credentials.yaml"
prefix =\> "AWSLogs/192006145812/CloudTrail"
add\_field =\> { source =\> gzfiles }
codec =\> cloudtrail {}
sincedb\_path =\> "/dev/null"
type =\> "cloud\_trail\_log"
interval =\> 30
region =\> "us-east-1"
}
}
output {
stdout { codec =\> json\_lines }
elasticsearch {
hosts =\> ["host:9200"]
action =\>"index"
index =\> "logstash-%{+YYYY.MM.dd}"
}
}
---
### Author:  [@elastico\_imp](https://discuss.elastic.co/u/elastico_imp)
#### Post date: [December 31, 2017, 3:08pm UTC](https://discuss.elastic.co/t/index-not-being-created-in-elastic-search-s3-as-input/113661/3 "2017-12-31T15:08:10Z")
[2017-12-31T09:58:58,799][DEBUG][o.e.a.a.i.m.p.TransportPutMappingAction] [blackbox-a] failed to put mappings on indices [[[cloudtrail\_logstash\_2/PffmrcHhQEG9sW192v9NqQ]]], type [cloudtrail]
java.lang.IllegalArgumentException: Limit of total fields [1000] in index [cloudtrail\_logstash\_2] has been exceeded
at org.elasticsearch.index.mapper.MapperService.checkTotalFieldsLimit(MapperService.java:604) ~[elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:420) ~[elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:336) ~[elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:268) ~[elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:311) ~[elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:230) ~[elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.cluster.service.ClusterService.executeTasks(ClusterService.java:634) ~[elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.cluster.service.ClusterService.calculateTaskOutputs(ClusterService.java:612) ~[elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.cluster.service.ClusterService.runTasks(ClusterService.java:571) [elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.cluster.service.ClusterService$ClusterServiceTaskBatcher.run(ClusterService.java:263) [elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:569) [elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:247) [elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:210) [elasticsearch-5.5.1.jar:5.5.1]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0\_144]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0\_144]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0\_144]
---
### Author:  [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [January 1, 2018, 3:11am UTC](https://discuss.elastic.co/t/index-not-being-created-in-elastic-search-s3-as-input/113661/4 "2018-01-01T03:11:41Z")
> [@elastico\_imp](#):
>
> Limit of total fields [1000] in index [cloudtrail\_logstash\_2] has been exceeded
You will need to increase the limit or trim your document size.
---
### Author:  [@elastico\_imp](https://discuss.elastic.co/u/elastico_imp)
#### Post date: [January 1, 2018, 3:00pm UTC](https://discuss.elastic.co/t/index-not-being-created-in-elastic-search-s3-as-input/113661/5 "2018-01-01T15:00:52Z")
thanks for quick reply. Sorry for confusion. lIMIT OF TOTAL FIELDS TO 1000 was addressed and i still dont see index being created. Above is my configuration file and the debug trace i provided.
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [January 29, 2018, 3:00pm UTC](https://discuss.elastic.co/t/index-not-being-created-in-elastic-search-s3-as-input/113661/6 "2018-01-29T15:00:58Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.