# Es index rate become slow after create index mapping **URL:** \ **Category:** Elasticsearch\ **Created:** [December 29, 2018, 1:36am UTC](https://discuss.elastic.co/t/es-index-rate-become-slow-after-create-index-mapping/162385 "2018-12-29T01:36:38Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![Yanchun](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yanchun/32/35596_2.png) [@Yanchun](https://discuss.elastic.co/u/Yanchun)\ **Post date:** [December 29, 2018, 1:36am UTC](https://discuss.elastic.co/t/es-index-rate-become-slow-after-create-index-mapping/162385/1 "2018-12-29T01:36:38Z")
I write data using ES BulkProcessor(I tried python script, storm es-bolt, flink es-sink), but the index rate is so slow after create index mapping. - Situation 1: Leave all index settings as its default, index rate can reach about 10000+. - Situation 2: Just create index mapping, index rate fall to 3000. I use the same data, same code, same machines. ### result flink es-sink write json data to es: ![es](https://us1.discourse-cdn.com/elastic/original/3X/b/e/be28a38e8f2401c6e4b300024483ac918580ae66.png) ### My data repeat write the same data below(the `message` field is the raw log, it's about 7KB size, the delete some content for exceeding the question limit): ```auto { "_index": "nyc_flink_test997", "_type": "doc", "_id": "k8uS92cBOH4ugSIjCzmn", "_score": 1, "_source": { "exception": "false", "log_id": "8F71AF1606EE46BFA9D57AA2282D8596", "offset": "2368", "message_length": "2103", "level": "INFO", "source": "/opt/hadoop/elastic-stack/s_login/Gusermanager.usermanager.s_login.20.log", "sessionid": "provider-60-2883b4bd3ff2b", "associate_id": "33d081b83a0654a2", "message": """ [16:41:33.376][I][ec4edfe0b2584b73]log start:53F9A1A1E71044E281755E930E1B004C [16:41:33.376][T][ec4edfe0b2584b73]入参0= __REQ__ at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4119) at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2570) at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2731) at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2815) at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2155) at com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:2322) at cn.com.agree.addal.cp.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:46) at tc.bank.aesb.mbs.MBS_DBIMPL.PyDBGetSel(MBS_DBIMPL.java:1624) at tc.bank.aesb.mbs.MBS_DBIMPL.PyDBExecOneSQL(MBS_DBIMPL.java:466) at tc.bank.aesb.mbs.MBS_DBIMPL.PyDBExecGrpSQL(MBS_DBIMPL.java:123) at tc.bank.aesb.mbs.B_MBS_DataBase.B_DBUnityRptOpr(B_MBS_DataBase.java:121) at CUST.CustomerInfoQry.TCustomerInfoQry$Step1$Node4.execute(TCustomerInfoQry.java:200) at CUST.CustomerInfoQry.TCustomerInfoQry$Step1.execute(TCustomerInfoQry.java:113) at CUST.CustomerInfoQry.TCustomerInfoQry.execute(TCustomerInfoQry.java:76) at cn.com.agree.afa.svc.javaengine.JavaEngine.execute(JavaEngine.java:237) at cn.com.agree.afa.svc.handler.TradeHandler.handle(TradeHandler.java:62) [16:41:33.414][I][ec4edfe0b2584b73]log end:53F9A1A1E71044E281755E930E1B004C """, "exec_ip": "10.88.188.167", "start_time": "2018-12-09 16:46:14.764", "group_v2": "Gusermanager", "script_exec_time": "1", "trade_exec_time": "2" } } ``` ### index mapping ```auto { "mappings": { "doc":{ "dynamic_templates": [ { "string_fields": { "match": "*", "match_mapping_type": "string", "mapping": { "type": "text", "norms": false, "fields": { "keyword": { "type": "keyword", "ignore_above": 256 } } } } } ], "properties": { "@timestamp": { "type": "date" }, "@version": { "type": "keyword" }, "geoip": { "dynamic": true, "properties": { "ip": { "type": "ip" }, "location": { "type": "geo_point" }, "latitude": { "type": "half_float" }, "longitude": { "type": "half_float" } } }, "exception": { "type": "boolean" }, "message":{ "type":"text", "norms": false, "analyzer": "ik_max_word" }, "associate_id": { "type": "text", "analyzer": "ik_max_word" }, "end_time": { "type": "date", "format": "date_time||yyyy-MM-dd HH:mm:ss.SSS||yyyy-MM-dd||epoch_millis||HH:mm:ss.SSS" }, "start_time": { "type": "date", "format": "date_time||yyyy-MM-dd HH:mm:ss.SSS||yyyy-MM-dd||epoch_millis||HH:mm:ss.SSS" }, "exec_ip": { "type": "ip" }, "level": { "type": "keyword" }, "script_exec_time": { "type": "long" }, "trade_exec_time": { "type": "long" }, "sessionid": { "type": "text", "analyzer": "ik_max_word" }, "log_id": { "type": "text", "analyzer": "ik_max_word" }, "discard_time": { "type": "long" }, "scene_code": { "type": "text", "analyzer": "ik_max_word" }, "service_code": { "type": "text", "analyzer": "ik_max_word" }, "group": { "type": "text" }, "group_v2" :{ "type": "text", "analyzer": "ik_max_word" }, "message_length":{ "type": "long" }, "log_filename":{ "type": "text", "analyzer": "ik_max_word" }, "ingest_time":{ "type": "date" } } } } } ``` I tried writing with python scirpts, storm es-bolt, the result is same, index rate falls after create index mapping. Can anyone give some ideas about it. Thanks in advance. ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [December 29, 2018, 8:39am UTC](https://discuss.elastic.co/t/es-index-rate-become-slow-after-create-index-mapping/162385/2 "2018-12-29T08:39:09Z")
My guess would be that the `ik_max_word` analyzer is more computationally expensive or slower than the `standard` analyzer which is used with dynamic mappings, but have never used it. ---
**Author:** ![Yanchun](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yanchun/32/35596_2.png) [@Yanchun](https://discuss.elastic.co/u/Yanchun)\ **Post date:** [January 2, 2019, 8:54am UTC](https://discuss.elastic.co/t/es-index-rate-become-slow-after-create-index-mapping/162385/3 "2019-01-02T08:54:46Z")
Thank you, I ignore the change of analyzer, and it's just the reason after I test. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [January 30, 2019, 9:06am UTC](https://discuss.elastic.co/t/es-index-rate-become-slow-after-create-index-mapping/162385/4 "2019-01-30T09:06:50Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.