# Some entries missing when uploading json file in kibana

**URL:** <https://discuss.elastic.co/t/some-entries-missing-when-uploading-json-file-in-kibana/248448>\
**Category:** Kibana\
**Created:** [September 13, 2020, 6:16pm UTC](https://discuss.elastic.co/t/some-entries-missing-when-uploading-json-file-in-kibana/248448 "2020-09-13T18:16:56Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![Kanav\_Ghai](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kanav_ghai/32/75484_2.png) [@Kanav\_Ghai](https://discuss.elastic.co/u/Kanav_Ghai)\
**Post date:** [September 13, 2020, 6:16pm UTC](https://discuss.elastic.co/t/some-entries-missing-when-uploading-json-file-in-kibana/248448/1 "2020-09-13T18:16:56Z")

</div>

I have 153 entries in my json file, but when i upload the corresponding log file in kibana, it shows 121 entires (sometimes lesser) . I don't understand why is it missing out a few entries. Below is my conf file

```auto
    input {
    	file {
    		path => "C:/Users/ADMIN/Desktop/BTP/tweets.json"
    		start_position => "beginning"
    		sincedb_path => "NULL"
    		type => "json"
            file_completed_log_path => "NULL"
    	}
    }

    filter {
    	json {
    		source => "message"
    	}
    	mutate {
    		remove_field => "message"
    	}
    }

    output {
    	elasticsearch {
    		hosts => "http://localhost:9200"
    		index => "test_json1"
    	}
    }

```

please help

---

<div class="post-metadata">

**Author:** ![aaron-nimocks](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aaron-nimocks/32/73965_2.png) [@aaron-nimocks](https://discuss.elastic.co/u/aaron-nimocks)\
**Post date:** [September 13, 2020, 7:55pm UTC](https://discuss.elastic.co/t/some-entries-missing-when-uploading-json-file-in-kibana/248448/2 "2020-09-13T19:55:00Z")

</div>

Windows - `sincedb_path => "nul"`

Linux - `sincedb_path => "/dev/null"`

You probably don't need `file_completed_log_path` also.

If that doesn't fix it I would try to validate your entire JSON file to ensure it's valid.

---

<div class="post-metadata">

**Author:** ![Kanav\_Ghai](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kanav_ghai/32/75484_2.png) [@Kanav\_Ghai](https://discuss.elastic.co/u/Kanav_Ghai)\
**Post date:** [September 17, 2020, 8:59am UTC](https://discuss.elastic.co/t/some-entries-missing-when-uploading-json-file-in-kibana/248448/3 "2020-09-17T08:59:08Z")

</div>

Thanks for the quick reply!

I tried your suggestion, it didn't work ☹ (displayed 113 entries).

```auto
[2020-09-17T14:07:18,388][WARN][logstash.outputs.elasticsearch][main][d89aae7cfe77d2a0efbee2a8145cb6c61774697e6c27700ab729173ced2aa465] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>nil, :_index=>"test_json1", :routing=>nil, :_type=>"_doc"}, #<LogStash::Event:0x12d7d7aa>], :response=>{"index"=>{"_index"=>"test_json1", "_type"=>"_doc", "_id"=>"epE1m3QBrwJIRxVUweSS", "status"=>400, "error"=>{"type"=>"illegal_argument_exception", "reason"=>"Limit of total fields [1000] in index [test_json1] has been exceeded"}}}}

```

This is my json file

> **[tweets.json](https://drive.google.com/file/d/1YJ7rk8QyJtMk3YRsuJsZQL741ahK0k1v/view?usp=sharing)**
>
> Google Drive file.

  
and this is my conf file  

> **[jsonconf.conf](https://drive.google.com/file/d/1YLrxTyDaXObpjruXX2Ug0O9W2eXywOlO/view?usp=sharing)**
>
> Google Drive file.

---

<div class="post-metadata">

**Author:** ![aaron-nimocks](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aaron-nimocks/32/73965_2.png) [@aaron-nimocks](https://discuss.elastic.co/u/aaron-nimocks)\
**Post date:** [September 17, 2020, 12:46pm UTC](https://discuss.elastic.co/t/some-entries-missing-when-uploading-json-file-in-kibana/248448/4 "2020-09-17T12:46:53Z")

</div>

@Kanav_Ghai I would verify your json is valid. When I run it in a validator it fails.

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/f/2/f2d61232323ea2ec5461523e6458de6e1e5afd83.png)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 15, 2020, 12:47pm UTC](https://discuss.elastic.co/t/some-entries-missing-when-uploading-json-file-in-kibana/248448/5 "2020-10-15T12:47:10Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.