Size limit in a query?

[roy_einhorn]

hi all , today i did a query in the dev tools in the visualize system, of course that the system gave me an error , when i try to make the same get request in the postman - i get great results , is there a size limit in the kibana query in the dev tools?

the error : "type": "json_e_o_f_exception",
"reason": "Unexpected end-of-input: expected close marker for Object (start marker at [Source: org.elasticsearch.common.bytes.BytesReference$MarkSupportingStreamInputWrapper@3f979fee; line: 1, column: 1])\n at [Source: org.elasticsearch.common.bytes.BytesReference$MarkSupportingStreamInputWrapper@3f979fee; line: 3, column: 4263]"

[flash1293 (Joe Reuter)]

Hi @roy_einhorn,

thanks for reaching out.

In general dev tools should be able to handle all kinds of queries. The error message suggests that there were something wrong with the provided JSON body. Can you copy and paste the problematic query here?

[roy_einhorn]

{
"query":
{ "bool" : { "must" : [{ "nested" : { "path" : "locations", "query" : { "bool" : { "must" : [{ "geo_distance" : { "distance" : "100km", "locations.geo" : { "lat" : 37.386051700000003, "lon" : -122.0838511 } } }, { "match" : { "locations.is_primary" : true } }] } } } }, { "nested" : { "path" : "skills", "query" : { "bool" : { "must" : [{ "bool" : { "should" : [{ "match_phrase" : { "skills.name" : "Program Management" } }, { "match_phrase" : { "skills.name" : "PMP" } }, { "match_phrase" : { "skills.name" : "Strategy" } }, { "match_phrase" : { "skills.name" : "Business Transformation" } }, { "match_phrase" : { "skills.name" : "Large Scale Change Management" } }, { "match_phrase" : { "skills.name" : "Digital Transformation" } }, { "match_phrase" : { "skills.name" : "Change Management" } }, { "match_phrase" : { "skills.name" : "Business Change" } }, { "match_phrase" : { "skills.name" : "Transition Management" } }, { "match_phrase" : { "skills.name" : "Transition Planning" } }, { "match_phrase" : { "skills.name" : "Application Management" } }, { "match_phrase" : { "skills.name" : "IT Strategy and Planning" } }, { "match_phrase" : { "skills.name" : "Mobile Application Management" } }, { "match_phrase" : { "skills.name" : "Infrastructure and Networking" } }, { "match_phrase" : { "skills.name" : "Infrastructure" } }, { "match_phrase" : { "skills.name" : "Networking" } }, { "match_phrase" : { "skills.name" : "Cloud" } }, { "match_phrase" : { "skills.name" : "Cloud Applications" } }, { "match_phrase" : { "skills.name" : "Cloud Solutions" } }, { "match_phrase" : { "skills.name" : "Mobility" } }, { "match_phrase" : { "skills.name" : "Mobility Solutions" } }, { "match_phrase" : { "skills.name" : "Managed Service" } }, { "match_phrase" : { "skills.name" : "Automation" } }, { "match_phrase" : { "skills.name" : "Artificial Intelligence" } }] } }, { "bool" : { "should" : [{ "match_phrase" : { "skills.name" : "Program Management" } }, { "match_phrase" : { "skills.name" : "PMP" } }, { "match_phrase" : { "skills.name" : "Strategy" } }, { "match_phrase" : { "skills.name" : "Business Transformation" } }, { "match_phrase" : { "skills.name" : "Large Scale Change Management" } }, { "match_phrase" : { "skills.name" : "Digital Transformation" } }, { "match_phrase" : { "skills.name" : "Change Management" } }, { "match_phrase" : { "skills.name" : "Business Change" } }, { "match_phrase" : { "skills.name" : "Transition Management" } }, { "match_phrase" : { "skills.name" : "Transition Planning" } }, { "match_phrase" : { "skills.name" : "Application Management" } }, { "match_phrase" : { "skills.name" : "IT Strategy and Planning" } }, { "match_phrase" : { "skills.name" : "Mobile Application Management" } }, { "match_phrase" : { "skills.name" : "Infrastructure and Networking" } }, { "match_phrase" : { "skills.name" : "Infrastructure" } }, { "match_phrase" : { "skills.name" : "Networking" } }, { "match_phrase" : { "skills.name" : "Cloud" } }, { "match_phrase" : { "skills.name" : "Cloud Applications" } }, { "match_phrase" : { "skills.name" : "Cloud Solutions" } }, { "match_phrase" : { "skills.name" : "Mobility" } }, { "match_phrase" : { "skills.name" : "Mobility Solutions" } }, { "match_phrase" : { "skills.name" : "Managed Service" } }, { "match_phrase" : { "skills.name" : "Automation" } }, { "match_phrase" : { "skills.name" : "Artificial Intelligence" } }] } }, { "bool" : { "should" : [{ "match_phrase" : { "skills.name" : "Program Management" } }, { "match_phrase" : { "skills.name" : "PMP" } }, { "match_phrase" : { "skills.name" : "Strategy" } }, { "match_phrase" : { "skills.name" : "Business Transformation" } }, { "match_phrase" : { "skills.name" : "Large Scale Change Management" } }, { "match_phrase" : { "skills.name" : "Digital Transformation" } }, { "match_phrase" : { "skills.name" : "Change Management" } }, { "match_phrase" : { "skills.name" : "Business Change" } }, { "match_phrase" : { "skills.name" : "Transition Management" } }, { "match_phrase" : { "skills.name" : "Transition Planning" } }, { "match_phrase" : { "skills.name" : "Application Management" } }, { "match_phrase" : { "skills.name" : "IT Strategy and Planning" } }, { "match_phrase" : { "skills.name" : "Mobile Application Management" } }, { "match_phrase" : { "skills.name" : "Infrastructure and Networking" } }, { "match_phrase" : { "skills.name" : "Infrastructure" } }, { "match_phrase" : { "skills.name" : "Networking" } }, { "match_phrase" : { "skills.name" : "Cloud" } }, { "match_phrase" : { "skills.name" : "Cloud Applications" } }, { "match_phrase" : { "skills.name" : "Cloud Solutions" } }, { "match_phrase" : { "skills.name" : "Mobility" } }, { "match_phrase" : { "skills.name" : "Mobility Solutions" } }, { "match_phrase" : { "skills.name" : "Managed Service" } }, { "match_phrase" : { "skills.name" : "Automation" } }, { "match_phrase" : { "skills.name" : "Artificial Intelligence" } }] } }] } } } }, { "nested" : { "path" : "experience", "query" : { "bool" : { "should" : [{ "match_phrase" : { "experience.company.name" : "Wipro Digital" } }, { "match_phrase" : { "experience.company.name" : "Wipro Technology Services Limited" } }, { "match_phrase" : { "experience.company.name" : "Wipro BPO" } }, { "match_phrase" : { "experience.company.name" : "Wipro" } }, { "match_phrase" : { "experience.company.name" : "Wipro Technologies" } }, { "match_phrase" : { "experience.company.name" : "Wipro Infotech" } }, { "match_phrase" : { "experience.company.name" : "Wipro Consulting" } }, { "match_phrase" : { "experience.company.name" : "Wipro Infrastructure Engineering" } }, { "match_phrase" : { "experience.company.name" : "Wipro Systems" } }] } } } }, { "match" : { "profiles.network" : "linkedin" } }, { "exists" : { "field" : "profiles.ids" } }] } }
}

when i send the request in postman with exactly the same body i get back results

[flash1293 (Joe Reuter)]

Hi @roy_einhorn,

when I'm submitting this query through dev_tools I get back an error message that my schema doesn't match (obviously), but it seems to go through fine. How are you sending the query - as a GET your_index/_search and a JSON body? Also, what version of Kibana are you running?

[roy_einhorn]

the query is sent with
GET /...../doc/_search with json body ,
also in the visual side i don't know if it have an effect but i get the query in colors until one point which the rest of the query is black ( looks like the query is too long) ,

i am using version Version: 6.3.1

[flash1293 (Joe Reuter)]

I can't pinpoint the exact commit, but it seems like this was a limitation in old versions that got fixed at some point. It is unlikely that 6.3 will get this fix backported because this will only happen for critical issues. If this is possible for you I suggest upgrading to a more recent version.

[roy_einhorn]

thanks for the help