Max_allowed_packet error

Elastic Stack Elasticsearch
1

Hi,

I want to do index mysql data with ES(2.3.3). I am using Mysql and php platform now.
My data size is 600.000.000 and I can't do index. My error:

Got a packet bigger than 'max_allowed_packet' bytes

I changed max_allowed_packet=1G in my.cnf but it didn't index.

What can I do? how much indexed data limit should be ? Is there such a limit?

2

This is a MySQL question in Elasticsearch discussion, you can not expect many answers.

Consider the following:

  • the data size has nothing to do with max_allowed_packet. There is no practical limit.
  • the default max_allowed_packet can be viewed with show variables like 'max_allowed_packet' in MySQL client.
  • Increase number carefully. A number too high will have massive impact on your system, it will not work any more. Maximum should be around 16M. 1G is much too high.
  • you have to change it on both client and server. Check MySQL documentation how to do that https://dev.mysql.com/doc/refman/5.7/en/packet-too-large.html
3

Sorry, you are right.
Thank you .