i am trying to copy data (more then 300 million rows) from hive table to Elasticsearch using this query:- insert overwrite table TableNameES select * from HiveTableName;
& after inserting some of rows i am getting this exception. i know this is because of different data type of mapping in ES ...
Caused by: org.elasticsearch.hadoop.rest.EsHadoopInvalidRequest: Found unrecoverable error [xx.xx.xx.xx:9200] returned Bad Request(400) - [MapperParsingException[failed to parse [pctblack.pctblack_raw]]; nested: NumberFormatException[For input string: "(S)"]; ]; Bailing out..**
i want to skip inserting those row which one giving error not only this exception may be other exception.