Hadoop-ES dynamic index exception


(Philip K. Adetiloye) #1

Am getting exception when using a datetime field in the dynamic index

val conf = Map("es.resource" -> "report-{@creation:YYYY-MM}/users", "es.mapping.id" -> "userId")

users.saveToEs(conf)

where creation field = 2016-03-01 16:52:52.933

16/03/17 14:08:02 WARN TaskSetManager: Lost task 5.0 in stage 0.0 (TID 5, localhost): java.lang.IllegalArgumentException: 2016-03-01 16:52:52.933
	at com.sun.org.apache.xerces.internal.jaxp.datatype.XMLGregorianCalendarImpl$Parser.parse(XMLGregorianCalendarImpl.java:2823)
	at com.sun.org.apache.xerces.internal.jaxp.datatype.XMLGregorianCalendarImpl.<init>(XMLGregorianCalendarImpl.java:435)
	at com.sun.org.apache.xerces.internal.jaxp.datatype.DatatypeFactoryImpl.newXMLGregorianCalendar(DatatypeFactoryImpl.java:536)
	at javax.xml.bind.DatatypeConverterImpl._parseDateTime(DatatypeConverterImpl.java:422)
	at javax.xml.bind.DatatypeConverterImpl.parseDateTime(DatatypeConverterImpl.java:417)
	at javax.xml.bind.DatatypeConverter.parseDateTime(DatatypeConverter.java:327)

Any idea ?


(Costin Leau) #2

The date is not ISO 8601 format and thus is invalid and cannot be properly parsed.


(system) #3