I have an unusual problem. We are using ES 1.3.4 (was using ES 1.0.1) and
Couchbase 3.0 (was using CB 2.5.1). We accidentally got a malformed UTF-8
Key into couchbase. Once the Key was in it created an Error in
elasticsearch. Shown below under "create Error from Elasticsearch".
I then was able to delete the offending key from couchbase, and another
error now is generated in elasticsearch. It appears that "XDCR" in
couchbase is attempting to send a "delete" to elasticsearch. I have tried
to reboot the servers, restart replication with elastaticsearch from
couchbase and nothing works. The only way I can stop the errors is to
delete the Database bucket in couchbase and start over. Which would not be
an option in a production system.
As far as unparable JSON data, that has not created any problems in the
past, we just got 2 lines of errors and the system moved on. Once we get
this error, elasticsearch stops replicating new data.
Any Ideas?
CREATE ERROR FROM ELASTICSEARCH
[2014-10-30 15:11:55,217][ERROR][transport.couchbase.capi ] [Hecate] Unable
to parse decoded base64 data as JSON, indexing stub for id: [73, 78, 67,
58, 58, 117, 115, 114, 94, 67, 67, 51, 185, 195, 184, 194, 167, 195, 185,
194, 132, 195, 184, 194, 185, 195, 184, 194, 170, 195, 185, 194, 138, 195,
184, 194, 168, 195, 185, 194, 58, 58, 99, 111, 100, 101]
[2014-10-30 15:11:55,217][ERROR][transport.couchbase.capi ] [Hecate] Body
was: 1 Parse error was: org.codehaus.jackson.map.JsonMappingException: Can
not deserialize instance of java.util.LinkedHashMap out of VALUE_NUMBER_INT
token
at [Source: [B@1ec4378b; line: 1, column: 1]
[2014-10-30 15:12:04,932][INFO ][cluster.metadata ] [Hecate]
[hotelserve] update_mapping [couchbaseDocument] (dynamic)
[2014-10-30 15:12:30,506][WARN ][org.eclipse.jetty.servlet.ServletHandler]
/hotelserve%2f24%3b28ee3b5f5bf24b21a9045cb649a219bd/_bulk_docs
java.lang.RuntimeException: indexing error, bulk failed after all retries
at
org.elasticsearch.transport.couchbase.capi.ElasticSearchCAPIBehavior.bulkDocs(ElasticSearchCAPIBehavior.java:381)
at
com.couchbase.capi.servlet.CAPIServlet.handleBulkDocs(CAPIServlet.java:529)
at
com.couchbase.capi.servlet.CAPIServlet.service(CAPIServlet.java:89)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
at
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:594)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:485)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:486)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:412)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
at org.eclipse.jetty.server.Server.handle(Server.java:351)
at
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:451)
at
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:931)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)
at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
at
org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:76)
at
org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:609)
at
org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:45)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
at java.lang.Thread.run(Thread.java:744)
REMOVE ERROR FROM ELASTICSEARCH
[2014-10-31 16:01:45,622][ERROR][transport.couchbase.capi ] [Hecate] Unable
to parse decoded base64 data as JSON, indexing stub for id: [73, 78, 67,
58, 58, 117, 115, 114, 94, 67, 67, 51, 185, 195, 184, 194, 167, 195, 185,
194, 132, 195, 184, 194, 185, 195, 184, 194, 170, 195, 185, 194, 138, 195,
184, 194, 168, 195, 185, 194, 58, 58, 99, 111, 100, 101]
[2014-10-31 16:01:45,622][ERROR][transport.couchbase.capi ] [Hecate] Body
was: Parse error was: java.io.EOFException: No content to map to Object
due to end of input
[2014-10-31 16:01:45,622][WARN ][org.eclipse.jetty.servlet.ServletHandler] /
hotelserve%2f24%3b28ee3b5f5bf24b21a9045cb649a219bd/_bulk_docs
java.lang.ClassCastException: java.util.ArrayList cannot be cast to
java.lang.String
at
org.elasticsearch.transport.couchbase.capi.ElasticSearchCAPIBehavior.bulkDocs(ElasticSearchCAPIBehavior.java:306)
at
com.couchbase.capi.servlet.CAPIServlet.handleBulkDocs(CAPIServlet.java:529)
at
com.couchbase.capi.servlet.CAPIServlet.service(CAPIServlet.java:89)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
at
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:594)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:485)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:486)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:412)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
at org.eclipse.jetty.server.Server.handle(Server.java:351)
at
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:451)
at
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:931)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)
at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:230)
at
org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:76)
at
org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:609)
at
org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:45)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
at java.lang.Thread.run(Thread.java:744)
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/21c21995-8ce5-4f6f-8170-fde63b923e3d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.