Error on Pattern Capture token filter

Faillissements_Dossi · August 10, 2013, 7:47pm

Hi,

I got an error on the Pattern Capture token filter.

I try to set the analyzer with the code: (using Head)

XPUT http://localhost:9200/index/_settings

{
"analysis": {
"filter": {
"artikel": {
"type": "pattern_capture",
"patterns": [
"(art\. |artikel |artikelen |op( de|) voet van )(.+?)( BW| van
het Burgerlijk Wetboek| Rv| van het Wetboek van Burgerlijke
Rechtsvordering)"
]
}
},
"analyzer": {
"artikel": {
"tokenizer": "pattern"
}
}
}
}

After opening the index again, I got a error in the logs:

Caused by: java.lang.ClassNotFoundException:
org.elasticsearch.index.analysis.patterncapture.PatternCaptureTokenFilterFactory
at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
at
org.elasticsearch.common.settings.ImmutableSettings.loadClass(ImmutableSettings.java:346)
... 17 more

I use ES 0.90.1

Please advice.

Thanks, Marcel

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Faillissements_Dossi · August 10, 2013, 8:58pm

Op zaterdag 10 augustus 2013 21:47:59 UTC+2 schreef Faillissements Dossier:

Hi,

I got an error on the Pattern Capture token filter.

I try to set the analyzer with the code: (using Head)

XPUT http://localhost:9200/index/_settings

{
"analysis": {
"filter": {
"artikel": {
"type": "pattern_capture",
"patterns": [
"(art\. |artikel |artikelen |op( de|) voet van )(.+?)( BW| van
het Burgerlijk Wetboek| Rv| van het Wetboek van Burgerlijke
Rechtsvordering)"
]
}
},
"analyzer": {
"artikel": {
"tokenizer": "pattern"
}
}
}
}

After opening the index again, I got a error in the logs:

org.elasticsearch.indices.IndexCreationException: [recht] failed to create
index
at
org.elasticsearch.indices.InternalIndicesService.createIndex(Internal
IndicesService.java:382)
at
org.elasticsearch.indices.cluster.IndicesClusterStateService.applyNewIndices(IndicesClusterStateService.java:296)
at
org.elasticsearch.indices.cluster.IndicesClusterStateService.clusterChanged(IndicesClusterStateService.java:162)
at
org.elasticsearch.cluster.service.InternalClusterService$2.run(InternalClusterService.java:321)
at
org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecu

tor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:95)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor
.java:615)
at java.lang.Thread.run(Thread.java:679)
Caused by: org.elasticsearch.ElasticSearchIllegalArgumentException: failed
to find token filter type [pattern_capture] for [artikel]
at
org.elasticsearch.index.analysis.AnalysisModule.configure(AnalysisModule.java:249)
at
org.elasticsearch.common.inject.AbstractModule.configure(AbstractModule.java:60)
at
org.elasticsearch.common.inject.spi.Elements$RecordingBinder.install(Elements.java:201)
at
org.elasticsearch.common.inject.spi.Elements.getElements(Elements.java:82)
at
org.elasticsearch.common.inject.InjectorShell$Builder.build(InjectorShell.java:130)
at
org.elasticsearch.common.inject.InjectorBuilder.build(InjectorBuilder.java:99)
at
org.elasticsearch.common.inject.InjectorImpl.createChildInjector(InjectorImpl.java:129)
at
org.elasticsearch.common.inject.ModulesBuilder.createChildInjector(ModulesBuilder.java:66)
at
org.elasticsearch.indices.InternalIndicesService.createIndex(InternalIndicesService.java:380)
... 7 more
Caused by: org.elasticsearch.common.settings.NoClassSettingsException:
Failed to load class setting [type] with value [pattern_capture]
at
org.elasticsearch.common.settings.ImmutableSettings.loadClass(ImmutableSettings.java:348)
at
org.elasticsearch.common.settings.ImmutableSettings.getAsClass(ImmutableSettings.java:336)
at
org.elasticsearch.index.analysis.AnalysisModule.configure(AnalysisModule.java:239)
... 15 more

Caused by: java.lang.ClassNotFoundException:
org.elasticsearch.index.analysis.patterncapture.PatternCaptureTokenFilterFactory
at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
at
org.elasticsearch.common.settings.ImmutableSettings.loadClass(ImmutableSettings.java:346)
... 17 more

I use ES 0.90.1

Please advice.

Thanks, Marcel

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Ivan · August 10, 2013, 11:12pm

Although the issue says that featured was released with version 0.90.0, I
don't think it was released until version 0.90.3.

--
Ivan

On Sat, Aug 10, 2013 at 1:58 PM, Faillissements Dossier <ronald@binqmedia.nl

wrote:

Op zaterdag 10 augustus 2013 21:47:59 UTC+2 schreef Faillissements Dossier:

Hi,

I got an error on the Pattern Capture token filter.

I try to set the analyzer with the code: (using Head)

XPUT http://localhost:9200/index/_**settings http://localhost:9200/index/_settings

{
"analysis": {
"filter": {
"artikel": {
"type": "pattern_capture",
"patterns": [
"(art\. |artikel |artikelen |op( de|) voet van )(.+?)( BW| van
het Burgerlijk Wetboek| Rv| van het Wetboek van Burgerlijke
Rechtsvordering)"
]
}
},
"analyzer": {
"artikel": {
"tokenizer": "pattern"
}
}
}
}

After opening the index again, I got a error in the logs:

org.elasticsearch.indices.IndexCreationException: [recht] failed to
create index
at
org.elasticsearch.indices.InternalIndicesService.createIndex(Internal
IndicesService.java:382)
at
org.elasticsearch.indices.cluster.IndicesClusterStateService.applyNewIndices(IndicesClusterStateService.java:296)
at
org.elasticsearch.indices.cluster.IndicesClusterStateService.clusterChanged(IndicesClusterStateService.java:162)
at
org.elasticsearch.cluster.service.InternalClusterService$2.run(InternalClusterService.java:321)
at
org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecu

tor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:95)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor
.java:615)
at java.lang.Thread.run(Thread.java:679)
Caused by: org.elasticsearch.ElasticSearchIllegalArgumentException: failed
to find token filter type [pattern_capture] for [artikel]
at
org.elasticsearch.index.analysis.AnalysisModule.configure(AnalysisModule.java:249)
at
org.elasticsearch.common.inject.AbstractModule.configure(AbstractModule.java:60)
at
org.elasticsearch.common.inject.spi.Elements$RecordingBinder.install(Elements.java:201)
at
org.elasticsearch.common.inject.spi.Elements.getElements(Elements.java:82)
at
org.elasticsearch.common.inject.InjectorShell$Builder.build(InjectorShell.java:130)
at
org.elasticsearch.common.inject.InjectorBuilder.build(InjectorBuilder.java:99)
at
org.elasticsearch.common.inject.InjectorImpl.createChildInjector(InjectorImpl.java:129)
at
org.elasticsearch.common.inject.ModulesBuilder.createChildInjector(ModulesBuilder.java:66)
at
org.elasticsearch.indices.InternalIndicesService.createIndex(InternalIndicesService.java:380)
... 7 more
Caused by: org.elasticsearch.common.settings.NoClassSettingsException:
Failed to load class setting [type] with value [pattern_capture]
at
org.elasticsearch.common.settings.ImmutableSettings.loadClass(ImmutableSettings.java:348)
at
org.elasticsearch.common.settings.ImmutableSettings.getAsClass(ImmutableSettings.java:336)
at
org.elasticsearch.index.analysis.AnalysisModule.configure(AnalysisModule.java:239)
... 15 more

Caused by: java.lang.ClassNotFoundException: org.elasticsearch.index.
analysis.patterncapture.PatternCaptureTokenFilterFactory
at java.net.URLClassLoader$1.run(**URLClassLoader.java:217)
at java.security.**AccessController.doPrivileged(**Native Method)
at java.net.URLClassLoader.**findClass(URLClassLoader.java:**205)
at java.lang.ClassLoader.**loadClass(ClassLoader.java:**321)
at sun.misc.Launcher$AppClassLoader.loadClass(
Launcher.java:294)
at java.lang.ClassLoader.**loadClass(ClassLoader.java:**266)
at org.elasticsearch.common.settings.ImmutableSettings.
loadClass(ImmutableSettings.**java:346)
... 17 more

I use ES 0.90.1

Please advice.

Thanks, Marcel

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

simonw_2 · August 11, 2013, 7:04am

On Sunday, August 11, 2013 1:12:05 AM UTC+2, Ivan Brusic wrote:

Although the issue says that featured was released with version 0.90.0, I
don't think it was released until version 0.90.3.

this is correct, I fixed the label on the issue:

github.com/elastic/elasticsearch

Analysis: Add the pattern_capture token filter

opened 01:30PM - 16 Jul 13 UTC

closed 04:20PM - 16 Jul 13 UTC

clintongormley

>enhancement v1.0.0.Beta1 v0.90.3

The `pattern_capture` token filter, unlike the `pattern` tokenizer, emits a toke…n for every capture group in the regular expression. Patterns are not anchored to the beginning and end of the string, so each pattern can match multiple times, and matches are allowed to overlap. For instance a pattern like : ``` "(([a-z]+)(\d*))" ``` when matched against: ``` "abc123def456" ``` would produce the tokens: [ `abc123`, `abc`, `123`, `def456`, `def`, `456` ] If `preserve_original` is set to `true` then it would also emit the original token: `abc123def456`. This is particularly useful for indexing text like camel-case code, eg `stripHTML` where a user may search for `"strip html"` or `"striphtml"`: ``` curl -XPUT localhost:9200/test/ -d ' { "settings" : { "analysis" : { "filter" : { "code" : { "type" : "pattern_capture", "preserve_original" : 1, "patterns" : [ "(\\p{Ll}+|\\p{Lu}\\p{Ll}+|\\p{Lu}+)", "(\\d+)" ] } }, "analyzer" : { "code" : { "tokenizer" : "pattern", "filter" : [ "code", "lowercase" ] } } } } } ' ``` When used to analyze the text `"import static org.apache.commons.lang.StringEscapeUtils.escapeHtml"`, this emits the tokens: [ `import`, `static`, `org`, `apache`, `commons`, `lang`, `stringescapeutils`, `string`, `escape`, `utils`, `escapehtml`, `escape`, `html` ] Another example is analyzing email addresses: ``` curl -XPUT localhost:9200/test/ -d ' { "settings" : { "analysis" : { "filter" : { "email" : { "type" : "pattern_capture", "preserve_original" : 1, "patterns" : [ "(\\w+)", "(\\p{L}+)", "(\\d+)", "@(.+)" ] } }, "analyzer" : { "email" : { "tokenizer" : "uax_url_email", "filter" : [ "email", "lowercase", "unique" ] } } } } } ' ``` When the above analyzer is used on an email address like `john-smith_123@foo-bar.com` it would produce the following tokens: [`john-smith_123@foo-bar.com`, `john`, `smith_123`, `smith`, `123`, `foo`, `foo-bar.com`, `bar`, `com`] Multiple patterns are required to allow overlapping captures, but also means that patterns are less dense and easier to understand. Note: All tokens are emitted in the same position, and with the same character offsets, so when combined with highlighting, the whole original token will be highlighted, not just the matching subset. For instance, querying the above email address for `"smith"` would highlight `"<em>john-smith_123@foo-bar.com</em>"`, not `"john-<em>smith</em>_123@foo-bar.com"`

simon

--
Ivan

On Sat, Aug 10, 2013 at 1:58 PM, Faillissements Dossier <
ron...@binqmedia.nl <javascript:>> wrote:

Op zaterdag 10 augustus 2013 21:47:59 UTC+2 schreef Faillissements
Dossier:

Hi,

I got an error on the Pattern Capture token filter.

I try to set the analyzer with the code: (using Head)

XPUT http://localhost:9200/index/_**settings http://localhost:9200/index/_settings

{
"analysis": {
"filter": {
"artikel": {
"type": "pattern_capture",
"patterns": [
"(art\. |artikel |artikelen |op( de|) voet van )(.+?)( BW|
van het Burgerlijk Wetboek| Rv| van het Wetboek van Burgerlijke
Rechtsvordering)"
]
}
},
"analyzer": {
"artikel": {
"tokenizer": "pattern"
}
}
}
}

After opening the index again, I got a error in the logs:

org.elasticsearch.indices.IndexCreationException: [recht] failed to
create index
at
org.elasticsearch.indices.InternalIndicesService.createIndex(Internal
IndicesService.java:382)
at
org.elasticsearch.indices.cluster.IndicesClusterStateService.applyNewIndices(IndicesClusterStateService.java:296)
at
org.elasticsearch.indices.cluster.IndicesClusterStateService.clusterChanged(IndicesClusterStateService.java:162)
at
org.elasticsearch.cluster.service.InternalClusterService$2.run(InternalClusterService.java:321)
at
org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecu

tor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:95)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor
.java:615)
at java.lang.Thread.run(Thread.java:679)
Caused by: org.elasticsearch.ElasticSearchIllegalArgumentException:
failed to find token filter type [pattern_capture] for [artikel]
at
org.elasticsearch.index.analysis.AnalysisModule.configure(AnalysisModule.java:249)
at
org.elasticsearch.common.inject.AbstractModule.configure(AbstractModule.java:60)
at
org.elasticsearch.common.inject.spi.Elements$RecordingBinder.install(Elements.java:201)
at
org.elasticsearch.common.inject.spi.Elements.getElements(Elements.java:82)
at
org.elasticsearch.common.inject.InjectorShell$Builder.build(InjectorShell.java:130)
at
org.elasticsearch.common.inject.InjectorBuilder.build(InjectorBuilder.java:99)
at
org.elasticsearch.common.inject.InjectorImpl.createChildInjector(InjectorImpl.java:129)
at
org.elasticsearch.common.inject.ModulesBuilder.createChildInjector(ModulesBuilder.java:66)
at
org.elasticsearch.indices.InternalIndicesService.createIndex(InternalIndicesService.java:380)
... 7 more
Caused by: org.elasticsearch.common.settings.NoClassSettingsException:
Failed to load class setting [type] with value [pattern_capture]
at
org.elasticsearch.common.settings.ImmutableSettings.loadClass(ImmutableSettings.java:348)
at
org.elasticsearch.common.settings.ImmutableSettings.getAsClass(ImmutableSettings.java:336)
at
org.elasticsearch.index.analysis.AnalysisModule.configure(AnalysisModule.java:239)
... 15 more

Caused by: java.lang.*ClassNotFoundException: org.elasticsearch.index.
*analysis.patterncapture.PatternCaptureTokenFilterFactory
at java.net.URLClassLoader$1.run(**URLClassLoader.java:217)
at java.security.**AccessController.doPrivileged(**Native
Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:
205)
at java.lang.ClassLoader.**loadClass(ClassLoader.java:**321)
at sun.misc.Launcher$AppClassLoader.loadClass(
Launcher.java:294)
at java.lang.ClassLoader.**loadClass(ClassLoader.java:**266)
at org.elasticsearch.common.settings.ImmutableSettings.
loadClass(ImmutableSettings.**java:346)
... 17 more

I use ES 0.90.1

Please advice.

Thanks, Marcel

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Faillissements_Dossi · August 11, 2013, 12:13pm

Thanks.

How do I upgrade from 0.90.1 to 0.90.3 and keep the data?

Marcel

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Faillissements_Dossi · August 11, 2013, 9:03pm

I upgraded to 0.90.3 and pattern_capture works.

But now I'm confused how it works.

I have a text like:

*taansprakelijk zijn uit hoofde van bestuurdersaansprakelijkheid ex artikel
2:248 BW en hoofdelijke veroordeling van [geintimeerde sub 1.] c.s. tot
betaling van..... de verplichtingen uit artikel 2:10 BW en dat de
bestuurders *

I only want to capture "artikel 2:248 BW" and "artikel 2:10 BW"

Using the json below doesn't give this back. When I test the analyzer with
Inquisitor I get all the individual words and not the phrases I need.

{
"analysis": {
"filter": {
"artikel": {
"type": "pattern_capture",
"preserve_original": 1,
"patterns": [
"(artikel .+? BW)",
"(.:...)"
]
}
},
"analyzer": {
"artikel": {
"tokenizer": "pattern",
"filter": [
"artikel",
"lowercase"
]
}
}
}
}

Please advice
Marcel

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Topic		Replies	Views
Understanding the java code (Pattern Capture token filter) Elasticsearch	1	204	May 21, 2022
Need help with Pattern Capture Token Filter Elasticsearch	1	193	May 2, 2022
Problem configuring PatternReplaceFilter Elasticsearch	7	714	July 6, 2017
How to configure a pattern_capture on a specific token type? Elasticsearch	1	381	July 6, 2017
Unknown char_filter type [pattern_replace] Elasticsearch	8	2532	April 27, 2018

Error on Pattern Capture token filter

Related topics