# Analyzer doesn't seems to be working on special characters **URL:** \ **Category:** Elasticsearch\ **Created:** [August 7, 2014, 4:21pm UTC](https://discuss.elastic.co/t/analyzer-doesnt-seems-to-be-working-on-special-characters/19143 "2014-08-07T16:21:07Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![Anand\_kumar](https://avatars.discourse-cdn.com/v4/letter/a/dfb087/32.png) [@Anand\_kumar](https://discuss.elastic.co/u/Anand_kumar)\ **Post date:** [August 7, 2014, 4:21pm UTC](https://discuss.elastic.co/t/analyzer-doesnt-seems-to-be-working-on-special-characters/19143/1 "2014-08-07T16:21:07Z")
Hi all, ``` While indexing the special characters such as copyright symbol, the ``` analyzers seems to be not working. For instance, the copyright symbol © is indexed as question mark symbol inside black diamond � . Any suggestion would be greatly appreciated. Thanks in advance. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/e143c15c-bf31-49da-91ec-16c542bb51d7%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/e143c15c-bf31-49da-91ec-16c542bb51d7%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Ivan](https://avatars.discourse-cdn.com/v4/letter/i/df788c/32.png) [@Ivan](https://discuss.elastic.co/u/Ivan)\ **Post date:** [August 7, 2014, 4:26pm UTC](https://discuss.elastic.co/t/analyzer-doesnt-seems-to-be-working-on-special-characters/19143/2 "2014-08-07T16:26:28Z")
The problem might be with your encoding, not the analyzer. Your content is in one format and either your output is in another or your viewer (terminal, browser) is in another. Make sure everything is consistent (UTF-8 for most people). Where are you seeing the � character? -- Ivan On Thu, Aug 7, 2014 at 9:21 AM, Anand kumar [anandv1000@gmail.com](mailto:anandv1000@gmail.com) wrote: > Hi all, > > ``` > While indexing the special characters such as copyright symbol, the > > ``` > > analyzers seems to be not working. > > For instance, the copyright symbol © is indexed as question mark symbol > inside black diamond � . > > Any suggestion would be greatly appreciated. Thanks in advance. > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/e143c15c-bf31-49da-91ec-16c542bb51d7%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/e143c15c-bf31-49da-91ec-16c542bb51d7%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/e143c15c-bf31-49da-91ec-16c542bb51d7%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/e143c15c-bf31-49da-91ec-16c542bb51d7%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAeyq0CYaCsDgWZ5GVziTr39PVShCoay9yfg%3DjMi9KU%3Dw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAeyq0CYaCsDgWZ5GVziTr39PVShCoay9yfg%3DjMi9KU%3Dw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Anand\_kumar](https://avatars.discourse-cdn.com/v4/letter/a/dfb087/32.png) [@Anand\_kumar](https://discuss.elastic.co/u/Anand_kumar)\ **Post date:** [August 7, 2014, 4:55pm UTC](https://discuss.elastic.co/t/analyzer-doesnt-seems-to-be-working-on-special-characters/19143/3 "2014-08-07T16:55:13Z")
I'm having that symbol in my ES indices only. Yeah some problem existing with the encoding itself. I've tried using setHighlighterEncoding to "HTML", but still the problem persists. There is no problem in indexing and searching, but while displaying in the browser, the issue emerges. The actual text contains copyright symbol, but after the indexing it has been changed to � symbol. I just know wanna know, how this has been changing into this format and is there any other way of encoding to resolve it? Thanks a lot for your reply. On Thu, Aug 7, 2014 at 9:56 PM, Ivan Brusic [ivan@brusic.com](mailto:ivan@brusic.com) wrote: > The problem might be with your encoding, not the analyzer. Your content is > in one format and either your output is in another or your viewer > (terminal, browser) is in another. Make sure everything is consistent > (UTF-8 for most people). > > Where are you seeing the � character? > > -- > Ivan > > On Thu, Aug 7, 2014 at 9:21 AM, Anand kumar [anandv1000@gmail.com](mailto:anandv1000@gmail.com) wrote: > > > Hi all, > > > > ``` > > While indexing the special characters such as copyright symbol, the > > > > ``` > > > > analyzers seems to be not working. > > > > For instance, the copyright symbol © is indexed as question mark symbol > > inside black diamond � . > > > > Any suggestion would be greatly appreciated. Thanks in advance. > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/e143c15c-bf31-49da-91ec-16c542bb51d7%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/e143c15c-bf31-49da-91ec-16c542bb51d7%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/e143c15c-bf31-49da-91ec-16c542bb51d7%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/e143c15c-bf31-49da-91ec-16c542bb51d7%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > [https://groups.google.com/d/topic/elasticsearch/\_FN0tsUkJYs/unsubscribe](https://groups.google.com/d/topic/elasticsearch/_FN0tsUkJYs/unsubscribe). > To unsubscribe from this group and all its topics, send an email to > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAeyq0CYaCsDgWZ5GVziTr39PVShCoay9yfg%3DjMi9KU%3Dw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAeyq0CYaCsDgWZ5GVziTr39PVShCoay9yfg%3DjMi9KU%3Dw%40mail.gmail.com) > [https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAeyq0CYaCsDgWZ5GVziTr39PVShCoay9yfg%3DjMi9KU%3Dw%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAeyq0CYaCsDgWZ5GVziTr39PVShCoay9yfg%3DjMi9KU%3Dw%40mail.gmail.com?utm_medium=email&utm_source=footer) > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- _Kind regards,_ _K.Anandkumar,_ _+91-96778 44774_ -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAH9YyJTF8N1ivs-3mKE%3DrwG9pdAbqGYFXDWP5Wkp6rFQ6w0SVQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAH9YyJTF8N1ivs-3mKE%3DrwG9pdAbqGYFXDWP5Wkp6rFQ6w0SVQ%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:10am UTC](https://discuss.elastic.co/t/analyzer-doesnt-seems-to-be-working-on-special-characters/19143/4 "2017-07-06T01:10:08Z")