# Unable to escape special character ""

**URL:** <https://discuss.elastic.co/t/unable-to-escape-special-character/273474>\
**Category:** Logstash\
**Created:** [May 20, 2021, 6:44am UTC](https://discuss.elastic.co/t/unable-to-escape-special-character/273474 "2021-05-20T06:44:34Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![ravi-shanker](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ravi-shanker/32/87347_2.png) [@ravi-shanker](https://discuss.elastic.co/u/ravi-shanker)\
**Post date:** [May 20, 2021, 6:44am UTC](https://discuss.elastic.co/t/unable-to-escape-special-character/273474/1 "2021-05-20T06:44:34Z")

</div>

I am trying to index my data into elasticsearch cluster through logstash. Currently my data is in aws postgres and i have to move data from postgres to elasticsearch.

Below is my logstash config file:

input {  
jdbc {  
jdbc\_connection\_string =\> "jdbc:postgresql://dtacsqldb-ccms-postgresql-dtacqual-1a.cpzfa7z6lrue.us-east-1.rds.amazonaws.com/dtacqual"  
jdbc\_user =\> "dtacuser"  
jdbc\_password =\> "xyz"  
jdbc\_driver\_library =\> "/solr-index/Logstash/logstash-7.12.1/logstash-core/lib/jars/postgresql-jdbc.jar"  
jdbc\_driver\_class =\> "org.postgresql.Driver"  
schedule =\> "\* \* \* \* \*" # cronjob schedule format (see "Helpful Links")  
#jdbc\_paging\_enabled =\> "true"  
#jdbc\_page\_size =\> "300"  
statement =\> "SELECT DISTINCT PYID AS "ID" FROM U90CCMWT.Marketing LIMIT 5"  
}  
}  
output {  
# used to output the values in the terminal (DEBUGGING)  
# once everything is working, comment out this line  
stdout { codec =\> "json" }  
# used to output the values into elasticsearch  
elasticsearch {  
hosts =\> ["http://ip\_of\_node:9200"]  
index =\> "vikings\_es"  
#document\_id =\> "{101}"  
#doc\_as\_upsert =\> true # upserts documents (e.g. if the document does not exist, creates a new record)  
}  
}

i am getting below error while running this logstash file for indexing data

Using bundled JDK: /solr-index/Logstash/logstash-7.12.1/jdk  
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.  
Sending Logstash logs to /solr-index/Logstash/logstash-7.12.1/logs which is now configured via log4j2.properties  
[2021-05-20T06:27:41,874][INFO][logstash.runner] Log4j configuration path used is: /solr-index/Logstash/logstash-7.12.1/config/log4j2.properties  
[2021-05-20T06:27:41,886][INFO][logstash.runner] Starting Logstash {"logstash.version"=\>"7.12.1", "jruby.version"=\>"jruby 9.2.13.0 (2.5.7) 2020-08-03 9a89c94bcc OpenJDK 64-Bit Server VM 11.0.10+9 on 11.0.10+9 +indy +jit [linux-x86\_64]"}  
[2021-05-20T06:27:42,300][WARN][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified  
[2021-05-20T06:27:42,913][INFO][logstash.agent] Successfully started Logstash API endpoint {:port=\>9600}  
[2021-05-20T06:27:43,152][ERROR][logstash.agent] Failed to execute action {:action=\>LogStash::PipelineAction::Create/pipeline\_id:test, :exception=\>"LogStash::ConfigurationError", :message=\>"Expected one of [\t\r\n], "#", "{", "}" at line 11, column 41 (byte 582) after input {\n jdbc {\n jdbc\_connection\_string =\> "jdbc:postgresql://dtacsqldb-ccms-postgresql-dtacqual-1a.cpzfa7z6lrue.us-east-1.rds.amazonaws.com/dtacqual"\n jdbc\_user =\> "dtacuser"\n jdbc\_password =\> "xyz"\n jdbc\_driver\_library =\> "/solr-index/Logstash/logstash-7.12.1/logstash-core/lib/jars/postgresql-jdbc.jar"\n jdbc\_driver\_class =\> "org.postgresql.Driver"\n schedule =\> "\* \* \* \* \*" # cronjob schedule format (see "Helpful Links")\n\t#jdbc\_paging\_enabled =\> "true"\n\t#jdbc\_page\_size =\> "300"\n\tstatement =\> "SELECT DISTINCT PYID AS "", :backtrace=\>["/solr-index/Logstash/logstash-7.12.1/logstash-core/lib/logstash/compiler.rb:32:in `compile_imperative'", "org/logstash/execution/AbstractPipelineExt.java:184:in `initialize'", "org/logstash/execution/JavaBasePipelineExt.java:69:in `initialize'", "/solr-index/Logstash/logstash-7.12.1/logstash-core/lib/logstash/java_pipeline.rb:47:in `initialize'", "/solr-index/Logstash/logstash-7.12.1/logstash-core/lib/logstash/pipeline\_action/create.rb:52:in `execute'", "/solr-index/Logstash/logstash-7.12.1/logstash-core/lib/logstash/agent.rb:389:in `block in converge\_state'"]}  
[2021-05-20T06:27:43,257][INFO][logstash.runner] Logstash shut down.  
[2021-05-20T06:27:43,268][FATAL][org.logstash.Logstash] Logstash stopped processing because of an error: (SystemExit) exit  
org.jruby.exceptions.SystemExit: (SystemExit) exit  
at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:747) ~[jruby-complete-9.2.13.0.jar:?]  
at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:710) ~[jruby-complete-9.2.13.0.jar:?]  
at solr\_minus\_index.Logstash.logstash\_minus\_7\_dot\_12\_dot\_1.lib.bootstrap.environment.(/solr-index/Logstash/logstash-7.12.1/lib/bootstrap/environment.rb:89) ~[?:?]

I tried to escape the special character by trying the below queries but none of them worked

"SELECT DISTINCT PYID AS" +""IDD""+ "FROM U90CCMWT.Marketing LIMIT 5"  
"SELECT DISTINCT PYID AS ""IDD"" FROM U90CCMWT.Marketing LIMIT 5"  
"SELECT DISTINCT PYID AS \""IDD\"" FROM U90CCMWT.Marketing LIMIT 5"  
"SELECT DISTINCT PYID AS \"IDD\" FROM U90CCMWT.Marketing LIMIT 5  
"SELECT DISTINCT PYID AS IDD FROM U90CCMWT.Marketing LIMIT 5  
"SELECT DISTINCT PYID AS "IDD" FROM U90CCMWT.Marketing LIMIT 5  
"SELECT DISTINCT PYID AS \t "IDD" \t FROM U90CCMWT.Marketing LIMIT 5

"SELECT DISTINCT PYID AS "ID#" FROM U90CCMWT.Marketing LIMIT 5"  
"SELECT DISTINCT PYID AS `"ID`" FROM U90CCMWT.Marketing LIMIT 5"  
"SELECT DISTINCT PYID AS UPPER(ID)" FROM U90CCMWT.Marketing LIMIT 5"  
'SELECT DISTINCT PYID AS "ID" FROM U90CCMWT.Marketing LIMIT 5'  
"SELECT DISTINCT PYID AS "ID=\>" FROM U90CCMWT.Marketing LIMIT 5"  
"SELECT DISTINCT 'PYID' AS ID FROM U90CCMWT.Marketing LIMIT 5"  
"SELECT DISTINCT PYID AS ''ID'' FROM U90CCMWT.Marketing LIMIT 5"

Please help me to resolve this issue.Preformatted text

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [May 20, 2021, 7:49am UTC](https://discuss.elastic.co/t/unable-to-escape-special-character/273474/2 "2021-05-20T07:49:42Z")

</div>

Please format your code, logs or configuration files using `</>` icon as explained in [this guide](https://discuss.elastic.co/t/about-the-elasticsearch-category/21) and not the citation button. It will make your post more readable.

Or use markdown style like:

````
```
CODE
```

````

This is the icon to use if you are not using markdown format:

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/7/e/7e6e239431ec2d71cbf1beef741f2e93e7cc762c.jpg)

There's a live preview panel for exactly this reasons.

Lots of people read these forums, and many of them will simply skip over a post that is difficult to read, because it's just too large an investment of their time to try and follow a wall of badly formatted text.  
If your goal is to get an answer to your questions, it's in your interest to make it as easy to read and understand as possible.  
Please update your post.

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [May 20, 2021, 3:31pm UTC](https://discuss.elastic.co/t/unable-to-escape-special-character/273474/3 "2021-05-20T15:31:50Z")

</div>

> [@ravi-shanker](#):
>
> statement =\> "SELECT DISTINCT PYID AS "ID" FROM U90CCMWT.Marketing LIMIT 5"

Use single quotes around a string containing double quotes.

```
statement => 'SELECT DISTINCT PYID AS "ID" FROM U90CCMWT.Marketing LIMIT 5'

```

---

<div class="post-metadata">

**Author:** ![ravi-shanker](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ravi-shanker/32/87347_2.png) [@ravi-shanker](https://discuss.elastic.co/u/ravi-shanker)\
**Post date:** [May 20, 2021, 4:01pm UTC](https://discuss.elastic.co/t/unable-to-escape-special-character/273474/4 "2021-05-20T16:01:22Z")

</div>

Hello Badger,

statement =\> 'SELECT DISTINCT PYID AS "ID" FROM U90CCMWT.Marketing LIMIT 5'

this query is also throwing the same error.

> "LogStash::ConfigurationError", :message=\>"Expected one of "\\'", any character, "'" at line 26, column 1 (byte 1082) after input {\n jdbc {\n jdbc\_connection\_string =\> "jdbc:postgresql://dtacsqldb-ccms-postgresql-dtacqual-1a.cpzfa7z6lrue.us-east-1.rds.amazonaws.com/dtacqual"\n jdbc\_user =\> "dtacuser"\n jdbc\_password =\> "xyz`Preformatted text`"\n jdbc\_driver\_library =\> "/solr-index/Logstash/logstash-7.12.1/logstash-core/lib/jars/postgresql-jdbc.jar"\n jdbc\_driver\_class =\> "org.postgresql.Driver"\n schedule =\> "\* \* \* \* \*" # cronjob schedule format (see "Helpful Links")\n\t#jdbc\_paging\_enabled =\> "true"\n\t#jdbc\_page\_size =\> "300"\n\tstatement =\> 'SELECT DISTINCT PYID AS "IDD" FROM U90CCMWT.Marketing limit 10\n }\n}\noutput {\n # used to output the values in the terminal (DEBUGGING)\n # once everything is working, comment out this line\n stdout { codec =\> "json" }\n # used to output the values into elasticsearch\n elasticsearch {\n hosts =\> ["[http://ip:9200](http://ip:9200)"]\n index =\> "vikings1"\n #document\_id =\> "{101}"\n #doc\_as\_upsert =\> true # upserts documents (e.g. if the document does not exist, creates a new record)\n }\n}\n", :backtrace=\>["/solr-index/Logstash/logstash-7.12.1/logstash-core/lib/logstash/compiler.rb:32:in `compile_imperative'", "org/logstash/execution/AbstractPipelineExt.java:184:in `initialize'", "org/logstash/execution/JavaBasePipelineExt.java:69:in `initialize'", "/solr-index/Logstash/logstash-7.12.1/logstash-core/lib/logstash/java_pipeline.rb:47:in `initialize'", "/solr-index/Logstash/logstash-7.12.1/logstash-core/lib/logstash/pipeline\_action/create.rb:52:in `execute'", "/solr-index/Logstash/logstash-7.12.1/logstash-core/lib/logstash/agent.rb:389:in `block in converge\_state'"]}  
> [2021-05-20T15:56:12,998][INFO][logstash.runner] Logstash shut down.  
> [2021-05-20T15:56:13,006][FATAL][org.logstash.Logstash] Logstash stopped processing because of an error: (SystemExit) exit  
> org.jruby.exceptions.SystemExit: (SystemExit) exit  
> at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:747) ~[jruby-complete-9.2.13.0.jar:?]  
> at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:710) ~[jruby-complete-9.2.13.0.jar:?]  
> at solr\_minus\_index.Logstash.logstash\_minus\_7\_dot\_12\_dot\_1.lib.bootstrap.environment.(/solr-index/Logstash/logstash-7.12.1/lib/bootstrap/environment.rb:89) ~[?:?]`Preformatted text`

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [May 20, 2021, 5:00pm UTC](https://discuss.elastic.co/t/unable-to-escape-special-character/273474/5 "2021-05-20T17:00:08Z")

</div>

> [@ravi-shanker](#):
>
> this query is also throwing the same error.

No, the error has changed. It is now complaining about what comes after the output section. That would suggest you have an unclosed quote in your configuration.

---

<div class="post-metadata">

**Author:** ![ravi-shanker](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ravi-shanker/32/87347_2.png) [@ravi-shanker](https://discuss.elastic.co/u/ravi-shanker)\
**Post date:** [May 21, 2021, 6:02am UTC](https://discuss.elastic.co/t/unable-to-escape-special-character/273474/6 "2021-05-21T06:02:24Z")

</div>

```
input {
    jdbc {
        jdbc_connection_string => "jdbc:postgresql://dtacsqldb-ccms-postgresql-dtacqual-1a.cpzfa7z6lrue.us-east-1.rds.amazonaws.com/dtacqual"
        jdbc_user => "dtacuser"
        jdbc_password => "xyz"
        jdbc_driver_library => "/solr-index/Logstash/logstash-7.12.1/logstash-core/lib/jars/postgresql-jdbc.jar"
        jdbc_driver_class => "org.postgresql.Driver"
        schedule => "* * * * *" # cronjob schedule format (see "Helpful Links")
        #jdbc_paging_enabled => "true"
        #jdbc_page_size => "300"
        statement => 'SELECT DISTINCT PYID AS "IDD" FROM U90CCMWT.Marketing limit 10
    }
}
output {
    # used to output the values in the terminal (DEBUGGING)
    # once everything is working, comment out this line
    stdout { codec => "json" }
    # used to output the values into elasticsearch
    elasticsearch {
        hosts => ["http://ip:9200"]
        index => "vikings1"
        #document_id => "{101}"
        #doc_as_upsert => true # upserts documents (e.g. if the document does not exist, creates a new record)
    }
}

those are the content of my config file. i don't find any missing quotes in output section. Could you please have a look from your end.
```

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [May 21, 2021, 2:07pm UTC](https://discuss.elastic.co/t/unable-to-escape-special-character/273474/7 "2021-05-21T14:07:49Z")

</div>

Indeed, there is no closing ' on the statement option.

---

<div class="post-metadata">

**Author:** ![ravi-shanker](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ravi-shanker/32/87347_2.png) [@ravi-shanker](https://discuss.elastic.co/u/ravi-shanker)\
**Post date:** [May 21, 2021, 2:48pm UTC](https://discuss.elastic.co/t/unable-to-escape-special-character/273474/8 "2021-05-21T14:48:48Z")

</div>

Yes I corrected that and query got executed but IDD got printed in small letter.....bdw thanks atleast was able to execute the query

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [May 21, 2021, 2:51pm UTC](https://discuss.elastic.co/t/unable-to-escape-special-character/273474/9 "2021-05-21T14:51:19Z")

</div>

> [@ravi-shanker](#):
>
> IDD got printed in small letter

Take a look at the [lowercase\_column\_names](https://www.elastic.co/guide/en/logstash/current/plugins-inputs-jdbc.html#plugins-inputs-jdbc-lowercase_column_names) option.

---

<div class="post-metadata">

**Author:** ![ravi-shanker](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ravi-shanker/32/87347_2.png) [@ravi-shanker](https://discuss.elastic.co/u/ravi-shanker)\
**Post date:** [May 22, 2021, 12:03am UTC](https://discuss.elastic.co/t/unable-to-escape-special-character/273474/10 "2021-05-22T00:03:32Z")

</div>

marking "lowercase\_column\_names " as false worked for me.

Thanks a lot badger for your response on this post.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [June 19, 2021, 12:04am UTC](https://discuss.elastic.co/t/unable-to-escape-special-character/273474/11 "2021-06-19T00:04:13Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.