Delete index command from kibana not working

I am running DELETE /<index_name> command from kibana. I get acknowledged:true response from kibana but Instead of the index getting deleted, i see that a replica shard appears instead while the primary index also stays. This is very strange and i cant wrap my head around what might be happening and how can i delete those indexes.

Details:
Kibana/Elastic version: 7.1.1
Licence: basic
Template for indexes in consideration: none
cluster settings:

    {
      "persistent" : {
        "cluster" : {
          "routing" : {
            "rebalance" : {
              "enable" : "none"
            },
            "allocation" : {
              "enable" : "new_primaries",
              "exclude" : {
                "_ip" : "10.147.112.108,10.147.118.67,10.147.120.51"
              }
            }
          }
        }
      },
      "transient" : {
        "cluster" : {
          "routing" : {
            "rebalance" : {
              "enable" : "none"
            },
            "allocation" : {
              "enable" : "new_primaries",
              "exclude" : {
                "_ip" : "10.147.112.108,10.147.118.67,10.147.120.51"
              }
            }
          }
        }
      }
    }

The new indexes are on the nodes not excluded from primary creation as in the settings.
How can i delete those indexes.

On running the GET /<index_name> command i get this

  {
  "search_supply_v5_06_2020" : {
    "aliases" : { },
    "mappings" : {...},
    "settings" : {
      "index" : {
        "creation_date" : "1599761098852",
        "number_of_shards" : "1",
        "number_of_replicas" : "1",
        "uuid" : "J9X5D3HUSneZC7J-bdgWWA",
        "version" : {
          "created" : "7010099"
        },
        "provided_name" : "search_supply_v5_06_2020"
      }
    }
  }
}

i changed the replicas set number to 0 and rerun delete command. That again reset the replica number to 1 here

one additional input.
So what appears to be happening is that as soon as i delete then the indexes get deleted but they reform again. This is because i see number of documents increasing again till original numbers when i run GET /<index_name> command multiple times .
There is no ingestion happening on these indexes from any external service