I see the following message when the config_dir is used. So when I configured filebeat.config.prospectors it is not working and I have to revert back to config_dir itslef to get it working.
DEPRECATED: config_dir is deprecated. Use
filebeat.config.prospectors instead. Will be removed in version: 7.0.0
Also when I checked the latest documentation still I see the config_dir details itself instead of filebeat.config.prospectors configuration option.
The full path to the directory that contains additional prospector configuration files. Each configuration file must end with .yml. Each config file must also specify the full Filebeat config hierarchy even though only the prospector part of the file is processed. All global options, such as registry_file, are ignored.
The config_dir option MUST point to a directory other than the directory where the main Filebeat config file resides.
If the specified path is not absolute, it is considered relative to the configuration path. See the Directory layout section for details.