Logstash Unvailable When Syncing with Elastic's Yum Repository

Elastic Stack Logstash
1

All,

Looks like when we attempt to sync with Elastic's yum repository, the logstash rpm is not downloaded.

Here is our full reposync command:

/usr/bin/dnf reposync \
  --repoid=elastic-7.x \
  --arch=x86_64 \
  --download-metadata \
  --delete \
  --download-path=/repos/elastic-7.x \
  --urls

As well as our /etc/yum.repos.d/elastic.repo file:

[elastic-7.x]
name=Elastic repository for 7.x packages
baseurl=https://artifacts.elastic.co/packages/7.x/yum
gpgcheck=1
gpgkey=https://artifacts.elastic.co/GPG-KEY-elasticsearch
enabled=0
autorefresh=1
type=rpm-md

We take note of the field "enabled=0", but of course this doesn't effect the reposync command because the repository is explicitly requested by reposync.

Here are the contents of /repos/elastic-7.x/elastic-7.x/7.8.1 after running reposync:

total 909980
-rw-r--r--. 1 root root  29800847 Jul 27 18:39 apm-server-7.8.1-x86_64.rpm
-rw-r--r--. 1 root root  25361537 Jul 27 18:39 auditbeat-7.8.1-x86_64.rpm
-rw-r--r--. 1 root root  72405215 Jul 27 18:40 elastic-agent-7.8.1-x86_64.rpm
-rw-r--r--. 1 root root 318401743 Jul 27 18:43 elasticsearch-7.8.1-x86_64.rpm
-rw-r--r--. 1 root root  28557354 Jul 27 18:39 filebeat-7.8.1-x86_64.rpm
-rw-r--r--. 1 root root  23637941 Jul 27 18:40 heartbeat-7.8.1-x86_64.rpm
-rw-r--r--. 1 root root  23094612 Jul 27 18:40 journalbeat-7.8.1-x86_64.rpm
-rw-r--r--. 1 root root 347916016 Jul 27 18:43 kibana-7.8.1-x86_64.rpm
-rw-r--r--. 1 root root  37633234 Jul 27 18:41 metricbeat-7.8.1-x86_64.rpm
-rw-r--r--. 1 root root  24943518 Jul 27 18:41 packetbeat-7.8.1-x86_64.rpm

And the results when running dnf upgrade:

Last metadata expiration check: 0:01:31 ago on Tue 28 Jul 2020 05:05:04 AM PDT.
Dependencies resolved.
==============================================================================================================================================================================================
 Package                                   Architecture                Version                                                                    Repository                             Size
==============================================================================================================================================================================================
Upgrading:
 elasticsearch                             x86_64                      7.8.1-1                                                                    Local-Kibana                          304 M
 filebeat                                  x86_64                      7.8.1-1                                                                    Local-Kibana                           27 M
 kibana                                    x86_64                      7.8.1-1                                                                    Local-Kibana                          332 M
 logstash                                  noarch                      1:7.8.1-1                                                                  Local-Kibana                          152 M
 metricbeat                                x86_64                      7.8.1-1                                                                    Local-Kibana                           36 M

Transaction Summary
==============================================================================================================================================================================================
Upgrade  5 Packages

Total download size: 1.0 G
Downloading Packages:
(1/5): filebeat-7.8.1-x86_64.rpm                                                                                                                               64 MB/s |  27 MB     00:00
[MIRROR] logstash-7.8.1.rpm: Status code: 404 for https://192.168.22.4/kibana-7.x/kibana-7.x/7.8.1/logstash-7.8.1.rpm (IP: 192.168.22.4)
[MIRROR] logstash-7.8.1.rpm: Status code: 404 for https://192.168.22.4/kibana-7.x/kibana-7.x/7.8.1/logstash-7.8.1.rpm (IP: 192.168.22.4)
[MIRROR] logstash-7.8.1.rpm: Status code: 404 for https://192.168.22.4/kibana-7.x/kibana-7.x/7.8.1/logstash-7.8.1.rpm (IP: 192.168.22.4)
[MIRROR] logstash-7.8.1.rpm: Status code: 404 for https://192.168.22.4/kibana-7.x/kibana-7.x/7.8.1/logstash-7.8.1.rpm (IP: 192.168.22.4)
[FAILED] logstash-7.8.1.rpm: No more mirrors to try - All mirrors were already tried without success
(3-4/5): elasticsearch-7.8.1-x86_64.rpm                                     21% [================                                                           ] 263 MB/s | 234 MB     00:03 ETA
The downloaded packages were saved in cache until the next successful transaction.
You can remove cached packages by executing 'dnf clean packages'.
Error: Error downloading packages:
  Cannot download 7.8.1/logstash-7.8.1.rpm: All mirrors were tried

Here we see dnf upgrade suggests upgrading logstash, but logstash-7.8.1.rpm isn't found in the repository hence the failure.

The local Elastic repository is configured like so:

[Local-Elastic]
name=Local - Elastic repository for 7.x packages
baseurl=https://192.168.22.4/elastic-7.x/elastic-7.x
gpgcheck=1
enabled=1
gpgkey=file:///etc/pki/rpm-gpg/GPG-KEY-elasticsearch
2

Changed reposync command to include noarch rpms:

/usr/bin/dnf reposync \
  --repoid=elastic-7.x \
  --download-metadata \
  --arch=x86_64 \
  --arch=noarch \
  --delete \
  --download-path=/repos/elastic-7.x
1 Like
3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.