CentOS Yum Repo Issues

[dgoldsmith]

If I simply point a server to the Elastic Yum repo at https://artifacts.elastic.co/packages/7.x/yum/ using a copy of the Yum repo config file provided from the elastic web site, it is able to reach out and retrieve the Yum/RPM packages (assuming outbound Internet access is allowed).

But we normally mirror public Yum repos on an internal Pulp server and then point our servers there. Neither the pulp-admin command nor wget can reach out and retrieve the top-level web page at packages/7.x/yum and I get similar issues with various web browsers on my laptop.

If I use wget to retrieve a specific know file, such as https://artifacts.elastic.co/packages/7.x/yum/repodata/filelists.xml.gz, it works. But in order to mirror the repo, I need a full listing.

Is this intentional behavior or unexpected?

Thanks,
dgoldsmith

[spinscale (Alexander Reelsen)]

Just on top of my head: Have you tried reposync? Is it showing the same errors?

[dgoldsmith]

Creating a local /etc/yum.repos.d/elk-7.repo file with the public URL and running 'reposync -r elk-7 -d ' did work and pulled down 900+ RPMs from 49 different versions of 7.x.y.

It seems like the web server on the elastic side is perhaps looking for specific user-agent strings or something else that distinguishes reposync from a web browser. Usually, Yum repos are viewable via a web browser to the repo URL.

Thanks,
dgoldsmith