Issue #3571
closedPulp not able to sync via DNS
Description
Hello,
Pulp is not able to sync repositories via DNS (/etc/resolv.conf) . However, if create an hosts entry in /etc/hosts, it is able to sync without any issues.
[rohan.ds@pulp-2 ~]$ dig pulp-hk.india.endurance.com
; <<>> DiG 9.9.4-RedHat-9.9.4-51.el7_4.1 <<>> pulp-hk.india.endurance.com
;; global options: +cmd
;; Got answer:
;; >>HEADER<< opcode: QUERY, status: NOERROR, id: 23329
;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 13, ADDITIONAL: 27
;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 4096
;; QUESTION SECTION:
;pulp-hk.india.endurance.com. IN A
;; ANSWER SECTION:
pulp-hk.india.endurance.com. 134 IN A 172.25.160.40
pulp-hk.india.endurance.com. 134 IN A 172.25.160.41
;; Query time: 1 msec
;; SERVER: 172.25.160.36#53(172.25.160.36)
;; WHEN: Mon Apr 16 19:10:46 UTC 2018
;; MSG SIZE rcvd: 884
As you can see, it hardly took about 1 msec to get the A record of the pulp server.
I get the following error when using my local DNS server for name resolution:
[rohan.ds@pulp-2 ~]$ sudo pulp-admin rpm repo sync run --repo-id obox-7-x86_64
--------------------------------------------------------------------
Synchronizing Repository [obox-7-x86_64]
--------------------------------------------------------------------
This command may be exited via ctrl+c without affecting the request.
Downloading metadata...
[/]
Task Failed
Importer indicated a failed response
Logs:
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: nectar.downloaders.threaded:INFO: Download failed: Download of https://pulp-austin.india.endura
nce.com/pulp/repos/obox-7-x86_64/repodata/690ce5d57fa45e23f3cd74fa10903795bdd9917a96e8c6437453b46bb85b3589-other.xml.gz failed with code
404: NOT FOUND
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://pulp-austin.india.endurance.com/p
ulp/repos/obox-7-x86_64/repodata/a27718cc28ec6d71432e0ef3e6da544b7f9d93f6bb7d0a55aacd592d03144b70-comps.xml.
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: nectar.downloaders.threaded:INFO: Download failed: Download of https://pulp-austin.india.endura
nce.com/pulp/repos/obox-7-x86_64/repodata/ccc68b23d5ede576394da4593097a8023ca2d407d8458a53db0566f4a1f3230c-primary.xml.gz failed with co
de 404: NOT FOUND
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) NOT FOUND
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) Traceback (most recent call
last):
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) File "/usr/lib/python2.7/s
ite-packages/pulp_rpm/plugins/importers/yum/sync.py", line 262, in run
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) metadata_files = self.ge
t_metadata(metadata_files)
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) File "/usr/lib/python2.7/s
ite-packages/pulp_rpm/plugins/importers/yum/sync.py", line 449, in get_metadata
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) metadata_files.download_
metadata_files()
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) File "/usr/lib/python2.7/s
ite-packages/pulp_rpm/plugins/importers/yum/repomd/metadata.py", line 217, in download_metadata_files
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) raise IOError(error_repo
rt.error_msg)
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) IOError: NOT FOUND
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp.server.async.tasks:INFO: [81df630b] Task failed : [81df630b-9895-4a15-9369-d3d402be6f66]
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: celery.worker.job:ERROR: (1900-95616) Task pulp.server.managers.repo.sync.sync[81df630b-9895-4a15-9369-d3d402be6f66] raised unexpected: PulpExecutionException('Importer indicated a failed response',)
Please let me know as to why am I facing this issue.
Regards,
Rohan Dsouza